00010000:00010000:1.0:1788201205.289603:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d1cd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x282b4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.289621:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d1cd8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x282b4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.289629:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d1cd8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x282b4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.289636:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.289643:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d1cd8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x282b4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.289653:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d1cd8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x282b4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.289672:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x282b4dce (ffff9e03c5173800) 00010000:00010000:1.0:1788201205.289676:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.289681:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d1cd8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x282b4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.289689:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d1cd8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x282b4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.300386:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442551296 00000100:00100000:1.0:1788201205.300401:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442551296 00000100:00100000:1.0:1788201205.300486:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4927 00000100:00100000:1.0:1788201205.300498:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+292:13079:x1875064442551296:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201205.300579:0:12969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201205.300616:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04d1ed6400/0x9383f985bc4ba1b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x15e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1beee1 expref: 292 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.300647:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0500a1a400/0x9383f985bc4ba196 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x15e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1beeda expref: 291 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.300658:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x15e:0x0].0x0 (ffff9e03c2a4a600) 00010000:00010000:1.0:1788201205.300671:0:12969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201205.300701:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d1d09 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.300718:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d1d09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.300731:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d1d09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.300748:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d1d10 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x976c0140 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.300756:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d1d10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x976c0140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.300763:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d1d10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x976c0140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.300923:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1d17 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x15e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.300934:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1d17 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x15e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.300958:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1d17 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x15e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201205.304479:0:12969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].459, 64 off37568 00010000:00010000:1.0:1788201205.304619:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d1d1e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x15e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.304640:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d1d1e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x15e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.304655:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d1d1e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x15e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.304667:0:12969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d1d1e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x15e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.304674:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d1d1e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x15e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.304681:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d1d1e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x15e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.304774:0:12969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201205.304807:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1d17 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x15e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.304814:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1d17 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x15e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.304821:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1d17 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x15e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.304828:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.304834:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1d17 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x15e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.304843:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1d17 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x15e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.304858:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x15e:0x0].0x0 (ffff9e03c5173b00) 00010000:00010000:1.0:1788201205.304862:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201205.304869:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1d17 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x15e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.304876:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1d17 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x15e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.304902:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d1d09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.304908:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d1d09 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.304915:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d1d09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.304920:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.304923:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d1d09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.304930:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d1d09 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.304950:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201205.304954:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.304958:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d1d09 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.304970:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d1d09 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201205.304983:0:12969:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000069814d3e reply state 00000000bb87fb28 transno 8589938509 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d1d10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x976c0140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.304994:0:12969:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201205.305130:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+292:13079:x1875064442551296:12345-192.168.201.30@tcp:36:rm.0 Request processed in 4628us (5010us total) trans 8589938509 rc 0/0 00000100:00100000:1.0:1788201205.305141:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4927 00010000:00010000:1.0:1788201205.309681:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d1d10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x976c0140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.309691:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d1d10 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x976c0140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.309699:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d1d10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x976c0140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.309705:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.309710:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d1d10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x976c0140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.309717:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d1d10 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x976c0140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.309729:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x976c0140 (ffff9e03c5173500) 00010000:00010000:1.0:1788201205.309732:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.309736:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d1d10 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x976c0140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.309748:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d1d10 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x976c0140 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.309875:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201205.309910:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442551552 00000100:00100000:1.0:1788201205.309922:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442551552 00000100:00100000:1.0:1788201205.309992:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4928 00000100:00100000:1.0:1788201205.310003:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5393100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+290:13079:x1875064442551552:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201205.310091:0:13379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201205.310114:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c86200/0x9383f985bc4b9843 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x147:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bebbc expref: 290 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.310131:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2950c00/0x9383f985bc4b9827 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x147:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bebb5 expref: 289 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.310140:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x147:0x0].0x0 (ffff9e03c1d0b800) 00010000:00010000:1.0:1788201205.310148:0:13379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201205.310187:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d1d25 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.310203:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d1d25 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.310213:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d1d25 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.310229:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d1d2c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x326dd640 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.310241:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d1d2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x326dd640 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.310248:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d1d2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x326dd640 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.310417:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d1d33 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x147:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.310426:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d1d33 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x147:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.310433:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d1d33 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x147:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201205.311139:0:13379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].452, 64 off37120 00010000:00010000:1.0:1788201205.311214:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d1d3a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x147:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.311226:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d1d3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x147:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.311235:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d1d3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x147:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.311243:0:13379:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d1d3a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x147:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.311250:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d1d3a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x147:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.311256:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d1d3a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x147:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.311320:0:13379:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201205.311345:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d1d33 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x147:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.311352:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d1d33 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x147:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.311359:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d1d33 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x147:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.311364:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.311369:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d1d33 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x147:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.311376:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d1d33 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x147:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.311385:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x147:0x0].0x0 (ffff9e03c5173400) 00010000:00010000:1.0:1788201205.311388:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201205.311392:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d1d33 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x147:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.311398:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d1d33 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x147:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.311418:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d1d25 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.311424:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d1d25 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.311433:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d1d25 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.311439:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.311441:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d1d25 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.311446:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d1d25 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.311452:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201205.311454:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.311457:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d1d25 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.311461:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d1d25 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201205.311469:0:13379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004787bfb0 reply state 0000000016a3f9c5 transno 8589938510 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d1d2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x326dd640 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.311478:0:13379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201205.311578:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5393100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+290:13079:x1875064442551552:12345-192.168.201.30@tcp:36:rm.0 Request processed in 1574us (1707us total) trans 8589938510 rc 0/0 00000100:00100000:1.0:1788201205.311588:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4928 00000100:00100000:1.0:1788201205.315640:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201205.323222:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201205.329149:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000040:00080000:1.0:1788201205.357344:0:12971:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].455, 64 off37312 00010000:00010000:1.0:1788201205.357471:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d1daa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2b1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.357493:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d1daa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2b1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.357508:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d1daa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2b1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.357518:0:12971:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d1daa lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2b1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.357525:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d1daa lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2b1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.357531:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d1daa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2b1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.357555:0:12971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201205.357584:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d1da3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2b1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.357591:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d1da3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2b1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.357598:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d1da3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2b1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.357605:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.357610:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d1da3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2b1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.357618:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d1da3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2b1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.357632:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2b1:0x0].0x0 (ffff9e03c2fc5400) 00010000:00010000:1.0:1788201205.357635:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201205.357639:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d1da3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2b1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.357645:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d1da3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2b1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.357667:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d1d95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.357674:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d1d95 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.357680:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d1d95 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.357684:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bcc00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.357687:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d1d95 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.357693:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d1d95 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.357700:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201205.357702:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.357705:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d1d95 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.357710:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d1d95 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201205.357725:0:12971:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000daae172d reply state 000000008f78d3b3 transno 8589938514 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d1d9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x2d3396b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.357735:0:12971:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201205.357855:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c20bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+286:13079:x1875064442552576:12345-192.168.201.30@tcp:36:rm.0 Request processed in 12674us (13215us total) trans 8589938514 rc 0/0 00000100:00100000:1.0:1788201205.357866:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4932 00010000:00010000:1.0:1788201205.361871:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201205.361885:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201205.361889:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201205.363569:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:1.0:1788201205.377625:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201205.377644:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d1de2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x262:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.377658:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201205.377664:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d1de2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x262:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.377677:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d1de2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x262:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.377701:0:7645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x262:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:1.0:1788201205.377705:0:7645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201205.377710:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d1de2 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x262:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.377718:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d1de2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x262:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.378493:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442553344 00000100:00100000:1.0:1788201205.378507:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442553344 00000100:00100000:1.0:1788201205.378585:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4935 00000100:00100000:1.0:1788201205.378597:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c294b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+284:13079:x1875064442553344:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201205.378677:0:12971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201205.378701:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2f0fc00/0x9383f985bc4c1fb2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x29b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1a69 expref: 284 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.378721:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f53e7e00/0x9383f985bc4c1f96 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x29b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1a62 expref: 283 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.378731:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x29b:0x0].0x0 (ffff9e03c2e84100) 00010000:00010000:1.0:1788201205.378739:0:12971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201205.378774:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1de9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.378791:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1de9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.378802:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1de9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.378819:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d1df0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0xbeadc76b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.378826:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d1df0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xbeadc76b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.378833:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d1df0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xbeadc76b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.378998:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d1df7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x29b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.379008:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d1df7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x29b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.379015:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d1df7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x29b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201205.379787:0:12971:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].456, 64 off37376 00010000:00010000:1.0:1788201205.379863:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d1dfe lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x29b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.379873:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d1dfe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x29b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.379883:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d1dfe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x29b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.379891:0:12971:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d1dfe lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x29b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.379897:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d1dfe lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x29b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.379904:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d1dfe lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x29b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.379932:0:12971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201205.379959:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d1df7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x29b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.379970:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d1df7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x29b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.379977:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d1df7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x29b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.379983:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.379988:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d1df7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x29b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.379995:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d1df7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x29b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.380005:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x29b:0x0].0x0 (ffff9e03c5173800) 00010000:00010000:1.0:1788201205.380008:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201205.380011:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d1df7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x29b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.380017:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d1df7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x29b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.380037:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1de9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.380043:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1de9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.380048:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1de9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.380065:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.380068:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1de9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.380074:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1de9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.380081:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201205.380083:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.380086:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1de9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.380092:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1de9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201205.380101:0:12971:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000589958f2 reply state 0000000015784089 transno 8589938517 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d1df0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xbeadc76b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.380110:0:12971:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201205.380224:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c294b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+284:13079:x1875064442553344:12345-192.168.201.30@tcp:36:rm.0 Request processed in 1625us (2014us total) trans 8589938517 rc 0/0 00000100:00100000:1.0:1788201205.380233:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4935 00010000:00010000:1.0:1788201205.403726:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201205.403736:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d1e36 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x101:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.403745:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201205.403750:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d1e36 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x101:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.403757:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d1e36 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x101:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.403776:0:7645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x101:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:1.0:1788201205.403779:0:7645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201205.403784:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d1e36 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x101:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.403790:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d1e36 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x101:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.403808:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201205.403812:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c600/0x9383f985bc4d1e52 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1d5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.403818:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507c600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201205.403820:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c600/0x9383f985bc4d1e52 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1d5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.403827:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c600/0x9383f985bc4d1e52 lrc: 5/0,0 mode: PW/PW res: [0x200000bd1:0x1d5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.403834:0:7645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1d5:0x0].0x0 (ffff9e03c33e8400) 00010000:00010000:1.0:1788201205.403836:0:7645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201205.403840:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c600/0x9383f985bc4d1e52 lrc: 3/0,0 mode: --/PW res: [0x200000bd1:0x1d5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.403846:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201205.403848:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201205.403850:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201205.418755:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201205.418766:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d1e6e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x341:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.418781:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201205.418786:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d1e6e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x341:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.418794:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d1e6e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x341:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.418808:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x341:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:1.0:1788201205.418811:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201205.418814:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d1e6e lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x341:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.418821:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d1e6e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x341:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.418835:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201205.418840:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ce00/0x9383f985bc4d1e8a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x34c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.418846:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507ce00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201205.418848:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ce00/0x9383f985bc4d1e8a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x34c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.418855:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ce00/0x9383f985bc4d1e8a lrc: 5/0,0 mode: PW/PW res: [0x200000bd1:0x34c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.418863:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x34c:0x0].0x0 (ffff9e03c33eda00) 00010000:00010000:1.0:1788201205.418866:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201205.418869:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ce00/0x9383f985bc4d1e8a lrc: 3/0,0 mode: --/PW res: [0x200000bd1:0x34c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.418879:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201205.418881:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201205.418883:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201205.419238:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201205.454025:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201205.454034:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d1ede lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1e7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.454041:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201205.454044:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d1ede lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1e7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.454062:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d1ede lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1e7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.454073:0:7645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1e7:0x0].0x0 (ffff9e03c33ed600) 00010000:00010000:1.0:1788201205.454075:0:7645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201205.454079:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d1ede lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x1e7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.454085:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d1ede lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1e7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.454102:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201205.454104:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201205.454105:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201205.465140:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442555648 00000100:00100000:1.0:1788201205.465164:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442555648 00000100:00100000:1.0:1788201205.465244:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4944 00000100:00100000:1.0:1788201205.465256:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+275:13079:x1875064442555648:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201205.465369:0:12968:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201205.465408:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c31ba600/0x9383f985bc4c9030 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3b5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c416e expref: 275 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.465436:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c31b9000/0x9383f985bc4c9014 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3b5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4167 expref: 274 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.465448:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3b5:0x0].0x0 (ffff9e03c2319d00) 00010000:00010000:1.0:1788201205.465471:0:12968:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201205.465500:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d1ee5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.465518:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d1ee5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.465530:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d1ee5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.465550:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d1eec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x4c456296 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.465558:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d1eec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x4c456296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.465565:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d1eec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x4c456296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.465713:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1ef3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3b5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.465722:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1ef3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3b5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.465731:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1ef3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3b5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201205.466437:0:12968:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].462, 64 off37760 00010000:00010000:1.0:1788201205.466511:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d1efa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3b5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.466523:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d1efa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3b5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.466531:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d1efa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3b5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.466539:0:12968:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d1efa lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3b5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.466545:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d1efa lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3b5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.466551:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d1efa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3b5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.467016:0:12968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201205.467058:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1ef3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3b5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.467065:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1ef3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3b5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.467072:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1ef3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3b5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.467082:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.467087:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1ef3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3b5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.467095:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1ef3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3b5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.467106:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3b5:0x0].0x0 (ffff9e03c5173300) 00010000:00010000:1.0:1788201205.467109:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201205.467121:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1ef3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3b5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.467127:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1ef3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3b5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.467148:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d1ee5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.467212:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d1ee5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.467219:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d1ee5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.467224:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.467227:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d1ee5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.467233:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d1ee5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.467246:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201205.467249:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.467252:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d1ee5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.467259:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d1ee5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201205.467270:0:12968:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a470530 reply state 00000000dbdd7da2 transno 8589938526 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d1eec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x4c456296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.467278:0:12968:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201205.467438:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+275:13079:x1875064442555648:12345-192.168.201.30@tcp:36:rm.0 Request processed in 2179us (2720us total) trans 8589938526 rc 0/0 00000100:00100000:1.0:1788201205.467448:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4944 00010000:00010000:1.0:1788201205.472750:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d1eec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x4c456296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.472760:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d1eec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x4c456296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.472768:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d1eec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x4c456296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.472774:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.472777:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d1eec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x4c456296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.472784:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d1eec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x4c456296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.472800:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x4c456296 (ffff9e03c5173d00) 00010000:00010000:1.0:1788201205.472803:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.472807:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d1eec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x4c456296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.472813:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d1eec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x4c456296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.485605:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201205.485615:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d1f32 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x9a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.485624:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201205.485629:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d1f32 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x9a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.485637:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d1f32 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x9a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.485650:0:7645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x9a:0x0].0x0 (ffff9e03c33e8700) 00010000:00010000:1.0:1788201205.485653:0:7645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201205.485657:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d1f32 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x9a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.485664:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d1f32 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x9a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.485683:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201205.485685:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201205.485687:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201205.492127:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442556416 00000100:00100000:1.0:1788201205.492140:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442556416 00000100:00100000:1.0:1788201205.492228:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4947 00000100:00100000:1.0:1788201205.492241:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c20be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+271:13079:x1875064442556416:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201205.492357:0:12968:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201205.492381:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2a7da00/0x9383f985bc4b46e3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcf76 expref: 271 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.492401:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2f77c00/0x9383f985bc4b46c7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x7b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcf6f expref: 270 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.492411:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x7b:0x0].0x0 (ffff9e03c115ee00) 00010000:00010000:1.0:1788201205.492420:0:12968:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201205.492447:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d1f39 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.492849:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d1f39 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.492864:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d1f39 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.492883:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d1f40 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x2ef922ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.492891:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d1f40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x2ef922ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.492898:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d1f40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x2ef922ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.493122:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1f47 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x7b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.493132:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1f47 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.493140:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d1f47 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x7b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201205.495109:0:12968:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].463, 64 off37824 00000100:00100000:1.0:1788201205.509130:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442556928 00000100:00100000:1.0:1788201205.509144:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442556928 00000100:00100000:1.0:1788201205.509221:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4949 00000100:00100000:1.0:1788201205.509233:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c20bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+269:13079:x1875064442556928:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201205.509365:0:13379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201205.509397:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c26f2000/0x9383f985bc4b29af lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc589 expref: 269 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.509421:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04d09c3a00/0x9383f985bc4b2993 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc582 expref: 268 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.509432:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x32:0x0].0x0 (ffff9e03c1175e00) 00010000:00010000:1.0:1788201205.509443:0:13379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201205.509486:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d1f71 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.509503:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d1f71 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.509518:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d1f71 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.509533:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d1f78 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0xf78c17b2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.509540:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d1f78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xf78c17b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.509546:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d1f78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xf78c17b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.509706:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d1f7f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.509716:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d1f7f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.509724:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d1f7f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201205.510454:0:13379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].468, 64 off38144 00010000:00010000:1.0:1788201205.510530:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d1f86 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.510543:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d1f86 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.510552:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d1f86 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.510560:0:13379:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d1f86 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.510568:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d1f86 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.510574:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d1f86 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.510605:0:13379:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201205.510631:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d1f7f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.510638:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d1f7f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.510644:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d1f7f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.510650:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.510655:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d1f7f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.510663:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d1f7f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.510673:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x32:0x0].0x0 (ffff9e03c5173800) 00010000:00010000:1.0:1788201205.510677:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201205.510682:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d1f7f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.510688:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d1f7f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.510713:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d1f71 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.510721:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d1f71 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.510728:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d1f71 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.510733:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.510737:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d1f71 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.510743:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d1f71 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.510749:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201205.510752:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.510754:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d1f71 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.510759:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d1f71 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201205.510768:0:13379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c7c2868 reply state 00000000cc7f9833 transno 8589938531 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d1f78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xf78c17b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.510778:0:13379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201205.510889:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c20bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+269:13079:x1875064442556928:12345-192.168.201.30@tcp:36:rm.0 Request processed in 1655us (2065us total) trans 8589938531 rc 0/0 00000100:00100000:1.0:1788201205.510900:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4949 00000100:00100000:1.0:1788201205.527970:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201205.542204:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201205.552219:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201205.561622:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442558208 00000100:00100000:1.0:1788201205.561637:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442558208 00000100:00100000:1.0:1788201205.561722:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4954 00000100:00100000:1.0:1788201205.561734:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c543a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+264:13079:x1875064442558208:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201205.561812:0:13379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201205.561839:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2f78a00/0x9383f985bc4c6407 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x347:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c31f4 expref: 264 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.561860:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2f7b200/0x9383f985bc4c63eb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x347:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c31ed expref: 263 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.561871:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x347:0x0].0x0 (ffff9e03c31df900) 00010000:00010000:1.0:1788201205.561881:0:13379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201205.561909:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d1ffd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.561926:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d1ffd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.561946:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d1ffd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.561964:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d2004 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x35a34fdd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.561971:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d2004 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x35a34fdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.561982:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d2004 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x35a34fdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.562145:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d200b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x347:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.563114:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d200b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x347:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.563129:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d200b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x347:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201205.565033:0:13379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].467, 64 off38080 00010000:00010000:1.0:1788201205.565148:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d2012 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x347:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.565238:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d2012 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x347:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.565249:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d2012 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x347:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.565258:0:13379:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d2012 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x347:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.565264:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d2012 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x347:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.565271:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d2012 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x347:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.571356:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442558464 00000100:00100000:1.0:1788201205.571369:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442558464 00000100:00100000:1.0:1788201205.571451:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4955 00000100:00100000:1.0:1788201205.571471:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c543a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+264:13079:x1875064442558464:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201205.571552:0:12971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201205.571584:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1837e00/0x9383f985bc4be4b7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c05fc expref: 264 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.571611:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3423000/0x9383f985bc4be49b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x207:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c05f5 expref: 263 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.571622:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x207:0x0].0x0 (ffff9e03c13a4f00) 00010000:00010000:1.0:1788201205.571633:0:12971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201205.571661:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d2019 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.571677:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d2019 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.571688:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d2019 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.571704:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2020 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x3a16d0b2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.571711:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2020 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x3a16d0b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.571717:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2020 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x3a16d0b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.571860:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2027 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x207:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.571869:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2027 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x207:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.571876:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2027 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x207:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201205.572662:0:12971:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].468, 64 off38144 00010000:00010000:1.0:1788201205.572745:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d202e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x207:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.572757:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d202e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x207:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.572767:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d202e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x207:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.572776:0:12971:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d202e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x207:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.572783:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d202e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x207:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.572791:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d202e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x207:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.572821:0:12971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201205.572855:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201205.572863:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d202e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x207:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.572871:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201205.572876:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d202e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x207:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.572886:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d202e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x207:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.572897:0:7645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x207:0x0].0x0 (ffff9e03c5173000) 00010000:00010000:1.0:1788201205.572901:0:7645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201205.572906:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d202e lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x207:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.572912:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d202e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x207:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.572927:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201205.572929:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201205.572931:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201205.572948:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2027 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x207:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.572956:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2027 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x207:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.572961:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2027 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x207:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.572967:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.572971:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2027 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x207:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.572977:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2027 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x207:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.572991:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x207:0x0].0x0 (ffff9e03c5173000) 00010000:00010000:1.0:1788201205.572993:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201205.572996:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2027 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x207:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.573001:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2027 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x207:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.573021:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d2019 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.573026:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d2019 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.573032:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d2019 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.573036:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.573039:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d2019 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.573044:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d2019 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.573065:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201205.573067:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.573070:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d2019 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.573075:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d2019 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201205.573088:0:12971:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017a4178a reply state 00000000193bb697 transno 8589938537 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2020 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x3a16d0b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.573098:0:12971:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201205.573212:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c543a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+264:13079:x1875064442558464:12345-192.168.201.30@tcp:36:rm.0 Request processed in 1739us (1997us total) trans 8589938537 rc 0/0 00000100:00100000:1.0:1788201205.573221:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4955 00010000:00010000:1.0:1788201205.588056:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201205.588059:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201205.588061:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201205.593785:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d205f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3a6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.593800:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d205f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.593812:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d205f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201205.596851:0:13379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].471, 64 off38336 00010000:00010000:1.0:1788201205.598017:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2066 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3a6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.598043:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2066 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3a6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.598070:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2066 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3a6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.598082:0:13379:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2066 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3a6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.598090:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2066 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3a6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.598097:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2066 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3a6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.598184:0:13379:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201205.598216:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d205f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.598225:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d205f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.598232:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d205f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.598240:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.598245:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d205f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.598254:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d205f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.598269:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3a6:0x0].0x0 (ffff9e03c5173000) 00010000:00010000:1.0:1788201205.598273:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201205.598278:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d205f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.598319:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d205f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.598350:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d2051 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.598357:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d2051 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.598364:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d2051 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.598370:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.598373:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d2051 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.598381:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d2051 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.598406:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201205.598410:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.598413:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d2051 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.598420:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d2051 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201205.598432:0:13379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000496badea reply state 0000000046ec8e0b transno 8589938539 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d2058 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x434ea996 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.598443:0:13379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201205.598638:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c543b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+261:13079:x1875064442558976:12345-192.168.201.30@tcp:36:rm.0 Request processed in 6378us (6834us total) trans 8589938539 rc 0/0 00000100:00100000:1.0:1788201205.598649:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4957 00010000:00010000:1.0:1788201205.605529:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201205.623968:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442559744 00000100:00100000:1.0:1788201205.623981:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442559744 00000100:00100000:1.0:1788201205.624063:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4960 00000100:00100000:1.0:1788201205.624075:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+258:13079:x1875064442559744:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201205.624163:0:13379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201205.624200:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c91600/0x9383f985bc4c1181 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x277:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c157d expref: 258 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.624224:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501a67200/0x9383f985bc4c1165 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x277:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1576 expref: 257 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.624234:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x277:0x0].0x0 (ffff9e04cb48e700) 00010000:00010000:1.0:1788201205.624243:0:13379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201205.624269:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d20a5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.624327:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d20a5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.624338:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d20a5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.624355:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d20ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0xcb4a9c6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.624363:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d20ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xcb4a9c6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.624369:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d20ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xcb4a9c6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.624583:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d20b3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x277:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.624592:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d20b3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x277:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.624599:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d20b3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x277:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201205.625320:0:13379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].470, 64 off38272 00010000:00010000:1.0:1788201205.627656:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d20ba lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x277:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.627676:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d20ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x277:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.627688:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d20ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x277:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.627698:0:13379:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d20ba lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x277:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.627705:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d20ba lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x277:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.627711:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d20ba lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x277:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.627770:0:13379:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201205.627801:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d20b3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x277:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.627812:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d20b3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x277:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.627818:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d20b3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x277:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.627823:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.627827:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d20b3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x277:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.627834:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d20b3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x277:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.627843:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x277:0x0].0x0 (ffff9e03c5173600) 00010000:00010000:1.0:1788201205.627846:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201205.627849:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d20b3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x277:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.627855:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d20b3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x277:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.627878:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d20a5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.627885:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d20a5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.627891:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d20a5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.627897:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.627911:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d20a5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.627918:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d20a5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.627926:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201205.627937:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.627940:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d20a5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.627947:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d20a5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201205.627957:0:13379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008039ba3c reply state 000000005b45df3c transno 8589938542 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d20ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xcb4a9c6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.627966:0:13379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201205.628108:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+258:13079:x1875064442559744:12345-192.168.201.30@tcp:36:rm.0 Request processed in 4028us (4238us total) trans 8589938542 rc 0/0 00000100:00100000:1.0:1788201205.628119:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4960 00000100:00100000:1.0:1788201205.634872:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442560000 00000100:00100000:1.0:1788201205.634887:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442560000 00000100:00100000:1.0:1788201205.635149:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4961 00000100:00100000:1.0:1788201205.635173:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c543aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+257:13079:x1875064442560000:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201205.635258:0:12969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201205.635321:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9cb7600/0x9383f985bc4b842a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x114:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be4a7 expref: 257 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.635345:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9540200/0x9383f985bc4b840e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x114:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be4a0 expref: 256 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.635357:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x114:0x0].0x0 (ffff9e04f4d69d00) 00010000:00010000:1.0:1788201205.635367:0:12969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201205.635651:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d20c1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.635669:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d20c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.635681:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d20c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.635700:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d20c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x742d1987 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.635708:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d20c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x742d1987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.635715:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d20c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x742d1987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.635868:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d20cf lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x114:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.635876:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d20cf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x114:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.635883:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d20cf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x114:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201205.637826:0:12969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].474, 64 off38528 00010000:00010000:1.0:1788201205.638072:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d20d6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x114:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.638089:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d20d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x114:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.638100:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d20d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x114:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.638109:0:12969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d20d6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x114:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.638116:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d20d6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x114:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.638124:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d20d6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x114:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.638263:0:12969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201205.638330:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d20cf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x114:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.638338:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d20cf lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x114:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.638346:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d20cf lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x114:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.638352:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.638357:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d20cf lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x114:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.638366:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d20cf lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x114:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.638383:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x114:0x0].0x0 (ffff9e03c5173200) 00010000:00010000:1.0:1788201205.638387:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201205.638402:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d20cf lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x114:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.638410:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d20cf lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x114:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.638434:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d20c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.638441:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d20c1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.638447:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d20c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.638452:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.638462:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d20c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.638469:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d20c1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.638477:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201205.638480:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.638482:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d20c1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.638488:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d20c1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201205.638504:0:12969:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f62a6fbd reply state 000000008a9e55cd transno 8589938543 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d20c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x742d1987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.638513:0:12969:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201205.638636:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c543aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+257:13079:x1875064442560000:12345-192.168.201.30@tcp:36:rm.0 Request processed in 3461us (5536us total) trans 8589938543 rc 0/0 00000100:00100000:1.0:1788201205.638647:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4961 00000100:00100000:1.0:1788201205.643433:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201205.655981:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:1.0:1788201205.659714:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201205.659717:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201205.659719:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788201205.660215:0:13379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].472, 64 off38400 00010000:00010000:1.0:1788201205.660758:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d210e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.660777:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d210e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xc9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.660792:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d210e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xc9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.660801:0:13379:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d210e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xc9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.660807:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d210e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xc9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.660813:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d210e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xc9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.660873:0:13379:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201205.660915:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507da00/0x9383f985bc4d2107 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xc9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.660922:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507da00/0x9383f985bc4d2107 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xc9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.660936:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507da00/0x9383f985bc4d2107 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xc9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.660944:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507da00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.660948:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507da00/0x9383f985bc4d2107 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xc9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.660955:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507da00/0x9383f985bc4d2107 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xc9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.660967:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xc9:0x0].0x0 (ffff9e03c33edf00) 00010000:00010000:1.0:1788201205.660970:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201205.660974:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507da00/0x9383f985bc4d2107 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xc9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.660980:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507da00/0x9383f985bc4d2107 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xc9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.661003:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507dc00/0x9383f985bc4d20f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.661009:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507dc00/0x9383f985bc4d20f9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.661019:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507dc00/0x9383f985bc4d20f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.661024:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507dc00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.661027:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507dc00/0x9383f985bc4d20f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.661034:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507dc00/0x9383f985bc4d20f9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.661041:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201205.661044:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.661057:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507dc00/0x9383f985bc4d20f9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.661064:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507dc00/0x9383f985bc4d20f9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201205.661074:0:13379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000287ff7d8 reply state 00000000801d1330 transno 8589938545 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d2100 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xb91c0a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.661084:0:13379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201205.661229:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c543dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+255:13079:x1875064442560512:12345-192.168.201.30@tcp:36:rm.0 Request processed in 5019us (5256us total) trans 8589938545 rc 0/0 00000100:00100000:1.0:1788201205.661239:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4963 00000100:00100000:1.0:1788201205.667242:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442560768 00000100:00100000:1.0:1788201205.667256:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442560768 00000100:00100000:1.0:1788201205.667847:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4964 00000100:00100000:1.0:1788201205.667860:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+254:13079:x1875064442560768:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201205.667960:0:12969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201205.667986:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2525400/0x9383f985bc4b8cb2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x12a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be7b0 expref: 254 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.668004:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2200/0x9383f985bc4b8c96 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x12a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be7a9 expref: 253 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.668017:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x12a:0x0].0x0 (ffff9e04c2f8d300) 00010000:00010000:1.0:1788201205.668025:0:12969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201205.668062:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2115 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.668077:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2115 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.668088:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2115 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.668104:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d211c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0xb8528b87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.668111:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d211c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xb8528b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.668118:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d211c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xb8528b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.668316:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2123 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x12a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.668326:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2123 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x12a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.668335:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2123 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x12a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201205.669821:0:12969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].475, 64 off38592 00010000:00010000:1.0:1788201205.669928:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d212a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x12a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.669952:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d212a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x12a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.669965:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d212a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x12a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.669975:0:12969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d212a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x12a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.669983:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d212a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x12a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.669990:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d212a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x12a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.670014:0:12969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201205.670042:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2123 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x12a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.670059:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2123 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x12a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.670067:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2123 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x12a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.670079:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.670084:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2123 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x12a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.670093:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2123 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x12a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.670107:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x12a:0x0].0x0 (ffff9e03c5173a00) 00010000:00010000:1.0:1788201205.670110:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201205.670115:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2123 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x12a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.670121:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2123 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x12a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.670147:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2115 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.670757:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2115 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.670765:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2115 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.670772:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.670775:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2115 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.670783:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2115 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.670799:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201205.670802:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.670805:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2115 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.670812:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2115 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201205.670825:0:12969:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002864c38b reply state 00000000a4fbcdc1 transno 8589938546 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d211c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xb8528b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.670836:0:12969:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201205.671075:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+254:13079:x1875064442560768:12345-192.168.201.30@tcp:36:rm.0 Request processed in 3212us (5419us total) trans 8589938546 rc 0/0 00000100:00100000:1.0:1788201205.671087:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4964 00000100:00100000:1.0:1788201205.677913:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:1.0:1788201205.681882:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d2146 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x132:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.682022:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d2146 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x132:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.682037:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d2146 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x132:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.682056:0:12968:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d2146 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x132:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.682063:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d2146 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x132:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.682075:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d2146 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x132:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.682135:0:12968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201205.682172:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d213f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x132:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.682179:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d213f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x132:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.682186:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d213f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x132:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.682193:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.682197:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d213f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x132:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.682204:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d213f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x132:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.682216:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x132:0x0].0x0 (ffff9e03c2fc5000) 00010000:00010000:1.0:1788201205.682219:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201205.682223:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d213f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x132:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.682230:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d213f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x132:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.682251:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d2131 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.682262:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d2131 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.682268:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d2131 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.682273:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.682275:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d2131 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.682475:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d2131 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.682488:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201205.682491:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.682494:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d2131 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.682500:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d2131 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201205.682512:0:12968:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000007549faa reply state 00000000659a9b87 transno 8589938547 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2138 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x48016440 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.682521:0:12968:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201205.682682:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c543f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+253:13079:x1875064442561024:12345-192.168.201.30@tcp:36:rm.0 Request processed in 4067us (4788us total) trans 8589938547 rc 0/0 00000100:00100000:1.0:1788201205.682693:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4965 00000100:00100000:1.0:1788201205.699082:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442561536 00000100:00100000:1.0:1788201205.699101:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442561536 00000100:00100000:1.0:1788201205.699208:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4967 00000100:00100000:1.0:1788201205.699221:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+252:13079:x1875064442561536:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201205.699341:0:12969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201205.699379:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1fb0400/0x9383f985bc4ba9d1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x173:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf1c7 expref: 252 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.699772:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501ba3600/0x9383f985bc4ba9b5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x173:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf1c0 expref: 251 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.699787:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x173:0x0].0x0 (ffff9e03c2700800) 00010000:00010000:1.0:1788201205.699801:0:12969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201205.699834:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2169 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.699850:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2169 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.699862:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2169 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.699879:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d2170 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x81d87340 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.699887:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d2170 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x81d87340 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.699894:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d2170 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x81d87340 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.700183:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2177 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x173:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.700193:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2177 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x173:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.700200:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2177 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x173:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201205.702528:0:12969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].473, 64 off38464 00010000:00010000:1.0:1788201205.702651:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d217e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x173:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.702671:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d217e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x173:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.702685:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d217e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x173:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.702696:0:12969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d217e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x173:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.702702:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d217e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x173:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.702709:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d217e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x173:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.702795:0:12969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201205.702830:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2177 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x173:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.702838:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2177 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x173:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.702850:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2177 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x173:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.702858:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.702863:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2177 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x173:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.702873:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2177 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x173:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.702886:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x173:0x0].0x0 (ffff9e03c5173e00) 00010000:00010000:1.0:1788201205.702890:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201205.702896:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2177 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x173:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.702914:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2177 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x173:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.702948:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2169 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.702955:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2169 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.702960:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2169 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.702965:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.702968:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2169 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.702979:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2169 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.702989:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201205.702991:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.702995:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2169 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.703002:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2169 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201205.703013:0:12969:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000040b52120 reply state 0000000066defaca transno 8589938549 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d2170 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x81d87340 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.703025:0:12969:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201205.703198:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+252:13079:x1875064442561536:12345-192.168.201.30@tcp:36:rm.0 Request processed in 3974us (5793us total) trans 8589938549 rc 0/0 00000100:00100000:1.0:1788201205.703210:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4967 00000100:00100000:1.0:1788201205.707779:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201205.707825:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442561792 00000100:00100000:1.0:1788201205.707837:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442561792 00000100:00100000:1.0:1788201205.707911:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4968 00000100:00100000:1.0:1788201205.707924:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+251:13079:x1875064442561792:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201205.708013:0:12968:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201205.708042:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2e54e00/0x9383f985bc4c3b18 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2e0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c23e6 expref: 251 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.708076:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1a96600/0x9383f985bc4c3ae7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c23df expref: 250 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.708088:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2e0:0x0].0x0 (ffff9e03c342be00) 00010000:00010000:1.0:1788201205.708097:0:12968:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201205.708124:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2185 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.708140:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2185 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.708160:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2185 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.708177:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d218c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x5a2ff624 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.708185:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d218c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x5a2ff624 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.708191:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d218c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x5a2ff624 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.708372:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d2193 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2e0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.708380:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d2193 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.709287:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d2193 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201205.711876:0:12968:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].478, 64 off38784 00010000:00010000:1.0:1788201205.712122:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d219a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2e0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.712141:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d219a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.712225:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d219a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.712236:0:12968:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d219a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.712243:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d219a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.712249:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d219a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.712496:0:12968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201205.712531:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d2193 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2e0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.712539:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d2193 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2e0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.712545:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d2193 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2e0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.712551:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.712556:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d2193 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2e0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.712563:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d2193 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2e0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.712579:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2e0:0x0].0x0 (ffff9e03c5173000) 00010000:00010000:1.0:1788201205.712582:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201205.712586:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d2193 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2e0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.712592:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d2193 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2e0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.712614:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2185 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.712621:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2185 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.712626:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2185 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.712632:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.712635:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2185 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.712642:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2185 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.712650:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201205.712652:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.712655:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2185 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.712661:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2185 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201205.712675:0:12968:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5c5058a reply state 00000000300814f4 transno 8589938550 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d218c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x5a2ff624 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.712686:0:12968:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201205.712855:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+250:13079:x1875064442561792:12345-192.168.201.30@tcp:36:rm.0 Request processed in 4926us (5079us total) trans 8589938550 rc 0/0 00000100:00100000:1.0:1788201205.712866:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4968 00000100:00100000:1.0:1788201205.718616:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442562048 00000100:00100000:1.0:1788201205.718629:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442562048 00000100:00100000:1.0:1788201205.718704:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4969 00000100:00100000:1.0:1788201205.718718:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+250:13079:x1875064442562048:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201205.718806:0:13379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201205.718843:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2092e00/0x9383f985bc4c3d10 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2e5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2495 expref: 250 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.718867:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2345200/0x9383f985bc4c3cf4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2e5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c248e expref: 249 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.718878:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2e5:0x0].0x0 (ffff9e03c1b6d200) 00010000:00010000:1.0:1788201205.718890:0:13379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201205.718941:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d21a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.718957:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d21a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.718968:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d21a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.718991:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d21a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0xe1ecaf24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.718998:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d21a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xe1ecaf24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.719004:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d21a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xe1ecaf24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.719172:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d21af lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2e5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.719182:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d21af lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.719191:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d21af lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201205.721735:0:13379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].474, 64 off38528 00010000:00010000:1.0:1788201205.721830:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d21b6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2e5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.721846:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d21b6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2e5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.721858:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d21b6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2e5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.721866:0:13379:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d21b6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2e5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.721873:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d21b6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2e5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.721879:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d21b6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2e5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.722009:0:13379:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201205.722039:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d21af lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2e5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.722056:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d21af lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2e5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.722063:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d21af lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2e5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.722069:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.722073:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d21af lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2e5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.722079:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d21af lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2e5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.722088:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2e5:0x0].0x0 (ffff9e03c5173400) 00010000:00010000:1.0:1788201205.722090:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201205.722094:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d21af lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2e5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.722101:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d21af lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2e5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.722121:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d21a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.722132:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d21a1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.722138:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d21a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.722143:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.722146:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d21a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.722163:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d21a1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.722173:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201205.722175:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.722179:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d21a1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.722186:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d21a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201205.722197:0:13379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000059dc8b6f reply state 0000000083d81f00 transno 8589938551 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d21a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xe1ecaf24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.722208:0:13379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201205.722379:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+249:13079:x1875064442562048:12345-192.168.201.30@tcp:36:rm.0 Request processed in 3657us (4195us total) trans 8589938551 rc 0/0 00000100:00100000:1.0:1788201205.725205:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4969 00000100:00100000:1.0:1788201205.729209:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442562304 00000100:00100000:1.0:1788201205.729227:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442562304 00000100:00100000:1.0:1788201205.729323:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4970 00000100:00100000:1.0:1788201205.729337:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+248:13079:x1875064442562304:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201205.729540:0:12969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201205.729570:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1fce600/0x9383f985bc4b324c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc868 expref: 248 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.729591:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c29d7400/0x9383f985bc4b3230 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x47:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc861 expref: 247 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.729602:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x47:0x0].0x0 (ffff9e04c52abf00) 00010000:00010000:1.0:1788201205.729612:0:12969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201205.729641:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d21bd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.729658:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d21bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.729669:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d21bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.729685:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d21c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0xdc768424 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.729693:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d21c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xdc768424 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.729700:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d21c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xdc768424 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.729845:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d21cb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.729853:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d21cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.729860:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d21cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201205.731425:0:12969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].475, 64 off38592 00010000:00010000:1.0:1788201205.731524:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d21d2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.731543:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d21d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.731555:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d21d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.731563:0:12969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d21d2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.731569:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d21d2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.731576:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d21d2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.731602:0:12969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201205.731629:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d21cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.731636:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d21cb lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.731647:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d21cb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.731654:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.731659:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d21cb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.731666:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d21cb lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.731679:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x47:0x0].0x0 (ffff9e03c5173500) 00010000:00010000:1.0:1788201205.731683:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201205.731688:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d21cb lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.731694:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d21cb lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.731717:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d21bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.731723:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d21bd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.731728:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d21bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.731733:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.731736:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d21bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.731745:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d21bd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.731753:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201205.731755:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.731758:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d21bd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.731764:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d21bd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201205.731775:0:12969:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d29a3ffe reply state 0000000079155238 transno 8589938552 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d21c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xdc768424 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.731785:0:12969:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201205.733255:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+248:13079:x1875064442562304:12345-192.168.201.30@tcp:36:rm.0 Request processed in 3912us (5394us total) trans 8589938552 rc 0/0 00000100:00100000:1.0:1788201205.733269:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4970 00000100:00100000:1.0:1788201205.740409:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442562560 00000100:00100000:1.0:1788201205.740422:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442562560 00000100:00100000:1.0:1788201205.740501:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4971 00000100:00100000:1.0:1788201205.740515:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+247:13079:x1875064442562560:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201205.740594:0:12968:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201205.740619:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4b4110 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x6c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcd7e expref: 247 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.740640:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cf5200/0x9383f985bc4b40df lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x6c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcd77 expref: 246 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.740656:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x6c:0x0].0x0 (ffff9e04d0b37600) 00010000:00010000:1.0:1788201205.740667:0:12968:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201205.740695:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d21d9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.740710:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d21d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.740721:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d21d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.740738:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d21e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x5ee2b0ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.740746:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d21e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x5ee2b0ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.740752:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d21e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x5ee2b0ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.740892:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d21e7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x6c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.740901:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d21e7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.740909:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d21e7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201205.741671:0:12968:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].479, 64 off38848 00010000:00010000:1.0:1788201205.741748:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d21ee lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x6c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.741760:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d21ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.741769:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d21ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.741778:0:12968:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d21ee lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.741784:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d21ee lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.741790:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d21ee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.741823:0:12968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201205.741849:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d21e7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.741855:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d21e7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.741861:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d21e7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.741868:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.741873:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d21e7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.741881:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d21e7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.741896:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x6c:0x0].0x0 (ffff9e03c5173d00) 00010000:00010000:1.0:1788201205.741899:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201205.741904:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d21e7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.741912:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d21e7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.741934:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d21d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.741941:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d21d9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.741947:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d21d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.741952:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.741955:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d21d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.741961:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d21d9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.741968:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201205.741971:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.741974:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d21d9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.741979:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d21d9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201205.741993:0:12968:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009efb7b38 reply state 0000000059b73044 transno 8589938553 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d21e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x5ee2b0ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.742002:0:12968:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201205.742114:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+247:13079:x1875064442562560:12345-192.168.201.30@tcp:36:rm.0 Request processed in 1599us (2119us total) trans 8589938553 rc 0/0 00000100:00100000:1.0:1788201205.742124:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4971 00000100:00100000:1.0:1788201205.750110:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442562816 00000100:00100000:1.0:1788201205.750124:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442562816 00000100:00100000:1.0:1788201205.750215:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4972 00000100:00100000:1.0:1788201205.750227:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+246:13079:x1875064442562816:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201205.750346:0:13379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201205.750391:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1be4600/0x9383f985bc4b621f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd8ec expref: 246 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.750418:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1be5c00/0x9383f985bc4b6203 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xbf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd8e5 expref: 245 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.750429:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xbf:0x0].0x0 (ffff9e03c2d27300) 00010000:00010000:1.0:1788201205.750441:0:13379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201205.750477:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d21f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.750494:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d21f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.750506:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d21f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.750529:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d21fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x75fb31ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.750536:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d21fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x75fb31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.750543:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d21fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x75fb31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.750690:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d2203 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xbf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.750698:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d2203 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.750706:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d2203 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201205.752677:0:13379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].476, 64 off38656 00010000:00010000:1.0:1788201205.752807:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d220a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xbf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.752827:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d220a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xbf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.752839:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d220a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xbf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.752849:0:13379:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d220a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xbf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.752856:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d220a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xbf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.752864:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d220a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xbf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.752890:0:13379:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201205.752928:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d2203 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.752935:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d2203 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.753202:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d2203 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.754656:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.754664:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d2203 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.754672:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d2203 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.754682:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xbf:0x0].0x0 (ffff9e03c5173d00) 00010000:00010000:1.0:1788201205.754685:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201205.754688:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d2203 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.754695:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d2203 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xbf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.754732:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d21f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.754744:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d21f5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.754750:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d21f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.754755:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.754758:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d21f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.754764:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d21f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.754772:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201205.754774:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.754777:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d21f5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.754783:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d21f5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201205.754794:0:13379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004263eb00 reply state 000000001d1e8e7d transno 8589938554 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d21fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x75fb31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.754804:0:13379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201205.755065:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+246:13079:x1875064442562816:12345-192.168.201.30@tcp:36:rm.0 Request processed in 4832us (5090us total) trans 8589938554 rc 0/0 00000100:00100000:1.0:1788201205.755076:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4972 00000100:00100000:1.0:1788201205.760232:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442563072 00000100:00100000:1.0:1788201205.760247:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442563072 00000100:00100000:1.0:1788201205.760363:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4973 00000100:00100000:1.0:1788201205.760376:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+245:13079:x1875064442563072:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201205.760598:0:12969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201205.760634:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2f2ee00/0x9383f985bc4c74d8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x371:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c37ea expref: 245 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.760661:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c500ca00/0x9383f985bc4c74a7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x371:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c37e3 expref: 244 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.760673:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x371:0x0].0x0 (ffff9e03c39e5000) 00010000:00010000:1.0:1788201205.760686:0:12969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201205.760714:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2211 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.760730:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2211 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.760741:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2211 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.760759:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2218 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0xd19becdd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.760767:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2218 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xd19becdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.760773:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2218 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xd19becdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.761057:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d221f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x371:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.761067:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d221f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x371:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.761073:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d221f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x371:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201205.762664:0:12969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].477, 64 off38720 00010000:00010000:1.0:1788201205.762756:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d2226 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x371:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.762772:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d2226 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x371:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.762784:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d2226 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x371:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.762793:0:12969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d2226 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x371:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.762800:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d2226 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x371:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.762808:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d2226 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x371:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.762891:0:12969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201205.762926:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d221f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x371:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.762932:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d221f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x371:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.762945:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d221f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x371:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.762952:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.762957:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d221f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x371:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.762965:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d221f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x371:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.762977:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x371:0x0].0x0 (ffff9e03c5173500) 00010000:00010000:1.0:1788201205.762980:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201205.762984:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d221f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x371:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.762991:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d221f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x371:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.763013:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2211 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.763019:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2211 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.763025:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2211 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.763030:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.763033:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2211 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.763051:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2211 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.763059:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201205.763062:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.763065:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2211 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.763071:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2211 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201205.763080:0:12969:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004a9eafcb reply state 00000000e44e5c75 transno 8589938555 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2218 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xd19becdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.763089:0:12969:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201205.763207:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+245:13079:x1875064442563072:12345-192.168.201.30@tcp:36:rm.0 Request processed in 2828us (3434us total) trans 8589938555 rc 0/0 00000100:00100000:1.0:1788201205.763217:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4973 00000100:00100000:1.0:1788201205.767890:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201205.777123:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000040:00080000:1.0:1788201205.783041:0:13379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].480, 64 off38912 00010000:00010000:1.0:1788201205.783161:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d225e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3c2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.783183:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d225e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3c2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.783195:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d225e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3c2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.783210:0:13379:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d225e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3c2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.783217:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d225e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3c2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.783224:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d225e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3c2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.783260:0:13379:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201205.783316:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2257 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3c2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.783323:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2257 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3c2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.783331:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2257 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3c2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.783338:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.783343:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2257 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3c2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.783352:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2257 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3c2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.783366:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3c2:0x0].0x0 (ffff9e03c2fc5a00) 00010000:00010000:1.0:1788201205.783370:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201205.783375:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2257 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3c2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.783387:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2257 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3c2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.783411:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d2249 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.783417:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d2249 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.783423:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d2249 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.783429:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.783432:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d2249 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.783438:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d2249 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.783517:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201205.783522:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.783526:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d2249 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.783532:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d2249 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201205.783544:0:13379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000164f92db reply state 00000000357426c4 transno 8589938557 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0a00/0x9383f985bc4d2250 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x68e9d496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.783553:0:13379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201205.783669:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+243:13079:x1875064442563584:12345-192.168.201.30@tcp:36:rm.0 Request processed in 5961us (6553us total) trans 8589938557 rc 0/0 00000100:00100000:1.0:1788201205.783679:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4975 00000100:00100000:1.0:1788201205.792831:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201205.804610:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201205.817331:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442564352 00000100:00100000:1.0:1788201205.817348:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442564352 00000100:00100000:1.0:1788201205.817423:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4978 00000100:00100000:1.0:1788201205.817436:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+241:13079:x1875064442564352:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201205.817526:0:13379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201205.817562:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e7600/0x9383f985bc4bc5f4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1ba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfb8a expref: 241 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.817588:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff01be00/0x9383f985bc4bc5d8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1ba:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfb83 expref: 240 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.817600:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1ba:0x0].0x0 (ffff9e0501bbec00) 00010000:00010000:1.0:1788201205.817614:0:13379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201205.817645:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d229d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.817663:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d229d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.817673:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d229d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.817691:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d22a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0xd0cca1f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.817705:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d22a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xd0cca1f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.817711:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d22a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xd0cca1f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.817852:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d22ab lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x1ba:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.817861:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d22ab lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x1ba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.817869:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d22ab lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x1ba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201205.818715:0:13379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].483, 64 off39104 00010000:00010000:1.0:1788201205.818805:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d22b2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1ba:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.818822:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d22b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1ba:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.818832:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d22b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1ba:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.818840:0:13379:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d22b2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x1ba:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.818847:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d22b2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x1ba:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.818854:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d22b2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1ba:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.818886:0:13379:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201205.818915:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d22ab lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x1ba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.818922:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d22ab lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x1ba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.818930:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d22ab lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x1ba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.818937:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.818942:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d22ab lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x1ba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.818951:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d22ab lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x1ba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.818962:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1ba:0x0].0x0 (ffff9e03c5173400) 00010000:00010000:1.0:1788201205.818965:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201205.818970:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d22ab lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x1ba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.818976:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d22ab lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x1ba:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.818998:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d229d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.819004:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d229d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.819015:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d229d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.819021:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.819024:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d229d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.819030:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d229d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.819038:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201205.819041:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.819056:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d229d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.819062:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d229d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201205.819072:0:13379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed0381ef reply state 000000007c010d1b transno 8589938560 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d22a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xd0cca1f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.819081:0:13379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201205.819194:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+241:13079:x1875064442564352:12345-192.168.201.30@tcp:36:rm.0 Request processed in 1758us (2331us total) trans 8589938560 rc 0/0 00000100:00100000:1.0:1788201205.819205:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4978 00000100:00100000:1.0:1788201205.847349:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201205.848671:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442565376 00000100:00100000:1.0:1788201205.848686:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442565376 00000100:00100000:1.0:1788201205.848769:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4982 00000100:00100000:1.0:1788201205.848781:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+237:13079:x1875064442565376:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201205.848868:0:12969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201205.848904:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c39b0c00/0x9383f985bc4be9f7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c07ed expref: 237 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.848942:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c39b1c00/0x9383f985bc4be9c6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x214:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c07df expref: 236 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.848955:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x214:0x0].0x0 (ffff9e03c2764600) 00010000:00010000:1.0:1788201205.848967:0:12969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201205.848997:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d230d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.849014:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d230d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.849026:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d230d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.849053:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2314 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x56bb42b2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.849062:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2314 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x56bb42b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.849068:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2314 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x56bb42b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.849425:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d231b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x214:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.849435:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d231b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x214:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.849444:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d231b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x214:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201205.852221:0:12969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].486, 64 off39296 00010000:00010000:1.0:1788201205.852761:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d2322 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x214:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.852780:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d2322 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x214:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.852793:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d2322 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x214:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.852803:0:12969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d2322 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x214:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.852810:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d2322 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x214:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.852817:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d2322 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x214:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.852906:0:12969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201205.852954:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d231b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x214:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.852962:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d231b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x214:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.852969:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d231b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x214:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.852981:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.852986:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d231b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x214:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.852994:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d231b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x214:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.853007:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x214:0x0].0x0 (ffff9e03c5173600) 00010000:00010000:1.0:1788201205.853010:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201205.853016:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d231b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x214:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.853022:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d231b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x214:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.853056:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d230d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.853063:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d230d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.853070:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d230d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.853075:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.853079:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d230d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.853085:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d230d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.853097:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201205.853099:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.853102:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d230d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.853108:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d230d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201205.853118:0:12969:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003448b4e4 reply state 000000003ca0d8d1 transno 8589938564 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2314 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x56bb42b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.853127:0:12969:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201205.853266:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+236:13079:x1875064442565376:12345-192.168.201.30@tcp:36:rm.0 Request processed in 4481us (5925us total) trans 8589938564 rc 0/0 00000100:00100000:1.0:1788201205.853277:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4982 00010000:00010000:1.0:1788201205.856733:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2314 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x56bb42b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.856755:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2314 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x56bb42b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.856763:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2314 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x56bb42b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.856771:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.856776:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2314 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x56bb42b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.856784:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2314 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x56bb42b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.856809:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x56bb42b2 (ffff9e03c5173b00) 00010000:00010000:1.0:1788201205.856813:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.856818:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2314 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x56bb42b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.856825:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2314 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x56bb42b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.857872:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201205.868288:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442565888 00000100:00100000:1.0:1788201205.868330:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442565888 00000100:00100000:1.0:1788201205.868405:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4984 00000100:00100000:1.0:1788201205.868417:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c543b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+234:13079:x1875064442565888:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201205.868519:0:13406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201205.868544:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2f7ac00/0x9383f985bc4c6eb1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x361:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c35b3 expref: 234 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.868565:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04cffdd600/0x9383f985bc4c6e95 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x361:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c35ac expref: 233 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.868574:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x361:0x0].0x0 (ffff9e04d2337200) 00010000:00010000:1.0:1788201205.868581:0:13406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201205.868607:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d2345 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.868622:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d2345 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.868638:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d2345 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.868655:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d234c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0xa7cc7add bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.868662:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d234c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xa7cc7add bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.868669:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d234c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xa7cc7add bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.868810:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d2353 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x361:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.868818:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d2353 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x361:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.868826:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d2353 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x361:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201205.869603:0:13406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].481, 64 off38976 00010000:00010000:1.0:1788201205.869681:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d235a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x361:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.869693:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d235a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x361:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.869703:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d235a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x361:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.869713:0:13406:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d235a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x361:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.869721:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d235a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x361:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.869727:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d235a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x361:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.869764:0:13406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201205.869790:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d2353 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x361:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.869797:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d2353 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x361:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.869804:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d2353 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x361:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.869811:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.869816:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d2353 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x361:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.869823:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d2353 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x361:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.869834:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x361:0x0].0x0 (ffff9e03c5173e00) 00010000:00010000:1.0:1788201205.869838:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201205.869843:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d2353 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x361:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.869849:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d2353 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x361:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.869877:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d2345 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.869884:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d2345 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.869890:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d2345 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.869896:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.869899:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d2345 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.869905:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d2345 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.869913:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201205.869915:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.869918:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d2345 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.869923:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d2345 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201205.869934:0:13406:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057ad2ab1 reply state 00000000057c48a5 transno 8589938566 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d234c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xa7cc7add bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.869943:0:13406:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201205.871552:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c543b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+234:13079:x1875064442565888:12345-192.168.201.30@tcp:36:rm.0 Request processed in 3130us (3683us total) trans 8589938566 rc 0/0 00000100:00100000:1.0:1788201205.871564:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4984 00010000:00010000:1.0:1788201205.876222:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d234c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xa7cc7add bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.876239:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d234c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xa7cc7add bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.876249:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d234c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xa7cc7add bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.876257:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.876263:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d234c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xa7cc7add bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.876273:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d234c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xa7cc7add bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.876317:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0xa7cc7add (ffff9e03c5173000) 00010000:00010000:1.0:1788201205.876322:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.876327:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d234c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0xa7cc7add bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.876334:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d234c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0xa7cc7add bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.879790:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201205.879802:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017000/0x9383f985bc4d2376 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x32c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.879812:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201205.879816:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017000/0x9383f985bc4d2376 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x32c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.879829:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017000/0x9383f985bc4d2376 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x32c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.879841:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x32c:0x0].0x0 (ffff9e03c33e8f00) 00010000:00010000:1.0:1788201205.879844:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201205.879847:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017000/0x9383f985bc4d2376 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x32c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.879853:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017000/0x9383f985bc4d2376 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x32c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.879877:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201205.879879:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201205.879881:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201205.899605:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d2384 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xeb22a1f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.899628:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d2384 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xeb22a1f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.899637:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d2384 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xeb22a1f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.899644:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.899650:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d2384 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xeb22a1f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.899659:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d2384 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xeb22a1f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.899681:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0xeb22a1f9 (ffff9e03c33e8d00) 00010000:00010000:1.0:1788201205.899686:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.899691:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d2384 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0xeb22a1f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.899698:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d2384 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0xeb22a1f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.899972:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:1.0:1788201205.906992:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201205.911419:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c600/0x9383f985bc4d23bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x448cb0ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.911428:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c600/0x9383f985bc4d23bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x448cb0ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.911434:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c600/0x9383f985bc4d23bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x448cb0ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.911439:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507c600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.911443:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c600/0x9383f985bc4d23bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x448cb0ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.911586:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c600/0x9383f985bc4d23bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x448cb0ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.911596:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x448cb0ce (ffff9e03c33ed700) 00010000:00010000:1.0:1788201205.911599:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.911601:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c600/0x9383f985bc4d23bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x448cb0ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.911606:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c600/0x9383f985bc4d23bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x448cb0ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.934735:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442567424 00000100:00100000:1.0:1788201205.934749:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442567424 00000100:00100000:1.0:1788201205.934827:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4990 00000100:00100000:1.0:1788201205.934839:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+228:13079:x1875064442567424:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201205.934934:0:12968:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201205.934971:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff67c000/0x9383f985bc4b3ba6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcbb7 expref: 228 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.934998:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cf1a00/0x9383f985bc4b3b8a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x5f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcbb0 expref: 227 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.935010:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5f:0x0].0x0 (ffff9e03c3558900) 00010000:00010000:1.0:1788201205.935025:0:12968:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201205.935067:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d23ed lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.935089:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d23ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.935101:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d23ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.935119:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d23f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x9a6e1b96 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.935126:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d23f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x9a6e1b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.935133:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d23f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x9a6e1b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.935333:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d23fb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.935342:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d23fb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.935349:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d23fb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201205.936016:0:12968:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].483, 64 off39104 00010000:00010000:1.0:1788201205.936106:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d2402 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.936119:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d2402 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.936128:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d2402 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.936136:0:12968:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d2402 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.936140:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d2402 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.936145:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d2402 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.936176:0:12968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201205.936202:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d23fb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.936212:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d23fb lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.936219:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d23fb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.936226:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.936231:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d23fb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.936241:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d23fb lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.937417:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5f:0x0].0x0 (ffff9e03c5173b00) 00010000:00010000:1.0:1788201205.937427:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201205.937435:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d23fb lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.937443:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d23fb lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.937551:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d23ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.937559:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d23ed lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.937566:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d23ed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.937572:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.937577:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d23ed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.937583:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d23ed lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.937596:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201205.937599:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.937602:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d23ed lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.937608:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d23ed lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201205.937619:0:12968:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000092c0355b reply state 0000000086dd5cef transno 8589938572 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d23f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x9a6e1b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.937629:0:12968:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201205.939417:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+228:13079:x1875064442567424:12345-192.168.201.30@tcp:36:rm.0 Request processed in 4565us (5056us total) trans 8589938572 rc 0/0 00000100:00100000:1.0:1788201205.939430:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4990 00010000:00010000:1.0:1788201205.947577:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d23f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x9a6e1b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.947592:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d23f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x9a6e1b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.947602:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d23f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x9a6e1b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.947609:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.947615:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d23f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x9a6e1b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.947626:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d23f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x9a6e1b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.947646:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x9a6e1b96 (ffff9e03c5173000) 00010000:00010000:1.0:1788201205.947649:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.947655:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d23f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x9a6e1b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.947661:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d23f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x9a6e1b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.949470:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201205.949478:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d241e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xe9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.949484:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201205.949488:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d241e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0xe9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.949495:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d241e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xe9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.949505:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xe9:0x0].0x0 (ffff9e03c33e8000) 00010000:00010000:1.0:1788201205.949507:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201205.949510:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d241e lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0xe9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.949516:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d241e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0xe9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.949532:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201205.949534:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201205.949536:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201205.954986:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442567936 00000100:00100000:1.0:1788201205.955001:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442567936 00000100:00100000:1.0:1788201205.955074:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4992 00000100:00100000:1.0:1788201205.955087:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+226:13079:x1875064442567936:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201205.955171:0:12971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201205.955197:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5e00/0x9383f985bc4b771f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0xf4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be047 expref: 226 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.955227:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4b76ee lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0xf4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be040 expref: 225 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.955238:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xf4:0x0].0x0 (ffff9e03c134b700) 00010000:00010000:1.0:1788201205.955249:0:12971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201205.955278:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d2425 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.955320:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d2425 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.955332:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d2425 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.955350:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d242c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0xe7adee87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.955358:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d242c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xe7adee87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.955364:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d242c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xe7adee87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.955518:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d2433 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0xf4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.955526:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d2433 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xf4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.955533:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d2433 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xf4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201205.956387:0:12971:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].491, 64 off39616 00010000:00010000:1.0:1788201205.956470:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d243a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0xf4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.956484:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d243a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xf4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.956493:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d243a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0xf4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.956501:0:12971:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d243a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xf4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.956507:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d243a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0xf4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.956512:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d243a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0xf4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.956539:0:12971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201205.956565:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d2433 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0xf4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.956577:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d2433 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0xf4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.956584:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d2433 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xf4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.956591:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.956596:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d2433 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0xf4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.956604:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d2433 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0xf4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.956613:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0xf4:0x0].0x0 (ffff9e03c5173200) 00010000:00010000:1.0:1788201205.956616:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201205.956620:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d2433 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0xf4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.956625:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d2433 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0xf4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.956644:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d2425 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.956650:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d2425 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.956657:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d2425 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.956662:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.956666:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d2425 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.956672:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d2425 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.956679:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201205.956681:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.956684:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d2425 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.956689:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d2425 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201205.956698:0:12971:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000030b6d541 reply state 00000000fc7d277a transno 8589938574 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d242c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xe7adee87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.956708:0:12971:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201205.956820:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+226:13079:x1875064442567936:12345-192.168.201.30@tcp:36:rm.0 Request processed in 1733us (2249us total) trans 8589938574 rc 0/0 00000100:00100000:1.0:1788201205.956830:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4992 00010000:00010000:1.0:1788201205.962476:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d242c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xe7adee87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.962500:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d242c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xe7adee87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.962508:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d242c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xe7adee87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.962515:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201205.962520:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d242c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xe7adee87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.962529:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d242c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xe7adee87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.962550:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0xe7adee87 (ffff9e03c5173b00) 00010000:00010000:1.0:1788201205.962553:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201205.962559:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d242c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0xe7adee87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201205.962566:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d242c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0xe7adee87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201205.990582:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875064458145920:0@lo:400:kworker.0 00000100:00100000:1.0:1788201206.027564:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201206.027941:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875064458145920:12345-0@lo:400:kworker.0 Request processed in 109us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201206.027953:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1788201206.028269:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201206.028442:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875064458145920:0@lo:400:kworker.0 00010000:00010000:3.0:1788201206.036380:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0a00/0x9383f985bc4d2480 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xa5af716b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.036416:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0a00/0x9383f985bc4d2480 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xa5af716b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.036424:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0a00/0x9383f985bc4d2480 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xa5af716b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.036432:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201206.036438:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0a00/0x9383f985bc4d2480 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xa5af716b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.036448:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0a00/0x9383f985bc4d2480 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xa5af716b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.036479:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0xa5af716b (ffff9e03c2fc5a00) 00010000:00010000:3.0:1788201206.036483:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201206.036489:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0a00/0x9383f985bc4d2480 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0xa5af716b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.036496:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0a00/0x9383f985bc4d2480 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0xa5af716b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.041672:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507cc00/0x9383f985bc4d249c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xf9dc806b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.041694:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507cc00/0x9383f985bc4d249c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xf9dc806b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.041707:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507cc00/0x9383f985bc4d249c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xf9dc806b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.041714:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507cc00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201206.041719:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507cc00/0x9383f985bc4d249c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xf9dc806b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.041727:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507cc00/0x9383f985bc4d249c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xf9dc806b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.041745:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0xf9dc806b (ffff9e03c33ed200) 00010000:00010000:3.0:1788201206.041748:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201206.041753:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507cc00/0x9383f985bc4d249c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0xf9dc806b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.041759:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507cc00/0x9383f985bc4d249c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0xf9dc806b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.042379:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d24b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x88c1da24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.042399:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d24b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x88c1da24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.042406:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d24b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x88c1da24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.042413:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201206.042416:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d24b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x88c1da24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.042427:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d24b8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x88c1da24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.042438:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x88c1da24 (ffff9e03c2fc5500) 00010000:00010000:3.0:1788201206.042440:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201206.042444:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d24b8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x88c1da24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.042450:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d24b8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x88c1da24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201206.043277:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442569472 00000100:00100000:3.0:1788201206.043568:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442569472 00000100:00100000:3.0:1788201206.043654:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4998 00000100:00100000:3.0:1788201206.043664:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+220:13079:x1875064442569472:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:3.0:1788201206.043749:0:12971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788201206.043776:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3379e00/0x9383f985bc4c087b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x261:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c127b expref: 220 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.043795:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2fe5200/0x9383f985bc4c085f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x261:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1274 expref: 219 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.043807:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x261:0x0].0x0 (ffff9e03c2a79e00) 00010000:00010000:3.0:1788201206.043819:0:12971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201206.043848:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d24cd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.043865:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d24cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.043876:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d24cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.043893:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016c00/0x9383f985bc4d24d4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0xc005716b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.043900:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016c00/0x9383f985bc4d24d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xc005716b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.043908:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016c00/0x9383f985bc4d24d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xc005716b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.044127:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017200/0x9383f985bc4d24db lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x261:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.044135:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017200/0x9383f985bc4d24db lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x261:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.044204:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017200/0x9383f985bc4d24db lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x261:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201206.045377:0:12971:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].489, 64 off39488 00010000:00010000:3.0:1788201206.045676:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017c00/0x9383f985bc4d24e2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x261:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.045692:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017c00/0x9383f985bc4d24e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x261:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.045702:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017c00/0x9383f985bc4d24e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x261:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.045712:0:12971:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017c00/0x9383f985bc4d24e2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x261:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.045719:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017c00/0x9383f985bc4d24e2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x261:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.045726:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017c00/0x9383f985bc4d24e2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x261:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.045886:0:12971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201206.045916:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017200/0x9383f985bc4d24db lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x261:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.045930:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017200/0x9383f985bc4d24db lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x261:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.045938:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017200/0x9383f985bc4d24db lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x261:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.045945:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201206.045950:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017200/0x9383f985bc4d24db lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x261:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.045958:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017200/0x9383f985bc4d24db lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x261:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.045970:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x261:0x0].0x0 (ffff9e03c33e8100) 00010000:00010000:3.0:1788201206.045973:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201206.045978:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017200/0x9383f985bc4d24db lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x261:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.045985:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017200/0x9383f985bc4d24db lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x261:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.046011:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d24cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.046017:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d24cd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.046024:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d24cd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.046029:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3016600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201206.046032:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d24cd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.046038:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d24cd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.046058:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:3.0:1788201206.046061:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201206.046064:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d24cd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.046070:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d24cd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201206.046081:0:12971:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002225b994 reply state 00000000b2c593ee transno 8589938580 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016c00/0x9383f985bc4d24d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xc005716b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201206.046091:0:12971:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201206.046244:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+220:13079:x1875064442569472:12345-192.168.201.30@tcp:36:rm.0 Request processed in 2574us (3490us total) trans 8589938580 rc 0/0 00000100:00100000:3.0:1788201206.046254:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4998 00010000:00010000:1.0:1788201206.048025:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016c00/0x9383f985bc4d24d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xc005716b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.048056:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016c00/0x9383f985bc4d24d4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xc005716b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.048066:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016c00/0x9383f985bc4d24d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xc005716b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.048073:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3016c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201206.048078:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016c00/0x9383f985bc4d24d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xc005716b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.048086:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016c00/0x9383f985bc4d24d4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xc005716b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.048104:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0xc005716b (ffff9e03c33e8800) 00010000:00010000:1.0:1788201206.048107:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201206.048112:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016c00/0x9383f985bc4d24d4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0xc005716b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.048118:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016c00/0x9383f985bc4d24d4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0xc005716b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201206.067797:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201206.068256:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442569984 00000100:00100000:1.0:1788201206.068270:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442569984 00000100:00100000:1.0:1788201206.068370:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5000 00000100:00100000:1.0:1788201206.068382:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c543bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+218:13079:x1875064442569984:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201206.068477:0:13379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201206.068509:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c39e1c00/0x9383f985bc4c2e61 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2c0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1f7f expref: 218 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.068533:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c21f1000/0x9383f985bc4c2e45 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2c0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1f78 expref: 217 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.068548:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2c0:0x0].0x0 (ffff9e03c299e200) 00010000:00010000:1.0:1788201206.068561:0:13379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201206.068591:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2505 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.068607:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2505 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.068618:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2505 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.068633:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d250c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0xcdb0cb24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.068639:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d250c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xcdb0cb24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.068645:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d250c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xcdb0cb24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.068793:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d2513 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2c0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.068802:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d2513 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2c0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.068810:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d2513 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2c0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201206.076340:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:1.0:1788201206.076847:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d250c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xcdb0cb24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.076863:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d250c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xcdb0cb24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.077031:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d250c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xcdb0cb24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.077051:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201206.077057:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d250c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xcdb0cb24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.077072:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d250c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xcdb0cb24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.077093:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0xcdb0cb24 (ffff9e03c5173b00) 00010000:00010000:1.0:1788201206.077096:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201206.077102:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d250c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0xcdb0cb24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.077108:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d250c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0xcdb0cb24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201206.087720:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:1.0:1788201206.103344:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d800/0x9383f985bc4d2544 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x5ff13587 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.103371:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d800/0x9383f985bc4d2544 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x5ff13587 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.103379:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d800/0x9383f985bc4d2544 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x5ff13587 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.103387:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201206.103406:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d800/0x9383f985bc4d2544 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x5ff13587 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.103415:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d800/0x9383f985bc4d2544 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x5ff13587 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.103438:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x5ff13587 (ffff9e03c33ed400) 00010000:00010000:1.0:1788201206.103441:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201206.103447:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d800/0x9383f985bc4d2544 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x5ff13587 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.103455:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d800/0x9383f985bc4d2544 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x5ff13587 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201206.104622:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:1.0:1788201206.105602:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201206.105607:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201206.105608:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201206.109049:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201206.109058:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ce00/0x9383f985bc4d256e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x157:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.109066:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507ce00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201206.109070:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ce00/0x9383f985bc4d256e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x157:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.109077:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ce00/0x9383f985bc4d256e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x157:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.109088:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x157:0x0].0x0 (ffff9e03c33ed900) 00010000:00010000:3.0:1788201206.109090:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788201206.109093:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ce00/0x9383f985bc4d256e lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x157:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.109099:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ce00/0x9383f985bc4d256e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x157:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.109118:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201206.109120:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201206.109121:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201206.115154:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000040:00080000:3.0:1788201206.119094:0:12971:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].495, 64 off39872 00010000:00010000:3.0:1788201206.119269:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d258a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x14e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.119626:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d258a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x14e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.119644:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d258a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x14e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.119655:0:12971:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d258a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x14e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.119662:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d258a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x14e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.119669:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d258a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x14e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.119728:0:12971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201206.119762:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d200/0x9383f985bc4d2583 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x14e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.119768:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d200/0x9383f985bc4d2583 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x14e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.119774:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d200/0x9383f985bc4d2583 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x14e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.119781:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201206.119785:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d200/0x9383f985bc4d2583 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x14e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.119793:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d200/0x9383f985bc4d2583 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x14e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.119807:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x14e:0x0].0x0 (ffff9e03c33ed400) 00010000:00010000:3.0:1788201206.119810:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201206.119815:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d200/0x9383f985bc4d2583 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x14e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.119822:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d200/0x9383f985bc4d2583 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x14e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.119865:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507da00/0x9383f985bc4d2575 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.119870:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507da00/0x9383f985bc4d2575 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.119877:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507da00/0x9383f985bc4d2575 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.119883:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507da00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201206.119885:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507da00/0x9383f985bc4d2575 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.119891:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507da00/0x9383f985bc4d2575 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.119907:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:3.0:1788201206.119910:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201206.119913:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507da00/0x9383f985bc4d2575 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.119919:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507da00/0x9383f985bc4d2575 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201206.119937:0:12971:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f92d1988 reply state 000000004ebf870d transno 8589938586 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c400/0x9383f985bc4d257c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x6d9c8f40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201206.119952:0:12971:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201206.120284:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c39c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+214:13079:x1875064442571008:12345-192.168.201.30@tcp:36:rm.0 Request processed in 4357us (5149us total) trans 8589938586 rc 0/0 00000100:00100000:3.0:1788201206.120327:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5004 00000100:00100000:3.0:1788201206.125438:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:1.0:1788201206.125647:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c400/0x9383f985bc4d257c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x6d9c8f40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.125660:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c400/0x9383f985bc4d257c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x6d9c8f40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.125668:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c400/0x9383f985bc4d257c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x6d9c8f40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.125675:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507c400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201206.125679:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c400/0x9383f985bc4d257c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x6d9c8f40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.125687:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c400/0x9383f985bc4d257c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x6d9c8f40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.125704:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x6d9c8f40 (ffff9e03c33edd00) 00010000:00010000:1.0:1788201206.125708:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201206.125712:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c400/0x9383f985bc4d257c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x6d9c8f40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.125718:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c400/0x9383f985bc4d257c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x6d9c8f40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201206.126162:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c39c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+213:13079:x1875064442571264:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201206.126248:0:12969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201206.126270:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c000/0x9383f985bc4c9099 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3b6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4191 expref: 213 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.126548:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c500b400/0x9383f985bc4c907d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3b6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c418a expref: 212 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.126563:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3b6:0x0].0x0 (ffff9e03c39ae000) 00010000:00010000:1.0:1788201206.126572:0:12969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201206.126600:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2591 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.126616:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2591 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.126627:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2591 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.126643:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2598 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x6d1e1b96 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.126650:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2598 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x6d1e1b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.126657:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2598 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x6d1e1b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.126798:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d259f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3b6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.126806:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d259f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3b6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.126814:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d259f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3b6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201206.128574:0:12969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].496, 64 off39936 00010000:00010000:1.0:1788201206.128673:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d25a6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3b6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.128690:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d25a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3b6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.128702:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d25a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3b6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.128711:0:12969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d25a6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3b6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.128718:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d25a6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3b6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.128725:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d25a6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3b6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.128758:0:12969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201206.128787:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d259f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3b6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.128794:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d259f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3b6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.128801:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d259f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3b6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.128813:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201206.128818:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d259f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3b6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.128826:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d259f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3b6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.128839:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3b6:0x0].0x0 (ffff9e03c5173900) 00010000:00010000:1.0:1788201206.128842:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201206.128848:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d259f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3b6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.128853:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d259f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3b6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.128878:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2591 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.128885:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2591 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.128892:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2591 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.128907:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201206.128910:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2591 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.128917:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2591 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.128936:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201206.128938:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201206.128941:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2591 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.128947:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2591 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201206.128957:0:12969:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d91f2fe9 reply state 000000001b5c8bbe transno 8589938587 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2598 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x6d1e1b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201206.128968:0:12969:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201206.129098:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c39c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+213:13079:x1875064442571264:12345-192.168.201.30@tcp:36:rm.0 Request processed in 2998us (3665us total) trans 8589938587 rc 0/0 00000100:00100000:1.0:1788201206.129109:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5005 00000100:00100000:1.0:1788201206.133330:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1788201206.143250:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201206.143272:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507cc00/0x9383f985bc4d25c2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x39f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.143288:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507cc00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201206.143475:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507cc00/0x9383f985bc4d25c2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x39f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.143489:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507cc00/0x9383f985bc4d25c2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x39f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.143512:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x39f:0x0].0x0 (ffff9e03c33ed100) 00010000:00010000:3.0:1788201206.143516:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788201206.143521:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507cc00/0x9383f985bc4d25c2 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x39f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.143528:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507cc00/0x9383f985bc4d25c2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x39f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.143554:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201206.143557:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201206.143559:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201206.144219:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ca00/0x9383f985bc4d25b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x81ff096 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.144235:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ca00/0x9383f985bc4d25b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x81ff096 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.144242:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ca00/0x9383f985bc4d25b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x81ff096 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.144248:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507ca00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201206.144252:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ca00/0x9383f985bc4d25b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x81ff096 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.144258:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ca00/0x9383f985bc4d25b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x81ff096 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.144269:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x81ff096 (ffff9e03c33ed000) 00010000:00010000:3.0:1788201206.144272:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201206.144276:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ca00/0x9383f985bc4d25b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x81ff096 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.144283:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ca00/0x9383f985bc4d25b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x81ff096 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.152998:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d25d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x628e98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.153014:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d25d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x628e98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.153022:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d25d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x628e98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.153029:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201206.153048:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d25d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x628e98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.153058:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d25d0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x628e98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.153079:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x628e98b2 (ffff9e03c2fc5000) 00010000:00010000:3.0:1788201206.153083:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201206.153088:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d25d0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x628e98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.153095:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d25d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x628e98b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201206.157727:0:12969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].495, 64 off39872 00010000:00010000:1.0:1788201206.157855:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d25fa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x197:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.157877:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d25fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.157889:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d25fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.157914:0:12969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d25fa lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.158031:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d25fa lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.158050:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d25fa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.158078:0:12969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201206.158112:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d25f3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.158118:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d25f3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.158125:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d25f3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.158132:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201206.158137:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d25f3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.158154:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d25f3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.158170:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x197:0x0].0x0 (ffff9e03c2fc5d00) 00010000:00010000:1.0:1788201206.158173:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201206.158178:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d25f3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.158185:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d25f3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.158211:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d25e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.158223:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d25e5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.158229:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d25e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.158234:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201206.158237:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d25e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.158242:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d25e5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.158250:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201206.158252:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201206.158255:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d25e5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.158260:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d25e5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201206.158270:0:12969:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e35adf6 reply state 00000000a2967881 transno 8589938590 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d25ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x7002bdf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201206.158280:0:12969:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201206.158708:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+210:13079:x1875064442572032:12345-192.168.201.30@tcp:36:rm.0 Request processed in 4298us (5838us total) trans 8589938590 rc 0/0 00000100:00100000:1.0:1788201206.158719:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5008 00000100:00100000:1.0:1788201206.165006:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1788201206.167654:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201206.167663:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0000/0x9383f985bc4d2616 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1d6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.167672:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201206.167677:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0000/0x9383f985bc4d2616 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1d6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.167687:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0000/0x9383f985bc4d2616 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1d6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.167701:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1d6:0x0].0x0 (ffff9e03c2fc5c00) 00010000:00010000:3.0:1788201206.167704:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788201206.167707:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0000/0x9383f985bc4d2616 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x1d6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.167714:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0000/0x9383f985bc4d2616 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1d6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.167733:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201206.167735:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201206.167736:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201206.167751:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d25ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x7002bdf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.167758:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d25ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x7002bdf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.167764:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d25ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x7002bdf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.167769:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201206.167773:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d25ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x7002bdf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.167779:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d25ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x7002bdf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.167785:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x7002bdf9 (ffff9e03c2fc5600) 00010000:00010000:3.0:1788201206.167787:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201206.167790:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d25ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x7002bdf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.167795:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d25ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x7002bdf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201206.173113:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442572544 00000100:00100000:1.0:1788201206.173128:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442572544 00000100:00100000:1.0:1788201206.173241:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5010 00000100:00100000:1.0:1788201206.173254:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+209:13079:x1875064442572544:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201206.173354:0:12971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201206.173399:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c343d000/0x9383f985bc4b270f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc478 expref: 209 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.173426:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c27a3e00/0x9383f985bc4b26f3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc471 expref: 208 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.173439:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2b:0x0].0x0 (ffff9e03c1175700) 00010000:00010000:1.0:1788201206.173451:0:12971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201206.173485:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d261d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.173501:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d261d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.173511:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d261d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.173527:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d2624 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x250e8f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.173534:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d2624 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x250e8f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.173540:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d2624 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x250e8f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.173677:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d262b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.173686:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d262b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.173693:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d262b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201206.174505:0:12971:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].496, 64 off39936 00010000:00010000:1.0:1788201206.174588:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d2632 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.174600:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d2632 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.174608:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d2632 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.174616:0:12971:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d2632 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.174621:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d2632 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.174628:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d2632 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.174663:0:12971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201206.174689:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d262b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.174696:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d262b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.174707:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d262b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.174714:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201206.174720:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d262b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.174729:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d262b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.174739:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2b:0x0].0x0 (ffff9e03c5173b00) 00010000:00010000:1.0:1788201206.174743:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201206.174748:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d262b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.174756:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d262b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.174778:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d261d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.174785:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d261d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.174791:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d261d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.174797:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201206.174800:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d261d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.174811:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d261d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.174819:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201206.174821:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201206.174824:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d261d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.174830:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d261d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201206.174840:0:12971:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da51711f reply state 00000000d9489d2c transno 8589938592 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d2624 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x250e8f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201206.174849:0:12971:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201206.174956:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+209:13079:x1875064442572544:12345-192.168.201.30@tcp:36:rm.0 Request processed in 1700us (2323us total) trans 8589938592 rc 0/0 00000100:00100000:1.0:1788201206.174967:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5010 00000100:00100000:1.0:1788201206.180057:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1788201206.185696:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d2624 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x250e8f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.185720:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d2624 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x250e8f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.185730:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d2624 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x250e8f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.185737:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201206.185742:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d2624 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x250e8f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.185750:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d2624 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x250e8f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.185770:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x250e8f9 (ffff9e03c5173a00) 00010000:00010000:3.0:1788201206.185774:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201206.185778:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d2624 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x250e8f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.185785:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d2624 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x250e8f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.190132:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201206.190158:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d400/0x9383f985bc4d264e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.190169:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201206.190174:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d400/0x9383f985bc4d264e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.190184:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d400/0x9383f985bc4d264e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.190207:0:7645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x22:0x0].0x0 (ffff9e03c33ed200) 00010000:00010000:1.0:1788201206.190210:0:7645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201206.190214:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d400/0x9383f985bc4d264e lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.190220:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d400/0x9383f985bc4d264e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.190244:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201206.190246:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201206.190248:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788201206.191902:0:13379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].497, 64 off40000 00010000:00010000:1.0:1788201206.192035:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d266a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x93:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.192065:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d266a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x93:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.192079:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d266a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x93:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.192088:0:13379:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d266a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x93:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.192094:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d266a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x93:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.192100:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d266a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x93:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.192128:0:13379:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201206.192169:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d2663 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x93:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.192176:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d2663 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x93:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.192182:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d2663 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x93:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.192189:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201206.192193:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d2663 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x93:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.192200:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d2663 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x93:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.192212:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x93:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:1.0:1788201206.192215:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201206.192219:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d2663 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x93:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.192225:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d2663 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x93:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.192248:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1200/0x9383f985bc4d2655 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.192255:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1200/0x9383f985bc4d2655 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.192261:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1200/0x9383f985bc4d2655 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.192270:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201206.192272:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1200/0x9383f985bc4d2655 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.192276:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1200/0x9383f985bc4d2655 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.192283:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201206.192285:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201206.192288:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1200/0x9383f985bc4d2655 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.192324:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1200/0x9383f985bc4d2655 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201206.192336:0:13379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc6d7594 reply state 000000005a579b70 transno 8589938594 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d265c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x269094ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201206.192346:0:13379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201206.193073:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+207:13079:x1875064442573056:12345-192.168.201.30@tcp:36:rm.0 Request processed in 5039us (5492us total) trans 8589938594 rc 0/0 00000100:00100000:1.0:1788201206.193085:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5012 00010000:00010000:3.0:1788201206.197849:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507dc00/0x9383f985bc4d2640 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x7c624840 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.197874:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507dc00/0x9383f985bc4d2640 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x7c624840 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.197884:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507dc00/0x9383f985bc4d2640 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x7c624840 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.197899:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507dc00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201206.197906:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507dc00/0x9383f985bc4d2640 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x7c624840 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.197927:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507dc00/0x9383f985bc4d2640 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x7c624840 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.197950:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x7c624840 (ffff9e03c33ede00) 00010000:00010000:3.0:1788201206.197953:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201206.197959:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507dc00/0x9383f985bc4d2640 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x7c624840 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.197965:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507dc00/0x9383f985bc4d2640 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x7c624840 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201206.198759:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1788201206.205989:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d265c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x269094ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.206013:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d265c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x269094ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.206022:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d265c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x269094ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.206028:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201206.206035:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d265c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x269094ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.206055:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d265c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x269094ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.206076:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x269094ce (ffff9e03c2fc5d00) 00010000:00010000:3.0:1788201206.206079:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201206.206084:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d265c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x269094ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.206092:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d265c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x269094ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201206.208750:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442573568 00000100:00100000:1.0:1788201206.208764:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442573568 00000100:00100000:1.0:1788201206.208843:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5014 00000100:00100000:1.0:1788201206.208855:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+205:13079:x1875064442573568:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201206.208965:0:12969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201206.208991:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ab7000/0x9383f985bc4b2946 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc566 expref: 205 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.209016:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c26f2800/0x9383f985bc4b292a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc55f expref: 204 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.209027:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x31:0x0].0x0 (ffff9e03c26b0500) 00010000:00010000:1.0:1788201206.209044:0:12969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201206.209073:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d268d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.209090:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d268d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.209100:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d268d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.209118:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d2694 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0xb46b3ef9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.209125:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d2694 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xb46b3ef9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.209132:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d2694 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xb46b3ef9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.209290:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d269b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.209330:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d269b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.209342:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d269b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.214525:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d2694 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xb46b3ef9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.214548:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d2694 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xb46b3ef9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.214557:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d2694 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xb46b3ef9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.214565:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201206.214571:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d2694 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xb46b3ef9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.214579:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d2694 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xb46b3ef9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.214601:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0xb46b3ef9 (ffff9e03c5173900) 00010000:00010000:3.0:1788201206.214604:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201206.214610:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d2694 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0xb46b3ef9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.214617:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d2694 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0xb46b3ef9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.214790:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201206.214800:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d26a2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.214807:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201206.214812:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d26a2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.214820:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d26a2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.214831:0:7645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x31:0x0].0x0 (ffff9e03c5173000) 00010000:00010000:1.0:1788201206.214834:0:7645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201206.214837:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d26a2 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.214843:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d26a2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.214860:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201206.214862:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201206.214864:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201206.220194:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442573824 00000100:00100000:1.0:1788201206.220214:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442573824 00000100:00100000:1.0:1788201206.220378:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5015 00000100:00100000:1.0:1788201206.220403:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+203:13079:x1875064442573824:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201206.220501:0:13379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201206.220539:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501472c00/0x9383f985bc4bfbee lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x241:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0e14 expref: 203 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.220564:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff051000/0x9383f985bc4bfbbd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x241:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0e0d expref: 202 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.220578:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x241:0x0].0x0 (ffff9e04ffd32600) 00010000:00010000:1.0:1788201206.220591:0:13379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201206.220620:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d26a9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.220637:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d26a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.220648:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d26a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.220663:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d26b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x38bf26b2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.220671:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d26b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x38bf26b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.220677:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d26b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x38bf26b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.220832:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d26b7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x241:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.220841:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d26b7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x241:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.220853:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d26b7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x241:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201206.221654:0:13379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].499, 64 off40128 00010000:00010000:1.0:1788201206.221737:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d26be lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x241:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.221751:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d26be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x241:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.221760:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d26be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x241:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.221768:0:13379:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d26be lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x241:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.221775:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d26be lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x241:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.221782:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d26be lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x241:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.221808:0:13379:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201206.221837:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d26b7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x241:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.221843:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d26b7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x241:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.221850:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d26b7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x241:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.221861:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201206.221867:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d26b7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x241:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.221875:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d26b7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x241:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.221884:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x241:0x0].0x0 (ffff9e03c5173e00) 00010000:00010000:1.0:1788201206.221887:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201206.221892:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d26b7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x241:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.221899:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d26b7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x241:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.221921:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d26a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.221927:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d26a9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.221934:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d26a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.221939:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201206.221942:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d26a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.221950:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d26a9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.221963:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201206.221966:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201206.221969:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d26a9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.221975:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d26a9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201206.221985:0:13379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c3fa57fc reply state 00000000f846b70a transno 8589938597 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d26b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x38bf26b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201206.221994:0:13379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201206.222131:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+203:13079:x1875064442573824:12345-192.168.201.30@tcp:36:rm.0 Request processed in 1737us (3053us total) trans 8589938597 rc 0/0 00000100:00100000:1.0:1788201206.222143:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5015 00000100:00100000:1.0:1788201206.228347:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442574080 00000100:00100000:1.0:1788201206.228362:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442574080 00000100:00100000:1.0:1788201206.228447:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5016 00000100:00100000:1.0:1788201206.228584:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5420e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+203:13079:x1875064442574080:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201206.228669:0:12971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201206.228704:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4bdd40 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c037f expref: 203 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.228728:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f51b2000/0x9383f985bc4bdd24 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0378 expref: 202 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.228738:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1f4:0x0].0x0 (ffff9e04ebb8f500) 00010000:00010000:1.0:1788201206.228754:0:12971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201206.228781:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d26c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.228797:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d26c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.228808:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d26c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.228824:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d26cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0xca3c17b2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.228831:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d26cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xca3c17b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.228838:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d26cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xca3c17b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.229111:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d26d3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.229121:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d26d3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.229129:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d26d3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201206.233635:0:12971:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].500, 64 off40192 00010000:00010000:1.0:1788201206.233751:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d26da lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.233775:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d26da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1f4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.233791:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d26da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1f4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.233801:0:12971:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d26da lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x1f4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.233809:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d26da lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x1f4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.233817:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d26da lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1f4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.233886:0:12971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201206.233933:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d26d3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.233941:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d26d3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.233948:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d26d3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.233955:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201206.233960:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d26d3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.233969:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d26d3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.233982:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1f4:0x0].0x0 (ffff9e03c5173100) 00010000:00010000:1.0:1788201206.233985:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201206.233991:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d26d3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.233998:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d26d3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.234022:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d26c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.234029:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d26c5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.234035:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d26c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.234052:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201206.234055:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d26c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.234061:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d26c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.234069:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201206.234071:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201206.234074:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d26c5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.234079:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d26c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201206.234091:0:12971:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e07d5576 reply state 00000000bc779882 transno 8589938598 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d26cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xca3c17b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201206.234108:0:12971:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201206.234252:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5420e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+202:13079:x1875064442574080:12345-192.168.201.30@tcp:36:rm.0 Request processed in 5789us (6378us total) trans 8589938598 rc 0/0 00000100:00100000:1.0:1788201206.234263:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5016 00000100:00100000:1.0:1788201206.238124:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442574336 00000100:00100000:1.0:1788201206.238137:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442574336 00000100:00100000:1.0:1788201206.238224:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5017 00000100:00100000:1.0:1788201206.238236:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+202:13079:x1875064442574336:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201206.238349:0:12969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201206.238396:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2207e00/0x9383f985bc4bdadf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c02ad expref: 202 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.238426:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19c5400/0x9383f985bc4bdaae lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c02a6 expref: 201 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.238441:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1ee:0x0].0x0 (ffff9e04f9a5cd00) 00010000:00010000:1.0:1788201206.238459:0:12969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201206.238490:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d26e1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.238506:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d26e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.238517:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d26e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.238535:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d26e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0xedff3ef9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.238543:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d26e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xedff3ef9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.238550:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d26e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xedff3ef9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.238688:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d26ef lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.238695:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d26ef lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.238700:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d26ef lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201206.239600:0:12969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].501, 64 off40256 00010000:00010000:1.0:1788201206.239681:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d26f6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.239696:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d26f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.239707:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d26f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.239716:0:12969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d26f6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.239724:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d26f6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.239731:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d26f6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.240592:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d26cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xca3c17b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.240606:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d26cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xca3c17b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.240614:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d26cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xca3c17b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.240621:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201206.240626:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d26cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xca3c17b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.240635:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d26cc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xca3c17b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.240650:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0xca3c17b2 (ffff9e03c5173600) 00010000:00010000:3.0:1788201206.240654:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201206.240659:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d26cc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0xca3c17b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.240665:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d26cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0xca3c17b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.241578:0:12969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788201206.241588:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d26f6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201206.246545:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442574592 00000100:00100000:1.0:1788201206.246559:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442574592 00000100:00100000:3.0:1788201206.256613:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201206.256877:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442574848 00000100:00100000:1.0:1788201206.256892:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442574848 00000100:00100000:1.0:1788201206.256980:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5019 00000100:00100000:1.0:1788201206.256992:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+199:13079:x1875064442574848:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201206.257104:0:12971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201206.257138:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3990000/0x9383f985bc4c048b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x257:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c10fa expref: 199 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.257167:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3472600/0x9383f985bc4c046f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x257:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c10f3 expref: 198 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.257181:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x257:0x0].0x0 (ffff9e03c2056f00) 00010000:00010000:1.0:1788201206.257195:0:12971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201206.257225:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d2719 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.257243:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d2719 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.257256:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d2719 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.257274:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d2720 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x7ce498b2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.257283:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d2720 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x7ce498b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.257328:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d2720 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x7ce498b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.257494:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2727 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x257:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.257504:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2727 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x257:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.257512:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2727 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x257:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201206.258337:0:12971:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].500, 64 off40192 00010000:00010000:1.0:1788201206.258421:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d272e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x257:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.258434:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d272e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x257:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.258444:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d272e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x257:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.258453:0:12971:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d272e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x257:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.258460:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d272e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x257:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.258467:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d272e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x257:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.258492:0:12971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201206.258519:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2727 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x257:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.258526:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2727 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x257:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.258534:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2727 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x257:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.258541:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201206.258546:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2727 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x257:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.258554:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2727 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x257:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.258565:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x257:0x0].0x0 (ffff9e03c5173c00) 00010000:00010000:1.0:1788201206.258569:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201206.258573:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2727 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x257:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.258580:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2727 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x257:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.258601:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d2719 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.258608:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d2719 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.258619:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d2719 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.258624:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201206.258627:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d2719 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.258633:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d2719 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.258639:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201206.258642:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201206.258645:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d2719 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.258651:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d2719 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201206.258661:0:12971:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b29bd42 reply state 00000000db612b49 transno 8589938601 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d2720 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x7ce498b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201206.258670:0:12971:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201206.258792:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+199:13079:x1875064442574848:12345-192.168.201.30@tcp:36:rm.0 Request processed in 1798us (2189us total) trans 8589938601 rc 0/0 00000100:00100000:1.0:1788201206.258802:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5019 00000100:00100000:3.0:1788201206.266511:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:1.0:1788201206.271801:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d274a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x359:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.271825:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d274a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x359:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.271845:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d274a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x359:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.271856:0:12969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d274a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x359:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.271863:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d274a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x359:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.271871:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d274a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x359:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.272071:0:12969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201206.272105:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0800/0x9383f985bc4d2743 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x359:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.272113:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0800/0x9383f985bc4d2743 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x359:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.272121:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0800/0x9383f985bc4d2743 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x359:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.272129:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201206.272134:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0800/0x9383f985bc4d2743 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x359:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.272155:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0800/0x9383f985bc4d2743 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x359:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.272172:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x359:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:1.0:1788201206.272176:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201206.272182:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0800/0x9383f985bc4d2743 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x359:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.272188:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0800/0x9383f985bc4d2743 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x359:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.272216:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d2735 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.272223:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d2735 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.272230:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d2735 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.272237:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201206.272240:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d2735 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.272248:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d2735 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.272256:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201206.272259:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201206.272262:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d2735 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.272269:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d2735 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201206.272280:0:12969:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af34866a reply state 000000001cdc08eb transno 8589938602 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0e00/0x9383f985bc4d273c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x12e4c1dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201206.272330:0:12969:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201206.272722:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+198:13079:x1875064442575104:12345-192.168.201.30@tcp:36:rm.0 Request processed in 5458us (6215us total) trans 8589938602 rc 0/0 00000100:00100000:1.0:1788201206.272733:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5020 00010000:00010000:3.0:1788201206.275651:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0e00/0x9383f985bc4d273c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x12e4c1dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.275678:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0e00/0x9383f985bc4d273c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x12e4c1dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.275704:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0e00/0x9383f985bc4d273c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x12e4c1dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.275713:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201206.275721:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0e00/0x9383f985bc4d273c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x12e4c1dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.275731:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0e00/0x9383f985bc4d273c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x12e4c1dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.275754:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x12e4c1dd (ffff9e03c2fc5300) 00010000:00010000:3.0:1788201206.275758:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201206.275764:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0e00/0x9383f985bc4d273c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x12e4c1dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.275771:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0e00/0x9383f985bc4d273c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x12e4c1dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201206.281172:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201206.284758:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201206.285168:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442575616 00000100:00100000:1.0:1788201206.285182:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442575616 00000100:00100000:1.0:1788201206.285252:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5021 00000100:00100000:1.0:1788201206.285265:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+198:13079:x1875064442575616:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201206.285382:0:13379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201206.285423:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c13f2c00/0x9383f985bc4ca529 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c48c9 expref: 198 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.285452:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c6757800/0x9383f985bc4b1661 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bbeba expref: 197 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.285465:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c1d1f600) 00010000:00010000:1.0:1788201206.285480:0:13379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201206.285513:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2751 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.285529:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2751 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.285539:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2751 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.285556:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2758 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x87726de2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.285563:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2758 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x87726de2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.285570:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2758 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x87726de2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.286539:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d275f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.286553:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d275f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.286563:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d275f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201206.289088:0:13379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 38400 00010000:00010000:1.0:1788201206.289115:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d275f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.289124:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d275f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.289131:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d275f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.289248:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201206.289255:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d275f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.289263:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d275f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.289281:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c5173300) 00010000:00010000:1.0:1788201206.289284:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201206.289288:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d275f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.289643:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d275f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.289676:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2751 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.289683:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2751 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.289689:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2751 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.289694:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201206.289698:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2751 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.289704:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2751 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.289714:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e03c1d1f300) 00010000:00010000:1.0:1788201206.289717:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201206.289721:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2751 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.289727:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2751 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201206.289743:0:13379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a879b40 reply state 000000001126cbbd transno 8589938604 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2758 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x87726de2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201206.289753:0:13379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201206.290004:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+198:13079:x1875064442575616:12345-192.168.201.30@tcp:36:rm.0 Request processed in 4737us (5254us total) trans 8589938604 rc 0/0 00000100:00100000:1.0:1788201206.290016:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5021 00000100:00100000:1.0:1788201206.297416:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201206.298290:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442575744 00000100:00100000:3.0:1788201206.298428:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442575744 00000100:00100000:3.0:1788201206.298738:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5022 00000100:00100000:3.0:1788201206.298753:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+197:13079:x1875064442575744:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1788201206.298786:0:12968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201206.298809:0:12968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017200/0x9383f985bc4d2766 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c49cc expref: -99 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.298893:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017000/0x9383f985bc4d276d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.298927:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017000/0x9383f985bc4d276d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.298939:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017000/0x9383f985bc4d276d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.298957:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d2774 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x960ceed4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.298965:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d2774 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x960ceed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.298971:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d2774 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x960ceed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.299750:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017a00/0x9383f985bc4d277b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.299764:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017a00/0x9383f985bc4d277b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.299773:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017a00/0x9383f985bc4d277b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201206.299825:0:12968:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788201206.299829:0:12968:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201206.299853:0:12968:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017a00/0x9383f985bc4d277b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.299866:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017000/0x9383f985bc4d276d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.299873:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017000/0x9383f985bc4d276d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.299880:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017000/0x9383f985bc4d276d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.299891:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201206.299896:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017000/0x9383f985bc4d276d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.299903:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017000/0x9383f985bc4d276d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.299916:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c2eb2600) 00010000:00010000:3.0:1788201206.300125:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201206.300131:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017000/0x9383f985bc4d276d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.300137:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017000/0x9383f985bc4d276d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.300217:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d2774 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x960ceed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.300223:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d2774 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x960ceed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.300229:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d2774 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x960ceed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.300235:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201206.300238:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d2774 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x960ceed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.300244:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d2774 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x960ceed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.300256:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x960ceed4 (ffff9e03c33e8500) 00010000:00010000:3.0:1788201206.300258:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201206.300261:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d2774 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x960ceed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.300268:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d2774 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x960ceed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.300336:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017200/0x9383f985bc4d2766 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c49cc expref: 199 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.300353:0:12968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017a00/0x9383f985bc4d277b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c49cc expref: 198 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.300361:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e03c1d1f300) 00010000:00010000:3.0:1788201206.300363:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201206.300367:0:12968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c3017a00, rc 0) 00000100:00100000:3.0:1788201206.303926:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+198:13079:x1875064442575744:12345-192.168.201.30@tcp:101:rm.0 Request processed in 5151us (6499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201206.303943:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5022 00000100:00100000:3.0:1788201206.307864:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201206.307983:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442576256 00000100:00100000:1.0:1788201206.307996:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442576256 00000100:00100000:1.0:1788201206.308082:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5023 00000100:00100000:1.0:1788201206.308095:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c502a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+199:13079:x1875064442576256:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201206.308186:0:12969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788201206.308221:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017a00/0x9383f985bc4d277b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c49cc expref: 199 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.308250:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c50a5400/0x9383f985bc4ca46c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4898 expref: 198 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.308262:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e03c1d1f300) 00010000:00010000:1.0:1788201206.308280:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2356e00/0x9383f985bc4b15dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bbe97 expref: 197 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.308289:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c2eb2600) 00010000:00010000:1.0:1788201206.308334:0:12969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201206.308368:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2782 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.308384:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2782 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.308394:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2782 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.308408:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d2789 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x960ceed4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.308415:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d2789 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x960ceed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.308422:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d2789 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x960ceed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.308808:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2790 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.308818:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2790 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.308826:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2790 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201206.309573:0:12969:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1788201206.309594:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2790 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.309603:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2790 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.309610:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2790 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.309618:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201206.309623:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2790 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.309631:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2790 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.309645:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e03c5173400) 00010000:00010000:1.0:1788201206.309647:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201206.309651:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2790 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.309657:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2790 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.309681:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2782 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.309687:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2782 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.309692:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2782 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.309697:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201206.309701:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2782 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.309707:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2782 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.309719:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173300) 00010000:00010000:1.0:1788201206.309721:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201206.309724:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2782 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.309730:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2782 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201206.309741:0:12969:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a1cb38d3 reply state 00000000fc0f3eb7 transno 8589938606 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d2789 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x960ceed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201206.309750:0:12969:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201206.309880:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c502a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+198:13079:x1875064442576256:12345-192.168.201.30@tcp:36:rm.0 Request processed in 1783us (2023us total) trans 8589938606 rc 0/0 00000100:00100000:1.0:1788201206.309890:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5023 00010000:00010000:3.0:1788201206.322447:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d2789 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x960ceed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.323232:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d2789 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x960ceed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.323242:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d2789 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x960ceed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.323250:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201206.323256:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d2789 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x960ceed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.323265:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d2789 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x960ceed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.323286:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x960ceed4 (ffff9e03c5173800) 00010000:00010000:3.0:1788201206.323289:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201206.323439:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d2789 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x960ceed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.323447:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d2789 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x960ceed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788201206.668148:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968700 is committed 00000001:00080000:3.0:1788201206.678896:0:6732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294968709 is committed 00000100:00100000:3.0:1788201207.014142:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458146432 00000100:00100000:3.0:1788201207.014224:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458146432 00000100:00100000:3.0:1788201207.014323:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788201207.014336:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458146432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201207.014381:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 525008896 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1788201207.014448:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458146432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201207.014456:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000004:00080000:3.0:1788201207.017694:0:12993:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 122 changes, 0 in progress, 0 in flight, 223 done 00000100:00100000:3.0:1788201208.209441:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201208.209491:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201208.209527:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201208.209553:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.209677:0:12964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442576384 00000100:00100000:1.0:1788201208.209686:0:12964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442576384 00000100:00100000:1.0:1788201208.209747:0:12964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93 00000100:00100000:1.0:1788201208.209757:0:12964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f50b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442576384:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201208.209826:0:12964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f50b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442576384:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 70us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201208.209833:0:12964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93 00000100:00100000:1.0:1788201208.209867:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442576640 00000100:00100000:1.0:1788201208.209871:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442576640 00000100:00100000:1.0:1788201208.209920:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442576768 00000100:00100000:1.0:1788201208.209924:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442576768 00000100:00100000:1.0:1788201208.209947:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 115 00000100:00100000:1.0:1788201208.209953:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c502ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+627:2359:x1875064442576640:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201208.209987:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c502ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+627:2359:x1875064442576640:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 33us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201208.209994:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 115 00000100:00100000:1.0:1788201208.210021:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 116 00000100:00100000:1.0:1788201208.210029:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5028700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+138:2359:x1875064442576768:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201208.210056:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5028700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+138:2359:x1875064442576768:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 28us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201208.210062:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 116 00000100:00100000:1.0:1788201208.210083:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442576512 00000100:00100000:1.0:1788201208.210086:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442576512 00000100:00100000:1.0:1788201208.210128:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:1.0:1788201208.210135:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5029c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+197:2359:x1875064442576512:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201208.210169:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5029c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+197:2359:x1875064442576512:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 35us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201208.210175:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:1.0:1788201208.675152:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458146560 00000100:00100000:1.0:1788201208.675161:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458146560 00000100:00100000:1.0:1788201208.675215:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458147072 00000100:00100000:1.0:1788201208.675218:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458147072 00000100:00100000:1.0:1788201208.675235:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458146944 00000100:00100000:1.0:1788201208.675239:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458146944 00000100:00100000:1.0:1788201208.675772:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458147456 00000100:00100000:1.0:1788201208.675777:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458147456 00000100:00100000:1.0:1788201208.675803:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458146688 00000100:00100000:1.0:1788201208.675806:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458146688 00000100:00100000:1.0:1788201208.675826:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3896 00000100:00100000:1.0:1788201208.675835:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3311:x1875064458146560:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201208.675861:0:6705:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:795 count 1 00010000:00010000:1.0:1788201208.675887:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f1c741f/0x9383f985bc4d2797 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.675908:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4bdcf3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c036a expref: 626 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.675918:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31b:0x0].0x0 since=45s v=(0 0) 00010000:00010000:1.0:1788201208.675922:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.675927:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f1c741f/0x9383f985bc4d2797 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.675956:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4bdcf3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c036a expref: 626 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.675969:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4bdcf3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c036a expref: 626 pid: 6705 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.675981:0:6705:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3770700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6705:1875064458147584:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201208.676053:0:6705:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201208.676067:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458147200 00000100:00100000:1.0:1788201208.676071:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458147200 00000100:00100000:1.0:1788201208.676090:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458146816 00000100:00100000:1.0:1788201208.676092:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458146816 00000100:00100000:1.0:1788201208.676105:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458147328 00000100:00100000:1.0:1788201208.676107:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458147328 00000100:00100000:1.0:1788201208.676122:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3897 00000100:00100000:1.0:1788201208.676127:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+12:3311:x1875064458147072:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201208.676139:0:13449:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:959 count 1 00010000:00010000:1.0:1788201208.676152:0:13449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f6beb5f/0x9383f985bc4d279e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.676164:0:13449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000058a28dd2/0x9383f985bc4c5f8b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c307a expref: 626 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.676171:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3bf:0x0].0x0 since=24s v=(0 0) 00010000:00010000:1.0:1788201208.676174:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.676178:0:13449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f6beb5f/0x9383f985bc4d279e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.676195:0:13449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000058a28dd2/0x9383f985bc4c5f8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c307a expref: 626 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.676205:0:13449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000058a28dd2/0x9383f985bc4c5f8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c307a expref: 626 pid: 6705 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.676216:0:13449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3771c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:13449:1875064458147712:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201208.676237:0:13449:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341d240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201208.676576:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3898 00000100:00100000:1.0:1788201208.676584:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3311:x1875064458146944:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201208.676599:0:13439:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:565 count 1 00010000:00010000:1.0:1788201208.676611:0:13439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0a1d546/0x9383f985bc4d27a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.676623:0:13439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000000c81369/0x9383f985bc4b25b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc408 expref: 626 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.676630:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x235:0x0].0x0 since=77s v=(0 0) 00010000:00010000:1.0:1788201208.676633:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x235:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.676637:0:13439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0a1d546/0x9383f985bc4d27a5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.676655:0:13439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000000c81369/0x9383f985bc4b25b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc408 expref: 626 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.676664:0:13439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000000c81369/0x9383f985bc4b25b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc408 expref: 626 pid: 6705 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.676674:0:13439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3773b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:13439:1875064458147840:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201208.676702:0:13439:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201208.677126:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3900 00000100:00100000:3.0:1788201208.677141:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f965fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+12:3312:x1875064458146688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201208.677156:0:13450:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:562 count 1 00010000:00010000:3.0:1788201208.677174:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009362eac0/0x9383f985bc4d27b3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x232:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.677190:0:13450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000032833b4d/0x9383f985bc4b233b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x232:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc336 expref: 626 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.677203:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x232:0x0].0x0 since=78s v=(0 0) 00010000:00010000:3.0:1788201208.677206:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x232:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.677210:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009362eac0/0x9383f985bc4d27b3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x232:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.677231:0:13450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000032833b4d/0x9383f985bc4b233b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x232:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc336 expref: 626 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.677241:0:13450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000032833b4d/0x9383f985bc4b233b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x232:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc336 expref: 626 pid: 6703 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.677251:0:13450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c502a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:13450:1875064458148096:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201208.677279:0:13450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d81400c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201208.677659:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3901 00000100:00100000:3.0:1788201208.677668:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2200700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+12:3312:x1875064458147200:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201208.677681:0:13445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:792 count 1 00010000:00010000:3.0:1788201208.677694:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004773894/0x9383f985bc4d27ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x318:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.677705:0:13445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000757948e0/0x9383f985bc4bda7d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x318:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0298 expref: 626 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.677712:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x318:0x0].0x0 since=45s v=(0 0) 00010000:00010000:3.0:1788201208.677715:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x318:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.677719:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004773894/0x9383f985bc4d27ba lrc: 4/0,1 mode: --/PW res: [0x240000400:0x318:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.677736:0:13445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000757948e0/0x9383f985bc4bda7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x318:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0298 expref: 626 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.677746:0:13445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000757948e0/0x9383f985bc4bda7d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x318:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0298 expref: 626 pid: 10484 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.677756:0:13445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c502b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13445:1875064458148224:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201208.677779:0:13445:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d81406c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201208.678058:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3902 00000100:00100000:1.0:1788201208.678068:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2200000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3312:x1875064458146816:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201208.678081:0:10484:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:614 count 1 00010000:00010000:1.0:1788201208.678093:0:10484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d26c56a/0x9383f985bc4d27c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x266:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.678111:0:10484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004337bcc1/0x9383f985bc4b4c93 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x266:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd191 expref: 626 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.678124:0:10484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x266:0x0].0x0 since=71s v=(0 0) 00010000:00010000:1.0:1788201208.678127:0:10484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x266:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.678131:0:10484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d26c56a/0x9383f985bc4d27c1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x266:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.678148:0:10484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004337bcc1/0x9383f985bc4b4c93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x266:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd191 expref: 626 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.678158:0:10484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004337bcc1/0x9383f985bc4b4c93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x266:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd191 expref: 626 pid: 12363 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.678168:0:10484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3771180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10484:1875064458148352:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201208.678191:0:10484:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341d300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201208.678287:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3903 00000100:00100000:1.0:1788201208.678318:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c6630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3312:x1875064458147328:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201208.678329:0:13443:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:799 count 1 00010000:00010000:1.0:1788201208.678834:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9237659/0x9383f985bc4d27c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.678849:0:13443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000001834ea8/0x9383f985bc4be026 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0482 expref: 626 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.678856:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31f:0x0].0x0 since=44s v=(0 0) 00010000:00010000:1.0:1788201208.678860:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.678865:0:13443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9237659/0x9383f985bc4d27c8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.679055:0:13443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000001834ea8/0x9383f985bc4be026 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0482 expref: 626 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.679066:0:13443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000001834ea8/0x9383f985bc4be026 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0482 expref: 626 pid: 12363 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.679076:0:13443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5382680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13443:1875064458149504:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201208.679179:0:13443:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201208.679894:0:13442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458148608 00000100:00100000:1.0:1788201208.679900:0:13442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458148608 00000100:00100000:1.0:1788201208.679937:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3904 00000100:00100000:1.0:1788201208.679951:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d1f0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3313:x1875064458148736:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788201208.679973:0:13442:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:942 count 1 00010000:00010000:1.0:1788201208.679991:0:13442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d27cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ae:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.680015:0:13442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002bdd6d0a/0x9383f985bc4c526b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2be9 expref: 137 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.680023:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3ae:0x0].0x0 since=27s v=(0 0) 00010000:00010000:1.0:1788201208.680026:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.680031:0:13442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d27cf lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.680060:0:13442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002bdd6d0a/0x9383f985bc4c526b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2be9 expref: 137 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.680070:0:13442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002bdd6d0a/0x9383f985bc4c526b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2be9 expref: 137 pid: 6705 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.680082:0:13442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5380e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:13442:1875064458149632:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201208.680195:0:13442:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341d180 going to sleep for 11 seconds 00000100:00100000:3.0:1788201208.682498:0:6705:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3770700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6705:1875064458147584:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201208.682522:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007f1c741f/0x9383f985bc4d2797 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.684491:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3771f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458148864:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201208.684557:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201208.684599:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5382300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458149376:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201208.684621:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201208.684644:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788201208.684650:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3772680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458148480:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201208.684670:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201208.684686:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3770a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458148992:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201208.684704:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201208.684732:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458148864 00000100:00100000:3.0:1788201208.684739:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458148864 00000100:00100000:3.0:1788201208.684773:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458149376 00000100:00100000:3.0:1788201208.684776:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458149376 00000100:00100000:3.0:1788201208.684787:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458148480 00000100:00100000:3.0:1788201208.684789:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458148480 00000100:00100000:3.0:1788201208.684796:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458148992 00000100:00100000:3.0:1788201208.684798:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458148992 00000100:00100000:3.0:1788201208.684811:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3908 00000100:00100000:3.0:1788201208.684818:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c502b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+12:3310:x1875064458148864:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788201208.684848:0:13448:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:845 count 1 00010000:00010000:3.0:1788201208.684872:0:13448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d27eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.686026:0:13448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000918ac790/0x9383f985bc4c04e6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c111d expref: 137 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.686033:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34d:0x0].0x0 since=38s v=(0 0) 00010000:00010000:3.0:1788201208.686037:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.686041:0:13448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d27eb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.686068:0:13448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000918ac790/0x9383f985bc4c04e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c111d expref: 137 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.686078:0:13448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000918ac790/0x9383f985bc4c04e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c111d expref: 137 pid: 6705 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.686089:0:13448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5029f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:13448:1875064458150272:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201208.686609:0:13448:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d81403c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201208.686707:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3911 00000100:00100000:3.0:1788201208.686717:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c502bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3310:x1875064458148992:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788201208.686734:0:13441:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:660 count 1 00010000:00010000:3.0:1788201208.686747:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004933b680/0x9383f985bc4d2800 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x294:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.686759:0:13441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000021e8ff12/0x9383f985bc4b71d1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x294:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bde5d expref: 137 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.686766:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x294:0x0].0x0 since=63s v=(0 0) 00010000:00010000:3.0:1788201208.686769:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x294:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.686773:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004933b680/0x9383f985bc4d2800 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x294:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.686792:0:13441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000021e8ff12/0x9383f985bc4b71d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x294:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bde5d expref: 137 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.686808:0:13441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000021e8ff12/0x9383f985bc4b71d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x294:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bde5d expref: 137 pid: 6706 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.686819:0:13441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5029180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:13441:1875064458150400:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201208.686843:0:13441:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8140540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201208.697729:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.697774:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201208.697987:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442576896 00000100:00100000:3.0:1788201208.698006:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442576896 00010000:00010000:3.0:1788201208.698047:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4bdcf3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c036a expref: 627 pid: 6705 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.698079:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442577024 00000100:00100000:3.0:1788201208.698082:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442577024 00010000:00010000:3.0:1788201208.698096:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000058a28dd2/0x9383f985bc4c5f8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c307a expref: 628 pid: 6705 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.698134:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1277 00000100:00100000:3.0:1788201208.698142:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5380a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+628:2359:x1875064442576896:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.698157:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.698162:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4bdcf3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c036a expref: 628 pid: 6705 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.698176:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4bdcf3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c036a expref: 628 pid: 6705 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.698204:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4bdcf3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c036a expref: 628 pid: 6705 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.698220:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.698225:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.698231:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007f1c741f/0x9383f985bc4d2797 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.698241:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f1c741f/0x9383f985bc4d2797 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.698263:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.698437:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5380a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+627:2359:x1875064442576896:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 188us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.698447:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1277 00000100:00100000:3.0:1788201208.698465:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1278 00000100:00100000:3.0:1788201208.698473:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5381c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+626:2359:x1875064442577024:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.698481:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.698486:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000058a28dd2/0x9383f985bc4c5f8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c307a expref: 626 pid: 6705 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.698498:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000058a28dd2/0x9383f985bc4c5f8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c307a expref: 626 pid: 6705 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.698517:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058a28dd2/0x9383f985bc4c5f8b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c307a expref: 626 pid: 6705 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.698527:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.698531:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.698535:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005f6beb5f/0x9383f985bc4d279e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.698544:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f6beb5f/0x9383f985bc4d279e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.698555:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.698571:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5381c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+625:2359:x1875064442577024:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 100us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.698577:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1278 00010000:00010000:3.0:1788201208.698600:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007f1c741f/0x9383f985bc4d2797 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.698608:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f1c741f/0x9383f985bc4d2797 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.698617:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f1c741f/0x9383f985bc4d2797 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.698625:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f1c741f/0x9383f985bc4d2797 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.698644:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201208.699446:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3311:x1875064458146560:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23609us (24651us total) trans 4294968710 rc 0/0 00000100:00100000:3.0:1788201208.699455:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3896 00000004:00080000:3.0:1788201208.699502:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c5421880/2, rc 0, transno 4294968710 00000100:00100000:3.0:1788201208.699513:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458146560:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788201208.700093:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c5420380/2, rc 0, transno 4294968711 00000100:00100000:3.0:1788201208.700161:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458147072:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201208.700814:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.700843:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.700895:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.700913:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.700968:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.700983:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.701004:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.701037:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.701059:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442577152 00000100:00100000:1.0:1788201208.701066:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442577152 00010000:00010000:1.0:1788201208.701094:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000000c81369/0x9383f985bc4b25b1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc408 expref: 625 pid: 6705 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.704314:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1286 00000100:00100000:1.0:1788201208.704409:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5383b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+624:2361:x1875064442577152:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201208.704426:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201208.704433:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000000c81369/0x9383f985bc4b25b1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x235:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc408 expref: 624 pid: 6705 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.704447:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000000c81369/0x9383f985bc4b25b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x235:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc408 expref: 624 pid: 6705 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.704463:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x235:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.704467:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x235:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.704472:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0a1d546/0x9383f985bc4d27a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x235:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.704481:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0a1d546/0x9383f985bc4d27a5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x235:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.704496:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201208.704521:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5383b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+624:2361:x1875064442577152:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 199us (3710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201208.704528:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1286 00010000:00010000:1.0:1788201208.704591:0:13439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000c81369/0x9383f985bc4b25b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc408 expref: 623 pid: 6705 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.704603:0:13439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3773b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:13439:1875064458147840:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201208.704621:0:13439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b0a1d546/0x9383f985bc4d27a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.704635:0:13439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b0a1d546/0x9383f985bc4d27a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.704643:0:13439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0a1d546/0x9383f985bc4d27a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.704651:0:13439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0a1d546/0x9383f985bc4d27a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.704658:0:13439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0a1d546/0x9383f985bc4d27a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.704672:0:13439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788201208.705076:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3311:x1875064458146944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 28492us (30128us total) trans 4294968713 rc 0/0 00000100:00100000:1.0:1788201208.705084:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3898 00010000:00010000:1.0:1788201208.705614:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001834ea8/0x9383f985bc4be026 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0482 expref: 622 pid: 12363 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.705626:0:13443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5382680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13443:1875064458149504:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201208.705639:0:13443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9237659/0x9383f985bc4d27c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.705647:0:13443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9237659/0x9383f985bc4d27c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.705654:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9237659/0x9383f985bc4d27c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.705663:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9237659/0x9383f985bc4d27c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.705670:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9237659/0x9383f985bc4d27c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.705684:0:13443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788201208.705813:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c6630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3312:x1875064458147328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 27519us (30564us total) trans 4294968714 rc 0/0 00000100:00100000:1.0:1788201208.705820:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3903 00010000:00010000:1.0:1788201208.705849:0:13442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bdd6d0a/0x9383f985bc4c526b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2be9 expref: 134 pid: 6705 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.705860:0:13442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5380e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:13442:1875064458149632:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201208.705871:0:13442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d27cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.705930:0:13442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d27cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.705938:0:13442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d27cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.705947:0:13442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d27cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.705954:0:13442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d27cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.705962:0:13442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1788201208.706261:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d1f0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3313:x1875064458148736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 26316us (26585us total) trans 4294968703 rc 0/0 00000100:00100000:1.0:1788201208.706267:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3904 00000100:00100000:3.0:1788201208.706512:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5380a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458150656:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201208.706550:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788201208.706590:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c5423800/2, rc 0, transno 4294968713 00000100:00100000:3.0:1788201208.706600:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458146944:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201208.707327:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.707418:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.707469:0:10484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3771180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10484:1875064458148352:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201208.707489:0:10484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005d26c56a/0x9383f985bc4d27c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x266:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.711125:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458151552:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201208.711154:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201208.711175:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201208.711180:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458151424:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201208.711197:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201208.711219:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458151808 00000100:00100000:1.0:1788201208.711224:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458151808 00000100:00100000:1.0:1788201208.711253:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458151680 00000100:00100000:1.0:1788201208.711256:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458151680 00000100:00100000:1.0:1788201208.711270:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458151552 00000100:00100000:1.0:1788201208.711273:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458151552 00000100:00100000:1.0:1788201208.711286:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458151424 00000100:00100000:1.0:1788201208.711288:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458151424 00000100:00100000:1.0:1788201208.711500:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3915 00000100:00100000:1.0:1788201208.711509:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+16:3313:x1875064458151808:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788201208.711533:0:13443:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:830 count 1 00010000:00010000:1.0:1788201208.711554:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c13fcde/0x9383f985bc4d281c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.711571:0:13443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000796dd177/0x9383f985bc4bf916 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x33e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0d2d expref: 133 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.711579:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33e:0x0].0x0 since=40s v=(0 0) 00010000:00010000:1.0:1788201208.711583:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.711587:0:13443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c13fcde/0x9383f985bc4d281c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.711615:0:13443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000796dd177/0x9383f985bc4bf916 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x33e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0d2d expref: 133 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.711628:0:13443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000796dd177/0x9383f985bc4bf916 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x33e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0d2d expref: 133 pid: 6705 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.711641:0:13443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5381880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13443:1875064458151936:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201208.711666:0:13443:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341d300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201208.711684:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3916 00000100:00100000:1.0:1788201208.711691:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+16:3313:x1875064458151680:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788201208.711703:0:13447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:970 count 1 00010000:00010000:1.0:1788201208.711715:0:13447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000456a114c/0x9383f985bc4d2823 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.711727:0:13447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000027868c7e/0x9383f985bc4c68a6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c33b4 expref: 133 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.711734:0:13447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3ca:0x0].0x0 since=23s v=(0 0) 00010000:00010000:1.0:1788201208.711737:0:13447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.711741:0:13447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000456a114c/0x9383f985bc4d2823 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.711757:0:13447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000027868c7e/0x9383f985bc4c68a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c33b4 expref: 133 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.711767:0:13447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000027868c7e/0x9383f985bc4c68a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c33b4 expref: 133 pid: 12363 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.711776:0:13447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5383800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:13447:1875064458152064:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201208.711796:0:13447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341d240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201208.711812:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3917 00000100:00100000:1.0:1788201208.711820:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5383b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3311:x1875064458151552:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788201208.711833:0:13442:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:615 count 1 00010000:00010000:1.0:1788201208.711844:0:13442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c474677/0x9383f985bc4d282a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x267:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.711855:0:13442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4b4dce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x267:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd1fa expref: 133 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.711862:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x267:0x0].0x0 since=71s v=(0 0) 00010000:00010000:1.0:1788201208.711865:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x267:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.711869:0:13442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c474677/0x9383f985bc4d282a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x267:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.711899:0:13442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4b4dce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x267:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd1fa expref: 133 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.711909:0:13442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4b4dce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x267:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd1fa expref: 133 pid: 6703 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.711919:0:13442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5383100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:13442:1875064458152192:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201208.711938:0:13442:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201208.713030:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201208.713041:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5382d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458152448:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201208.713069:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201208.713408:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000757948e0/0x9383f985bc4bda7d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x318:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0298 expref: 620 pid: 10484 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.713423:0:13445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c502b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13445:1875064458148224:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201208.713443:0:13445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000004773894/0x9383f985bc4d27ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.713453:0:13445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000004773894/0x9383f985bc4d27ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.713460:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004773894/0x9383f985bc4d27ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.713471:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004773894/0x9383f985bc4d27ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.713479:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004773894/0x9383f985bc4d27ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.713494:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201208.713771:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2200700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+16:3312:x1875064458147200:12345-0@lo:6:osp-syn-0-0.0 Request processed in 36104us (38640us total) trans 4294968716 rc 0/0 00000100:00100000:3.0:1788201208.713779:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3901 00000100:00100000:3.0:1788201208.713797:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458152448 00000100:00100000:3.0:1788201208.713802:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458152448 00000100:00100000:3.0:1788201208.713825:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3919 00000100:00100000:3.0:1788201208.713831:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5381500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+16:3311:x1875064458152448:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201208.713845:0:13445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:894 count 1 00010000:00010000:3.0:1788201208.713859:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1124bc0/0x9383f985bc4d2838 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.713871:0:13445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002c4d1c2c/0x9383f985bc4c2b89 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1e91 expref: 619 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.714457:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057c20a95/0x9383f985bc4b9d4b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bed6e expref: 619 pid: 6706 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.714471:0:6706:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c6630e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1875064458147968:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201208.714489:0:6706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d27ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.714499:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d27ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.714506:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d27ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.714514:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d27ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.714521:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d27ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.714551:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788201208.714839:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3311:x1875064458147456:12345-0@lo:6:osp-syn-0-0.0 Request processed in 37744us (39842us total) trans 4294968717 rc 0/0 00000100:00100000:1.0:1788201208.714846:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3899 00010000:00010000:3.0:1788201208.714979:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37e:0x0].0x0 since=33s v=(0 0) 00010000:00010000:3.0:1788201208.714984:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.714988:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1124bc0/0x9383f985bc4d2838 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.715034:0:13445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002c4d1c2c/0x9383f985bc4c2b89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1e91 expref: 618 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.715046:0:13445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002c4d1c2c/0x9383f985bc4c2b89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1e91 expref: 618 pid: 6705 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.715059:0:13445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c502b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13445:1875064458152576:192.168.201.30@tcp:104: 00000004:00080000:1.0:1788201208.715709:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c5420700/2, rc 0, transno 4294968717 00000100:00100000:1.0:1788201208.715714:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458147456:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201208.715958:0:13445:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8140e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201208.715986:0:13448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5029f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:13448:1875064458150272:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201208.716012:0:13448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d27eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.716492:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458152832:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201208.716518:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201208.716538:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201208.716543:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458152960:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201208.716559:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201208.716580:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458153088 00000100:00100000:3.0:1788201208.716586:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458153088 00000100:00100000:3.0:1788201208.716615:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458152832 00000100:00100000:3.0:1788201208.716618:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458152832 00000100:00100000:3.0:1788201208.716632:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458152960 00000100:00100000:3.0:1788201208.716635:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458152960 00000100:00100000:3.0:1788201208.716653:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3920 00000100:00100000:3.0:1788201208.716661:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1a71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3310:x1875064458153088:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201208.716685:0:6705:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:670 count 1 00010000:00010000:3.0:1788201208.716704:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea26b3fb/0x9383f985bc4d283f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x29e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.716718:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dcaacb7e/0x9383f985bc4b7933 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x29e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be104 expref: 618 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.716726:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29e:0x0].0x0 since=61s v=(0 0) 00010000:00010000:3.0:1788201208.716730:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.716734:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea26b3fb/0x9383f985bc4d283f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x29e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.716753:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dcaacb7e/0x9383f985bc4b7933 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x29e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be104 expref: 618 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.716763:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dcaacb7e/0x9383f985bc4b7933 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x29e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be104 expref: 618 pid: 6703 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.716774:0:6705:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5028700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6705:1875064458153216:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201208.716808:0:6705:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d81403c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201208.718221:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458152704 00000100:00100000:3.0:1788201208.718227:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458152704 00000100:00100000:3.0:1788201208.718629:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3923 00000100:00100000:3.0:1788201208.718639:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c20bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3310:x1875064458152704:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201208.718660:0:6706:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:897 count 1 00010000:00010000:3.0:1788201208.718676:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2854 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.718692:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb860793/0x9383f985bc4c2e14 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1f6a expref: 618 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.718699:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x381:0x0].0x0 since=32s v=(0 0) 00010000:00010000:3.0:1788201208.718703:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x381:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.718707:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2854 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.718728:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cb860793/0x9383f985bc4c2e14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1f6a expref: 618 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.718738:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cb860793/0x9383f985bc4c2e14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1f6a expref: 618 pid: 6706 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.718749:0:6706:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3770380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1875064458153600:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201208.718791:0:6706:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8140600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201208.722846:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201208.722943:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442578432 00000100:00100000:3.0:1788201208.722949:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442578432 00010000:00010000:3.0:1788201208.722985:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000918ac790/0x9383f985bc4c04e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c111d expref: 134 pid: 6705 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.723037:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1289 00000100:00100000:3.0:1788201208.723047:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5380000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+134:2359:x1875064442578432:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.723059:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.723063:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000918ac790/0x9383f985bc4c04e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c111d expref: 134 pid: 6705 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.723072:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000918ac790/0x9383f985bc4c04e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c111d expref: 134 pid: 6705 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.723090:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000918ac790/0x9383f985bc4c04e6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c111d expref: 134 pid: 6705 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.723103:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.723106:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.723111:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d27eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.723117:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d27eb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.723134:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.726568:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5380000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+133:2359:x1875064442578432:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 3520us (3727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.726581:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1289 00000100:00100000:3.0:1788201208.726629:0:13441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5029180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:13441:1875064458150400:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201208.726644:0:13441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004933b680/0x9383f985bc4d2800 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x294:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.726665:0:13448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d27eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.726673:0:13448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d27eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.726683:0:13448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d27eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.726689:0:13448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d27eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.726714:0:13448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201208.726988:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c502b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+17:3310:x1875064458148864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 42169us (42430us total) trans 4294968705 rc 0/0 00000100:00100000:3.0:1788201208.727005:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3908 00000100:00100000:1.0:1788201208.727442:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.727664:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.727723:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201208.729898:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1291 00000100:00100000:3.0:1788201208.729916:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5383480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+134:2359:x1875064442578560:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.729934:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.729941:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000021e8ff12/0x9383f985bc4b71d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x294:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bde5d expref: 134 pid: 6706 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.729956:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000021e8ff12/0x9383f985bc4b71d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x294:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bde5d expref: 134 pid: 6706 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.734167:0:13447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5383800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:13447:1875064458152064:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201208.734168:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021e8ff12/0x9383f985bc4b71d1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x294:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bde5d expref: 132 pid: 6706 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.734196:0:13447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000456a114c/0x9383f985bc4d2823 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.734204:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x294:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.734208:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x294:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.734213:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004933b680/0x9383f985bc4d2800 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x294:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.734222:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004933b680/0x9383f985bc4d2800 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x294:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.734224:0:13443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5381880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13443:1875064458151936:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201208.734234:0:13443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007c13fcde/0x9383f985bc4d281c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.734250:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.734325:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5383480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+131:2359:x1875064442578560:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 4415us (6660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.734639:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1291 00010000:00010000:3.0:1788201208.734662:0:13441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004933b680/0x9383f985bc4d2800 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.734665:0:13442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5383100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:13442:1875064458152192:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201208.734672:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004933b680/0x9383f985bc4d2800 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.734678:0:13442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009c474677/0x9383f985bc4d282a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x267:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.734680:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004933b680/0x9383f985bc4d2800 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.734688:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004933b680/0x9383f985bc4d2800 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.734705:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788201208.735704:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.735844:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.736042:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.736060:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.736073:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.736084:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.736096:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.736148:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.736188:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.736202:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.736216:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.736232:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201208.741786:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c502bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3310:x1875064458148992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 55069us (57078us total) trans 4294968709 rc 0/0 00000100:00100000:3.0:1788201208.741797:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3911 00010000:00010000:3.0:1788201208.741844:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c4d1c2c/0x9383f985bc4c2b89 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1e91 expref: 614 pid: 6705 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.741861:0:13445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c502b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13445:1875064458152576:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201208.741883:0:13445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1124bc0/0x9383f985bc4d2838 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.741893:0:13445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1124bc0/0x9383f985bc4d2838 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.741900:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1124bc0/0x9383f985bc4d2838 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.741910:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1124bc0/0x9383f985bc4d2838 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.741918:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1124bc0/0x9383f985bc4d2838 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.741929:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788201208.742275:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5381500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+21:3311:x1875064458152448:12345-0@lo:6:osp-syn-0-0.0 Request processed in 28443us (29204us total) trans 4294968720 rc 0/0 00000100:00100000:3.0:1788201208.742282:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3919 00010000:00010000:3.0:1788201208.742575:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dcaacb7e/0x9383f985bc4b7933 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x29e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be104 expref: 613 pid: 6703 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.742591:0:6705:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5028700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6705:1875064458153216:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201208.742603:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ea26b3fb/0x9383f985bc4d283f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.742611:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ea26b3fb/0x9383f985bc4d283f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.742618:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea26b3fb/0x9383f985bc4d283f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.742626:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea26b3fb/0x9383f985bc4d283f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.742633:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea26b3fb/0x9383f985bc4d283f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.742642:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1788201208.742759:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1a71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3310:x1875064458153088:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26098us (26440us total) trans 4294968721 rc 0/0 00000100:00100000:3.0:1788201208.742766:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3920 00010000:00010000:3.0:1788201208.742795:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb860793/0x9383f985bc4c2e14 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1f6a expref: 612 pid: 6706 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.742826:0:6706:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3770380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1875064458153600:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201208.742838:0:6706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2854 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.742846:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2854 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.742854:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2854 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.742861:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2854 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.742868:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2854 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.742877:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:3.0:1788201208.743121:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c20bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3310:x1875064458152704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24483us (25389us total) trans 4294968722 rc 0/0 00000100:00100000:3.0:1788201208.743128:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3923 00010000:00010000:1.0:1788201208.745434:0:13446:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d280e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.745447:0:13446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d280e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.745456:0:13446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d280e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.745463:0:13446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d280e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201208.746618:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c5287b80/2, rc 0, transno 4294968711 00000100:00100000:3.0:1788201208.746627:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458151808:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788201208.746852:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c5285500/2, rc 0, transno 4294968724 00000100:00100000:1.0:1788201208.746871:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458152832:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201208.747140:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201208.747149:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3770380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458155136:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201208.747185:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201208.747210:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458155136 00000100:00100000:3.0:1788201208.747215:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458155136 00000100:00100000:3.0:1788201208.747241:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3929 00000100:00100000:3.0:1788201208.747247:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3773480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+24:3312:x1875064458155136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201208.747264:0:13445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:813 count 1 00010000:00010000:3.0:1788201208.747280:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069f90440/0x9383f985bc4d287e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x32d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.748059:0:13445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c19372fe/0x9383f985bc4beb39 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x32d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c085d expref: 610 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.748069:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32d:0x0].0x0 since=44s v=(0 0) 00010000:00010000:3.0:1788201208.748073:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.748077:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069f90440/0x9383f985bc4d287e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x32d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.748102:0:13445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c19372fe/0x9383f985bc4beb39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x32d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c085d expref: 610 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.748114:0:13445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c19372fe/0x9383f985bc4beb39 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x32d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c085d expref: 610 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.748127:0:13445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3771500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13445:1875064458155392:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201208.748163:0:13445:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8140f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201208.750244:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458155648 00000100:00100000:3.0:1788201208.750249:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458155648 00000100:00100000:3.0:1788201208.750285:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3931 00000100:00100000:3.0:1788201208.750327:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5383800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3310:x1875064458155648:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201208.750348:0:10484:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:866 count 1 00010000:00010000:3.0:1788201208.750363:0:10484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080c7e6b2/0x9383f985bc4d288c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.750376:0:10484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000013131edf/0x9383f985bc4c1524 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c16b8 expref: 610 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.750382:0:10484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x362:0x0].0x0 since=37s v=(0 0) 00010000:00010000:3.0:1788201208.750386:0:10484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x362:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.750389:0:10484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080c7e6b2/0x9383f985bc4d288c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.750412:0:10484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000013131edf/0x9383f985bc4c1524 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c16b8 expref: 610 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.750421:0:10484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000013131edf/0x9383f985bc4c1524 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c16b8 expref: 610 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.750432:0:10484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3771180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10484:1875064458155776:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201208.750512:0:10484:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8140900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201208.751719:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458156672 00000100:00100000:1.0:1788201208.751723:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458156672 00000100:00100000:1.0:1788201208.751745:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458156544 00000100:00100000:1.0:1788201208.751747:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458156544 00000100:00100000:3.0:1788201208.753243:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3936 00000100:00100000:3.0:1788201208.753253:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5381180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3313:x1875064458156544:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788201208.753266:0:12363:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:594 count 1 00010000:00010000:3.0:1788201208.753279:0:12363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b40878ab/0x9383f985bc4d28af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x252:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.753799:0:12363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000086186302/0x9383f985bc4b3cfd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x252:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcc2e expref: 125 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.753809:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x252:0x0].0x0 since=75s v=(0 0) 00010000:00010000:3.0:1788201208.753812:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x252:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.753816:0:12363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b40878ab/0x9383f985bc4d28af lrc: 4/0,1 mode: --/PW res: [0x280000400:0x252:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.753836:0:12363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000086186302/0x9383f985bc4b3cfd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x252:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcc2e expref: 125 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.753846:0:12363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000086186302/0x9383f985bc4b3cfd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x252:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcc2e expref: 125 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.753856:0:12363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3773b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12363:1875064458157312:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201208.755566:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3938 00000100:00100000:1.0:1788201208.755671:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+24:3311:x1875064458156288:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788201208.755709:0:13450:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:717 count 1 00010000:00010000:1.0:1788201208.755733:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9237659/0x9383f985bc4d28bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.755763:0:13450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eca37e4a/0x9383f985bc4b9f58 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bee1d expref: 125 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.755772:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2cd:0x0].0x0 since=56s v=(0 0) 00010000:00010000:1.0:1788201208.755778:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.755783:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9237659/0x9383f985bc4d28bd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.756171:0:13450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eca37e4a/0x9383f985bc4b9f58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bee1d expref: 125 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.756238:0:13450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eca37e4a/0x9383f985bc4b9f58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bee1d expref: 125 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.756809:0:13450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c341bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:13450:1875064458157440:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201208.757269:0:12363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8140600 going to sleep for 11 seconds 00010000:00010000:3.0:1788201208.762578:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e360906/0x9383f985bc4c9cee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x40c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c45e3 expref: 609 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.762592:0:13443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5420a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13443:1875064458155008:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201208.762610:0:13443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d2877 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.762745:0:13450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341dd80 going to sleep for 11 seconds 00010000:00010000:1.0:1788201208.773431:0:12363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086186302/0x9383f985bc4b3cfd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x252:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcc2e expref: 125 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.773446:0:12363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3773b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12363:1875064458157312:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201208.773467:0:12363:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b40878ab/0x9383f985bc4d28af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.773476:0:12363:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b40878ab/0x9383f985bc4d28af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.773482:0:12363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b40878ab/0x9383f985bc4d28af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.773490:0:12363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b40878ab/0x9383f985bc4d28af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.773503:0:12363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b40878ab/0x9383f985bc4d28af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.773518:0:12363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788201208.774017:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5381180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+25:3313:x1875064458156544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20765us (22324us total) trans 4294968713 rc 0/0 00000100:00100000:1.0:1788201208.774024:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3936 00000100:00100000:3.0:1788201208.774199:0:10484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3771180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10484:1875064458155776:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201208.774213:0:10484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000080c7e6b2/0x9383f985bc4d288c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.774499:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201208.774515:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201208.774529:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201208.774543:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201208.774557:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442581888 00000100:00100000:3.0:1788201208.774562:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442581888 00010000:00010000:3.0:1788201208.774586:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003d2766f2/0x9383f985bc4c4a22 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2926 expref: 125 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.774603:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442581760 00000100:00100000:3.0:1788201208.774605:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442581760 00010000:00010000:3.0:1788201208.774615:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007f22935f/0x9383f985bc4c965e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x404:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c43b3 expref: 608 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.774625:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442582016 00000100:00100000:3.0:1788201208.774628:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442582016 00010000:00010000:3.0:1788201208.774636:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f0189b57/0x9383f985bc4b3475 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc925 expref: 126 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.774646:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442582144 00000100:00100000:3.0:1788201208.774648:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442582144 00010000:00010000:3.0:1788201208.774659:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a33c87f7/0x9383f985bc4b6448 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd9a9 expref: 127 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.774672:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1311 00000100:00100000:3.0:1788201208.774679:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3771180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+127:2360:x1875064442581888:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.774689:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.774693:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003d2766f2/0x9383f985bc4c4a22 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2926 expref: 127 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.774705:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003d2766f2/0x9383f985bc4c4a22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2926 expref: 127 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.774721:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d2766f2/0x9383f985bc4c4a22 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2926 expref: 127 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.774732:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.774735:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.774741:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e8bee2d2/0x9383f985bc4d289a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.774750:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8bee2d2/0x9383f985bc4d289a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.774769:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.774797:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3771180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+126:2360:x1875064442581888:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 117us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.774807:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1311 00000100:00100000:3.0:1788201208.774821:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1312 00000100:00100000:3.0:1788201208.774827:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3770700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+608:2360:x1875064442581760:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.774835:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.774839:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007f22935f/0x9383f985bc4c965e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x404:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c43b3 expref: 608 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.774849:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007f22935f/0x9383f985bc4c965e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x404:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c43b3 expref: 608 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.774861:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f22935f/0x9383f985bc4c965e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x404:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c43b3 expref: 608 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.774872:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x404:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.774875:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x404:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.774878:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d0d4f162/0x9383f985bc4d2893 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x404:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.774885:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0d4f162/0x9383f985bc4d2893 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x404:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.774902:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.774920:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3770700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+607:2360:x1875064442581760:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 93us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.774926:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1312 00000100:00100000:3.0:1788201208.774940:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1313 00000100:00100000:3.0:1788201208.774946:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3773b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+125:2360:x1875064442582016:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.774953:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.774958:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f0189b57/0x9383f985bc4b3475 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x247:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc925 expref: 125 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.775215:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f0189b57/0x9383f985bc4b3475 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x247:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc925 expref: 125 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.775228:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x247:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.775231:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x247:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.775236:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d28a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.775244:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d28a1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.775256:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.775271:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3773b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+125:2360:x1875064442582016:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 325us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.775277:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1313 00010000:00010000:3.0:1788201208.776218:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788201208.776224:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8bee2d2/0x9383f985bc4d289a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.776233:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507de00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201208.776238:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8bee2d2/0x9383f985bc4d289a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.776247:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8bee2d2/0x9383f985bc4d289a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.776260:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8bee2d2/0x9383f985bc4d289a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.776266:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8bee2d2/0x9383f985bc4d289a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.776283:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201208.776286:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0d4f162/0x9383f985bc4d2893 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x404:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.776426:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507da00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201208.776430:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0d4f162/0x9383f985bc4d2893 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x404:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.776438:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0d4f162/0x9383f985bc4d2893 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x404:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.776450:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0d4f162/0x9383f985bc4d2893 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x404:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.776458:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201208.776462:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c576e396/0x9383f985bc4d28c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.776468:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201208.776471:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c576e396/0x9383f985bc4d28c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.776478:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c576e396/0x9383f985bc4d28c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.776486:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c576e396/0x9383f985bc4d28c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.776492:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201208.776494:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201208.776495:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201208.777288:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201208.777490:0:13442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a33c87f7/0x9383f985bc4b6448 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd9a9 expref: 123 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.777503:0:13442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5285180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:13442:1875064458157184:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201208.777523:0:13442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000927e33d1/0x9383f985bc4d28b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.777532:0:13442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000927e33d1/0x9383f985bc4d28b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.777545:0:13442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000927e33d1/0x9383f985bc4d28b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.777554:0:13442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000927e33d1/0x9383f985bc4d28b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.777561:0:13442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000927e33d1/0x9383f985bc4d28b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.777577:0:13442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201208.777889:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+25:3311:x1875064458156416:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24357us (24980us total) trans 4294968715 rc 0/0 00000100:00100000:3.0:1788201208.777896:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3937 00000100:00100000:3.0:1788201208.779578:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458159104:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201208.779610:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201208.780467:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201208.782690:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201208.782697:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d28a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.782705:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201208.782710:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d28a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.782719:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d28a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.782738:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d28a1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.782744:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d28a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.782762:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201208.782764:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201208.782766:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201208.783961:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201208.784057:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c341b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458159616:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201208.784090:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788201208.784124:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04d0821500/2, rc 0, transno 4294968731 00000100:00100000:3.0:1788201208.784139:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d0821500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458157824:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201208.784281:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458159872:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201208.786777:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458159872 00000100:00100000:3.0:1788201208.786785:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458159872 00000100:00100000:3.0:1788201208.786858:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3948 00000100:00100000:3.0:1788201208.786868:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+33:3311:x1875064458159872:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201208.786895:0:13444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1015 count 1 00010000:00010000:3.0:1788201208.786916:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2903 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.786934:0:13444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d20a3ca/0x9383f985bc4c8c1d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c401e expref: 604 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.786950:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f7:0x0].0x0 since=19s v=(0 0) 00010000:00010000:3.0:1788201208.786954:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.786958:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2903 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.787014:0:13444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008d20a3ca/0x9383f985bc4c8c1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c401e expref: 604 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.787026:0:13444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008d20a3ca/0x9383f985bc4c8c1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c401e expref: 604 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.787041:0:13444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13444:1875064458160000:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201208.787087:0:13444:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d81403c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201208.788448:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201208.788474:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442580864 00000100:00100000:1.0:1788201208.788476:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201208.788479:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442580864 00010000:00010000:3.0:1788201208.788501:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4c5a9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2ed6 expref: 605 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.788503:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.788519:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201208.788527:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442582400 00000100:00100000:3.0:1788201208.788529:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442582400 00000100:00100000:1.0:1788201208.788537:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1788201208.788542:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000013131edf/0x9383f985bc4c1524 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c16b8 expref: 606 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.788552:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442581120 00000100:00100000:1.0:1788201208.788553:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442580736 00000100:00100000:1.0:1788201208.788555:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442580736 00000100:00100000:3.0:1788201208.788555:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442581120 00010000:00010000:3.0:1788201208.788569:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000087f223a4/0x9383f985bc4b7375 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdee9 expref: 123 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.788571:0:7646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000027c31e45/0x9383f985bc4c0675 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c11da expref: 123 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.788580:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442580992 00000100:00100000:3.0:1788201208.788583:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442580992 00010000:00010000:3.0:1788201208.788594:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006a3cc7bf/0x9383f985bc4bc736 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x300:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfbfa expref: 607 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.788607:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1315 00000100:00100000:3.0:1788201208.788613:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d80dc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+607:2362:x1875064442580864:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.788623:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.788628:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4c5a9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2ed6 expref: 607 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.788640:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4c5a9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2ed6 expref: 607 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.788660:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4c5a9f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2ed6 expref: 607 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.788674:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.788677:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.788683:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d2869 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.788690:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d2869 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.788708:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.788735:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d80dc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+606:2362:x1875064442580864:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 121us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.788742:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1315 00000100:00100000:3.0:1788201208.788782:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1316 00000100:00100000:3.0:1788201208.788789:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c341a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+605:2359:x1875064442582400:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.788797:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.788801:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000013131edf/0x9383f985bc4c1524 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x362:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c16b8 expref: 605 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.789367:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1318 00000100:00100000:1.0:1788201208.789376:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3419f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+605:2362:x1875064442580992:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201208.789384:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201208.789389:0:7646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006a3cc7bf/0x9383f985bc4bc736 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x300:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfbfa expref: 605 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.792661:0:7646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006a3cc7bf/0x9383f985bc4bc736 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x300:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfbfa expref: 605 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.792703:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a3cc7bf/0x9383f985bc4bc736 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x300:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfbfa expref: 605 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.792720:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x300:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.792724:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x300:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.792729:0:7646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2870 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x300:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.792738:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2870 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x300:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.792784:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000013131edf/0x9383f985bc4c1524 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x362:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c16b8 expref: 604 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.792801:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013131edf/0x9383f985bc4c1524 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x362:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c16b8 expref: 604 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.792814:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x362:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.792817:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x362:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.792822:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000080c7e6b2/0x9383f985bc4d288c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.792829:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080c7e6b2/0x9383f985bc4d288c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.792858:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.792906:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c341a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+603:2359:x1875064442582400:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 4115us (4427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.792916:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1316 00010000:00010000:1.0:1788201208.793465:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201208.793465:0:10484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000080c7e6b2/0x9383f985bc4d288c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.793476:0:10484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080c7e6b2/0x9383f985bc4d288c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.793485:0:10484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080c7e6b2/0x9383f985bc4d288c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.793489:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3419f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+602:2362:x1875064442580992:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 4116us (4951us total) trans 0 rc 0/0 00010000:00010000:3.0:1788201208.793494:0:10484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080c7e6b2/0x9383f985bc4d288c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.793497:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1318 00010000:00010000:3.0:1788201208.793511:0:10484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788201208.793550:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201208.793960:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5383800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+35:3310:x1875064458155648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 43666us (43777us total) trans 4294968732 rc 0/0 00000100:00100000:1.0:1788201208.793990:0:13450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c341bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:13450:1875064458157440:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201208.794019:0:13450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d9237659/0x9383f985bc4d28bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.794158:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3931 00010000:00010000:3.0:1788201208.794182:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201208.794188:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080c7e6b2/0x9383f985bc4d288c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.794197:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3016400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201208.794202:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080c7e6b2/0x9383f985bc4d288c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.794211:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080c7e6b2/0x9383f985bc4d288c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.794224:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080c7e6b2/0x9383f985bc4d288c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.794232:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080c7e6b2/0x9383f985bc4d288c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.794248:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201208.794250:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201208.794252:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201208.794265:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1320 00000100:00100000:3.0:1788201208.794275:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c341a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+122:2362:x1875064442582272:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.794290:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.794423:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f799a27c/0x9383f985bc4c50c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2b5d expref: 122 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.794437:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f799a27c/0x9383f985bc4c50c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2b5d expref: 122 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.794516:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f799a27c/0x9383f985bc4c50c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2b5d expref: 122 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.794535:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.794539:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.794544:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee9d20ef/0x9383f985bc4d28a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.794552:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee9d20ef/0x9383f985bc4d28a8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.794570:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.794601:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c341a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+121:2362:x1875064442582272:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 328us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.794607:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1320 00010000:00010000:3.0:1788201208.795416:0:13440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d285b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.795426:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d285b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.795435:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d285b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.795441:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d285b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.795460:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788201208.797422:0:13441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c39c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:13441:1875064458158976:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201208.797446:0:13441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004525f602/0x9383f985bc4d28e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.797488:0:13443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c39c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13443:1875064458158720:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201208.797500:0:13443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f3bc9e08/0x9383f985bc4d28d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.797521:0:12363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c39c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12363:1875064458158848:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201208.797533:0:12363:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b13647a1/0x9383f985bc4d28e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.797555:0:13447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5383480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:13447:1875064458159232:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201208.797566:0:13447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d28ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201208.797665:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c12d0000/2, rc 0, transno 4294968717 00000100:00100000:1.0:1788201208.797688:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458156032:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788201208.797702:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c20bdc00/2, rc 0, transno 4294968733 00000100:00100000:1.0:1788201208.797712:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c20bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458154240:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201208.797738:0:6706:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c6630e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1875064458159488:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201208.797827:0:6706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d28f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x33b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.797865:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3311:x1875064458153728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 54303us (54398us total) trans 4294968718 rc 0/0 00000100:00100000:3.0:1788201208.797873:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3924 00010000:00010000:3.0:1788201208.797900:0:13451:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d2869 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.797908:0:13451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d2869 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.797917:0:13451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d2869 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.797925:0:13451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d2869 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.797938:0:13451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201208.798360:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201208.798366:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2862 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.798375:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201208.798378:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2862 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.798386:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2862 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.798397:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2862 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.798405:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2862 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.798420:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201208.798422:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201208.798424:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201208.798518:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d0822a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458160384:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201208.798565:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1788201208.798853:0:13442:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:988 count 1 00010000:00010000:0.0:1788201208.798871:0:13442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c576e396/0x9383f985bc4d2911 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.798886:0:13442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b9a35640/0x9383f985bc4c76d7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c38a0 expref: 119 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.798894:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3dc:0x0].0x0 since=22s v=(0 0) 00010000:00010000:0.0:1788201208.798898:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.798901:0:13442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c576e396/0x9383f985bc4d2911 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.798925:0:13442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b9a35640/0x9383f985bc4c76d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c38a0 expref: 119 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.798938:0:13442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b9a35640/0x9383f985bc4c76d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c38a0 expref: 119 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.798949:0:13442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d0822680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:13442:1875064458160512:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201208.799087:0:13442:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5180 going to sleep for 11 seconds 00000100:00100000:3.0:1788201208.800217:0:13451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c20bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+35:3313:x1875064458154624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 55945us (55994us total) trans 4294968734 rc 0/0 00000100:00100000:3.0:1788201208.800226:0:13451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3927 00000004:00080000:1.0:1788201208.800432:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c20bd180/2, rc 0, transno 4294968734 00000100:00100000:1.0:1788201208.801165:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c20bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458154624:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788201208.801180:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c20bca80/2, rc 0, transno 4294968719 00000100:00100000:1.0:1788201208.801193:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c20bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458153856:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201208.802227:0:13445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c39c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13445:1875064458158208:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201208.802245:0:13445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d28d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.802315:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201208.802381:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201208.802468:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201208.802550:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442582528 00000100:00100000:3.0:1788201208.802554:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442582528 00010000:00010000:3.0:1788201208.802573:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eca37e4a/0x9383f985bc4b9f58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bee1d expref: 119 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.802594:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442582784 00000100:00100000:3.0:1788201208.802597:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442582784 00010000:00010000:3.0:1788201208.802608:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d3a752b/0x9383f985bc4b5ce6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x27a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd733 expref: 120 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.802624:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442583040 00000100:00100000:3.0:1788201208.802627:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442583040 00010000:00010000:3.0:1788201208.802638:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000de6e481/0x9383f985bc4c3912 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2345 expref: 602 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.802657:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1321 00000100:00100000:3.0:1788201208.802664:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+120:2360:x1875064442582528:12345-192.168.201.30@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201208.802673:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1788201208.802674:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.802679:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eca37e4a/0x9383f985bc4b9f58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bee1d expref: 120 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.802687:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1788201208.802691:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eca37e4a/0x9383f985bc4b9f58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bee1d expref: 120 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.802698:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1788201208.802711:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eca37e4a/0x9383f985bc4b9f58 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bee1d expref: 120 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.802729:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.802732:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2cd:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1788201208.802735:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1788201208.802738:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9237659/0x9383f985bc4d28bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.802745:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1788201208.802748:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9237659/0x9383f985bc4d28bd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.802768:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1788201208.802781:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.802875:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+119:2360:x1875064442582528:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 210us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.802883:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1321 00000100:00100000:3.0:1788201208.802896:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442582656 00000100:00100000:3.0:1788201208.802899:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442582656 00010000:00010000:3.0:1788201208.802913:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b4178bb4/0x9383f985bc4b8e02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be827 expref: 603 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.802925:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442582912 00000100:00100000:3.0:1788201208.802927:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442582912 00010000:00010000:3.0:1788201208.802939:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c0a69dcb/0x9383f985bc4c7008 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c362a expref: 119 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.803061:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442583168 00000100:00100000:3.0:1788201208.803064:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442583168 00010000:00010000:3.0:1788201208.803078:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ec47b855/0x9383f985bc4bc274 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfa33 expref: 120 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.803093:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442583296 00000100:00100000:3.0:1788201208.803095:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442583296 00010000:00010000:3.0:1788201208.803105:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000991fbd77/0x9383f985bc4bf637 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x33b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0c38 expref: 604 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.803115:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442583552 00000100:00100000:3.0:1788201208.803116:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442583552 00010000:00010000:3.0:1788201208.803125:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ad49ffb2/0x9383f985bc4c8196 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3c35 expref: 121 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.803134:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442583424 00000100:00100000:3.0:1788201208.803135:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442583424 00010000:00010000:3.0:1788201208.803144:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008d20a3ca/0x9383f985bc4c8c1d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c401e expref: 605 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.803154:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1322 00000100:00100000:3.0:1788201208.803159:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d80de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+121:2360:x1875064442582784:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.803166:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.803170:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d3a752b/0x9383f985bc4b5ce6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x27a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd733 expref: 121 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.803179:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d3a752b/0x9383f985bc4b5ce6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x27a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd733 expref: 121 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.803192:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d3a752b/0x9383f985bc4b5ce6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x27a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd733 expref: 121 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.803203:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.803206:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.803211:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3bc9e08/0x9383f985bc4d28d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.803219:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3bc9e08/0x9383f985bc4d28d9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.803236:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201208.803732:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.804058:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201208.804148:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d80de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+120:2360:x1875064442582784:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 986us (1765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.804156:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1322 00000100:00100000:3.0:1788201208.804194:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442583808 00000100:00100000:3.0:1788201208.804199:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442583808 00010000:00010000:3.0:1788201208.804214:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b9a35640/0x9383f985bc4c76d7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c38a0 expref: 120 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.804226:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442583680 00000100:00100000:3.0:1788201208.804228:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442583680 00010000:00010000:3.0:1788201208.804238:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000060c39800/0x9383f985bc4bbd1f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf86c expref: 605 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.804249:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1324 00000100:00100000:3.0:1788201208.804254:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3419180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+605:2360:x1875064442582656:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.804262:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.804266:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b4178bb4/0x9383f985bc4b8e02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be827 expref: 605 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.804277:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b4178bb4/0x9383f985bc4b8e02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be827 expref: 605 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.804289:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4178bb4/0x9383f985bc4b8e02 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be827 expref: 605 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.804315:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.804318:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.804323:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d28d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.804490:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d28d2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.804514:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.804588:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3419180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+604:2360:x1875064442582656:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 332us (1913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.804595:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1324 00000100:00100000:3.0:1788201208.804610:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1325 00000100:00100000:3.0:1788201208.804618:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3418e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+120:2360:x1875064442582912:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.804626:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.804632:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c0a69dcb/0x9383f985bc4c7008 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c362a expref: 120 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.804648:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c0a69dcb/0x9383f985bc4c7008 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c362a expref: 120 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.804662:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0a69dcb/0x9383f985bc4c7008 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c362a expref: 120 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.804673:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.804676:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.804680:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b13647a1/0x9383f985bc4d28e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.804688:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b13647a1/0x9383f985bc4d28e0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.804706:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.804725:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3418e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+119:2360:x1875064442582912:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 108us (2037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.804732:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1325 00000100:00100000:3.0:1788201208.805635:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1326 00000100:00100000:3.0:1788201208.805647:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3419880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+118:2360:x1875064442583168:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.805658:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.805664:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ec47b855/0x9383f985bc4bc274 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfa33 expref: 118 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.805719:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ec47b855/0x9383f985bc4bc274 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfa33 expref: 118 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.805734:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec47b855/0x9383f985bc4bc274 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfa33 expref: 118 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.805745:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.805748:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.805752:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d28ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.805761:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d28ee lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.805784:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.805806:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3419880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+117:2360:x1875064442583168:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 162us (3106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201208.805951:0:13438:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d0820700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:13438:1875064458160256:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201208.806000:0:13438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d290a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.806043:0:13449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d0823480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:13449:1875064458159744:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201208.806058:0:13449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d28fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.806081:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d0820380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458161408:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201208.806116:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201208.806560:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1326 00000100:00100000:3.0:1788201208.806581:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1327 00000100:00100000:3.0:1788201208.806590:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3419c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+602:2360:x1875064442583296:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.806600:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.806607:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000991fbd77/0x9383f985bc4bf637 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x33b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0c38 expref: 602 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.806608:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1328 00000100:00100000:1.0:1788201208.806617:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3418700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+116:2362:x1875064442583552:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.806624:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000991fbd77/0x9383f985bc4bf637 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x33b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0c38 expref: 602 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.806625:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201208.806629:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ad49ffb2/0x9383f985bc4c8196 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3c35 expref: 116 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.806638:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ad49ffb2/0x9383f985bc4c8196 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3c35 expref: 116 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.806639:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000991fbd77/0x9383f985bc4bf637 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x33b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0c38 expref: 602 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.806651:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad49ffb2/0x9383f985bc4c8196 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3c35 expref: 116 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.806653:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.806657:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.806661:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.806661:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d28f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.806663:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.806667:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d28fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.806670:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d28f5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x33b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.806676:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d28fc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.806689:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201208.806694:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.806754:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3419c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+601:2360:x1875064442583296:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 165us (4017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.806760:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1327 00000100:00100000:3.0:1788201208.806775:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1329 00000100:00100000:3.0:1788201208.806783:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d80dec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+600:2360:x1875064442583424:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.806792:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.806798:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008d20a3ca/0x9383f985bc4c8c1d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c401e expref: 600 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.806814:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008d20a3ca/0x9383f985bc4c8c1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c401e expref: 600 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.806827:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.806830:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.806834:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2903 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.806840:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2903 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.806851:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201208.809243:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3418700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+115:2362:x1875064442583552:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 2615us (6484us total) trans 0 rc 0/0 00010000:00010000:0.0:1788201208.809285:0:13449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d28fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.809324:0:13449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d28fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.809344:0:13449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d28fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.809352:0:13449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d28fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.809376:0:13449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201208.809609:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5029180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+32:3311:x1875064458159616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 25457us (25517us total) trans 4294968720 rc 0/0 00000100:00100000:0.0:1788201208.809617:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3947 00000100:00100000:0.0:1788201208.809666:0:13442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d0822680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:13442:1875064458160512:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201208.809666:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1328 00010000:00010000:0.0:1788201208.809685:0:13442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c576e396/0x9383f985bc4d2911 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.809687:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1330 00000100:00100000:1.0:1788201208.809698:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3419500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+114:2362:x1875064442583808:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201208.809712:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201208.809718:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b9a35640/0x9383f985bc4c76d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c38a0 expref: 114 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.809730:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b9a35640/0x9383f985bc4c76d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c38a0 expref: 114 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.809749:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9a35640/0x9383f985bc4c76d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c38a0 expref: 114 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.809830:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.809836:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.809841:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c576e396/0x9383f985bc4d2911 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.809851:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c576e396/0x9383f985bc4d2911 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.809927:0:13447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d28ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.809937:0:13447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d28ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.809945:0:13447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d28ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.809952:0:13447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d28ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.810099:0:13447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788201208.810493:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201208.810518:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3419500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+113:2362:x1875064442583808:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 823us (6786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201208.810526:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1330 00000100:00100000:1.0:1788201208.810545:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1331 00000100:00100000:1.0:1788201208.810553:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3418380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+600:2362:x1875064442583680:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201208.810563:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201208.810569:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000060c39800/0x9383f985bc4bbd1f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf86c expref: 600 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.810655:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000060c39800/0x9383f985bc4bbd1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf86c expref: 600 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.810656:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5028700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+32:3312:x1875064458159104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 30963us (31044us total) trans 4294968721 rc 0/0 00000100:00100000:3.0:1788201208.810663:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3945 00010000:00010000:1.0:1788201208.810672:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060c39800/0x9383f985bc4bbd1f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf86c expref: 600 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.810682:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.810685:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.810689:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d290a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.810691:0:12363:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b13647a1/0x9383f985bc4d28e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.810698:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d290a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.810699:0:12363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b13647a1/0x9383f985bc4d28e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.810708:0:12363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b13647a1/0x9383f985bc4d28e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.810716:0:12363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b13647a1/0x9383f985bc4d28e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.810719:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201208.810729:0:12363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1788201208.810738:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3418380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+599:2362:x1875064442583680:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 187us (6681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201208.810744:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1331 00010000:00010000:1.0:1788201208.810842:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d28f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.810851:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d28f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.811055:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c39c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3311:x1875064458158464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 32055us (32428us total) trans 4294968722 rc 0/0 00000100:00100000:3.0:1788201208.811062:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3943 00010000:00010000:3.0:1788201208.811086:0:13443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f3bc9e08/0x9383f985bc4d28d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.811095:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3bc9e08/0x9383f985bc4d28d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.811104:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3bc9e08/0x9383f985bc4d28d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.811118:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3bc9e08/0x9383f985bc4d28d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.811127:0:13443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1788201208.811406:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d28f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.811415:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d28f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.811424:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:3.0:1788201208.811547:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c39c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3312:x1875064458158336:12345-0@lo:6:osp-syn-1-0.0 Request processed in 32879us (33306us total) trans 4294968723 rc 0/0 00000100:00100000:3.0:1788201208.811553:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3942 00000100:00100000:1.0:1788201208.811569:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5381880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3313:x1875064458159360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29670us (29846us total) trans 4294968736 rc 0/0 00000100:00100000:1.0:1788201208.811575:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3946 00010000:00010000:3.0:1788201208.811598:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d20a3ca/0x9383f985bc4c8c1d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c401e expref: 598 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.812150:0:13444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13444:1875064458160000:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201208.812171:0:13444:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2903 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.812180:0:13444:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2903 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.812188:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2903 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.812196:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2903 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.812203:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2903 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.812214:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:1.0:1788201208.812365:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.812397:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442583936 00000100:00100000:1.0:1788201208.812404:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442583936 00010000:00010000:1.0:1788201208.812431:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008d3fdbee/0x9383f985bc4c65c7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c32bf expref: 598 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.812455:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788201208.812462:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d28fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.812463:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1332 00010000:00010000:0.0:1788201208.812471:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1a00 already unused, calling callback (ffffffffc13fbfe0) 00000100:00100000:1.0:1788201208.812471:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c341b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+598:2360:x1875064442583936:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201208.812475:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d28fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.812482:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201208.812484:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d28fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.812486:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008d3fdbee/0x9383f985bc4c65c7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c32bf expref: 598 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.812499:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008d3fdbee/0x9383f985bc4c65c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c32bf expref: 598 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.812502:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d28fc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.812509:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d28fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.812515:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.812518:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.812523:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000927e33d1/0x9383f985bc4d2918 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.812525:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788201208.812529:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d28ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.812533:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000927e33d1/0x9383f985bc4d2918 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.812535:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.812538:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d28ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.812545:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d28ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.812547:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201208.812553:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d28ee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.812560:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d28ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.812571:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:1.0:1788201208.812574:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c341b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+598:2360:x1875064442583936:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 103us (210us total) trans 0 rc 0/0 00010000:00010000:0.0:1788201208.812575:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b13647a1/0x9383f985bc4d28e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.812582:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507ca00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.812585:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b13647a1/0x9383f985bc4d28e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.812592:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b13647a1/0x9383f985bc4d28e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.812600:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b13647a1/0x9383f985bc4d28e0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.812607:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b13647a1/0x9383f985bc4d28e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.812619:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201208.812623:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3bc9e08/0x9383f985bc4d28d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.812629:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507cc00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.812633:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3bc9e08/0x9383f985bc4d28d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.812641:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3bc9e08/0x9383f985bc4d28d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.812649:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3bc9e08/0x9383f985bc4d28d9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.812656:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3bc9e08/0x9383f985bc4d28d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.812667:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201208.812670:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d28f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.812677:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.812680:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d28f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.812687:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d28f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.812696:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d28f5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.812704:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d28f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.812718:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788201208.812718:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1332 00010000:00010000:0.0:1788201208.812720:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2903 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.812726:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.812729:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2903 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.812737:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2903 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.812746:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2903 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.812752:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2903 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.812765:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.812767:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.812769:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.812780:0:13438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d290a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.812787:0:13438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d290a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.812800:0:13438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d290a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.812808:0:13438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d290a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.812821:0:13438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201208.813259:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0501b36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3312:x1875064458160128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 25188us (25566us total) trans 4294968737 rc 0/0 00000100:00100000:0.0:1788201208.813267:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3949 00010000:00010000:0.0:1788201208.813288:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201208.813312:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d290a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.813320:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.813324:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d290a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.813381:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.813403:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442584192 00000100:00100000:1.0:1788201208.813408:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442584192 00010000:00010000:1.0:1788201208.813430:0:7646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d5043f7f/0x9383f985bc4bf08e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x333:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0a24 expref: 113 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.813452:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1333 00000100:00100000:1.0:1788201208.813459:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c341a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+113:2360:x1875064442584192:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201208.813468:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201208.813473:0:7646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d5043f7f/0x9383f985bc4bf08e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x333:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0a24 expref: 113 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.813484:0:7646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d5043f7f/0x9383f985bc4bf08e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x333:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0a24 expref: 113 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.813499:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x333:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.813503:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x333:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.813508:0:7646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007be97ade/0x9383f985bc4d2926 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x333:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.813516:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007be97ade/0x9383f985bc4d2926 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x333:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.813530:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201208.813549:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c341a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+113:2360:x1875064442584192:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 90us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201208.813556:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1333 00000100:00100000:3.0:1788201208.813607:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3311:x1875064458159872:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26739us (26941us total) trans 4294968738 rc 0/0 00000100:00100000:3.0:1788201208.813614:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3948 00010000:00010000:3.0:1788201208.813638:0:13445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d28d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.813648:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d28d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.813655:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d28d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.813661:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d28d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.813670:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788201208.813749:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201208.813784:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c39c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+37:3313:x1875064458158080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 50099us (50173us total) trans 4294968739 rc 0/0 00000100:00100000:3.0:1788201208.813790:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3941 00000100:00100000:3.0:1788201208.813817:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d80dec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+597:2360:x1875064442583424:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 7035us (11047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.813824:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1329 00010000:00010000:0.0:1788201208.813857:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d290a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.813870:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d290a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.813876:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d290a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.813892:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201208.813895:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d28d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.813902:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507c800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.813905:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d28d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.813911:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d28d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.813920:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d28d2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.813928:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d28d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.813942:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.813943:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.813945:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788201208.814121:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c502b100/2, rc 0, transno 4294968736 00000100:00100000:0.0:1788201208.814133:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c502b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458159360:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788201208.814142:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c39c4380/2, rc 0, transno 4294968739 00000100:00100000:0.0:1788201208.814146:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c39c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458158080:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788201208.814205:0:13442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c576e396/0x9383f985bc4d2911 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.814214:0:13442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c576e396/0x9383f985bc4d2911 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.814224:0:13442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c576e396/0x9383f985bc4d2911 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.814231:0:13442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c576e396/0x9383f985bc4d2911 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.814241:0:13442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201208.814682:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c341bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3313:x1875064458160384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15850us (16116us total) trans 4294968724 rc 0/0 00000100:00100000:0.0:1788201208.814689:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3950 00010000:00010000:0.0:1788201208.814705:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201208.814709:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c576e396/0x9383f985bc4d2911 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.814717:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.814721:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c576e396/0x9383f985bc4d2911 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.814729:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c576e396/0x9383f985bc4d2911 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.814740:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c576e396/0x9383f985bc4d2911 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.814748:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c576e396/0x9383f985bc4d2911 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.814763:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.814765:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.814766:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788201208.814786:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04d0822a00/2, rc 0, transno 4294968724 00000100:00100000:0.0:1788201208.814800:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d0822a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458160384:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201208.814837:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201208.814848:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d0821180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458161920:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201208.814878:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201208.814906:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458161920 00000100:00100000:0.0:1788201208.814910:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458161920 00000100:00100000:0.0:1788201208.814938:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3955 00000100:00100000:0.0:1788201208.814945:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d0823800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+32:3313:x1875064458161920:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201208.814977:0:13448:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:764 count 1 00000100:00100000:3.0:1788201208.815125:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442584064 00000100:00100000:3.0:1788201208.815129:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442584064 00010000:00010000:3.0:1788201208.815147:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009995a6f5/0x9383f985bc4c6d92 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3558 expref: 113 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.815169:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1334 00000100:00100000:3.0:1788201208.815175:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3419f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+113:2360:x1875064442584064:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.815183:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.815188:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009995a6f5/0x9383f985bc4c6d92 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3558 expref: 113 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.815200:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009995a6f5/0x9383f985bc4c6d92 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3558 expref: 113 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.815215:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009995a6f5/0x9383f985bc4c6d92 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3558 expref: 113 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.815226:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.815230:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.815236:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d0d4f162/0x9383f985bc4d291f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.815245:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0d4f162/0x9383f985bc4d291f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.815263:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.815285:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3419f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+112:2360:x1875064442584064:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 110us (1537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.815422:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1334 00000100:00100000:3.0:1788201208.815629:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d0822680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458161664:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201208.815661:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788201208.815693:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c3770000/2, rc 0, transno 4294968732 00000100:00100000:3.0:1788201208.815703:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3770000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458155648:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201208.815712:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201208.815717:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d0820700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458161792:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201208.815784:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201208.815814:0:13450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d9237659/0x9383f985bc4d28bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.815823:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9237659/0x9383f985bc4d28bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.815832:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9237659/0x9383f985bc4d28bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.815839:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9237659/0x9383f985bc4d28bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.815851:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201208.816093:0:13448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2934 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.816108:0:13448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000083339579/0x9383f985bc4bc496 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfae9 expref: 111 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.816115:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2fc:0x0].0x0 since=50s v=(0 0) 00010000:00010000:0.0:1788201208.816119:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.816123:0:13448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2934 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.816152:0:13448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000083339579/0x9383f985bc4bc496 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfae9 expref: 111 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.816164:0:13448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000083339579/0x9383f985bc4bc496 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfae9 expref: 111 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.816176:0:13448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d0820a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:13448:1875064458162048:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201208.816218:0:13448:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5d80 going to sleep for 11 seconds 00010000:00010000:0.0:1788201208.816228:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201208.816233:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9237659/0x9383f985bc4d28bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.816240:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.816245:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9237659/0x9383f985bc4d28bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.816253:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9237659/0x9383f985bc4d28bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.816265:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9237659/0x9383f985bc4d28bd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.816274:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9237659/0x9383f985bc4d28bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.816320:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.816322:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.816324:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.817083:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201208.817088:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007be97ade/0x9383f985bc4d2926 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.817097:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507c000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.817100:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007be97ade/0x9383f985bc4d2926 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.817108:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007be97ade/0x9383f985bc4d2926 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.817120:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007be97ade/0x9383f985bc4d2926 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.817127:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007be97ade/0x9383f985bc4d2926 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.817143:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.817145:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.817147:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201208.817160:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3957 00000100:00100000:0.0:1788201208.817168:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+38:3310:x1875064458161792:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201208.817184:0:13449:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:574 count 1 00010000:00010000:0.0:1788201208.817197:0:13449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2942 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.817209:0:13449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba5161b6/0x9383f985bc4b2caa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc68c expref: 596 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.817216:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23e:0x0].0x0 since=77s v=(0 0) 00010000:00010000:0.0:1788201208.817219:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.817223:0:13449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2942 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.817244:0:13449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba5161b6/0x9383f985bc4b2caa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc68c expref: 596 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.817254:0:13449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba5161b6/0x9383f985bc4b2caa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc68c expref: 596 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.817266:0:13449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d0823b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:13449:1875064458162304:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201208.817389:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d0821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458162176:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201208.817422:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201208.817456:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458162176 00000100:00100000:1.0:1788201208.817460:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458162176 00000100:00100000:1.0:1788201208.817485:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3958 00000100:00100000:1.0:1788201208.817492:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f965c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3313:x1875064458162176:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201208.817503:0:12363:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:830 count 1 00010000:00010000:1.0:1788201208.817516:0:12363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d2949 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x33e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.817527:0:12363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002b708452/0x9383f985bc4bf8ad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x33e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0d0a expref: 596 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.817534:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33e:0x0].0x0 since=41s v=(0 0) 00010000:00010000:1.0:1788201208.817536:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.817540:0:12363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d2949 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x33e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.817559:0:12363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002b708452/0x9383f985bc4bf8ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x33e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0d0a expref: 596 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.817567:0:12363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002b708452/0x9383f985bc4bf8ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x33e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0d0a expref: 596 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.817593:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+33:3311:x1875064458156288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 62015us (64633us total) trans 4294968725 rc 0/0 00000100:00100000:3.0:1788201208.817600:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3938 00000100:00100000:1.0:1788201208.817653:0:12363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c341a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12363:1875064458162432:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201208.817699:0:12363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341d240 going to sleep for 11 seconds 00010000:00010000:1.0:1788201208.818083:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201208.818089:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0d4f162/0x9383f985bc4d291f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.818107:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507da00 already unused, calling callback (ffffffffc13fbfe0) 00000100:00100000:0.0:1788201208.818110:0:13449:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5180 going to sleep for 11 seconds 00010000:00010000:1.0:1788201208.818111:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0d4f162/0x9383f985bc4d291f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.818119:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0d4f162/0x9383f985bc4d291f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.818131:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0d4f162/0x9383f985bc4d291f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.818139:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0d4f162/0x9383f985bc4d291f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.818155:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201208.818157:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201208.818159:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201208.818893:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c341ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458162688:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788201208.818916:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201208.818920:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000927e33d1/0x9383f985bc4d2918 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.818927:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201208.818930:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000927e33d1/0x9383f985bc4d2918 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.818943:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000927e33d1/0x9383f985bc4d2918 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.818955:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000927e33d1/0x9383f985bc4d2918 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.818962:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000927e33d1/0x9383f985bc4d2918 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.818976:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201208.818978:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201208.818979:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201208.819018:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201208.819052:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458162688 00000100:00100000:1.0:1788201208.819058:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458162688 00000100:00100000:1.0:1788201208.819087:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3959 00000100:00100000:1.0:1788201208.819484:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3310:x1875064458162688:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201208.819490:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d0822300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458162944:0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788201208.819507:0:6706:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1012 count 1 00000100:00100000:0.0:1788201208.819518:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788201208.819525:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d2950 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.819539:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1788201208.819539:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6ead4eb/0x9383f985bc4c89bc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3f4c expref: 595 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.819544:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d0820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458163072:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788201208.819546:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f4:0x0].0x0 since=19s v=(0 0) 00010000:00010000:1.0:1788201208.819550:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.819554:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d2950 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.819564:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788201208.819575:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b6ead4eb/0x9383f985bc4c89bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3f4c expref: 595 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.819588:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458162944 00000100:00100000:0.0:1788201208.819592:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458162944 00000100:00100000:0.0:1788201208.819616:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458163072 00000100:00100000:0.0:1788201208.819619:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458163072 00000100:00100000:0.0:1788201208.819638:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3960 00000100:00100000:0.0:1788201208.819645:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d1f0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+34:3312:x1875064458162944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201208.819657:0:13444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:816 count 1 00010000:00010000:1.0:1788201208.819666:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b6ead4eb/0x9383f985bc4c89bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3f4c expref: 595 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.819669:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2957 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x330:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.819677:0:6706:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3418e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1875064458163200:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201208.819681:0:13444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002db26b92/0x9383f985bc4bee18 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x330:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0952 expref: 110 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.819687:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x330:0x0].0x0 since=43s v=(0 0) 00010000:00010000:0.0:1788201208.819690:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x330:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.819694:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2957 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x330:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.819713:0:13444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002db26b92/0x9383f985bc4bee18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x330:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0952 expref: 110 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.819720:0:6706:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341de40 going to sleep for 11 seconds 00010000:00010000:0.0:1788201208.819723:0:13444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002db26b92/0x9383f985bc4bee18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x330:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0952 expref: 110 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.819734:0:13444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13444:1875064458163328:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201208.819897:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201208.819907:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d0823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458162816:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201208.820432:0:13444:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201208.820463:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3961 00000100:00100000:0.0:1788201208.820472:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d1f0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+34:3312:x1875064458163072:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201208.820486:0:13445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:591 count 1 00010000:00010000:0.0:1788201208.820499:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d295e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.820512:0:13445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8e8f697/0x9383f985bc4b3a87 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcb5c expref: 110 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.820519:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24f:0x0].0x0 since=75s v=(0 0) 00010000:00010000:0.0:1788201208.820522:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.820526:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d295e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.820544:0:13445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d8e8f697/0x9383f985bc4b3a87 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcb5c expref: 110 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.820553:0:13445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d8e8f697/0x9383f985bc4b3a87 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcb5c expref: 110 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.820564:0:13445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13445:1875064458163456:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201208.823135:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201208.823184:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458162816 00000100:00100000:1.0:1788201208.823193:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458162816 00000100:00100000:1.0:1788201208.823232:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3962 00000100:00100000:1.0:1788201208.823240:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+35:3310:x1875064458162816:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201208.823287:0:13445:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5840 going to sleep for 11 seconds 00002000:00080000:1.0:1788201208.823682:0:13443:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1004 count 1 00010000:00010000:1.0:1788201208.823707:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c474677/0x9383f985bc4d2965 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.823728:0:13443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2817481/0x9383f985bc4c838e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3cdd expref: 110 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.823737:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3ec:0x0].0x0 since=20s v=(0 0) 00010000:00010000:1.0:1788201208.823741:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.823745:0:13443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c474677/0x9383f985bc4d2965 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201208.823766:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c2200000/2, rc 0, transno 4294968726 00000100:00100000:3.0:1788201208.823784:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2200000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458160768:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788201208.823798:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f000e300/2, rc 0, transno 4294968740 00000100:00100000:3.0:1788201208.823809:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458160640:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788201208.823821:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c5285180/2, rc 0, transno 4294968738 00000100:00100000:3.0:1788201208.823825:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458159872:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788201208.823835:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c341b480/2, rc 0, transno 4294968720 00000100:00100000:3.0:1788201208.823839:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c341b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458159616:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788201208.823847:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c39c7b80/2, rc 0, transno 4294968735 00000100:00100000:3.0:1788201208.823850:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c39c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458158592:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788201208.823860:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c341aa00/2, rc 0, transno 4294968722 00000100:00100000:3.0:1788201208.823863:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c341aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458158464:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788201208.823875:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c12d2680/2, rc 0, transno 4294968725 00000100:00100000:3.0:1788201208.823878:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458156288:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201208.824118:0:13439:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f967ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201208.824260:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f4de9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458163840:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201208.824443:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788201208.824466:0:13443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f2817481/0x9383f985bc4c838e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3cdd expref: 110 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.824468:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201208.824473:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f4de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458163968:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788201208.824479:0:13443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f2817481/0x9383f985bc4c838e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3cdd expref: 110 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.824491:0:13443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3419880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13443:1875064458164096:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201208.824494:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201208.824521:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f4deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458163712:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201208.824522:0:13443:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201208.824542:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201208.824560:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3418700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458164352:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201208.824572:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c6630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458164480:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201208.824594:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201208.824624:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458163840 00000100:00100000:0.0:1788201208.824629:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458163840 00000100:00100000:3.0:1788201208.824801:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458163584:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201208.824827:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201208.824843:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458164224:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201208.824860:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201208.825407:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201208.826820:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3969 00000100:00100000:0.0:1788201208.826829:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3312:x1875064458163840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201208.826841:0:13438:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:648 count 1 00010000:00010000:0.0:1788201208.826853:0:13438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2996 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x288:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.826865:0:13438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000030d0c682/0x9383f985bc4b67f9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdb15 expref: 110 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.826872:0:13438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x288:0x0].0x0 since=66s v=(0 0) 00010000:00010000:0.0:1788201208.826875:0:13438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x288:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.826879:0:13438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2996 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.826898:0:13438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000030d0c682/0x9383f985bc4b67f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdb15 expref: 110 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.826907:0:13438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000030d0c682/0x9383f985bc4b67f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdb15 expref: 110 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.826923:0:13438:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cff38000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13438:1875064458165376:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201208.826948:0:13438:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201208.830498:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201208.830519:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201208.830541:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442584448 00000100:00100000:3.0:1788201208.830550:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442584448 00010000:00010000:3.0:1788201208.830585:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba5161b6/0x9383f985bc4b2caa lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc68c expref: 596 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.830616:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442584576 00000100:00100000:3.0:1788201208.830619:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442584576 00010000:00010000:3.0:1788201208.830633:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000083339579/0x9383f985bc4bc496 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfae9 expref: 111 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.830653:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1335 00000100:00100000:3.0:1788201208.830661:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+596:2362:x1875064442584448:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.830676:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.830681:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba5161b6/0x9383f985bc4b2caa lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x23e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc68c expref: 596 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.830693:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba5161b6/0x9383f985bc4b2caa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x23e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc68c expref: 596 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.830706:0:12363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c341a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12363:1875064458162432:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201208.830715:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.830719:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.830725:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2942 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.830731:0:12363:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d2949 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x33e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.830735:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2942 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.830751:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201208.830773:0:13448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d0820a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:13448:1875064458162048:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201208.830788:0:13448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2934 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.830808:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1336 00000100:00100000:1.0:1788201208.830815:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d80dd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+111:2362:x1875064442584576:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201208.830824:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201208.830829:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000083339579/0x9383f985bc4bc496 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfae9 expref: 111 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.830843:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000083339579/0x9383f985bc4bc496 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfae9 expref: 111 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.830869:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083339579/0x9383f985bc4bc496 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfae9 expref: 111 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.830920:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+596:2362:x1875064442584448:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 258us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.830928:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1335 00000100:00100000:3.0:1788201208.830988:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:1.0:1788201208.831054:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.831059:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.831063:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2934 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.831071:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2934 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.831089:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.831101:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201208.831117:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442584704 00000100:00100000:3.0:1788201208.831121:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442584704 00010000:00010000:3.0:1788201208.831135:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002b708452/0x9383f985bc4bf8ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x33e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0d0a expref: 596 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.831156:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442584320 00000100:00100000:3.0:1788201208.831159:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442584320 00010000:00010000:3.0:1788201208.831171:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fb1df1af/0x9383f985bc4b5584 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x271:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd48c expref: 597 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.831234:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1337 00000100:00100000:1.0:1788201208.831241:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d80dd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+110:2362:x1875064442584576:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 426us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.831241:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+597:2362:x1875064442584704:12345-192.168.201.30@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201208.831248:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1336 00010000:00010000:3.0:1788201208.831250:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.831254:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002b708452/0x9383f985bc4bf8ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x33e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0d0a expref: 597 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.831264:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002b708452/0x9383f985bc4bf8ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x33e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0d0a expref: 597 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.831277:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b708452/0x9383f985bc4bf8ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x33e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0d0a expref: 597 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.831432:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1338 00000100:00100000:1.0:1788201208.831440:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+596:2360:x1875064442584320:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201208.831448:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201208.831453:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fb1df1af/0x9383f985bc4b5584 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x271:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd48c expref: 596 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.831469:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fb1df1af/0x9383f985bc4b5584 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x271:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd48c expref: 596 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.831483:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x271:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.831483:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.831487:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x271:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.831487:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.831492:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d293b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x271:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.831492:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d2949 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.831502:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d293b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x271:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.831502:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d2949 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x33e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.831515:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201208.831519:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201208.831534:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+596:2360:x1875064442584320:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 95us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.831539:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+596:2362:x1875064442584704:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 298us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201208.831541:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1338 00000100:00100000:3.0:1788201208.831544:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1337 00010000:00010000:1.0:1788201208.831559:0:12363:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d2949 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.831568:0:12363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d2949 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.831976:0:12363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d2949 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.831987:0:12363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d2949 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.833116:0:13449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba5161b6/0x9383f985bc4b2caa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc68c expref: 593 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.833129:0:13449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d0823b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:13449:1875064458162304:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201208.833145:0:13449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2942 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.833154:0:13449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2942 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.833161:0:13449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2942 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.833170:0:13449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2942 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.833175:0:13449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2942 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.835159:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788201208.835170:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d293b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.835183:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201208.835188:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d293b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.835199:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d293b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.835217:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d293b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.835231:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d293b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.835252:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201208.835255:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d2949 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.835261:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201208.835265:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d2949 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.835273:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d2949 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.835282:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d2949 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.835288:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201208.835315:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2942 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.835322:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201208.835325:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2942 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.835397:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2942 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.835408:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2942 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.835417:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201208.835418:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201208.835420:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201208.836120:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201208.836127:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2934 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.836134:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201208.836138:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2934 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.836145:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2934 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.836158:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2934 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.836166:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2934 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.836185:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201208.836187:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201208.836189:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201208.837264:0:12363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788201208.837477:0:12363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d2949 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.837728:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f965c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3313:x1875064458162176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20236us (20305us total) trans 4294968742 rc 0/0 00000100:00100000:1.0:1788201208.837736:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3958 00010000:00010000:0.0:1788201208.837892:0:13449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788201208.837899:0:13449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2942 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.837975:0:13444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d1f0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13444:1875064458163328:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201208.838009:0:13444:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2957 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x330:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.838035:0:13445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d1f0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13445:1875064458163456:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201208.838046:0:13445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d295e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.838187:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+45:3310:x1875064458161792:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21020us (22402us total) trans 4294968743 rc 0/0 00000100:00100000:0.0:1788201208.838194:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3957 00000100:00100000:0.0:1788201208.838435:0:13439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5028a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:13439:1875064458161536:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201208.838449:0:13439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d292d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.838575:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201208.839077:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458165760 00000100:00100000:3.0:1788201208.839084:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458165760 00000100:00100000:0.0:1788201208.839553:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458165888 00000100:00100000:0.0:1788201208.839558:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458165888 00000100:00100000:0.0:1788201208.839581:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458166016 00000100:00100000:0.0:1788201208.839583:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458166016 00000100:00100000:0.0:1788201208.839600:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3971 00000100:00100000:0.0:1788201208.839607:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+46:3311:x1875064458165760:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201208.839630:0:6703:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:724 count 1 00010000:00010000:0.0:1788201208.839650:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d29a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2d4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.839672:0:6703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000063b7cfcf/0x9383f985bc4ba46e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1befcf expref: 592 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.839680:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d4:0x0].0x0 since=55s v=(0 0) 00010000:00010000:0.0:1788201208.839685:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.839690:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d29a4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.839715:0:6703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000063b7cfcf/0x9383f985bc4ba46e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1befcf expref: 592 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.839727:0:6703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000063b7cfcf/0x9383f985bc4ba46e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1befcf expref: 592 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.839740:0:6703:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cff3b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6703:1875064458166144:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201208.839794:0:6703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201208.839810:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3972 00000100:00100000:0.0:1788201208.839817:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+40:3311:x1875064458165888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201208.839831:0:13449:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:733 count 1 00010000:00010000:0.0:1788201208.839845:0:13449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d29ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.839857:0:13449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3e87af9/0x9383f985bc4babfa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf284 expref: 109 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.839870:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2dd:0x0].0x0 since=54s v=(0 0) 00010000:00010000:0.0:1788201208.839873:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.839876:0:13449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d29ab lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.839896:0:13449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b3e87af9/0x9383f985bc4babfa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf284 expref: 109 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.839906:0:13449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b3e87af9/0x9383f985bc4babfa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf284 expref: 109 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.839918:0:13449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cff3bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:13449:1875064458166272:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201208.839943:0:13449:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201208.839960:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3973 00000100:00100000:0.0:1788201208.840090:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+46:3312:x1875064458166016:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201208.840103:0:13450:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:940 count 1 00010000:00010000:0.0:1788201208.840115:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d29b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ac:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.840127:0:13450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e5ddd3c6/0x9383f985bc4c505e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2b3a expref: 592 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.840134:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3ac:0x0].0x0 since=28s v=(0 0) 00010000:00010000:0.0:1788201208.840137:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.840142:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d29b2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.840158:0:13450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e5ddd3c6/0x9383f985bc4c505e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2b3a expref: 592 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.840168:0:13450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e5ddd3c6/0x9383f985bc4c505e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2b3a expref: 592 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.840179:0:13450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cff39500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:13450:1875064458166400:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201208.840201:0:13450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201208.841455:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.841480:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.841540:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201208.841705:0:13438:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cff38000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13438:1875064458165376:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201208.841718:0:13438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2996 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.841738:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442584832 00000100:00100000:0.0:1788201208.841743:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442584832 00010000:00010000:0.0:1788201208.841770:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b6ead4eb/0x9383f985bc4c89bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3f4c expref: 593 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.841802:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442585088 00000100:00100000:0.0:1788201208.841805:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442585088 00000100:00100000:1.0:1788201208.841843:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:0.0:1788201208.842248:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d8e8f697/0x9383f985bc4b3a87 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcb5c expref: 110 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.842323:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442584960 00000100:00100000:0.0:1788201208.842328:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442584960 00000100:00100000:1.0:1788201208.842380:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:0.0:1788201208.842418:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002db26b92/0x9383f985bc4bee18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x330:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0952 expref: 111 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.845511:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442585344 00000100:00100000:3.0:1788201208.845525:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442585344 00000100:00100000:1.0:1788201208.845531:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.845546:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.845557:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.845568:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1788201208.845646:0:7646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f2817481/0x9383f985bc4c838e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3cdd expref: 112 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.845672:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442585600 00000100:00100000:3.0:1788201208.845676:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442585600 00010000:00010000:3.0:1788201208.845688:0:7646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006c6baf44/0x9383f985bc4c1380 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x35f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c162c expref: 113 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.845700:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442585856 00000100:00100000:3.0:1788201208.845701:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442585856 00010000:00010000:3.0:1788201208.845712:0:7646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000f203e70/0x9383f985bc4b5a70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x277:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd661 expref: 114 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.845721:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442586112 00000100:00100000:3.0:1788201208.845723:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442586112 00010000:00010000:3.0:1788201208.845732:0:7646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000030d0c682/0x9383f985bc4b67f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdb15 expref: 115 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.845742:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442585216 00000100:00100000:3.0:1788201208.845744:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442585216 00010000:00010000:3.0:1788201208.845755:0:7646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005fc17117/0x9383f985bc4b5323 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x26e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd3c1 expref: 594 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.845766:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442585472 00000100:00100000:3.0:1788201208.845769:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442585472 00010000:00010000:3.0:1788201208.845780:0:7646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000067a0031/0x9383f985bc4bb28a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf4b4 expref: 116 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.845796:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1339 00000100:00100000:3.0:1788201208.845805:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d0823b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+594:2362:x1875064442584832:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.845820:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.845827:0:7646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b6ead4eb/0x9383f985bc4c89bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3f4c expref: 594 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.845841:0:7646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b6ead4eb/0x9383f985bc4c89bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3f4c expref: 594 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.845862:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6ead4eb/0x9383f985bc4c89bc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3f4c expref: 594 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.845888:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.845893:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.845899:0:7646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d2950 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.845910:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d2950 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.845922:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1788201208.845944:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201208.845946:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201208.846162:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d0823b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+593:2362:x1875064442584832:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 356us (4710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.846170:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1339 00000100:00100000:3.0:1788201208.846188:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442585728 00000100:00100000:3.0:1788201208.846190:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442585728 00010000:00010000:3.0:1788201208.846203:0:7646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000074512ef5/0x9383f985bc4c000f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x347:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0f80 expref: 593 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.846214:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442585984 00000100:00100000:3.0:1788201208.846216:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442585984 00010000:00010000:3.0:1788201208.846228:0:7646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000073122894/0x9383f985bc4bbaa9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf79a expref: 594 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.846240:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1340 00000100:00100000:3.0:1788201208.846246:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d0820a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+116:2362:x1875064442585088:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.846254:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.846259:0:7646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d8e8f697/0x9383f985bc4b3a87 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcb5c expref: 116 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.846269:0:7646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d8e8f697/0x9383f985bc4b3a87 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcb5c expref: 116 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.846284:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8e8f697/0x9383f985bc4b3a87 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcb5c expref: 116 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.846335:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.846339:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.846344:0:7646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d295e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.846352:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d295e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.846369:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.846387:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d0820a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+115:2362:x1875064442585088:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 141us (4907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.846393:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1340 00000100:00100000:3.0:1788201208.846407:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1341 00000100:00100000:3.0:1788201208.846413:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3418e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+114:2362:x1875064442584960:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.846421:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.846426:0:7646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002db26b92/0x9383f985bc4bee18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x330:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0952 expref: 114 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.846436:0:7646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002db26b92/0x9383f985bc4bee18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x330:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0952 expref: 114 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.846449:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002db26b92/0x9383f985bc4bee18 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x330:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0952 expref: 114 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.846466:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x330:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.846470:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x330:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.846474:0:7646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2957 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x330:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.846481:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2957 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x330:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.846497:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.846516:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3418e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+113:2362:x1875064442584960:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 102us (4975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.846523:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1341 00000100:00100000:0.0:1788201208.846747:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1342 00000100:00100000:0.0:1788201208.846758:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3419500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+113:2362:x1875064442585344:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201208.846767:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788201208.847173:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.847207:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:0.0:1788201208.847238:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f2817481/0x9383f985bc4c838e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3cdd expref: 113 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.847250:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f2817481/0x9383f985bc4c838e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3cdd expref: 112 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.847264:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.847267:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.847271:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009c474677/0x9383f985bc4d2965 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.847279:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c474677/0x9383f985bc4d2965 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.848097:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201208.848123:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3419500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+112:2362:x1875064442585344:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1368us (6283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201208.848131:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1342 00000100:00100000:0.0:1788201208.848146:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442586240 00000100:00100000:0.0:1788201208.848152:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442586240 00010000:00010000:0.0:1788201208.848169:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000002359bf1/0x9383f985bc4c683d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3391 expref: 595 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.848181:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442586368 00000100:00100000:0.0:1788201208.848183:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442586368 00010000:00010000:0.0:1788201208.848192:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000944dd46b/0x9383f985bc4b17d4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bbf38 expref: 596 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.848203:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1344 00000100:00100000:0.0:1788201208.848209:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3418380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+111:2362:x1875064442585856:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201208.848216:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201208.848222:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000f203e70/0x9383f985bc4b5a70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x277:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd661 expref: 111 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.848231:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000f203e70/0x9383f985bc4b5a70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x277:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd661 expref: 111 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.848245:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f203e70/0x9383f985bc4b5a70 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x277:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd661 expref: 111 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.848256:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x277:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.848259:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x277:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.848264:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007be97ade/0x9383f985bc4d2981 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x277:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.848272:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007be97ade/0x9383f985bc4d2981 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x277:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.848317:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.848490:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1345 00000100:00100000:3.0:1788201208.848498:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c341b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+109:2362:x1875064442586112:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.848506:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.848511:0:7646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000030d0c682/0x9383f985bc4b67f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x288:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdb15 expref: 109 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.848563:0:7646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000030d0c682/0x9383f985bc4b67f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x288:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdb15 expref: 109 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.848575:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030d0c682/0x9383f985bc4b67f9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x288:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdb15 expref: 109 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.848592:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x288:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.848595:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x288:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.848599:0:7646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2996 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.848606:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2996 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.848639:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.848660:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c341b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+108:2362:x1875064442586112:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 163us (3112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.848666:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1345 00000100:00100000:3.0:1788201208.848679:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1346 00000100:00100000:3.0:1788201208.848685:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c341a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+596:2362:x1875064442585216:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.848693:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.848698:0:7646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005fc17117/0x9383f985bc4b5323 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x26e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd3c1 expref: 596 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.848709:0:7646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005fc17117/0x9383f985bc4b5323 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x26e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd3c1 expref: 596 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.848722:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc17117/0x9383f985bc4b5323 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x26e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd3c1 expref: 596 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.848737:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.848740:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.848744:0:7646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d292d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.848752:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d292d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x26e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.848768:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.848787:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c341a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+595:2362:x1875064442585216:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 101us (3227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.848793:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1346 00000100:00100000:3.0:1788201208.848807:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1347 00000100:00100000:3.0:1788201208.848814:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3419f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+107:2362:x1875064442585472:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.848821:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.848826:0:7646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000067a0031/0x9383f985bc4bb28a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf4b4 expref: 107 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.848835:0:7646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000067a0031/0x9383f985bc4bb28a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf4b4 expref: 107 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.848847:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000067a0031/0x9383f985bc4bb28a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf4b4 expref: 107 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.848864:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.848867:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.848871:0:7646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004525f602/0x9383f985bc4d296c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.848878:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004525f602/0x9383f985bc4d296c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.848896:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.848914:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3419f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+106:2362:x1875064442585472:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 101us (3345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.848921:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1347 00000100:00100000:3.0:1788201208.848935:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1348 00000100:00100000:3.0:1788201208.848942:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c341a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+594:2362:x1875064442585728:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.848950:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.848955:0:7646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000074512ef5/0x9383f985bc4c000f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x347:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0f80 expref: 594 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.848977:0:7646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000074512ef5/0x9383f985bc4c000f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x347:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0f80 expref: 594 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.849050:0:13441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007be97ade/0x9383f985bc4d2981 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.849060:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007be97ade/0x9383f985bc4d2981 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.849070:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007be97ade/0x9383f985bc4d2981 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.849077:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007be97ade/0x9383f985bc4d2981 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.849091:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201208.849247:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3310:x1875064458163584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23045us (24419us total) trans 4294968730 rc 0/0 00000100:00100000:0.0:1788201208.849254:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3966 00010000:00010000:0.0:1788201208.849275:0:13438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2996 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.849283:0:13438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2996 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.849290:0:13438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2996 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.849324:0:13438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2996 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.849748:0:13438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201208.850076:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074512ef5/0x9383f985bc4c000f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x347:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0f80 expref: 594 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.850092:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x347:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.850095:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x347:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.850100:0:7646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d297a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x347:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.850108:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d297a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x347:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.850127:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.850153:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c341a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+593:2362:x1875064442585728:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1212us (4574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.850160:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1348 00000100:00100000:3.0:1788201208.850179:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1349 00000100:00100000:3.0:1788201208.850187:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5381500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+592:2362:x1875064442585984:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.850197:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.850203:0:7646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000073122894/0x9383f985bc4bbaa9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf79a expref: 592 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.850214:0:7646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000073122894/0x9383f985bc4bbaa9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf79a expref: 592 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.850226:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073122894/0x9383f985bc4bbaa9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf79a expref: 592 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.850241:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.850245:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.850249:0:7646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d2988 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.850257:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d2988 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.850274:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.850319:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5381500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+591:2362:x1875064442585984:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 108us (4348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.850325:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1349 00000100:00100000:0.0:1788201208.850947:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3312:x1875064458163840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24118us (26615us total) trans 4294968731 rc 0/0 00000100:00100000:0.0:1788201208.850955:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3969 00010000:00010000:0.0:1788201208.851449:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201208.851456:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2996 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.851464:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.851468:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2996 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.851478:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2996 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.851493:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2996 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.851501:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2996 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.851517:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201208.851521:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004525f602/0x9383f985bc4d296c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.851527:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507dc00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.851531:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004525f602/0x9383f985bc4d296c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.851538:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004525f602/0x9383f985bc4d296c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.851546:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004525f602/0x9383f985bc4d296c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.851553:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004525f602/0x9383f985bc4d296c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.851564:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.851566:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.851567:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.851578:0:13444:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2957 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.851586:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2957 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.851595:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2957 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.851608:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2957 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.851623:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201208.851749:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d1f0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3312:x1875064458162944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 32104us (32229us total) trans 4294968733 rc 0/0 00000100:00100000:0.0:1788201208.851755:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3960 00010000:00010000:0.0:1788201208.851777:0:13445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d295e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.851786:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d295e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.851794:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d295e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.851801:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d295e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.851813:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788201208.851918:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d1f0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+41:3312:x1875064458163072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 31447us (32352us total) trans 4294968734 rc 0/0 00000100:00100000:0.0:1788201208.851925:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3961 00010000:00010000:0.0:1788201208.851941:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201208.851945:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2957 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.851952:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.851955:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2957 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.851977:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2957 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.853082:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2957 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.853089:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2957 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.853104:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.853106:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.853107:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201208.853139:0:6703:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cff3b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6703:1875064458166144:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201208.853154:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:0.0:1788201208.853160:0:6703:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d29a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.853177:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201208.853200:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3418380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+105:2362:x1875064442585856:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 4990us (7671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201208.853202:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201208.853209:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1344 00000100:00100000:0.0:1788201208.853227:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442586624 00000100:00100000:0.0:1788201208.853234:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442586624 00010000:00010000:0.0:1788201208.853256:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b3e87af9/0x9383f985bc4babfa lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf284 expref: 105 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.853273:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442586496 00000100:00100000:0.0:1788201208.853275:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442586496 00010000:00010000:0.0:1788201208.853286:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000063b7cfcf/0x9383f985bc4ba46e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1befcf expref: 592 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.853327:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442586752 00000100:00100000:0.0:1788201208.853498:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442586752 00010000:00010000:0.0:1788201208.853513:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e5ddd3c6/0x9383f985bc4c505e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2b3a expref: 593 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.853521:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2817481/0x9383f985bc4c838e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3cdd expref: 105 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.853529:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1350 00000100:00100000:0.0:1788201208.853537:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d89e8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+593:2361:x1875064442586240:12345-192.168.201.30@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201208.853538:0:13443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3419880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13443:1875064458164096:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201208.853549:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201208.853553:0:13443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009c474677/0x9383f985bc4d2965 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.853555:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000002359bf1/0x9383f985bc4c683d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3391 expref: 593 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.853562:0:13443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009c474677/0x9383f985bc4d2965 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.853567:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000002359bf1/0x9383f985bc4c683d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3391 expref: 593 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.853570:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c474677/0x9383f985bc4d2965 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.853584:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002359bf1/0x9383f985bc4c683d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3391 expref: 593 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.853590:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c474677/0x9383f985bc4d2965 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.853596:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.853597:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c474677/0x9383f985bc4d2965 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.853601:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.853606:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d298f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.853612:0:13443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201208.853615:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d298f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.853634:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201208.853660:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d89e8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+592:2361:x1875064442586240:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 123us (6485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201208.853666:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1350 00000100:00100000:0.0:1788201208.853681:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1351 00000100:00100000:0.0:1788201208.853689:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5381f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+591:2362:x1875064442586368:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201208.853696:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201208.853701:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000944dd46b/0x9383f985bc4b17d4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bbf38 expref: 591 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.853711:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000944dd46b/0x9383f985bc4b17d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bbf38 expref: 591 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.853723:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x224:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.853726:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x224:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.853730:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d299d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.853737:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d299d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.853747:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201208.853929:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5381f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+591:2362:x1875064442586368:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 239us (6719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201208.853936:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1351 00000100:00100000:1.0:1788201208.853947:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3310:x1875064458162816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 30707us (30816us total) trans 4294968735 rc 0/0 00000100:00100000:0.0:1788201208.853950:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1352 00000100:00100000:1.0:1788201208.853954:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3962 00000100:00100000:0.0:1788201208.853957:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5383b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+104:2362:x1875064442586624:12345-192.168.201.30@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788201208.853976:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1353 00010000:00010000:0.0:1788201208.853978:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788201208.853984:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5383480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+590:2362:x1875064442586496:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201208.854000:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201208.854007:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000063b7cfcf/0x9383f985bc4ba46e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1befcf expref: 590 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.854017:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000063b7cfcf/0x9383f985bc4ba46e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1befcf expref: 590 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.854030:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063b7cfcf/0x9383f985bc4ba46e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1befcf expref: 590 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.854040:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.854044:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.854048:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d29a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.854055:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b3e87af9/0x9383f985bc4babfa lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf284 expref: 104 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.854056:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d29a4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.854066:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b3e87af9/0x9383f985bc4babfa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf284 expref: 104 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.854081:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.854081:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201208.854084:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.854088:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d29ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.854096:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d29ab lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.854098:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5383480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+589:2362:x1875064442586496:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 116us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201208.854105:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1353 00010000:00010000:0.0:1788201208.854111:0:6703:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d29a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.854118:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1354 00010000:00010000:0.0:1788201208.854123:0:6703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d29a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.854125:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0085180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+588:2362:x1875064442586752:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201208.854132:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d29a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.854132:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201208.854136:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e5ddd3c6/0x9383f985bc4c505e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2b3a expref: 588 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.854140:0:6703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d29a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.854152:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e5ddd3c6/0x9383f985bc4c505e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2b3a expref: 588 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.854153:0:6703:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201208.854163:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.854166:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.854170:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d29b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.854177:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d29b2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.854189:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201208.854206:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0085180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+588:2362:x1875064442586752:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 81us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201208.854211:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1354 00000100:00100000:0.0:1788201208.854641:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+47:3311:x1875064458165760:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15033us (15945us total) trans 4294968746 rc 0/0 00000100:00100000:0.0:1788201208.854649:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3971 00010000:00010000:0.0:1788201208.854666:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201208.854671:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d29a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.854678:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.854681:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d29a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.854689:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d29a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.854700:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d29a4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.854707:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d29a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.854720:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.854722:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.854723:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201208.854724:0:13449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3e87af9/0x9383f985bc4babfa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf284 expref: 104 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.854732:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201208.854735:0:13449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cff3bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:13449:1875064458166272:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201208.854750:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5383b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+103:2362:x1875064442586624:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 793us (1595us total) trans 0 rc 0/0 00010000:00010000:1.0:1788201208.854751:0:13449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d29ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.854757:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1352 00010000:00010000:1.0:1788201208.854771:0:13449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d29ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.854784:0:13449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d29ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.854788:0:13450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5ddd3c6/0x9383f985bc4c505e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2b3a expref: 587 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.854794:0:13449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d29ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.854798:0:13450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cff39500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:13450:1875064458166400:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201208.854802:0:13449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d29ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.854809:0:13450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d29b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.854816:0:13450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d29b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.854820:0:13449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201208.854825:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d29b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.854832:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d29b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.854839:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d29b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.854849:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201208.854852:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d29ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.854858:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.854861:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d29ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.854868:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d29ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.854879:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d29ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.854886:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d29ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.854899:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.854901:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.854903:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.854912:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201208.854919:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201208.854922:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d29b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.854930:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.854933:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d29b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.854940:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d29b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.854949:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d29b2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.854955:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d29b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.856136:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201208.856142:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d298f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.856150:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.856153:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d298f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.856161:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d298f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.856176:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d298f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.856189:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d298f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.856203:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.856205:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.856206:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201208.856271:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cff38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458167040:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788201208.857425:0:13442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944dd46b/0x9383f985bc4b17d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bbf38 expref: 585 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.857441:0:13442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5420a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:13442:1875064458165632:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201208.857466:0:13442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d299d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.857476:0:13442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d299d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.857486:0:13442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d299d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.857506:0:13442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d299d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.857514:0:13442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d299d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.857535:0:13442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788201208.859252:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+41:3311:x1875064458165888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19434us (20460us total) trans 4294968736 rc 0/0 00000100:00100000:1.0:1788201208.859263:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3972 00000100:00100000:0.0:1788201208.860119:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201208.860157:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458167040 00000100:00100000:0.0:1788201208.860161:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458167040 00000100:00100000:0.0:1788201208.860183:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3977 00000100:00100000:0.0:1788201208.860189:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3312:x1875064458167040:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201208.860200:0:13438:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:785 count 1 00010000:00010000:0.0:1788201208.860211:0:13438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d29ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x311:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.860223:0:13438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000094a77bce/0x9383f985bc4bd528 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x311:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c00a0 expref: 102 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.860231:0:13438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x311:0x0].0x0 since=47s v=(0 0) 00010000:00010000:0.0:1788201208.860234:0:13438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x311:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.860237:0:13438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d29ce lrc: 4/0,1 mode: --/PW res: [0x280000400:0x311:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.860255:0:13438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000094a77bce/0x9383f985bc4bd528 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x311:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c00a0 expref: 102 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.860264:0:13438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000094a77bce/0x9383f985bc4bd528 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x311:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c00a0 expref: 102 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.860273:0:13438:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cff39180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13438:1875064458167552:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201208.860438:0:13438:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5a80 going to sleep for 11 seconds 00010000:00010000:0.0:1788201208.860453:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201208.860659:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+49:3312:x1875064458166016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20571us (21439us total) trans 4294968749 rc 0/0 00000100:00100000:0.0:1788201208.860666:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3973 00010000:00010000:1.0:1788201208.860681:0:13439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d292d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.860691:0:13439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d292d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201208.860696:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c12d2d80/2, rc 0, transno 4294968749 00010000:00010000:1.0:1788201208.860699:0:13439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d292d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.860706:0:13439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d292d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.860707:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458166016:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788201208.860727:0:13439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788201208.861593:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d0823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+49:3313:x1875064458161408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 54435us (55476us total) trans 4294968750 rc 0/0 00000100:00100000:1.0:1788201208.861600:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3954 00000100:00100000:1.0:1788201208.861703:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458167936 00000100:00100000:1.0:1788201208.861707:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458167936 00000100:00100000:3.0:1788201208.862397:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c502bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3312:x1875064458165504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29642us (29712us total) trans 4294968748 rc 0/0 00000100:00100000:3.0:1788201208.862405:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3970 00000100:00100000:0.0:1788201208.863155:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458168064 00000100:00100000:0.0:1788201208.863162:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458168064 00000100:00100000:0.0:1788201208.863195:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3978 00000100:00100000:0.0:1788201208.863203:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+49:3313:x1875064458167936:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201208.863228:0:13445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:937 count 1 00010000:00010000:0.0:1788201208.863248:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058fbae95/0x9383f985bc4d29d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.863267:0:13445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002f2e72ba/0x9383f985bc4c4de8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2a68 expref: 584 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.863283:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a9:0x0].0x0 since=29s v=(0 0) 00010000:00010000:0.0:1788201208.863287:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.863314:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058fbae95/0x9383f985bc4d29d5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.863406:0:13445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002f2e72ba/0x9383f985bc4c4de8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2a68 expref: 584 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.863419:0:13445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002f2e72ba/0x9383f985bc4c4de8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2a68 expref: 584 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.863431:0:13445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cff3b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13445:1875064458168192:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201208.863472:0:13445:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201208.863488:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3979 00000100:00100000:0.0:1788201208.863495:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+49:3313:x1875064458168064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201208.863506:0:13443:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:659 count 1 00010000:00010000:0.0:1788201208.863518:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092295f0a/0x9383f985bc4d29dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x293:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.863529:0:13443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006c5666e3/0x9383f985bc4b7096 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x293:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bddf4 expref: 584 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.863536:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x293:0x0].0x0 since=64s v=(0 0) 00010000:00010000:0.0:1788201208.863539:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x293:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.863544:0:13443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092295f0a/0x9383f985bc4d29dc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x293:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.863560:0:13443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006c5666e3/0x9383f985bc4b7096 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x293:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bddf4 expref: 584 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.863569:0:13443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006c5666e3/0x9383f985bc4b7096 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x293:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bddf4 expref: 584 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.863579:0:13443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cff38380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13443:1875064458168320:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201208.863597:0:13443:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5e40 going to sleep for 11 seconds 00000004:00080000:0.0:1788201208.863624:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c20bd500/2, rc 0, transno 4294968748 00000100:00100000:0.0:1788201208.863633:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c20bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458165504:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788201208.866180:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d2950 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.866198:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d2950 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.866210:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d2950 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.866219:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d2950 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.866252:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201208.866809:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+50:3310:x1875064458162688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 47656us (47731us total) trans 4294968751 rc 0/0 00000100:00100000:3.0:1788201208.866824:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3959 00000100:00100000:3.0:1788201208.866999:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d89eb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:2362:x1875064442585600:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 19835us (24609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.867007:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1343 00000100:00100000:3.0:1788201208.867434:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cff3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458166912:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201208.867471:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201208.867497:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cff39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458167808:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201208.867518:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788201208.867562:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04cff38a80/2, rc 0, transno 4294968736 00000100:00100000:3.0:1788201208.867573:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cff38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458165888:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788201208.867662:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c5421f80/2, rc 0, transno 4294968746 00000100:00100000:3.0:1788201208.867672:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458165760:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788201208.867685:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c3418700/2, rc 0, transno 4294968747 00000100:00100000:3.0:1788201208.867688:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3418700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458164352:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788201208.867697:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f4deb800/2, rc 0, transno 4294968729 00000100:00100000:3.0:1788201208.867700:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f4deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458163712:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201208.867711:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788201208.867716:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cff3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458167680:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201208.867738:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201208.867814:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cff3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458168448:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201208.867835:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201208.868009:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458166912 00000100:00100000:1.0:1788201208.868016:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458166912 00000100:00100000:1.0:1788201208.868054:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458167808 00000100:00100000:1.0:1788201208.868057:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458167808 00000100:00100000:1.0:1788201208.868076:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458167680 00000100:00100000:1.0:1788201208.868079:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458167680 00000100:00100000:1.0:1788201208.868092:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458168448 00000100:00100000:1.0:1788201208.868094:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458168448 00000100:00100000:1.0:1788201208.868108:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3980 00000100:00100000:1.0:1788201208.868116:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+45:3311:x1875064458166912:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788201208.868141:0:13449:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:918 count 1 00010000:00010000:1.0:1788201208.868162:0:13449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d29e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.868181:0:13449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c75f1e32/0x9383f985bc4c3f39 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2552 expref: 101 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.868190:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x396:0x0].0x0 since=31s v=(0 0) 00010000:00010000:1.0:1788201208.868194:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x396:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.868199:0:13449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d29e3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.868233:0:13449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c75f1e32/0x9383f985bc4c3f39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2552 expref: 101 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.868246:0:13449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c75f1e32/0x9383f985bc4c3f39 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2552 expref: 101 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.868415:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3981 00000100:00100000:3.0:1788201208.868425:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+45:3311:x1875064458167808:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788201208.868438:0:13447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:962 count 1 00010000:00010000:3.0:1788201208.868449:0:13447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d29ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3c2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.868461:0:13447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001fa8fdf0/0x9383f985bc4c626a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c316f expref: 101 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.868468:0:13447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c2:0x0].0x0 since=25s v=(0 0) 00010000:00010000:3.0:1788201208.868472:0:13447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.868475:0:13447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d29ea lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.868491:0:13447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001fa8fdf0/0x9383f985bc4c626a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c316f expref: 101 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.868500:0:13447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001fa8fdf0/0x9383f985bc4c626a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c316f expref: 101 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.868512:0:13447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:13447:1875064458168704:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201208.868556:0:13447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8140540 going to sleep for 11 seconds 00000100:00100000:3.0:1788201208.868570:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3982 00000100:00100000:3.0:1788201208.868639:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+51:3311:x1875064458167680:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201208.868653:0:13448:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:854 count 1 00010000:00010000:3.0:1788201208.868669:0:13448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080c7e6b2/0x9383f985bc4d29f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.868686:0:13448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e7419518/0x9383f985bc4c0bdf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c13a1 expref: 584 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.868694:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x356:0x0].0x0 since=38s v=(0 0) 00010000:00010000:3.0:1788201208.868697:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x356:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.868701:0:13448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080c7e6b2/0x9383f985bc4d29f1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.868718:0:13448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e7419518/0x9383f985bc4c0bdf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c13a1 expref: 584 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.868726:0:13448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e7419518/0x9383f985bc4c0bdf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c13a1 expref: 584 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.868737:0:13448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:13448:1875064458168832:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201208.868839:0:13449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0085c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:13449:1875064458168576:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201208.868966:0:13448:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d81400c0 going to sleep for 11 seconds 00000004:00080000:3.0:1788201208.869002:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04d0823100/2, rc 0, transno 4294968735 00000100:00100000:3.0:1788201208.869007:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d0823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458162816:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788201208.869020:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c341ad80/2, rc 0, transno 4294968751 00000100:00100000:3.0:1788201208.869024:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c341ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458162688:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201208.869089:0:13449:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341d300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201208.869105:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3983 00000100:00100000:1.0:1788201208.869113:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+51:3311:x1875064458168448:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201208.869127:0:13439:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:626 count 1 00010000:00010000:1.0:1788201208.869140:0:13439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000456a114c/0x9383f985bc4d29f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x272:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.869151:0:13439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d8cf57d/0x9383f985bc4b562c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x272:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd4c4 expref: 584 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.869159:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x272:0x0].0x0 since=70s v=(0 0) 00010000:00010000:1.0:1788201208.869162:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x272:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.869165:0:13439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000456a114c/0x9383f985bc4d29f8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x272:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.869183:0:13439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008d8cf57d/0x9383f985bc4b562c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x272:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd4c4 expref: 584 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.869199:0:13439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008d8cf57d/0x9383f985bc4b562c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x272:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd4c4 expref: 584 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.869209:0:13439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0087100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:13439:1875064458168960:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201208.869234:0:13439:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201208.904680:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.904710:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.904736:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442586880 00000100:00100000:1.0:1788201208.904744:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442586880 00010000:00010000:1.0:1788201208.904788:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cb29e7bc/0x9383f985bc4be31a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0577 expref: 102 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.904820:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442587008 00000100:00100000:1.0:1788201208.904823:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442587008 00010000:00010000:1.0:1788201208.904837:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000094a77bce/0x9383f985bc4bd528 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x311:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c00a0 expref: 103 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.904862:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1355 00000100:00100000:1.0:1788201208.904871:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0085500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+103:2360:x1875064442586880:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201208.904887:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201208.904893:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cb29e7bc/0x9383f985bc4be31a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0577 expref: 103 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.904906:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cb29e7bc/0x9383f985bc4be31a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0577 expref: 103 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.904931:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x322:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.904936:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x322:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.904942:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d29c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.904952:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d29c0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.905239:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1356 00000100:00100000:3.0:1788201208.905250:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0084700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+103:2360:x1875064442587008:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.905259:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.905265:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000094a77bce/0x9383f985bc4bd528 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x311:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c00a0 expref: 103 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.905276:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000094a77bce/0x9383f985bc4bd528 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x311:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c00a0 expref: 103 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.905289:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x311:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.905330:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x311:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.905335:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d29ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x311:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.905343:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d29ce lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x311:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.905360:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.905410:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0084700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+103:2360:x1875064442587008:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 162us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.905417:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1356 00010000:00010000:0.0:1788201208.905957:0:13438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094a77bce/0x9383f985bc4bd528 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x311:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c00a0 expref: 101 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.905970:0:13438:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cff39180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13438:1875064458167552:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201208.906055:0:13438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d29ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.906066:0:13438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d29ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.906073:0:13438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d29ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.906090:0:13438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d29ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.906106:0:13438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d29ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.906130:0:13438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201208.906590:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3312:x1875064458167040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 46400us (46470us total) trans 4294968737 rc 0/0 00000100:00100000:0.0:1788201208.906599:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3977 00000004:00080000:0.0:1788201208.906641:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04cff38000/2, rc 0, transno 4294968737 00000100:00100000:0.0:1788201208.906653:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cff38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458167040:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201208.906715:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201208.906726:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cff39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458170624:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201208.906756:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201208.906800:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458170624 00000100:00100000:0.0:1788201208.906806:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458170624 00000100:00100000:0.0:1788201208.906836:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3990 00000100:00100000:0.0:1788201208.906843:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+49:3312:x1875064458170624:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201208.906865:0:13450:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:777 count 1 00010000:00010000:0.0:1788201208.906885:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffa13277/0x9383f985bc4d2a29 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x309:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.906900:0:13450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b16393c6/0x9383f985bc4bcf16 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x309:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfe9a expref: 100 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.906914:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x309:0x0].0x0 since=48s v=(0 0) 00010000:00010000:0.0:1788201208.906918:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x309:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.906922:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffa13277/0x9383f985bc4d2a29 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x309:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.906945:0:13450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b16393c6/0x9383f985bc4bcf16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x309:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfe9a expref: 100 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.906956:0:13450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b16393c6/0x9383f985bc4bcf16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x309:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfe9a expref: 100 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.906968:0:13450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5029180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:13450:1875064458170752:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201208.907022:0:13450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201208.907098:0:6705:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6705:1875064458166656:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201208.907120:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b13647a1/0x9383f985bc4d29b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.907190:0:13449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0085c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:13449:1875064458168576:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201208.907205:0:13449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d29e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.907378:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201208.907396:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442587264 00000100:00100000:0.0:1788201208.907399:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442587264 00010000:00010000:0.0:1788201208.907415:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c75f1e32/0x9383f985bc4c3f39 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2552 expref: 101 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.907436:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1357 00000100:00100000:0.0:1788201208.907442:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d89ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:2359:x1875064442587264:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201208.907450:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201208.907455:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c75f1e32/0x9383f985bc4c3f39 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2552 expref: 101 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.907466:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c75f1e32/0x9383f985bc4c3f39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2552 expref: 101 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.907483:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c75f1e32/0x9383f985bc4c3f39 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2552 expref: 101 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.907494:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x396:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.907497:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x396:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.907502:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d29e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.907511:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d29e3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.907526:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201208.907547:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d89ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+100:2359:x1875064442587264:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 105us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201208.907555:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1357 00010000:00010000:0.0:1788201208.907574:0:13449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d29e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.907582:0:13449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d29e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.907590:0:13449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d29e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.907597:0:13449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d29e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.907608:0:13449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788201208.907765:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+50:3311:x1875064458166912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 39649us (40293us total) trans 4294968738 rc 0/0 00000100:00100000:0.0:1788201208.907772:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3980 00000004:00080000:0.0:1788201208.907803:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04cff3b800/2, rc 0, transno 4294968738 00000100:00100000:0.0:1788201208.907813:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cff3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458166912:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201208.907849:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201208.907858:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5028700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458170880:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201208.907883:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201208.907915:0:13439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0087100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:13439:1875064458168960:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201208.907930:0:13439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000456a114c/0x9383f985bc4d29f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x272:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.907968:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201208.907984:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442587520 00000100:00100000:0.0:1788201208.907987:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442587520 00010000:00010000:0.0:1788201208.908013:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000210bb178/0x9383f985bc4c8e3f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c40cd expref: 100 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.908032:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1358 00000100:00100000:0.0:1788201208.908038:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5029880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+100:2359:x1875064442587520:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201208.908046:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201208.908050:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000210bb178/0x9383f985bc4c8e3f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c40cd expref: 100 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.908060:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000210bb178/0x9383f985bc4c8e3f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c40cd expref: 100 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.908071:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.908074:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.908079:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e8bee2d2/0x9383f985bc4d29ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.908087:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8bee2d2/0x9383f985bc4d29ff lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.908097:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201208.908113:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5029880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+100:2359:x1875064442587520:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 75us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201208.908119:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1358 00000100:00100000:0.0:1788201208.908159:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201208.908179:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201208.908189:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442587776 00000100:00100000:0.0:1788201208.908191:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442587776 00010000:00010000:0.0:1788201208.908203:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c95eeb3c/0x9383f985bc4bb4ac lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf56a expref: 100 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.908216:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442587136 00000100:00100000:0.0:1788201208.908218:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442587136 00010000:00010000:0.0:1788201208.908228:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c5103a75/0x9383f985bc4c4758 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2838 expref: 585 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.908241:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1359 00000100:00100000:0.0:1788201208.908247:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5029f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+100:2359:x1875064442587776:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201208.908253:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201208.908257:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c95eeb3c/0x9383f985bc4bb4ac lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf56a expref: 100 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.908267:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c95eeb3c/0x9383f985bc4bb4ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf56a expref: 100 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.908279:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.908282:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.908286:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee9d20ef/0x9383f985bc4d29c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.908321:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee9d20ef/0x9383f985bc4d29c7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.908334:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201208.908353:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5029f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+100:2359:x1875064442587776:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 105us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201208.908359:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1359 00000100:00100000:0.0:1788201208.908373:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1360 00000100:00100000:0.0:1788201208.908379:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c502a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+585:2359:x1875064442587136:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201208.908386:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201208.908390:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c5103a75/0x9383f985bc4c4758 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2838 expref: 585 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.908402:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c5103a75/0x9383f985bc4c4758 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2838 expref: 585 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.908415:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5103a75/0x9383f985bc4c4758 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2838 expref: 585 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.908425:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.908427:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.908432:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b13647a1/0x9383f985bc4d29b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.908446:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b13647a1/0x9383f985bc4d29b9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.908460:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201208.908473:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c502a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+584:2359:x1875064442587136:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 95us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201208.908479:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1360 00010000:00010000:0.0:1788201208.908494:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b13647a1/0x9383f985bc4d29b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.908502:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b13647a1/0x9383f985bc4d29b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.908511:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b13647a1/0x9383f985bc4d29b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.908518:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b13647a1/0x9383f985bc4d29b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.908528:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1788201208.908679:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+55:3312:x1875064458166528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 52856us (53391us total) trans 4294968752 rc 0/0 00000100:00100000:0.0:1788201208.908686:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3974 00000100:00100000:0.0:1788201208.908700:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458170880 00000100:00100000:0.0:1788201208.908703:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458170880 00000100:00100000:0.0:1788201208.908719:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3991 00000100:00100000:0.0:1788201208.908724:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c502ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3311:x1875064458170880:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201208.908739:0:6705:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:705 count 1 00010000:00010000:0.0:1788201208.908752:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2a30 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.908764:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008fc9d9fd/0x9383f985bc4b9580 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1beaa4 expref: 99 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.908772:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c1:0x0].0x0 since=57s v=(0 0) 00010000:00010000:0.0:1788201208.908774:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.908778:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2a30 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.908798:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008fc9d9fd/0x9383f985bc4b9580 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1beaa4 expref: 99 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.908809:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008fc9d9fd/0x9383f985bc4b9580 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1beaa4 expref: 99 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.908820:0:6705:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c502b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1875064458171008:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201208.908852:0:6705:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5540 going to sleep for 11 seconds 00000004:00080000:0.0:1788201208.908879:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c12d0700/2, rc 0, transno 4294968752 00000100:00100000:0.0:1788201208.908888:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458166528:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201208.908927:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201208.908941:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442587392 00000100:00100000:0.0:1788201208.908944:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442587392 00010000:00010000:0.0:1788201208.908957:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008d8cf57d/0x9383f985bc4b562c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x272:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd4c4 expref: 584 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.908973:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1361 00000100:00100000:0.0:1788201208.908979:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5028a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+584:2359:x1875064442587392:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201208.908985:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201208.909055:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201208.909075:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0085500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+99:2360:x1875064442586880:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 4205us (4405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201208.909082:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1355 00000100:00100000:1.0:1788201208.909133:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.909149:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.909210:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.909223:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.909274:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442587648 00000100:00100000:1.0:1788201208.909278:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442587648 00010000:00010000:1.0:1788201208.909310:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef9137e5/0x9383f985bc4b1de6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc16f expref: 99 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.909324:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442587904 00000100:00100000:1.0:1788201208.909327:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442587904 00010000:00010000:1.0:1788201208.909340:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000afd5ac78/0x9383f985bc4c7143 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3693 expref: 585 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.909358:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442588160 00000100:00100000:1.0:1788201208.909361:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442588160 00010000:00010000:1.0:1788201208.909372:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006c5666e3/0x9383f985bc4b7096 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x293:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bddf4 expref: 586 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.909383:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442588416 00000100:00100000:1.0:1788201208.909385:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442588416 00010000:00010000:1.0:1788201208.909395:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e7419518/0x9383f985bc4c0bdf lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c13a1 expref: 587 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.909407:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1362 00000100:00100000:1.0:1788201208.909412:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0085180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+99:2359:x1875064442587648:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201208.909419:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201208.909422:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef9137e5/0x9383f985bc4b1de6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc16f expref: 99 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.909432:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef9137e5/0x9383f985bc4b1de6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc16f expref: 99 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.909446:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.909450:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.909454:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000056e17fb0/0x9383f985bc4d2a06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.909461:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056e17fb0/0x9383f985bc4d2a06 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.909473:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201208.909492:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0085180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+99:2359:x1875064442587648:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 79us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201208.909498:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1362 00000100:00100000:1.0:1788201208.909509:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1363 00000100:00100000:1.0:1788201208.909515:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0084700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+587:2359:x1875064442587904:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201208.909522:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201208.909526:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000afd5ac78/0x9383f985bc4c7143 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3693 expref: 587 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.909537:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000afd5ac78/0x9383f985bc4c7143 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3693 expref: 587 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.909549:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.909552:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.909557:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000927e33d1/0x9383f985bc4d2a0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.909564:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000927e33d1/0x9383f985bc4d2a0d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.909574:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201208.909589:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0084700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+587:2359:x1875064442587904:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 75us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201208.909598:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1363 00000100:00100000:1.0:1788201208.909610:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1364 00000100:00100000:1.0:1788201208.909616:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d89e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+586:2360:x1875064442588160:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201208.909623:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201208.909628:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006c5666e3/0x9383f985bc4b7096 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x293:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bddf4 expref: 586 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.909639:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006c5666e3/0x9383f985bc4b7096 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x293:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bddf4 expref: 586 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.909650:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x293:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.909653:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x293:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.909657:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000092295f0a/0x9383f985bc4d29dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x293:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.909664:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092295f0a/0x9383f985bc4d29dc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x293:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.909676:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201208.909693:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d89e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+586:2360:x1875064442588160:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 77us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201208.909699:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1364 00000100:00100000:1.0:1788201208.909710:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1365 00000100:00100000:1.0:1788201208.909716:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0085500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+585:2360:x1875064442588416:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201208.909725:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201208.909729:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e7419518/0x9383f985bc4c0bdf lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c13a1 expref: 585 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.909739:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e7419518/0x9383f985bc4c0bdf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c13a1 expref: 585 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.909750:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x356:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.909753:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x356:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.909757:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000080c7e6b2/0x9383f985bc4d29f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.909765:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080c7e6b2/0x9383f985bc4d29f1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.909775:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201208.909792:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0085500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+585:2360:x1875064442588416:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 76us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201208.909798:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1365 00000100:00100000:3.0:1788201208.913246:0:13447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:13447:1875064458168704:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201208.913270:0:13447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d29ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.913407:0:13448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7419518/0x9383f985bc4c0bdf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c13a1 expref: 583 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.913421:0:13448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:13448:1875064458168832:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201208.913434:0:13448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000080c7e6b2/0x9383f985bc4d29f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.913443:0:13448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000080c7e6b2/0x9383f985bc4d29f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.913450:0:13448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080c7e6b2/0x9383f985bc4d29f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.913459:0:13448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080c7e6b2/0x9383f985bc4d29f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.913467:0:13448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080c7e6b2/0x9383f985bc4d29f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.913489:0:13448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201208.913694:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+56:3311:x1875064458167680:12345-0@lo:6:osp-syn-0-0.0 Request processed in 45116us (45953us total) trans 4294968754 rc 0/0 00000100:00100000:3.0:1788201208.913701:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3982 00000004:00080000:1.0:1788201208.914057:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00c2d80/2, rc 0, transno 4294968740 00000100:00100000:1.0:1788201208.914073:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458169216:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788201208.914085:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04d80f2d80/2, rc 0, transno 4294968753 00000100:00100000:1.0:1788201208.914103:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d80f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458169728:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788201208.914113:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00c0000/2, rc 0, transno 4294968742 00000100:00100000:1.0:1788201208.914117:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458169344:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788201208.914126:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04cff38e00/2, rc 0, transno 4294968739 00000100:00100000:1.0:1788201208.914129:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cff38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458167168:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788201208.915453:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04cff39500/2, rc 0, transno 4294968741 00000100:00100000:3.0:1788201208.915460:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cff39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458166784:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201208.915513:0:13446:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f967e540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201208.915753:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458171264:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201208.915797:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201208.915857:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.915900:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.915944:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.915956:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.916454:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201208.917262:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442588032 00000100:00100000:3.0:1788201208.917267:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442588032 00010000:00010000:3.0:1788201208.917316:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002f2e72ba/0x9383f985bc4c4de8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2a68 expref: 583 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.917487:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442588288 00000100:00100000:3.0:1788201208.917491:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442588288 00010000:00010000:3.0:1788201208.917507:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001fa8fdf0/0x9383f985bc4c626a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c316f expref: 96 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.917518:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442588544 00000100:00100000:3.0:1788201208.917520:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442588544 00010000:00010000:3.0:1788201208.917529:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003475e2c5/0x9383f985bc4b3658 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc9c6 expref: 584 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.917539:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442588672 00000100:00100000:3.0:1788201208.917541:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442588672 00010000:00010000:3.0:1788201208.917550:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5a4fd4/0x9383f985bc4b473e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x25f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcf99 expref: 97 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.917559:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442588800 00000100:00100000:3.0:1788201208.917561:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442588800 00010000:00010000:3.0:1788201208.917570:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000f020425/0x9383f985bc4bf1c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x335:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0a8d expref: 585 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.917583:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1366 00000100:00100000:3.0:1788201208.917589:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0086d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+585:2360:x1875064442588032:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.917599:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.917604:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002f2e72ba/0x9383f985bc4c4de8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2a68 expref: 585 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.917622:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002f2e72ba/0x9383f985bc4c4de8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2a68 expref: 585 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.917641:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.917645:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.917650:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000058fbae95/0x9383f985bc4d29d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.917659:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058fbae95/0x9383f985bc4d29d5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.917675:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.917695:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0086d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+585:2360:x1875064442588032:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 106us (1838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.917703:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1366 00000100:00100000:3.0:1788201208.917718:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1367 00000100:00100000:3.0:1788201208.917724:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0084000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+97:2360:x1875064442588288:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.917733:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.917737:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001fa8fdf0/0x9383f985bc4c626a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c316f expref: 97 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.917748:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001fa8fdf0/0x9383f985bc4c626a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c316f expref: 97 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.917767:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fa8fdf0/0x9383f985bc4c626a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c316f expref: 97 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.917778:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.917781:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.917785:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d29ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.917793:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d29ea lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.917812:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201208.917826:0:13447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d29ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.917834:0:13447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d29ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.917843:0:13447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d29ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.917851:0:13447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d29ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.917867:0:13447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788201208.918073:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201208.918816:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+51:3311:x1875064458167808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 50392us (51295us total) trans 4294968743 rc 0/0 00000100:00100000:3.0:1788201208.918825:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3981 00000100:00100000:3.0:1788201208.918858:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0084000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+96:2360:x1875064442588288:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1133us (2957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.918865:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1367 00010000:00010000:0.0:1788201208.919455:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008d8cf57d/0x9383f985bc4b562c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x272:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd4c4 expref: 584 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.919474:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008d8cf57d/0x9383f985bc4b562c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x272:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd4c4 expref: 584 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.919489:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d8cf57d/0x9383f985bc4b562c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x272:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd4c4 expref: 584 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.919500:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x272:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.919504:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x272:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.919509:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000456a114c/0x9383f985bc4d29f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x272:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.919518:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000456a114c/0x9383f985bc4d29f8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x272:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.919555:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c5666e3/0x9383f985bc4b7096 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x293:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bddf4 expref: 583 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.919571:0:13443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cff38380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13443:1875064458168320:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201208.919591:0:13443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000092295f0a/0x9383f985bc4d29dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.919599:0:13443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000092295f0a/0x9383f985bc4d29dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.919606:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092295f0a/0x9383f985bc4d29dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.919615:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092295f0a/0x9383f985bc4d29dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.919624:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092295f0a/0x9383f985bc4d29dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.919640:0:13443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201208.919820:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+57:3313:x1875064458168064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 56324us (58051us total) trans 4294968755 rc 0/0 00000100:00100000:0.0:1788201208.919827:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3979 00000100:00100000:3.0:1788201208.920574:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442588928 00000100:00100000:3.0:1788201208.920579:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442588928 00010000:00010000:3.0:1788201208.920601:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b16393c6/0x9383f985bc4bcf16 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x309:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfe9a expref: 96 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.920619:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1368 00000100:00100000:3.0:1788201208.920627:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0084e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+582:2362:x1875064442588544:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.920637:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.920644:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003475e2c5/0x9383f985bc4b3658 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc9c6 expref: 582 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.920655:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003475e2c5/0x9383f985bc4b3658 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc9c6 expref: 582 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.920670:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003475e2c5/0x9383f985bc4b3658 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc9c6 expref: 582 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.920680:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.920683:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.920688:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d0d4f162/0x9383f985bc4d2a14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.920697:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0d4f162/0x9383f985bc4d2a14 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.920723:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.920739:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0084e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+581:2362:x1875064442588544:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 113us (4794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.920745:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1368 00000100:00100000:3.0:1788201208.920760:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1369 00000100:00100000:3.0:1788201208.920767:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0084380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+96:2362:x1875064442588672:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.920776:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.920781:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cd5a4fd4/0x9383f985bc4b473e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x25f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcf99 expref: 96 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.920791:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cd5a4fd4/0x9383f985bc4b473e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x25f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcf99 expref: 96 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.920805:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd5a4fd4/0x9383f985bc4b473e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x25f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcf99 expref: 96 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.920815:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.920818:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.920822:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d2a1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.920834:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d2a1b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x25f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.920850:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.920864:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0084380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+95:2362:x1875064442588672:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 98us (4907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.920870:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1369 00000004:00080000:1.0:1788201208.921010:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00c0700/2, rc 0, transno 4294968755 00000100:00100000:1.0:1788201208.921019:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458168064:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201208.921376:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cff38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458171776:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201208.921416:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201208.921504:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1370 00000100:00100000:3.0:1788201208.921514:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0085f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+580:2362:x1875064442588800:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.921523:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.921529:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000f020425/0x9383f985bc4bf1c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x335:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0a8d expref: 580 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.921541:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000f020425/0x9383f985bc4bf1c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x335:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0a8d expref: 580 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.921554:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f020425/0x9383f985bc4bf1c9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x335:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0a8d expref: 580 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.921563:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x335:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.921566:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x335:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.921571:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000002c7609e/0x9383f985bc4d2a22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x335:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.921584:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002c7609e/0x9383f985bc4d2a22 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x335:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.921601:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.921619:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0085f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+579:2362:x1875064442588800:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 108us (5165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.921625:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1370 00000100:00100000:3.0:1788201208.921639:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1371 00000100:00100000:3.0:1788201208.921646:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d89e8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+94:2359:x1875064442588928:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.921655:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201208.921659:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b16393c6/0x9383f985bc4bcf16 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x309:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfe9a expref: 94 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.921669:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b16393c6/0x9383f985bc4bcf16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x309:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfe9a expref: 94 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.921680:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x309:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.921683:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x309:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.921686:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ffa13277/0x9383f985bc4d2a29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x309:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.921694:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffa13277/0x9383f985bc4d2a29 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x309:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.921709:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.921722:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d89e8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+94:2359:x1875064442588928:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 76us (3650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.921727:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1371 00000100:00100000:0.0:1788201208.922160:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458171776 00000100:00100000:0.0:1788201208.922166:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458171776 00000100:00100000:0.0:1788201208.922197:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3995 00000100:00100000:0.0:1788201208.922203:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+51:3310:x1875064458171776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201208.922226:0:13438:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:887 count 1 00010000:00010000:0.0:1788201208.922245:0:13438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2a4c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.922258:0:13438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea158daf/0x9383f985bc4c2634 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1cd1 expref: 93 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.922266:0:13438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x377:0x0].0x0 since=34s v=(0 0) 00010000:00010000:0.0:1788201208.922269:0:13438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x377:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.922273:0:13438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2a4c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.923043:0:13438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea158daf/0x9383f985bc4c2634 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1cd1 expref: 93 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.923056:0:13438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea158daf/0x9383f985bc4c2634 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1cd1 expref: 93 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.923071:0:13438:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5225f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13438:1875064458172672:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201208.923204:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458172032:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201208.923320:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5226680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458172416:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201208.923596:0:13438:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5480 going to sleep for 11 seconds 00010000:00010000:0.0:1788201208.923631:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f2e72ba/0x9383f985bc4c4de8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2a68 expref: 578 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.923645:0:13445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cff3b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13445:1875064458168192:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201208.923665:0:13445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000058fbae95/0x9383f985bc4d29d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.923675:0:13445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000058fbae95/0x9383f985bc4d29d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.923682:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058fbae95/0x9383f985bc4d29d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.923691:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058fbae95/0x9383f985bc4d29d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.923698:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058fbae95/0x9383f985bc4d29d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.923711:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201208.923888:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201208.923919:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201208.923926:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458172288:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201208.923950:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201208.923986:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458172032 00000100:00100000:3.0:1788201208.924001:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458172032 00000100:00100000:3.0:1788201208.924029:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458172288 00000100:00100000:3.0:1788201208.924031:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458172288 00000100:00100000:3.0:1788201208.924046:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3996 00000100:00100000:3.0:1788201208.924053:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+54:3312:x1875064458172032:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788201208.924074:0:13448:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:900 count 1 00010000:00010000:3.0:1788201208.924090:0:13448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004933b680/0x9383f985bc4d2a53 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x384:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.924113:0:13448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000003ff2bdc/0x9383f985bc4c30f3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x384:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c205f expref: 93 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.924122:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x384:0x0].0x0 since=33s v=(0 0) 00010000:00010000:3.0:1788201208.924125:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x384:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.924129:0:13448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004933b680/0x9383f985bc4d2a53 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x384:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.924152:0:13448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000003ff2bdc/0x9383f985bc4c30f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x384:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c205f expref: 93 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.924163:0:13448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000003ff2bdc/0x9383f985bc4c30f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x384:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c205f expref: 93 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.924173:0:13448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:13448:1875064458172800:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201208.924191:0:13448:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8140540 going to sleep for 11 seconds 00000100:00100000:3.0:1788201208.924207:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3997 00000100:00100000:3.0:1788201208.924213:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+54:3312:x1875064458172288:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788201208.924223:0:13447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:875 count 1 00010000:00010000:3.0:1788201208.924234:0:13447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004773894/0x9383f985bc4d2a5a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.924244:0:13447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007a9665d8/0x9383f985bc4c1cef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1982 expref: 93 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.924251:0:13447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36b:0x0].0x0 since=36s v=(0 0) 00010000:00010000:3.0:1788201208.924254:0:13447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.924258:0:13447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004773894/0x9383f985bc4d2a5a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.924276:0:13447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007a9665d8/0x9383f985bc4c1cef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1982 expref: 93 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.924290:0:13447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007a9665d8/0x9383f985bc4c1cef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1982 expref: 93 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.924319:0:13447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5423480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:13447:1875064458172928:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201208.924341:0:13447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d81400c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201208.924705:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788201208.924742:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04d80f1c00/2, rc 0, transno 4294968756 00000100:00100000:1.0:1788201208.924762:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d80f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458169472:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201208.924773:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788201208.924779:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458172160:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201208.924803:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201208.924827:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5224e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458172544:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201208.924847:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201208.927461:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458173824:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201208.927499:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201208.927574:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458173824 00000100:00100000:3.0:1788201208.927580:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458173824 00000100:00100000:3.0:1788201208.927612:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4002 00000100:00100000:3.0:1788201208.927619:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+60:3310:x1875064458173824:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201208.927638:0:12363:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:923 count 1 00010000:00010000:3.0:1788201208.927657:0:12363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1124bc0/0x9383f985bc4d2a7d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x39b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.927672:0:12363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb9eb5a5/0x9383f985bc4c42ea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x39b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c268d expref: 577 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.927679:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39b:0x0].0x0 since=30s v=(0 0) 00010000:00010000:3.0:1788201208.927683:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.927687:0:12363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1124bc0/0x9383f985bc4d2a7d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x39b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.927710:0:12363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fb9eb5a5/0x9383f985bc4c42ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x39b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c268d expref: 577 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.927726:0:12363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fb9eb5a5/0x9383f985bc4c42ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x39b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c268d expref: 577 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.927737:0:12363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5383480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12363:1875064458173952:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201208.927769:0:12363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8140a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201208.928178:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458173696 00000100:00100000:3.0:1788201208.928183:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458173696 00010000:00010000:1.0:1788201208.928619:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201208.928653:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5028a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+577:2359:x1875064442587392:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 19671us (19723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201208.928663:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1361 00000100:00100000:0.0:1788201208.929321:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+61:3313:x1875064458167936:12345-0@lo:6:osp-syn-0-0.0 Request processed in 66115us (67708us total) trans 4294968757 rc 0/0 00000100:00100000:0.0:1788201208.929329:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3978 00000100:00100000:0.0:1788201208.929353:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4003 00000100:00100000:0.0:1788201208.929363:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+60:3312:x1875064458173696:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201208.929386:0:13445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:638 count 1 00010000:00010000:0.0:1788201208.929405:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f91e6384/0x9383f985bc4d2a84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.929421:0:13445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000097a46d50/0x9383f985bc4b5fc5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x27e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd828 expref: 576 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.929435:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27e:0x0].0x0 since=68s v=(0 0) 00010000:00010000:0.0:1788201208.929439:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.929443:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f91e6384/0x9383f985bc4d2a84 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x27e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.929465:0:13445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000097a46d50/0x9383f985bc4b5fc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x27e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd828 expref: 576 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.929477:0:13445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000097a46d50/0x9383f985bc4b5fc5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x27e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd828 expref: 576 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.929489:0:13445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5225180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13445:1875064458174080:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201208.929528:0:13445:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5000 going to sleep for 11 seconds 00000004:00080000:0.0:1788201208.930561:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c20bf480/2, rc 0, transno 4294968757 00000100:00100000:0.0:1788201208.930577:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c20bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458167936:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201208.930639:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201208.930650:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5225500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458174208:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201208.930687:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201208.930718:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458174208 00000100:00100000:0.0:1788201208.930723:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458174208 00000100:00100000:0.0:1788201208.930750:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4004 00000100:00100000:0.0:1788201208.930757:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+61:3310:x1875064458174208:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201208.930776:0:13443:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:728 count 1 00010000:00010000:0.0:1788201208.930798:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2a8b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.930814:0:13443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001130b4aa/0x9383f985bc4ba777 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf103 expref: 576 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.930822:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d8:0x0].0x0 since=55s v=(0 0) 00010000:00010000:0.0:1788201208.930826:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.930830:0:13443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2a8b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.930852:0:13443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001130b4aa/0x9383f985bc4ba777 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf103 expref: 576 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.930862:0:13443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001130b4aa/0x9383f985bc4ba777 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf103 expref: 576 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.930873:0:13443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5226d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13443:1875064458174336:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201208.930926:0:13443:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5840 going to sleep for 11 seconds 00010000:00010000:0.0:1788201208.930955:0:13450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b16393c6/0x9383f985bc4bcf16 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x309:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfe9a expref: 93 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.930980:0:13450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5029180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:13450:1875064458170752:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201208.931005:0:13450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ffa13277/0x9383f985bc4d2a29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.931016:0:13450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ffa13277/0x9383f985bc4d2a29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.931024:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffa13277/0x9383f985bc4d2a29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.931034:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffa13277/0x9383f985bc4d2a29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.931042:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffa13277/0x9383f985bc4d2a29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.931061:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201208.931314:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+57:3312:x1875064458170624:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24450us (24535us total) trans 4294968745 rc 0/0 00000100:00100000:0.0:1788201208.931322:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3990 00010000:00010000:0.0:1788201208.931348:0:13439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000456a114c/0x9383f985bc4d29f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.931357:0:13439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000456a114c/0x9383f985bc4d29f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.931366:0:13439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000456a114c/0x9383f985bc4d29f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.931374:0:13439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000456a114c/0x9383f985bc4d29f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.931392:0:13439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788201208.931512:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+62:3311:x1875064458168448:12345-0@lo:6:osp-syn-0-0.0 Request processed in 62400us (63676us total) trans 4294968759 rc 0/0 00000100:00100000:0.0:1788201208.931519:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3983 00010000:00010000:0.0:1788201208.932434:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201208.932441:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffa13277/0x9383f985bc4d2a29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.932452:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.932457:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffa13277/0x9383f985bc4d2a29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.932467:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffa13277/0x9383f985bc4d2a29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.932487:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffa13277/0x9383f985bc4d2a29 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.932495:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffa13277/0x9383f985bc4d2a29 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.932512:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201208.932516:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000456a114c/0x9383f985bc4d29f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.932528:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.932532:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000456a114c/0x9383f985bc4d29f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.932539:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000456a114c/0x9383f985bc4d29f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.932548:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000456a114c/0x9383f985bc4d29f8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.932555:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000456a114c/0x9383f985bc4d29f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.932566:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.932568:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.932569:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788201208.932599:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04cff3a300/2, rc 0, transno 4294968759 00000100:00100000:0.0:1788201208.932663:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cff3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458168448:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201208.932809:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201208.932824:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0085180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458174464:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201208.932863:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201208.933048:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458174464 00000100:00100000:1.0:1788201208.933055:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458174464 00000100:00100000:1.0:1788201208.933154:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4005 00000100:00100000:1.0:1788201208.933164:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5227800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+62:3313:x1875064458174464:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201208.933187:0:13450:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:653 count 1 00010000:00010000:1.0:1788201208.933206:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f6beb5f/0x9383f985bc4d2a92 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x28d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.933221:0:13450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1e52b3f/0x9383f985bc4b6b9c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdc50 expref: 576 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.933230:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28d:0x0].0x0 since=65s v=(0 0) 00010000:00010000:1.0:1788201208.933234:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.933238:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f6beb5f/0x9383f985bc4d2a92 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.933262:0:13450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c1e52b3f/0x9383f985bc4b6b9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdc50 expref: 576 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.933273:0:13450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c1e52b3f/0x9383f985bc4b6b9c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdc50 expref: 576 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.933375:0:13450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0084700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:13450:1875064458174592:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201208.933459:0:13450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341d0c0 going to sleep for 11 seconds 00000004:00080000:3.0:1788201208.934721:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04cff39180/2, rc 0, transno 4294968745 00000100:00100000:3.0:1788201208.935376:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cff39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458170624:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201208.935598:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201208.935613:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458174720:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201208.935670:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201208.935697:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458174720 00000100:00100000:3.0:1788201208.935703:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458174720 00000100:00100000:3.0:1788201208.936345:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4006 00000100:00100000:3.0:1788201208.936357:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:3312:x1875064458174720:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788201208.936380:0:6703:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:808 count 1 00010000:00010000:3.0:1788201208.936402:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009362eac0/0x9383f985bc4d2a99 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x328:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.936423:0:6703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007d9141eb/0x9383f985bc4be788 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x328:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0722 expref: 92 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.936432:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x328:0x0].0x0 since=44s v=(0 0) 00010000:00010000:3.0:1788201208.936436:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x328:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.936441:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009362eac0/0x9383f985bc4d2a99 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x328:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.936473:0:6703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007d9141eb/0x9383f985bc4be788 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x328:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0722 expref: 92 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.936486:0:6703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007d9141eb/0x9383f985bc4be788 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x328:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0722 expref: 92 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.936498:0:6703:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5383b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6703:1875064458174848:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201208.936559:0:6703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8140600 going to sleep for 11 seconds 00010000:00010000:3.0:1788201208.937518:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201208.941516:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.941551:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201208.941571:0:13446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:13446:1875064458171392:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201208.941579:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442589184 00000100:00100000:1.0:1788201208.941586:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442589184 00010000:00010000:3.0:1788201208.941613:0:13446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d2a37 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.941621:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bf5d5069/0x9383f985bc4c7d13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3ab4 expref: 577 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.941647:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442589056 00000100:00100000:1.0:1788201208.941651:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442589056 00000100:00100000:3.0:1788201208.941661:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1372 00010000:00010000:1.0:1788201208.941666:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008fc9d9fd/0x9383f985bc4b9580 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1beaa4 expref: 93 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.941671:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0084e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+577:2362:x1875064442589184:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.941686:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788201208.941692:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1373 00010000:00010000:3.0:1788201208.941692:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bf5d5069/0x9383f985bc4c7d13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3ab4 expref: 577 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.941699:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0084380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+93:2362:x1875064442589056:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201208.941704:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bf5d5069/0x9383f985bc4c7d13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3ab4 expref: 577 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.941707:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201208.941711:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008fc9d9fd/0x9383f985bc4b9580 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1beaa4 expref: 93 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.941720:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008fc9d9fd/0x9383f985bc4b9580 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1beaa4 expref: 93 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.941727:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf5d5069/0x9383f985bc4c7d13 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3ab4 expref: 577 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.941736:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.941740:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.941740:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.941743:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.941747:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2a30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.941747:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d2a37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.941757:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2a30 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.941768:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d2a37 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.941774:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201208.941782:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.941820:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0084e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+576:2362:x1875064442589184:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 150us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201208.941828:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1372 00010000:00010000:3.0:1788201208.941849:0:13446:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d2a37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.941996:0:13446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d2a37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.942005:0:13446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d2a37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.942012:0:13446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d2a37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.942025:0:13446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788201208.942445:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201208.942453:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2a30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.942466:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.942471:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2a30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.942480:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2a30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.942493:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2a30 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.942500:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2a30 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.942517:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201208.942520:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d2a37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.942526:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.942529:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d2a37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.942536:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d2a37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.942544:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d2a37 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.942552:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d2a37 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.942564:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.942565:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.942567:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201208.943250:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0084380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+92:2362:x1875064442589056:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1546us (1693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201208.943260:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1373 00000100:00100000:3.0:1788201208.944947:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+63:3311:x1875064458171136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 32739us (32821us total) trans 4294968760 rc 0/0 00000100:00100000:3.0:1788201208.944959:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3992 00010000:00010000:3.0:1788201208.945427:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788201208.946249:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00df800/2, rc 0, transno 4294968760 00000100:00100000:1.0:1788201208.946278:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458171136:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201208.946481:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458174976:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201208.946539:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201208.946748:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458174976 00000100:00100000:1.0:1788201208.946915:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458174976 00000100:00100000:1.0:1788201208.947003:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4007 00000100:00100000:1.0:1788201208.947014:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+63:3310:x1875064458174976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201208.947041:0:13449:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:736 count 1 00010000:00010000:1.0:1788201208.947066:0:13449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8727954/0x9383f985bc4d2aa0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.947089:0:13449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd5516e0/0x9383f985bc4bae07 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf333 expref: 575 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.947098:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e0:0x0].0x0 since=54s v=(0 0) 00010000:00010000:1.0:1788201208.947103:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.947108:0:13449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8727954/0x9383f985bc4d2aa0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.947136:0:13449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dd5516e0/0x9383f985bc4bae07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf333 expref: 575 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.947149:0:13449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dd5516e0/0x9383f985bc4bae07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf333 expref: 575 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.947161:0:13449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0087100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:13449:1875064458175104:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201208.947220:0:13449:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341d300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201208.951645:0:10484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10484:1875064458171904:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201208.951675:0:10484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d1c58db5/0x9383f985bc4d2a45 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.951709:0:13438:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5225f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13438:1875064458172672:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201208.951723:0:13438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2a4c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.951972:0:13440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:13440:1875064458171520:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201208.951986:0:13440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d2a3e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.952027:0:13447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5423480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:13447:1875064458172928:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201208.952043:0:13447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000004773894/0x9383f985bc4d2a5a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.952068:0:13448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:13448:1875064458172800:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201208.952079:0:13448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004933b680/0x9383f985bc4d2a53 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x384:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.952436:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.952463:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.952485:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201208.952488:0:6706:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffaa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1875064458173568:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201208.952504:0:6706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b13647a1/0x9383f985bc4d2a76 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.952509:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442589312 00000100:00100000:1.0:1788201208.952515:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442589312 00000100:00100000:0.0:1788201208.952536:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442589440 00000100:00100000:0.0:1788201208.952539:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442589440 00010000:00010000:0.0:1788201208.952553:0:7646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000945d1ea8/0x9383f985bc4bbdf1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf8b2 expref: 577 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.952553:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a1b8056f/0x9383f985bc4c7a9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c39e2 expref: 577 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.952686:0:13442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:13442:1875064458173312:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201208.952699:0:13442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d2a6f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.953463:0:12363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5383480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12363:1875064458173952:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201208.953480:0:12363:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1124bc0/0x9383f985bc4d2a7d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x39b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.953685:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442589568 00000100:00100000:1.0:1788201208.953692:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442589568 00010000:00010000:1.0:1788201208.953720:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea158daf/0x9383f985bc4c2634 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1cd1 expref: 92 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.954022:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1374 00000100:00100000:0.0:1788201208.954035:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0085c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+577:2360:x1875064442589312:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201208.954050:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201208.954057:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a1b8056f/0x9383f985bc4c7a9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c39e2 expref: 577 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.954070:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a1b8056f/0x9383f985bc4c7a9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c39e2 expref: 577 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.954094:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1b8056f/0x9383f985bc4c7a9d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c39e2 expref: 577 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.954111:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.954116:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.954122:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d2a3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.954132:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d2a3e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.954162:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201208.954211:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0085c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+576:2360:x1875064442589312:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 179us (1776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201208.954218:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1374 00000100:00100000:0.0:1788201208.954236:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1375 00000100:00100000:0.0:1788201208.954243:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c502b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+575:2359:x1875064442589440:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201208.954255:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201208.954261:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000945d1ea8/0x9383f985bc4bbdf1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf8b2 expref: 575 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.954272:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000945d1ea8/0x9383f985bc4bbdf1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf8b2 expref: 575 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.954284:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000945d1ea8/0x9383f985bc4bbdf1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf8b2 expref: 575 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.954319:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.954322:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.954327:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1c58db5/0x9383f985bc4d2a45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.954335:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1c58db5/0x9383f985bc4d2a45 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.954353:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201208.954372:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c502b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+574:2359:x1875064442589440:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 130us (1908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201208.954378:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1375 00000100:00100000:0.0:1788201208.954394:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1376 00000100:00100000:0.0:1788201208.954401:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c502bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+92:2360:x1875064442589568:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201208.954409:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201208.954415:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea158daf/0x9383f985bc4c2634 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x377:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1cd1 expref: 92 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.954426:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea158daf/0x9383f985bc4c2634 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x377:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1cd1 expref: 92 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.954440:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea158daf/0x9383f985bc4c2634 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x377:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1cd1 expref: 92 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.954451:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x377:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.954454:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x377:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.954458:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2a4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.954466:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2a4c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.954482:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201208.954498:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c502bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+91:2360:x1875064442589568:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 98us (2012us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201208.954505:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1376 00000100:00100000:0.0:1788201208.955140:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201208.955199:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201208.955222:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201208.955272:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201208.955286:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201208.955519:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201208.955535:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201208.955738:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201208.955754:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201208.955768:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201208.955804:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201208.955843:0:13443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5226d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13443:1875064458174336:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201208.955863:0:13443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2a8b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.955899:0:10484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d1c58db5/0x9383f985bc4d2a45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.955907:0:10484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1c58db5/0x9383f985bc4d2a45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.955917:0:10484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1c58db5/0x9383f985bc4d2a45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.955925:0:10484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1c58db5/0x9383f985bc4d2a45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.955943:0:10484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201208.956380:0:13440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d2a3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.956390:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d2a3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.956399:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d2a3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.956412:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d2a3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.956428:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788201208.957084:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+64:3312:x1875064458171264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 40492us (41283us total) trans 4294968761 rc 0/0 00000100:00100000:3.0:1788201208.957374:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3993 00000100:00100000:1.0:1788201208.957427:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201208.957444:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5383480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458175232:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201208.957487:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788201208.957560:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f000d180/2, rc 0, transno 4294968761 00000100:00100000:1.0:1788201208.957574:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458171264:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201208.957722:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+64:3312:x1875064458171648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 37492us (37633us total) trans 4294968762 rc 0/0 00000100:00100000:0.0:1788201208.957730:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3994 00000100:00100000:0.0:1788201208.957744:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458175232 00000100:00100000:0.0:1788201208.957749:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458175232 00000100:00100000:0.0:1788201208.957780:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4008 00000100:00100000:0.0:1788201208.957788:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5029180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3310:x1875064458175232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201208.957813:0:10484:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1041 count 1 00010000:00010000:0.0:1788201208.957836:0:10484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2aa7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x411:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.957854:0:10484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000006bddf41/0x9383f985bc4ca171 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x411:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4764 expref: 90 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.957863:0:10484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x411:0x0].0x0 since=15s v=(0 0) 00010000:00010000:0.0:1788201208.957868:0:10484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x411:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.957882:0:10484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2aa7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x411:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.957920:0:10484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000006bddf41/0x9383f985bc4ca171 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x411:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4764 expref: 90 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.957934:0:10484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000006bddf41/0x9383f985bc4ca171 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x411:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4764 expref: 90 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.957946:0:10484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5226d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10484:1875064458175360:192.168.201.30@tcp:104: 00000004:00080000:1.0:1788201208.958489:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00dc380/2, rc 0, transno 4294968762 00000100:00100000:1.0:1788201208.958495:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458171648:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201208.958585:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5029880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458175488:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201208.958621:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201208.958692:0:10484:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5480 going to sleep for 11 seconds 00010000:00010000:0.0:1788201208.958707:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201208.958714:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1c58db5/0x9383f985bc4d2a45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.958728:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.958732:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1c58db5/0x9383f985bc4d2a45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.958742:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1c58db5/0x9383f985bc4d2a45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.958759:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1c58db5/0x9383f985bc4d2a45 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.958768:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1c58db5/0x9383f985bc4d2a45 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.958786:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201208.958790:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d2a3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.958797:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.958800:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d2a3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.958808:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d2a3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.958816:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d2a3e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.958824:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d2a3e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.958836:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.958838:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.958840:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.960673:0:13438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2a4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.960692:0:13438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2a4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.960703:0:13438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2a4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.960711:0:13438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2a4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.960741:0:13438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201208.961374:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3310:x1875064458171776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 39167us (39954us total) trans 4294968747 rc 0/0 00000100:00100000:0.0:1788201208.961384:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3995 00000100:00100000:0.0:1788201208.961417:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458175488 00000100:00100000:0.0:1788201208.961423:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458175488 00000100:00100000:0.0:1788201208.961459:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4009 00000100:00100000:0.0:1788201208.961467:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5382680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+64:3312:x1875064458175488:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201208.961494:0:13438:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:858 count 1 00010000:00010000:0.0:1788201208.961777:0:13438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d2aae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.961796:0:13438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000961854c1/0x9383f985bc4c0f27 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c14b9 expref: 573 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.961805:0:13438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35a:0x0].0x0 since=38s v=(0 0) 00010000:00010000:0.0:1788201208.961809:0:13438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.961814:0:13438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d2aae lrc: 4/0,1 mode: --/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.961850:0:13438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000961854c1/0x9383f985bc4c0f27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c14b9 expref: 573 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.961864:0:13438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000961854c1/0x9383f985bc4c0f27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c14b9 expref: 573 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.962480:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201208.962493:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5029f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458175616:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201208.962660:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1378 00000100:00100000:1.0:1788201208.962672:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d89eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+95:2361:x1875064442589824:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201208.962680:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201208.962687:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009cdf84fd/0x9383f985bc4b799c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x29e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be127 expref: 95 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.962697:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009cdf84fd/0x9383f985bc4b799c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x29e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be127 expref: 95 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.962710:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cdf84fd/0x9383f985bc4b799c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x29e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be127 expref: 95 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.962720:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.962723:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.962727:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d2a61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.962740:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d2a61 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.962953:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201208.963085:0:13438:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5224380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:13438:1875064458175744:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201208.963142:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201208.963147:0:13438:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201208.963163:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d89eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+94:2361:x1875064442589824:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 494us (7962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201208.963170:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1378 00000100:00100000:1.0:1788201208.963190:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1379 00000100:00100000:1.0:1788201208.963196:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5227480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+93:2361:x1875064442590080:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201208.963204:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201208.963209:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000069a377e1/0x9383f985bc4b1d14 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc129 expref: 93 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.963219:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000069a377e1/0x9383f985bc4b1d14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc129 expref: 93 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.963232:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069a377e1/0x9383f985bc4b1d14 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc129 expref: 93 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.963236:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:1.0:1788201208.963243:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.963246:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.963325:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201208.963332:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2a4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.963340:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.963344:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2a4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.963353:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2a4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.963366:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2a4c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.963374:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2a4c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.963391:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.963393:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.963395:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788201208.963435:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04cff38380/2, rc 0, transno 4294968747 00000100:00100000:0.0:1788201208.963448:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cff38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458171776:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201208.963519:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458175872:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201208.963547:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201208.963549:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458175616 00000100:00100000:3.0:1788201208.963554:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458175616 00010000:00010000:1.0:1788201208.964054:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d2a6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.964070:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d2a6f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.964074:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201208.964084:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442591104 00000100:00100000:0.0:1788201208.964087:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442591104 00010000:00010000:1.0:1788201208.964092:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201208.964117:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dd5516e0/0x9383f985bc4bae07 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf333 expref: 579 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.964132:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458175872 00000100:00100000:0.0:1788201208.964136:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1380 00000100:00100000:3.0:1788201208.964136:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458175872 00000100:00100000:0.0:1788201208.964143:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5226a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+579:2361:x1875064442590336:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201208.964153:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788201208.964153:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4010 00000100:00100000:3.0:1788201208.964159:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5380000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+65:3312:x1875064458175616:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788201208.964160:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fb9eb5a5/0x9383f985bc4c42ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x39b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c268d expref: 579 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.964169:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fb9eb5a5/0x9383f985bc4c42ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x39b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c268d expref: 579 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788201208.964178:0:13440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:908 count 1 00010000:00010000:0.0:1788201208.964183:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb9eb5a5/0x9383f985bc4c42ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x39b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c268d expref: 579 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.964194:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.964196:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaee9d17/0x9383f985bc4d2ab5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.964197:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.964201:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1124bc0/0x9383f985bc4d2a7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.964208:0:13440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000601cf275/0x9383f985bc4c369c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2273 expref: 578 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.964209:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1124bc0/0x9383f985bc4d2a7d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x39b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.964216:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38c:0x0].0x0 since=32s v=(0 0) 00010000:00010000:3.0:1788201208.964219:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.964222:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaee9d17/0x9383f985bc4d2ab5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.964228:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201208.964242:0:13440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000601cf275/0x9383f985bc4c369c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2273 expref: 578 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.964265:0:13440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000601cf275/0x9383f985bc4c369c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2273 expref: 578 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.964285:0:13440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5383800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:13440:1875064458176000:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201208.968730:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5227480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+86:2361:x1875064442590080:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 5532us (13506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201208.968738:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1379 00010000:00010000:1.0:1788201208.968777:0:13442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d2a6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.968785:0:13442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d2a6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.968793:0:13442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d2a6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.968800:0:13442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d2a6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.968814:0:13442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788201208.971041:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+61:3310:x1875064458172544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 45504us (46192us total) trans 4294968750 rc 0/0 00000100:00100000:1.0:1788201208.971048:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4000 00010000:00010000:1.0:1788201208.971089:0:13450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1e52b3f/0x9383f985bc4b6b9c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdc50 expref: 571 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.971108:0:13450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0084700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:13450:1875064458174592:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201208.971126:0:13450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005f6beb5f/0x9383f985bc4d2a92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.971135:0:13450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005f6beb5f/0x9383f985bc4d2a92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.971143:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f6beb5f/0x9383f985bc4d2a92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.971151:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f6beb5f/0x9383f985bc4d2a92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.971158:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f6beb5f/0x9383f985bc4d2a92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.971166:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:0.0:1788201208.971214:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5226a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+570:2361:x1875064442590336:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 7069us (15939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201208.971224:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1380 00010000:00010000:0.0:1788201208.971274:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788201208.971281:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2a8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.971914:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5227800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+66:3313:x1875064458174464:12345-0@lo:6:osp-syn-0-0.0 Request processed in 38690us (38988us total) trans 4294968765 rc 0/0 00000100:00100000:1.0:1788201208.971922:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4005 00010000:00010000:0.0:1788201208.971940:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.971945:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2a8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.971954:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2a8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.971970:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2a8b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.971978:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2a8b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.972211:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788201208.972217:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d2a6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.972224:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.972228:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d2a6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.972237:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d2a6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.972373:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d2a6f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.972382:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d2a6f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.972396:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788201208.972400:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004773894/0x9383f985bc4d2a5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.972406:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.972409:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004773894/0x9383f985bc4d2a5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.972416:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004773894/0x9383f985bc4d2a5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.972426:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004773894/0x9383f985bc4d2a5a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.972427:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097a46d50/0x9383f985bc4b5fc5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x27e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd828 expref: 569 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.972434:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004773894/0x9383f985bc4d2a5a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.972438:0:13445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5225180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13445:1875064458174080:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201208.972446:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788201208.972450:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d2a61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.972454:0:13445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f91e6384/0x9383f985bc4d2a84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.972456:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.972460:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d2a61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.972463:0:13445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f91e6384/0x9383f985bc4d2a84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.972468:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d2a61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.972471:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f91e6384/0x9383f985bc4d2a84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.972476:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d2a61 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.972480:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f91e6384/0x9383f985bc4d2a84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.972482:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d2a61 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.972487:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f91e6384/0x9383f985bc4d2a84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.972494:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201208.972495:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788201208.972498:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d2a68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.972504:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.972506:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d2a68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.972513:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d2a68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.972521:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d2a68 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.972528:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d2a68 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.972540:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201208.972543:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004933b680/0x9383f985bc4d2a53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.972550:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.972552:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004933b680/0x9383f985bc4d2a53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.972641:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+66:3312:x1875064458173696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 43280us (44573us total) trans 4294968766 rc 0/0 00000100:00100000:1.0:1788201208.972661:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4003 00010000:00010000:1.0:1788201208.972705:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d9141eb/0x9383f985bc4be788 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x328:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0722 expref: 85 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.972717:0:6703:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5383b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6703:1875064458174848:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201208.972729:0:6703:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009362eac0/0x9383f985bc4d2a99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.972742:0:6703:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009362eac0/0x9383f985bc4d2a99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.972749:0:6703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009362eac0/0x9383f985bc4d2a99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.972766:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009362eac0/0x9383f985bc4d2a99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.972772:0:6703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009362eac0/0x9383f985bc4d2a99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.972782:0:6703:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788201208.973404:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004933b680/0x9383f985bc4d2a53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.973417:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004933b680/0x9383f985bc4d2a53 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.973424:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004933b680/0x9383f985bc4d2a53 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.973438:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.973440:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.973441:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.973448:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201208.973448:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+62:3312:x1875064458174720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 37095us (37778us total) trans 4294968752 rc 0/0 00000100:00100000:1.0:1788201208.973455:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4006 00010000:00010000:0.0:1788201208.973469:0:13449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd5516e0/0x9383f985bc4bae07 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf333 expref: 568 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.973471:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458176384 00000100:00100000:1.0:1788201208.973475:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458176384 00000100:00100000:0.0:1788201208.973481:0:13449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0087100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:13449:1875064458175104:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201208.973494:0:13449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c8727954/0x9383f985bc4d2aa0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.973502:0:13449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c8727954/0x9383f985bc4d2aa0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.973507:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4014 00010000:00010000:0.0:1788201208.973509:0:13449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8727954/0x9383f985bc4d2aa0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.973514:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+66:3312:x1875064458176384:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788201208.973518:0:13449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8727954/0x9383f985bc4d2aa0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.973524:0:13449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8727954/0x9383f985bc4d2aa0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788201208.973527:0:13442:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:703 count 1 00010000:00010000:0.0:1788201208.973538:0:13449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201208.973540:0:13442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000def97333/0x9383f985bc4d2ad1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.973550:0:13442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004ee9fecf/0x9383f985bc4b93c7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bea11 expref: 567 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.973557:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2bf:0x0].0x0 since=58s v=(0 0) 00010000:00010000:1.0:1788201208.973560:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.973564:0:13442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000def97333/0x9383f985bc4d2ad1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.973584:0:13442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004ee9fecf/0x9383f985bc4b93c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bea11 expref: 567 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.973594:0:13442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004ee9fecf/0x9383f985bc4b93c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bea11 expref: 567 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.973605:0:13442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c502a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:13442:1875064458177024:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201208.973636:0:13442:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c33d53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201208.973893:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+67:3310:x1875064458174976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26881us (27353us total) trans 4294968767 rc 0/0 00000100:00100000:0.0:1788201208.973900:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4007 00010000:00010000:0.0:1788201208.973924:0:12363:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1124bc0/0x9383f985bc4d2a7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.973934:0:12363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1124bc0/0x9383f985bc4d2a7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.973943:0:12363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1124bc0/0x9383f985bc4d2a7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.973951:0:12363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1124bc0/0x9383f985bc4d2a7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.973965:0:12363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788201208.973973:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201208.973977:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8727954/0x9383f985bc4d2aa0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.973983:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.973986:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8727954/0x9383f985bc4d2aa0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.974005:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8727954/0x9383f985bc4d2aa0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.974017:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8727954/0x9383f985bc4d2aa0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.974024:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8727954/0x9383f985bc4d2aa0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.974038:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201208.974041:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1124bc0/0x9383f985bc4d2a7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.974052:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3016c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.974054:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1124bc0/0x9383f985bc4d2a7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201208.974060:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c5381180/2, rc 0, transno 4294968767 00010000:00010000:0.0:1788201208.974061:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1124bc0/0x9383f985bc4d2a7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.974065:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458174976:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788201208.974071:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1124bc0/0x9383f985bc4d2a7d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.974078:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1124bc0/0x9383f985bc4d2a7d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.974090:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.974092:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.974093:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201208.974226:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+67:3310:x1875064458173824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 46607us (46725us total) trans 4294968768 rc 0/0 00000100:00100000:0.0:1788201208.974233:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4002 00000100:00100000:1.0:1788201208.975172:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458177536:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201208.975199:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788201208.975226:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c5381f80/2, rc 0, transno 4294968768 00000100:00100000:1.0:1788201208.975234:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458173824:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201208.975243:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788201208.975248:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458177152:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201208.975281:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201208.975318:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0084700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458177664:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201208.975343:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201208.975545:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458177536 00000100:00100000:0.0:1788201208.975552:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458177536 00000100:00100000:0.0:1788201208.975706:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458177152 00000100:00100000:0.0:1788201208.975710:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458177152 00000100:00100000:0.0:1788201208.975719:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458177664 00000100:00100000:0.0:1788201208.975721:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458177664 00000100:00100000:0.0:1788201208.975731:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4017 00000100:00100000:0.0:1788201208.975738:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+64:3312:x1875064458177408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201208.975750:0:13448:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:874 count 1 00000100:00100000:3.0:1788201208.975813:0:13440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d89e1300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201208.975837:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4018 00000100:00100000:3.0:1788201208.975845:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5028a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+69:3310:x1875064458177536:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788201208.975901:0:13448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d2ae6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.975915:0:13448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000b7273f7/0x9383f985bc4c1c1d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c193c expref: 84 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.975922:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36a:0x0].0x0 since=36s v=(0 0) 00010000:00010000:0.0:1788201208.975925:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.975928:0:13448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d2ae6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.975952:0:13448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000b7273f7/0x9383f985bc4c1c1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c193c expref: 84 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.975962:0:13448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000b7273f7/0x9383f985bc4c1c1d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c193c expref: 84 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.975974:0:13448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c20bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:13448:1875064458178048:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201208.976015:0:13448:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201208.976034:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4019 00000100:00100000:0.0:1788201208.976042:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c502b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+64:3310:x1875064458177152:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201208.976055:0:13449:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:773 count 1 00010000:00010000:0.0:1788201208.976067:0:13449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3effe3a/0x9383f985bc4d2aed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.976085:0:13449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000388487b3/0x9383f985bc4bcbce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfd82 expref: 84 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.976091:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x305:0x0].0x0 since=49s v=(0 0) 00010000:00010000:0.0:1788201208.976094:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x305:0x0].0x0 since=0s v=(0 0) 00002000:00080000:3.0:1788201208.976097:0:13439:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:678 count 1 00010000:00010000:0.0:1788201208.976098:0:13449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3effe3a/0x9383f985bc4d2aed lrc: 4/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.976117:0:13449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000388487b3/0x9383f985bc4bcbce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfd82 expref: 84 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.976126:0:13449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000388487b3/0x9383f985bc4bcbce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfd82 expref: 84 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.976135:0:13449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d80f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:13449:1875064458178176:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201208.976161:0:13449:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201208.976176:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4020 00000100:00100000:0.0:1788201208.976181:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c502bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+69:3310:x1875064458177664:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201208.976193:0:12363:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:873 count 1 00010000:00010000:0.0:1788201208.976204:0:12363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2af4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.976215:0:12363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001a1ff243/0x9383f985bc4c1ae2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c18d3 expref: 567 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.976226:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x369:0x0].0x0 since=36s v=(0 0) 00010000:00010000:0.0:1788201208.976229:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x369:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.976233:0:12363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2af4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.976496:0:13439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4e56fd5/0x9383f985bc4d2afb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2a6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.976509:0:13439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2c78ea3/0x9383f985bc4b7fc3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be334 expref: 567 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.976516:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a6:0x0].0x0 since=61s v=(0 0) 00010000:00010000:3.0:1788201208.976519:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201208.976522:0:13439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4e56fd5/0x9383f985bc4d2afb lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.976538:0:12363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001a1ff243/0x9383f985bc4c1ae2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c18d3 expref: 567 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.976542:0:13439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c2c78ea3/0x9383f985bc4b7fc3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be334 expref: 567 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.976549:0:12363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001a1ff243/0x9383f985bc4c1ae2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c18d3 expref: 567 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.976551:0:13439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c2c78ea3/0x9383f985bc4b7fc3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be334 expref: 567 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201208.976562:0:13439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5380700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:13439:1875064458178560:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201208.976710:0:12363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12363:1875064458178432:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201208.976839:0:10484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5226d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10484:1875064458175360:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201208.976858:0:10484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2aa7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x411:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.976883:0:13438:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5224380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:13438:1875064458175744:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201208.976895:0:13438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d2aae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.979635:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.979732:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201208.980179:0:12363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201208.980179:0:13439:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d89e1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201208.980201:0:13451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458178304 00000100:00100000:0.0:1788201208.980208:0:13451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458178304 00000100:00100000:0.0:1788201208.980247:0:13451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4021 00000100:00100000:0.0:1788201208.980266:0:13451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+70:3312:x1875064458178304:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201208.980428:0:13451:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:601 count 1 00010000:00010000:0.0:1788201208.980454:0:13451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072b69b02/0x9383f985bc4d2b02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x259:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.980473:0:13451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4b4252 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x259:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcdf5 expref: 567 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.980483:0:13451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x259:0x0].0x0 since=74s v=(0 0) 00010000:00010000:0.0:1788201208.980488:0:13451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x259:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.980492:0:13451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072b69b02/0x9383f985bc4d2b02 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x259:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.980712:0:13451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4b4252 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x259:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcdf5 expref: 567 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.980726:0:13451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4b4252 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x259:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcdf5 expref: 567 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.980741:0:13451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:13451:1875064458178688:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201208.980796:0:13451:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201208.981115:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1389 00000100:00100000:0.0:1788201208.981124:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0501b36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+568:2362:x1875064442591360:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201208.981134:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201208.981141:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000961854c1/0x9383f985bc4c0f27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x35a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c14b9 expref: 568 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.981153:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000961854c1/0x9383f985bc4c0f27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x35a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c14b9 expref: 568 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.981174:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000961854c1/0x9383f985bc4c0f27 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x35a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c14b9 expref: 568 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.981186:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.981190:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35a:0x0].0x0 since=0s v=(0 0) 00000004:00080000:3.0:1788201208.981190:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f0085180/2, rc 0, transno 4294968765 00010000:00010000:0.0:1788201208.981194:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d2aae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.981202:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d2aae lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.981221:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.981291:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0085180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458174464:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201208.981385:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0501b36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+567:2362:x1875064442591360:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 129us (1625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201208.981389:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1390 00000100:00100000:0.0:1788201208.981394:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1389 00000100:00100000:1.0:1788201208.981399:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5285880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+85:2359:x1875064442591232:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201208.981409:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201208.981413:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000006bddf41/0x9383f985bc4ca171 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x411:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4764 expref: 85 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.981425:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000006bddf41/0x9383f985bc4ca171 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x411:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4764 expref: 85 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.981437:0:13438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d2aae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.981439:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006bddf41/0x9383f985bc4ca171 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x411:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4764 expref: 85 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.981447:0:13438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d2aae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.981450:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x411:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.981453:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x411:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.981458:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2aa7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x411:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.981463:0:13438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d2aae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.981466:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2aa7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x411:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.981472:0:13438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d2aae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.981484:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201208.981486:0:13438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788201208.981508:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5285880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+84:2359:x1875064442591232:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 112us (1776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201208.981518:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1390 00010000:00010000:3.0:1788201208.983126:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b13647a1/0x9383f985bc4d2a76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.983136:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b13647a1/0x9383f985bc4d2a76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.983151:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b13647a1/0x9383f985bc4d2a76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.983158:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5382680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+72:3312:x1875064458175488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21691us (24535us total) trans 4294968769 rc 0/0 00010000:00010000:3.0:1788201208.983158:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b13647a1/0x9383f985bc4d2a76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.983167:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4009 00010000:00010000:3.0:1788201208.983181:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788201208.983196:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201208.983201:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d2aae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.983210:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.983214:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d2aae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.983223:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d2aae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.983238:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d2aae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.983245:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d2aae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.984404:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201208.984410:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b13647a1/0x9383f985bc4d2a76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.984418:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507ca00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201208.984422:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b13647a1/0x9383f985bc4d2a76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.984430:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b13647a1/0x9383f985bc4d2a76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.984445:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b13647a1/0x9383f985bc4d2a76 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.984452:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b13647a1/0x9383f985bc4d2a76 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.984473:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201208.984474:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201208.984476:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.984686:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.984689:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.984691:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.984705:0:10484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2aa7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x411:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.984713:0:10484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2aa7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x411:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.984722:0:10484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2aa7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x411:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.984728:0:10484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2aa7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x411:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.984746:0:10484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201208.985149:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:3312:x1875064458173440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 58559us (58630us total) trans 4294968753 rc 0/0 00000100:00100000:3.0:1788201208.985159:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4001 00000100:00100000:0.0:1788201208.985160:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5029180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+66:3310:x1875064458175232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 27373us (27673us total) trans 4294968754 rc 0/0 00000100:00100000:0.0:1788201208.985166:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4008 00000004:00080000:1.0:1788201208.989521:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c5383480/2, rc 0, transno 4294968754 00000100:00100000:1.0:1788201208.989536:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5383480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458175232:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201208.994046:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5381880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458179328:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201208.994122:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201208.994291:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.994691:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.994710:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.994727:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.994771:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.994815:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.994830:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201208.994865:0:13442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c502a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:13442:1875064458177024:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201208.994884:0:13442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000def97333/0x9383f985bc4d2ad1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.994903:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442592256 00000100:00100000:1.0:1788201208.994905:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442592256 00010000:00010000:1.0:1788201208.994918:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000054a7c2c6/0x9383f985bc4b1a9e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc057 expref: 88 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201208.994932:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1392 00000100:00100000:1.0:1788201208.994937:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8104050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+88:2360:x1875064442591616:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201208.994944:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201208.994948:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ab7f4a9a/0x9383f985bc4c9ae1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x409:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4534 expref: 88 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.994967:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ab7f4a9a/0x9383f985bc4c9ae1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x409:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4534 expref: 88 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.994980:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab7f4a9a/0x9383f985bc4c9ae1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x409:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4534 expref: 88 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.994997:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x409:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.995000:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x409:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.995005:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee9d20ef/0x9383f985bc4d2ac3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x409:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.995015:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee9d20ef/0x9383f985bc4d2ac3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x409:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.995034:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201208.996030:0:13443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffaad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13443:1875064458176128:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201208.996048:0:13443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000927e33d1/0x9383f985bc4d2abc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.996068:0:13447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ee9d20ef/0x9383f985bc4d2ac3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x409:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.996076:0:13447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee9d20ef/0x9383f985bc4d2ac3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x409:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.996086:0:13447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee9d20ef/0x9383f985bc4d2ac3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x409:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.996094:0:13447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee9d20ef/0x9383f985bc4d2ac3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x409:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.996115:0:13447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788201208.996117:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8104050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+87:2360:x1875064442591616:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1177us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201208.996125:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1392 00010000:00010000:1.0:1788201208.996163:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201208.996169:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee9d20ef/0x9383f985bc4d2ac3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x409:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.996177:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201208.996181:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee9d20ef/0x9383f985bc4d2ac3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x409:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.996190:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee9d20ef/0x9383f985bc4d2ac3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x409:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.996202:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee9d20ef/0x9383f985bc4d2ac3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x409:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.996208:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee9d20ef/0x9383f985bc4d2ac3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x409:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.996229:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201208.996231:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201208.996233:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201208.996264:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1394 00000100:00100000:1.0:1788201208.996283:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+86:2361:x1875064442591488:12345-192.168.201.30@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201208.996495:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+66:3310:x1875064458176256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 25752us (25828us total) trans 4294968755 rc 0/0 00000100:00100000:3.0:1788201208.996503:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4012 00000100:00100000:3.0:1788201208.996545:0:13445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0085c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13445:1875064458177920:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201208.996667:0:13445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e97511ea/0x9383f985bc4d2adf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.996688:0:13442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000def97333/0x9383f985bc4d2ad1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.996697:0:13442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000def97333/0x9383f985bc4d2ad1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.996705:0:13442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000def97333/0x9383f985bc4d2ad1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.996713:0:13442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000def97333/0x9383f985bc4d2ad1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201208.996726:0:13442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201208.996929:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+73:3312:x1875064458176384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23415us (23769us total) trans 4294968770 rc 0/0 00000100:00100000:3.0:1788201208.996936:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4014 00010000:00010000:0.0:1788201208.997166:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201208.997173:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000def97333/0x9383f985bc4d2ad1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.997187:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201208.997191:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000def97333/0x9383f985bc4d2ad1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.997200:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000def97333/0x9383f985bc4d2ad1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.997213:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000def97333/0x9383f985bc4d2ad1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.997220:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000def97333/0x9383f985bc4d2ad1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.997235:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.997237:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201208.997239:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201208.997383:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1788201208.997389:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788201208.997395:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458179584:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788201208.997397:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001418dcd8/0x9383f985bc4ca393 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x414:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c481a expref: 86 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.997407:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001418dcd8/0x9383f985bc4ca393 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x414:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c481a expref: 86 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.997424:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001418dcd8/0x9383f985bc4ca393 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x414:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c481a expref: 86 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.997434:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x414:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.997438:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x414:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201208.997443:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000000382589/0x9383f985bc4d2aca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x414:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.997450:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000382589/0x9383f985bc4d2aca lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x414:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201208.997471:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201208.997472:0:13449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d80f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:13449:1875064458178176:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201208.997488:0:13449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b3effe3a/0x9383f985bc4d2aed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201208.997516:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1395 00000100:00100000:0.0:1788201208.997526:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+85:2362:x1875064442592000:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201208.997535:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201208.997540:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000460d2d36/0x9383f985bc4c56ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2d9b expref: 85 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.997550:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000460d2d36/0x9383f985bc4c56ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2d9b expref: 85 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.997635:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000460d2d36/0x9383f985bc4c56ee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2d9b expref: 85 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.997647:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.997650:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201208.997654:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000927e33d1/0x9383f985bc4d2abc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.997661:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000927e33d1/0x9383f985bc4d2abc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.997680:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201208.997692:0:13443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000927e33d1/0x9383f985bc4d2abc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.997701:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000927e33d1/0x9383f985bc4d2abc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.998506:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000927e33d1/0x9383f985bc4d2abc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.998515:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000927e33d1/0x9383f985bc4d2abc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201208.998535:0:13443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201208.999928:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201208.999980:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458179584 00000100:00100000:3.0:1788201208.999998:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458179584 00000100:00100000:3.0:1788201209.000040:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4025 00000100:00100000:3.0:1788201209.000050:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5381500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:3313:x1875064458179584:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788201209.000075:0:6706:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:679 count 1 00010000:00010000:3.0:1788201209.000096:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080c7e6b2/0x9383f985bc4d2b1e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.000114:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b92058bd/0x9383f985bc4b80fe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be39d expref: 84 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.000122:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a7:0x0].0x0 since=61s v=(0 0) 00010000:00010000:3.0:1788201209.000126:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.000130:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080c7e6b2/0x9383f985bc4d2b1e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.000159:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b92058bd/0x9383f985bc4b80fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be39d expref: 84 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.000170:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b92058bd/0x9383f985bc4b80fe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be39d expref: 84 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.000184:0:6706:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5383b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1875064458179712:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201209.000230:0:6706:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8140540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201209.000512:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+84:2361:x1875064442591488:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 4230us (5781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.000522:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1394 00000100:00100000:1.0:1788201209.000544:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1396 00000100:00100000:1.0:1788201209.000552:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+83:2360:x1875064442592128:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201209.000562:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201209.000568:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000388487b3/0x9383f985bc4bcbce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfd82 expref: 83 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.000581:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000388487b3/0x9383f985bc4bcbce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfd82 expref: 83 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.000600:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000388487b3/0x9383f985bc4bcbce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfd82 expref: 83 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.000611:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x305:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.000614:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x305:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.000619:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3effe3a/0x9383f985bc4d2aed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.000628:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3effe3a/0x9383f985bc4d2aed lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.000649:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201209.000670:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+82:2360:x1875064442592128:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 119us (5854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.000680:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1396 00000100:00100000:1.0:1788201209.000694:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1397 00000100:00100000:1.0:1788201209.000701:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+81:2360:x1875064442592256:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.000703:0:13441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d2ad8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.000708:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201209.000713:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000054a7c2c6/0x9383f985bc4b1a9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x227:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc057 expref: 81 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.000713:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d2ad8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.000724:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000054a7c2c6/0x9383f985bc4b1a9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x227:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc057 expref: 81 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.000725:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d2ad8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.000733:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d2ad8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.000738:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054a7c2c6/0x9383f985bc4b1a9e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x227:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc057 expref: 81 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.000747:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x227:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.000750:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x227:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.000817:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788201209.001036:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+73:3312:x1875064458176512:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26210us (26622us total) trans 4294968771 rc 0/0 00000100:00100000:3.0:1788201209.001044:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4015 00000100:00100000:3.0:1788201209.001072:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+565:2360:x1875064442591872:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 5700us (6359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.001079:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1393 00010000:00010000:1.0:1788201209.001403:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e97511ea/0x9383f985bc4d2adf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.001412:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e97511ea/0x9383f985bc4d2adf lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.001427:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201209.001434:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000927e33d1/0x9383f985bc4d2abc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.001447:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201209.001451:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000927e33d1/0x9383f985bc4d2abc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.001461:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000927e33d1/0x9383f985bc4d2abc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.001465:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c6630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+67:3310:x1875064458175872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 32839us (37916us total) trans 4294968756 rc 0/0 00000100:00100000:0.0:1788201209.001473:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4011 00010000:00010000:1.0:1788201209.001474:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000927e33d1/0x9383f985bc4d2abc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.001480:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000927e33d1/0x9383f985bc4d2abc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.001496:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201209.001500:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d2ad8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.001503:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201209.001506:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507cc00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201209.001509:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d2ad8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.001515:0:13449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b3effe3a/0x9383f985bc4d2aed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.001517:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d2ad8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.001524:0:13449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3effe3a/0x9383f985bc4d2aed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.001528:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d2ad8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.001533:0:13449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3effe3a/0x9383f985bc4d2aed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.001535:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d2ad8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.001541:0:13449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3effe3a/0x9383f985bc4d2aed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.001547:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201209.001549:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201209.001552:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3effe3a/0x9383f985bc4d2aed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.001554:0:13449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788201209.001557:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201209.001560:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3effe3a/0x9383f985bc4d2aed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.001568:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3effe3a/0x9383f985bc4d2aed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.001577:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3effe3a/0x9383f985bc4d2aed lrc: 2/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.001584:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201209.001586:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201209.001588:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788201209.001621:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04cffa8e00/2, rc 0, transno 4294968755 00000100:00100000:1.0:1788201209.001634:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458176256:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788201209.001645:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04d1f0c700/2, rc 0, transno 4294968756 00000100:00100000:1.0:1788201209.001649:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d1f0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458175872:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788201209.001725:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201209.001760:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+80:2360:x1875064442592256:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1050us (6918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.001769:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1397 00010000:00010000:0.0:1788201209.001823:0:13449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3effe3a/0x9383f985bc4d2aed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.003942:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442592640 00010000:00010000:2.0:1788201209.003952:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4b4252 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x259:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcdf5 expref: 568 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.003961:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442592896 00000100:00100000:2.0:1788201209.003964:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442592896 00010000:00010000:2.0:1788201209.003973:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cc26c653/0x9383f985bc4ca297 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x413:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c47c6 expref: 569 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.003981:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442593152 00000100:00100000:2.0:1788201209.003983:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442593152 00010000:00010000:2.0:1788201209.004007:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000b7273f7/0x9383f985bc4c1c1d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c193c expref: 80 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.004018:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442593024 00000100:00100000:2.0:1788201209.004021:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442593024 00010000:00010000:2.0:1788201209.004030:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000601cf275/0x9383f985bc4c369c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2273 expref: 570 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.004041:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1398 00000100:00100000:2.0:1788201209.004047:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5226d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+570:2359:x1875064442592512:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.004056:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.004060:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c2c78ea3/0x9383f985bc4b7fc3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be334 expref: 570 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.004071:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c2c78ea3/0x9383f985bc4b7fc3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be334 expref: 570 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.004093:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.004096:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.004101:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4e56fd5/0x9383f985bc4d2afb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.004109:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4e56fd5/0x9383f985bc4d2afb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.004121:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201209.004141:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5226d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+570:2359:x1875064442592512:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 94us (2084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.004148:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1398 00000100:00100000:2.0:1788201209.004161:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1399 00000100:00100000:2.0:1788201209.004166:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8107850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+569:2359:x1875064442592768:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.004172:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.004177:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a901a328/0x9383f985bc4c54cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2cec expref: 569 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.004186:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a901a328/0x9383f985bc4c54cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2cec expref: 569 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.004198:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a901a328/0x9383f985bc4c54cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2cec expref: 569 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.004214:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.004217:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.004221:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004525f602/0x9383f985bc4d2b09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.004228:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004525f602/0x9383f985bc4d2b09 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.004245:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201209.004424:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8107850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+568:2359:x1875064442592768:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 256us (2343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.004431:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1399 00000100:00100000:2.0:1788201209.004443:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1400 00000100:00100000:2.0:1788201209.004449:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5224700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+567:2359:x1875064442592384:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.004455:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.004460:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001a1ff243/0x9383f985bc4c1ae2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x369:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c18d3 expref: 567 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.004470:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001a1ff243/0x9383f985bc4c1ae2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x369:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c18d3 expref: 567 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.004482:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x369:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.004485:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x369:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.004489:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2af4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x369:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.004497:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2af4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x369:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.004507:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201209.004520:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5224700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+567:2359:x1875064442592384:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 71us (2424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.004525:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1400 00000100:00100000:2.0:1788201209.004535:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1401 00000100:00100000:2.0:1788201209.004540:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5227100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+566:2359:x1875064442592640:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.004546:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.004550:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4b4252 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x259:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcdf5 expref: 566 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.004559:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4b4252 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x259:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcdf5 expref: 566 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.004570:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x259:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.004703:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x259:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.004709:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000072b69b02/0x9383f985bc4d2b02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x259:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.004718:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072b69b02/0x9383f985bc4d2b02 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x259:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.004736:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201209.004811:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5227100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+566:2359:x1875064442592640:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 212us (2644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.004818:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1401 00000100:00100000:2.0:1788201209.004832:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1402 00000100:00100000:2.0:1788201209.004838:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0085c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+565:2359:x1875064442592896:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.004847:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.004851:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cc26c653/0x9383f985bc4ca297 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x413:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c47c6 expref: 565 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.004861:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cc26c653/0x9383f985bc4ca297 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x413:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c47c6 expref: 565 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.004873:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x413:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.004875:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x413:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.004880:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d2b10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x413:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.004888:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d2b10 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x413:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.004897:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201209.004912:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0085c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+565:2359:x1875064442592896:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 75us (2793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.004921:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1402 00000100:00100000:2.0:1788201209.004932:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1403 00000100:00100000:2.0:1788201209.004937:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0084e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+80:2362:x1875064442593152:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.004944:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.004948:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000b7273f7/0x9383f985bc4c1c1d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x36a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c193c expref: 80 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.004957:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000b7273f7/0x9383f985bc4c1c1d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x36a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c193c expref: 80 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.004969:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.004971:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.004975:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d2ae6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.004982:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d2ae6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.005006:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201209.005019:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0084e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+80:2362:x1875064442593152:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 82us (2866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.005024:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1403 00000100:00100000:2.0:1788201209.005038:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1404 00000100:00100000:2.0:1788201209.005044:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+564:2362:x1875064442593024:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.005054:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.005058:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000601cf275/0x9383f985bc4c369c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2273 expref: 564 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.005069:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000601cf275/0x9383f985bc4c369c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2273 expref: 564 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.005081:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000601cf275/0x9383f985bc4c369c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2273 expref: 564 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.005092:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.005094:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.005098:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aaee9d17/0x9383f985bc4d2ab5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.005105:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaee9d17/0x9383f985bc4d2ab5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.005125:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201209.005139:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+563:2362:x1875064442593024:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 95us (2975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.005145:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1404 00010000:00010000:2.0:1788201209.005168:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004525f602/0x9383f985bc4d2b09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.005177:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004525f602/0x9383f985bc4d2b09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.005185:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004525f602/0x9383f985bc4d2b09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.005192:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004525f602/0x9383f985bc4d2b09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.005216:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788201209.005732:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+75:3312:x1875064458178816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23687us (23756us total) trans 4294968772 rc 0/0 00000100:00100000:2.0:1788201209.005740:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4022 00000004:00080000:2.0:1788201209.005845:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c5224000/2, rc 0, transno 4294968772 00000100:00100000:2.0:1788201209.005857:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458178816:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.005918:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201209.005929:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff057480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458180352:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.005963:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788201209.006042:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201209.006050:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000382589/0x9383f985bc4d2aca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x414:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.006059:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507c600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201209.006064:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000382589/0x9383f985bc4d2aca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x414:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.006073:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000382589/0x9383f985bc4d2aca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x414:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.006075:0:13448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b7273f7/0x9383f985bc4c1c1d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c193c expref: 79 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.006086:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000382589/0x9383f985bc4d2aca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x414:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.006087:0:13448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c20bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:13448:1875064458178048:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201209.006093:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000382589/0x9383f985bc4d2aca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x414:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.006106:0:13448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d2ae6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.006109:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201209.006113:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004525f602/0x9383f985bc4d2b09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.006114:0:13448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d2ae6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.006120:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507dc00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.006122:0:13448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d2ae6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.006124:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004525f602/0x9383f985bc4d2b09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.006132:0:13448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d2ae6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.006132:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004525f602/0x9383f985bc4d2b09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.006140:0:13448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d2ae6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.006142:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004525f602/0x9383f985bc4d2b09 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.006149:0:13448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201209.006150:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004525f602/0x9383f985bc4d2b09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.006161:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201209.006164:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d2ae6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.006170:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201209.006173:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d2ae6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.006180:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d2ae6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.006189:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d2ae6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.006196:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000608f96c4/0x9383f985bc4d2ae6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.006207:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201209.006209:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201209.006210:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201209.006430:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458180352 00000100:00100000:2.0:1788201209.006439:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458180352 00000100:00100000:2.0:1788201209.006470:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4028 00000100:00100000:2.0:1788201209.006478:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+75:3310:x1875064458180352:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201209.006498:0:13441:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1031 count 1 00010000:00010000:2.0:1788201209.006518:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d2b33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x407:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.006533:0:13441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008baee9f0/0x9383f985bc4c98d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x407:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4485 expref: 562 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.006546:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x407:0x0].0x0 since=17s v=(0 0) 00010000:00010000:2.0:1788201209.006550:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x407:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.006554:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d2b33 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x407:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.006832:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+68:3312:x1875064458177408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 31093us (31710us total) trans 4294968759 rc 0/0 00000100:00100000:0.0:1788201209.006840:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4017 00010000:00010000:0.0:1788201209.006861:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.006867:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788201209.006886:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04cffaa680/2, rc 0, transno 4294968759 00000100:00100000:0.0:1788201209.006891:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458177408:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.006922:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c502b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+67:3310:x1875064458177152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 30881us (31640us total) trans 4294968757 rc 0/0 00000100:00100000:0.0:1788201209.006929:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4019 00000004:00080000:0.0:1788201209.006953:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04cffa9180/2, rc 0, transno 4294968757 00000100:00100000:0.0:1788201209.006957:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458177152:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.007037:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458180736:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.007061:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201209.007077:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201209.007082:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458180864:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.007099:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201209.007119:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458180736 00000100:00100000:0.0:1788201209.007122:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458180736 00000100:00100000:0.0:1788201209.007141:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458180864 00000100:00100000:0.0:1788201209.007143:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458180864 00000100:00100000:0.0:1788201209.007156:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4029 00000100:00100000:0.0:1788201209.007162:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d80f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+68:3310:x1875064458180736:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201209.007175:0:13444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:676 count 1 00010000:00010000:0.0:1788201209.007187:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000853c0bb8/0x9383f985bc4d2b3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.007200:0:13444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000578cd141/0x9383f985bc4b7e88 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be2cb expref: 78 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.007207:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a4:0x0].0x0 since=61s v=(0 0) 00010000:00010000:0.0:1788201209.007211:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.007215:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000853c0bb8/0x9383f985bc4d2b3a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.007235:0:13444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000578cd141/0x9383f985bc4b7e88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be2cb expref: 78 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.007253:0:13444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000578cd141/0x9383f985bc4b7e88 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be2cb expref: 78 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.007264:0:13444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13444:1875064458181120:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.007463:0:13441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008baee9f0/0x9383f985bc4c98d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x407:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4485 expref: 562 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.007472:0:13441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008baee9f0/0x9383f985bc4c98d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x407:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4485 expref: 562 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.007483:0:13441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff054380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:13441:1875064458181248:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.007514:0:13440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aaee9d17/0x9383f985bc4d2ab5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.007522:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaee9d17/0x9383f985bc4d2ab5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.007529:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaee9d17/0x9383f985bc4d2ab5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.007535:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaee9d17/0x9383f985bc4d2ab5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.007569:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201209.007920:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5380000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+76:3312:x1875064458175616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 43759us (44966us total) trans 4294968773 rc 0/0 00000100:00100000:2.0:1788201209.007927:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4010 00000100:00100000:2.0:1788201209.007947:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4030 00000100:00100000:2.0:1788201209.007954:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+68:3310:x1875064458180864:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201209.007966:0:13440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:704 count 1 00010000:00010000:2.0:1788201209.007979:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8bee2d2/0x9383f985bc4d2b41 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.008001:0:13440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec0fe3ff/0x9383f985bc4b94d8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bea6c expref: 78 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.008009:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c0:0x0].0x0 since=58s v=(0 0) 00010000:00010000:2.0:1788201209.008012:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.008016:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8bee2d2/0x9383f985bc4d2b41 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.008034:0:13440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ec0fe3ff/0x9383f985bc4b94d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bea6c expref: 78 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.008044:0:13440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ec0fe3ff/0x9383f985bc4b94d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bea6c expref: 78 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.008060:0:13440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff054a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:13440:1875064458181376:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.008107:0:13446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc26c653/0x9383f985bc4ca297 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x413:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c47c6 expref: 562 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.008120:0:13446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5225f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:13446:1875064458179200:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.008135:0:13446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d2b10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x413:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.008144:0:13446:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d2b10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x413:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.008151:0:13446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d2b10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x413:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.008159:0:13446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d2b10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x413:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.008167:0:13446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d2b10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x413:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.008232:0:13446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788201209.008500:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5226a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+76:3310:x1875064458179072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24538us (24625us total) trans 4294968774 rc 0/0 00000100:00100000:2.0:1788201209.008510:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4023 00010000:00010000:2.0:1788201209.008552:0:13439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2c78ea3/0x9383f985bc4b7fc3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be334 expref: 561 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.008580:0:13439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5380700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:13439:1875064458178560:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.008594:0:13439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c4e56fd5/0x9383f985bc4d2afb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.008603:0:13439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c4e56fd5/0x9383f985bc4d2afb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.008610:0:13439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4e56fd5/0x9383f985bc4d2afb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.008618:0:13439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4e56fd5/0x9383f985bc4d2afb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.008626:0:13439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4e56fd5/0x9383f985bc4d2afb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.008638:0:13439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1788201209.008742:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5028a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+76:3310:x1875064458177536:12345-0@lo:6:osp-syn-0-0.0 Request processed in 32898us (33541us total) trans 4294968775 rc 0/0 00000100:00100000:2.0:1788201209.008748:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4018 00010000:00010000:1.0:1788201209.010522:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201209.010533:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaee9d17/0x9383f985bc4d2ab5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.010545:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201209.010550:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaee9d17/0x9383f985bc4d2ab5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.010560:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaee9d17/0x9383f985bc4d2ab5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.010581:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaee9d17/0x9383f985bc4d2ab5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.010588:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaee9d17/0x9383f985bc4d2ab5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.010610:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201209.010615:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d2b10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x413:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.010621:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507c800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201209.010625:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d2b10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x413:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.010633:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d2b10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x413:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.010641:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d2b10 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x413:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.010648:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d2b10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x413:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.010661:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201209.010665:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4e56fd5/0x9383f985bc4d2afb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.010672:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3016600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201209.010675:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4e56fd5/0x9383f985bc4d2afb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.010682:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4e56fd5/0x9383f985bc4d2afb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.010691:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4e56fd5/0x9383f985bc4d2afb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.010697:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4e56fd5/0x9383f985bc4d2afb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.010710:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201209.010712:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201209.010713:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201209.010729:0:13444:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201209.010833:0:13441:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d033a900 going to sleep for 11 seconds 00010000:00010000:0.0:1788201209.010850:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.010855:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788201209.010896:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c5227480/2, rc 0, transno 4294968774 00000100:00100000:0.0:1788201209.010910:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5227480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458179072:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788201209.010923:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f0087100/2, rc 0, transno 4294968775 00000100:00100000:0.0:1788201209.010927:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458177536:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201209.011013:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458181632:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201209.011062:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201209.011100:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458181632 00000100:00100000:0.0:1788201209.011106:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458181632 00000100:00100000:0.0:1788201209.011141:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4031 00000100:00100000:0.0:1788201209.011148:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+76:3310:x1875064458181632:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201209.011170:0:13443:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:709 count 1 00010000:00010000:0.0:1788201209.011188:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2b48 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.011204:0:13443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000005914f50/0x9383f985bc4b985f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bebca expref: 560 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.011219:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c5:0x0].0x0 since=57s v=(0 0) 00010000:00010000:0.0:1788201209.011223:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.011227:0:13443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2b48 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.011261:0:13443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000005914f50/0x9383f985bc4b985f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bebca expref: 560 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.011274:0:13443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000005914f50/0x9383f985bc4b985f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bebca expref: 560 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.011286:0:13443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13443:1875064458181760:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.011532:0:13443:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201209.011680:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458180480:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.011709:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201209.011831:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c20bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458180992:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.011854:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788201209.011978:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c5029f80/2, rc 0, transno 4294968773 00000100:00100000:0.0:1788201209.011998:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5029f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458175616:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201209.012009:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788201209.012015:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458180608:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.012037:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.012063:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458180480 00000100:00100000:2.0:1788201209.012068:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458180480 00000100:00100000:2.0:1788201209.012096:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458180992 00000100:00100000:2.0:1788201209.012099:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458180992 00000100:00100000:2.0:1788201209.012114:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4032 00000100:00100000:2.0:1788201209.012120:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+70:3312:x1875064458180480:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201209.012138:0:13450:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:688 count 1 00010000:00010000:3.0:1788201209.012139:0:13445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e97511ea/0x9383f985bc4d2adf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.012152:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e97511ea/0x9383f985bc4d2adf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.012154:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056e17fb0/0x9383f985bc4d2b4f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.012161:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e97511ea/0x9383f985bc4d2adf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.012166:0:13450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000742aee97/0x9383f985bc4b87e2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be61a expref: 78 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.012175:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b0:0x0].0x0 since=60s v=(0 0) 00010000:00010000:3.0:1788201209.012175:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e97511ea/0x9383f985bc4d2adf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.012178:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.012182:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056e17fb0/0x9383f985bc4d2b4f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.012192:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201209.012202:0:13450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000742aee97/0x9383f985bc4b87e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be61a expref: 78 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.012211:0:13450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000742aee97/0x9383f985bc4b87e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be61a expref: 78 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.012223:0:13450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff057800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:13450:1875064458181888:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.012246:0:13450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341d180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201209.012276:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4033 00000100:00100000:2.0:1788201209.012283:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+70:3312:x1875064458180992:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201209.012324:0:6703:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:871 count 1 00010000:00010000:2.0:1788201209.012336:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d2b56 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.012348:0:6703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7259ee5/0x9383f985bc4c1992 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1863 expref: 78 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.012355:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x367:0x0].0x0 since=36s v=(0 0) 00010000:00010000:2.0:1788201209.012358:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x367:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.012362:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d2b56 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.012381:0:6703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a7259ee5/0x9383f985bc4c1992 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1863 expref: 78 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.012391:0:6703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a7259ee5/0x9383f985bc4c1992 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1863 expref: 78 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.012401:0:6703:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff056300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6703:1875064458182016:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.012422:0:6703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341d3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788201209.012453:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201209.012458:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e97511ea/0x9383f985bc4d2adf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.012467:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201209.012471:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e97511ea/0x9383f985bc4d2adf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.012480:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e97511ea/0x9383f985bc4d2adf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.012495:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e97511ea/0x9383f985bc4d2adf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.012501:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e97511ea/0x9383f985bc4d2adf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.012518:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201209.012520:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201209.012521:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201209.012593:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201209.012652:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442593280 00000100:00100000:2.0:1788201209.012656:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442593280 00010000:00010000:2.0:1788201209.012675:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004ffc7af9/0x9383f985bc4c3561 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c21d2 expref: 79 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.012700:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1405 00000100:00100000:2.0:1788201209.012707:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+79:2359:x1875064442593280:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.012717:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.012722:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004ffc7af9/0x9383f985bc4c3561 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c21d2 expref: 79 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.012734:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004ffc7af9/0x9383f985bc4c3561 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c21d2 expref: 79 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.012813:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ffc7af9/0x9383f985bc4c3561 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c21d2 expref: 79 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.012826:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.012829:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.012834:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007be97ade/0x9383f985bc4d2b17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.012842:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007be97ade/0x9383f985bc4d2b17 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x38a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.012862:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201209.013724:0:13438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007be97ade/0x9383f985bc4d2b17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.013737:0:13438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007be97ade/0x9383f985bc4d2b17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.013816:0:13438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007be97ade/0x9383f985bc4d2b17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.013826:0:13438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007be97ade/0x9383f985bc4d2b17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.013842:0:13438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201209.013986:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+72:3311:x1875064458179328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19709us (19862us total) trans 4294968761 rc 0/0 00000100:00100000:2.0:1788201209.014003:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4024 00000100:00100000:2.0:1788201209.014023:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458180608 00000100:00100000:2.0:1788201209.014027:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458180608 00000100:00100000:2.0:1788201209.014049:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4034 00000100:00100000:2.0:1788201209.014055:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+72:3312:x1875064458180608:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201209.014073:0:13438:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:701 count 1 00010000:00010000:2.0:1788201209.014088:0:13438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0d4f162/0x9383f985bc4d2b5d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.014101:0:13438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000321c339c/0x9383f985bc4b928c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be9a8 expref: 78 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.014109:0:13438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2bd:0x0].0x0 since=58s v=(0 0) 00010000:00010000:2.0:1788201209.014112:0:13438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.014117:0:13438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0d4f162/0x9383f985bc4d2b5d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.014144:0:13438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000321c339c/0x9383f985bc4b928c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be9a8 expref: 78 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.014155:0:13438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000321c339c/0x9383f985bc4b928c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be9a8 expref: 78 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.014167:0:13438:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff054700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13438:1875064458182144:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.014467:0:13438:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788201209.014492:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+78:2359:x1875064442593280:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1784us (1899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.014501:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1405 00000100:00100000:0.0:1788201209.014950:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458181504:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201209.015201:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201209.015285:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458181504 00000100:00100000:0.0:1788201209.015290:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458181504 00000100:00100000:0.0:1788201209.015494:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4035 00000100:00100000:0.0:1788201209.015502:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+77:3312:x1875064458181504:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201209.015521:0:13448:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:553 count 1 00010000:00010000:0.0:1788201209.015539:0:13448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2b64 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.015667:0:13448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ecb43c96/0x9383f985bc4b1bd9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc0c0 expref: 560 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.015678:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x229:0x0].0x0 since=80s v=(0 0) 00010000:00010000:0.0:1788201209.015681:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x229:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.015686:0:13448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2b64 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.015710:0:13448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ecb43c96/0x9383f985bc4b1bd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc0c0 expref: 560 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.015722:0:13448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ecb43c96/0x9383f985bc4b1bd9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc0c0 expref: 560 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.015734:0:13448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cff3b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:13448:1875064458182400:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.015884:0:13448:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5300 going to sleep for 11 seconds 00010000:00010000:0.0:1788201209.015899:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201209.015905:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007be97ade/0x9383f985bc4d2b17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.015914:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507c000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.015919:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007be97ade/0x9383f985bc4d2b17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.015927:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007be97ade/0x9383f985bc4d2b17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.015945:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007be97ade/0x9383f985bc4d2b17 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.015953:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007be97ade/0x9383f985bc4d2b17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.015973:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.015975:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.015977:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201209.015996:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201209.016006:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cff39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458182272:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201209.016033:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201209.016054:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458182272 00000100:00100000:0.0:1788201209.016058:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458182272 00000100:00100000:0.0:1788201209.016088:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4036 00000100:00100000:0.0:1788201209.016095:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+78:3310:x1875064458182272:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201209.016107:0:10484:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:904 count 1 00010000:00010000:0.0:1788201209.016119:0:10484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d2b6b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.016131:0:10484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001bd15a0d/0x9383f985bc4c33a8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2146 expref: 560 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.016138:0:10484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x388:0x0].0x0 since=33s v=(0 0) 00010000:00010000:0.0:1788201209.016141:0:10484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x388:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.016145:0:10484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d2b6b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.016162:0:10484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001bd15a0d/0x9383f985bc4c33a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2146 expref: 560 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.016171:0:10484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001bd15a0d/0x9383f985bc4c33a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2146 expref: 560 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.016182:0:10484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cff3a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10484:1875064458182528:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.016203:0:10484:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201209.016227:0:13440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d033acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201209.016259:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+77:2362:x1875064442592000:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 18724us (21475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201209.016268:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1395 00010000:00010000:0.0:1788201209.016369:0:12363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a1ff243/0x9383f985bc4c1ae2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c18d3 expref: 560 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.016387:0:12363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12363:1875064458178432:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.016403:0:12363:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2af4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.016412:0:12363:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2af4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.016419:0:12363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2af4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.016428:0:12363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2af4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.016436:0:12363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2af4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.016451:0:12363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201209.016463:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201209.016468:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2af4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.016475:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.016479:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2af4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.016492:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2af4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.016503:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2af4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.016510:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2af4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.016523:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.016525:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.016526:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201209.016769:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c502bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+79:3310:x1875064458177664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 40587us (41424us total) trans 4294968776 rc 0/0 00000100:00100000:0.0:1788201209.016776:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4020 00000004:00080000:0.0:1788201209.016810:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f0084700/2, rc 0, transno 4294968776 00000100:00100000:0.0:1788201209.016820:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0084700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458177664:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201209.016865:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cff3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458182656:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201209.016889:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201209.016918:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458182656 00000100:00100000:0.0:1788201209.016922:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458182656 00000100:00100000:0.0:1788201209.016941:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4037 00000100:00100000:0.0:1788201209.016947:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+79:3312:x1875064458182656:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201209.016961:0:6705:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:887 count 1 00010000:00010000:0.0:1788201209.016974:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c576e396/0x9383f985bc4d2b72 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.016986:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000203ea8e/0x9383f985bc4c25e0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1cae expref: 559 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.017006:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x377:0x0].0x0 since=34s v=(0 0) 00010000:00010000:0.0:1788201209.017010:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x377:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.017014:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c576e396/0x9383f985bc4d2b72 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.017035:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000203ea8e/0x9383f985bc4c25e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1cae expref: 559 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.017045:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000203ea8e/0x9383f985bc4c25e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1cae expref: 559 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.017055:0:6705:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6705:1875064458182784:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.017086:0:6705:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5b40 going to sleep for 11 seconds 00010000:00010000:0.0:1788201209.017122:0:13451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4b4252 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x259:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcdf5 expref: 559 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.017134:0:13451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:13451:1875064458178688:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.017146:0:13451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000072b69b02/0x9383f985bc4d2b02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.017155:0:13451:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000072b69b02/0x9383f985bc4d2b02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.017163:0:13451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072b69b02/0x9383f985bc4d2b02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.017171:0:13451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072b69b02/0x9383f985bc4d2b02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.017179:0:13451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072b69b02/0x9383f985bc4d2b02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.017198:0:13451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201209.017343:0:13451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+80:3312:x1875064458178304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 37088us (37510us total) trans 4294968777 rc 0/0 00000100:00100000:0.0:1788201209.017350:0:13451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4021 00000004:00080000:0.0:1788201209.017379:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c5225180/2, rc 0, transno 4294968777 00000100:00100000:0.0:1788201209.017386:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5225180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458178304:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201209.017420:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201209.017428:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458182912:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201209.017451:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201209.017477:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458182912 00000100:00100000:0.0:1788201209.017481:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458182912 00000100:00100000:0.0:1788201209.017505:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4038 00000100:00100000:0.0:1788201209.017511:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+80:3312:x1875064458182912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201209.017522:0:12363:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:890 count 1 00010000:00010000:0.0:1788201209.017533:0:12363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f91e6384/0x9383f985bc4d2b79 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.017543:0:12363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000782a0b8c/0x9383f985bc4c2856 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1d80 expref: 558 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.017549:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37a:0x0].0x0 since=34s v=(0 0) 00010000:00010000:0.0:1788201209.017551:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.017554:0:12363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f91e6384/0x9383f985bc4d2b79 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.017572:0:12363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000782a0b8c/0x9383f985bc4c2856 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1d80 expref: 558 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.017581:0:12363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000782a0b8c/0x9383f985bc4c2856 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1d80 expref: 558 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.017591:0:12363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12363:1875064458183040:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.018397:0:12363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a59c0 going to sleep for 11 seconds 00000004:00080000:0.0:1788201209.018440:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c5381880/2, rc 0, transno 4294968761 00000100:00100000:0.0:1788201209.018451:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5381880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458179328:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.018498:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458183168:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.018525:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201209.018686:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458183168 00000100:00100000:0.0:1788201209.018691:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458183168 00000100:00100000:0.0:1788201209.018722:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4039 00000100:00100000:0.0:1788201209.018728:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+73:3310:x1875064458183168:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201209.018745:0:13446:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:909 count 1 00010000:00010000:0.0:1788201209.018952:0:13446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2b80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.018969:0:13446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000080d08ad3/0x9383f985bc4c37d7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c22dc expref: 76 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.018976:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38d:0x0].0x0 since=32s v=(0 0) 00010000:00010000:0.0:1788201209.018980:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.018984:0:13446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2b80 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.019018:0:13446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000080d08ad3/0x9383f985bc4c37d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c22dc expref: 76 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.019030:0:13446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000080d08ad3/0x9383f985bc4c37d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c22dc expref: 76 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.019042:0:13446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3449180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:13446:1875064458183296:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.019070:0:13446:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5780 going to sleep for 11 seconds 00010000:00010000:0.0:1788201209.019503:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201209.019510:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072b69b02/0x9383f985bc4d2b02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.019519:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.019524:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072b69b02/0x9383f985bc4d2b02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.019534:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072b69b02/0x9383f985bc4d2b02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.019551:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072b69b02/0x9383f985bc4d2b02 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.019568:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072b69b02/0x9383f985bc4d2b02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.019654:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.019656:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.019658:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201209.021606:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f965d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+73:3312:x1875064458177280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 46404us (46527us total) trans 4294968760 rc 0/0 00000100:00100000:3.0:1788201209.021618:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4016 00000100:00100000:2.0:1788201209.021652:0:6706:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5383b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1875064458179712:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.021673:0:6706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000080c7e6b2/0x9383f985bc4d2b1e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.021710:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201209.021748:0:13442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff054000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:13442:1875064458180224:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.021934:0:13442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b13647a1/0x9383f985bc4d2b2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x326:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.021962:0:13447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff055180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:13447:1875064458180096:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.021974:0:13447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000345b80e5/0x9383f985bc4d2b25 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.022010:0:13438:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff054700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13438:1875064458182144:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.022021:0:13438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d0d4f162/0x9383f985bc4d2b5d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.022044:0:13450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff057800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:13450:1875064458181888:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.022056:0:13450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000056e17fb0/0x9383f985bc4d2b4f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.022074:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442593408 00000100:00100000:2.0:1788201209.022080:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442593408 00010000:00010000:2.0:1788201209.022105:0:7646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b92058bd/0x9383f985bc4b80fe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be39d expref: 77 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.022130:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1406 00000100:00100000:2.0:1788201209.022137:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8105450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+77:2361:x1875064442593408:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.022149:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.022154:0:7646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b92058bd/0x9383f985bc4b80fe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be39d expref: 77 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.022166:0:7646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b92058bd/0x9383f985bc4b80fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be39d expref: 77 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.022185:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b92058bd/0x9383f985bc4b80fe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be39d expref: 77 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.022199:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.022203:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.022208:0:7646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000080c7e6b2/0x9383f985bc4d2b1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.022218:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080c7e6b2/0x9383f985bc4d2b1e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.022236:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201209.022262:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000080c7e6b2/0x9383f985bc4d2b1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.022270:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080c7e6b2/0x9383f985bc4d2b1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.022281:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080c7e6b2/0x9383f985bc4d2b1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.022289:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080c7e6b2/0x9383f985bc4d2b1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.022384:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201209.022811:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5381500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+73:3313:x1875064458179584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22704us (22828us total) trans 4294968762 rc 0/0 00000100:00100000:2.0:1788201209.022820:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4025 00000100:00100000:2.0:1788201209.022870:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8105450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+76:2361:x1875064442593408:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 732us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.022927:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1406 00000100:00100000:2.0:1788201209.023171:0:6703:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff056300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6703:1875064458182016:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.023188:0:6703:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d2b56 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.023548:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201209.023681:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201209.023701:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201209.023718:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201209.023739:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201209.023823:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201209.023843:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201209.023854:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201209.023943:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201209.023961:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442593536 00000100:00100000:2.0:1788201209.023966:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442593536 00010000:00010000:2.0:1788201209.024000:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b6269758/0x9383f985bc4be566 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x326:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0673 expref: 559 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.024020:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442593792 00000100:00100000:2.0:1788201209.024023:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442593792 00010000:00010000:2.0:1788201209.024036:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000742aee97/0x9383f985bc4b87e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be61a expref: 76 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.024047:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442594048 00000100:00100000:2.0:1788201209.024050:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442594048 00010000:00010000:2.0:1788201209.024059:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000321c339c/0x9383f985bc4b928c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be9a8 expref: 77 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.024068:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442594304 00000100:00100000:2.0:1788201209.024070:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442594304 00010000:00010000:2.0:1788201209.024080:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008baee9f0/0x9383f985bc4c98d4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x407:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4485 expref: 560 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.024089:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442594560 00000100:00100000:2.0:1788201209.024091:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442594560 00010000:00010000:2.0:1788201209.024099:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ec0fe3ff/0x9383f985bc4b94d8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bea6c expref: 78 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.024109:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442593664 00000100:00100000:2.0:1788201209.024110:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442593664 00010000:00010000:2.0:1788201209.024120:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000005914f50/0x9383f985bc4b985f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bebca expref: 561 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.024129:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442593920 00000100:00100000:2.0:1788201209.024131:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442593920 00010000:00010000:2.0:1788201209.024139:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a7259ee5/0x9383f985bc4c1992 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1863 expref: 79 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.024148:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442594176 00000100:00100000:2.0:1788201209.024150:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442594176 00010000:00010000:2.0:1788201209.024159:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000578cd141/0x9383f985bc4b7e88 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be2cb expref: 80 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.024174:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442594432 00000100:00100000:2.0:1788201209.024176:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442594432 00010000:00010000:2.0:1788201209.024185:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c07187d8/0x9383f985bc4bc9c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfcd3 expref: 562 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.024197:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1407 00000100:00100000:2.0:1788201209.024204:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff056300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+562:2360:x1875064442593536:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.024215:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.024220:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b6269758/0x9383f985bc4be566 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x326:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0673 expref: 562 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.024230:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b6269758/0x9383f985bc4be566 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x326:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0673 expref: 562 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.024250:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6269758/0x9383f985bc4be566 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x326:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0673 expref: 562 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.024400:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1408 00000100:00100000:3.0:1788201209.024410:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff057800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+80:2360:x1875064442593792:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.024412:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x326:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.024416:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x326:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.024419:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.024421:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b13647a1/0x9383f985bc4d2b2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x326:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.024424:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000742aee97/0x9383f985bc4b87e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be61a expref: 80 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.024430:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b13647a1/0x9383f985bc4d2b2c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x326:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.024434:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000742aee97/0x9383f985bc4b87e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be61a expref: 80 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.024448:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000742aee97/0x9383f985bc4b87e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be61a expref: 80 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.024457:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.024459:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201209.024460:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.024464:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000056e17fb0/0x9383f985bc4d2b4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.024476:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056e17fb0/0x9383f985bc4d2b4f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.024489:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff056300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+561:2360:x1875064442593536:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 285us (942us total) trans 0 rc 0/0 00010000:00010000:3.0:1788201209.024491:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201209.024497:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1407 00000100:00100000:3.0:1788201209.024507:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff057800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+79:2360:x1875064442593792:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 101us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.024513:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1408 00000100:00100000:2.0:1788201209.024678:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1409 00000100:00100000:2.0:1788201209.024687:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff054700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+78:2360:x1875064442594048:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.024695:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.024700:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000321c339c/0x9383f985bc4b928c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be9a8 expref: 78 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.024711:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000321c339c/0x9383f985bc4b928c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be9a8 expref: 78 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.024724:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000321c339c/0x9383f985bc4b928c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be9a8 expref: 78 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.024735:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.024738:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.024742:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d0d4f162/0x9383f985bc4d2b5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.024847:0:13443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13443:1875064458181760:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.024866:0:13443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2b48 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.024952:0:13441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff054380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:13441:1875064458181248:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.024965:0:13441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d2b33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x407:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.024999:0:13444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13444:1875064458181120:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.025012:0:13444:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000853c0bb8/0x9383f985bc4d2b3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.025033:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201209.025040:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080c7e6b2/0x9383f985bc4d2b1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.025048:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3016400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.025053:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080c7e6b2/0x9383f985bc4d2b1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.025063:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080c7e6b2/0x9383f985bc4d2b1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.025075:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080c7e6b2/0x9383f985bc4d2b1e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.025083:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080c7e6b2/0x9383f985bc4d2b1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.025099:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.025101:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.025102:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788201209.025126:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00dea00/2, rc 0, transno 4294968762 00000100:00100000:0.0:1788201209.025138:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458179584:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.025195:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201209.025205:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3449f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458183424:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.025241:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201209.025481:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0d4f162/0x9383f985bc4d2b5d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.025512:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201209.025729:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff054700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+77:2360:x1875064442594048:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1042us (2025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.025738:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1409 00000100:00100000:2.0:1788201209.025816:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1410 00000100:00100000:2.0:1788201209.025825:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff055180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+560:2360:x1875064442594304:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.025835:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.025840:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008baee9f0/0x9383f985bc4c98d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x407:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4485 expref: 560 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.025851:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008baee9f0/0x9383f985bc4c98d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x407:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4485 expref: 560 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.025866:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008baee9f0/0x9383f985bc4c98d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x407:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4485 expref: 560 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.025946:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x407:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.025949:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x407:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.025953:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d2b33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x407:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.025962:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d2b33 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x407:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.025999:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201209.026014:0:13441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d2b33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x407:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.026022:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d2b33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x407:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.026031:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d2b33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x407:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.026040:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d2b33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x407:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.026056:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1788201209.026136:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04cffab480/2, rc 0, transno 4294968760 00000100:00100000:1.0:1788201209.026147:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458177280:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.026422:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+81:3310:x1875064458180352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19943us (20457us total) trans 4294968778 rc 0/0 00000100:00100000:2.0:1788201209.026430:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4028 00000100:00100000:2.0:1788201209.026444:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458183424 00000100:00100000:2.0:1788201209.026449:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458183424 00000100:00100000:2.0:1788201209.026479:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4040 00000100:00100000:2.0:1788201209.026484:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+73:3310:x1875064458183424:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201209.026504:0:13441:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:921 count 1 00010000:00010000:2.0:1788201209.026522:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d2b87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x399:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.026536:0:13441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4d0dca6/0x9383f985bc4c41af lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x399:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2624 expref: 76 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.026544:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x399:0x0].0x0 since=31s v=(0 0) 00010000:00010000:2.0:1788201209.026547:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x399:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.026551:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d2b87 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x399:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.026687:0:13441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f4d0dca6/0x9383f985bc4c41af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x399:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2624 expref: 76 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.026699:0:13441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f4d0dca6/0x9383f985bc4c41af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x399:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2624 expref: 76 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.026712:0:13441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff055880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:13441:1875064458183552:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.026852:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201209.026858:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d2b33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x407:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.026866:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507ce00 already unused, calling callback (ffffffffc13fbfe0) 00000100:00100000:2.0:1788201209.026954:0:13441:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341d180 going to sleep for 11 seconds 00010000:00010000:2.0:1788201209.026971:0:13442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b13647a1/0x9383f985bc4d2b2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.026979:0:13442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b13647a1/0x9383f985bc4d2b2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.026998:0:13442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b13647a1/0x9383f985bc4d2b2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.027006:0:13442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b13647a1/0x9383f985bc4d2b2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.027026:0:13442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1788201209.027059:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04ff057480/2, rc 0, transno 4294968778 00000100:00100000:1.0:1788201209.027070:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff057480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458180352:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788201209.027492:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d2b33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x407:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.027505:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d2b33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x407:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.027520:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d2b33 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x407:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.027528:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d2b33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x407:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.027545:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201209.027548:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b13647a1/0x9383f985bc4d2b2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.027554:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507ca00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.027672:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b13647a1/0x9383f985bc4d2b2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.027681:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b13647a1/0x9383f985bc4d2b2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.027698:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b13647a1/0x9383f985bc4d2b2c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.027706:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b13647a1/0x9383f985bc4d2b2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.027720:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.027721:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.027723:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.027729:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201209.027857:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff054e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+81:3312:x1875064458179840:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24749us (25014us total) trans 4294968779 rc 0/0 00000100:00100000:2.0:1788201209.027865:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4027 00000100:00100000:2.0:1788201209.027911:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff055180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+559:2360:x1875064442594304:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 2087us (4191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.027919:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1410 00000100:00100000:2.0:1788201209.027934:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1411 00000100:00100000:2.0:1788201209.027943:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff054000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+76:2360:x1875064442594560:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.027954:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.027960:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ec0fe3ff/0x9383f985bc4b94d8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bea6c expref: 76 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.027971:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ec0fe3ff/0x9383f985bc4b94d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bea6c expref: 76 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.027986:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.027999:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.028004:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e8bee2d2/0x9383f985bc4d2b41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.028013:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8bee2d2/0x9383f985bc4d2b41 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.028032:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201209.028050:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff054000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+76:2360:x1875064442594560:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 109us (4310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.028057:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1411 00000100:00100000:2.0:1788201209.028070:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1412 00000100:00100000:2.0:1788201209.028077:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff057100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+558:2360:x1875064442593664:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.028085:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.028091:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000005914f50/0x9383f985bc4b985f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bebca expref: 558 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.028101:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000005914f50/0x9383f985bc4b985f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bebca expref: 558 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.028113:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005914f50/0x9383f985bc4b985f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bebca expref: 558 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.028123:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.028126:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.028130:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2b48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.028137:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2b48 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.028160:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201209.028178:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff057100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+557:2360:x1875064442593664:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 102us (4356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.028185:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1412 00000100:00100000:2.0:1788201209.028198:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1413 00000100:00100000:2.0:1788201209.028205:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8107450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+75:2360:x1875064442593920:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.028212:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.028217:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a7259ee5/0x9383f985bc4c1992 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x367:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1863 expref: 75 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.028228:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a7259ee5/0x9383f985bc4c1992 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x367:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1863 expref: 75 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.028240:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7259ee5/0x9383f985bc4c1992 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x367:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1863 expref: 75 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.028263:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x367:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.028266:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x367:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.028270:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d2b56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.028279:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d2b56 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.028371:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201209.028390:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8107450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+74:2360:x1875064442593920:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 185us (4546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.028397:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1413 00000100:00100000:2.0:1788201209.028438:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1414 00000100:00100000:2.0:1788201209.028445:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff056d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+73:2360:x1875064442594176:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.028452:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.028457:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000578cd141/0x9383f985bc4b7e88 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be2cb expref: 73 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.028467:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000578cd141/0x9383f985bc4b7e88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be2cb expref: 73 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.028480:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000578cd141/0x9383f985bc4b7e88 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be2cb expref: 73 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.028489:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.028492:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.028497:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000853c0bb8/0x9383f985bc4d2b3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.028504:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000853c0bb8/0x9383f985bc4d2b3a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.028525:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201209.028537:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff056d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+72:2360:x1875064442594176:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 93us (4682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.028543:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1414 00000100:00100000:2.0:1788201209.028565:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1415 00000100:00100000:2.0:1788201209.028572:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff055500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+556:2360:x1875064442594432:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.029214:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.029221:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c07187d8/0x9383f985bc4bc9c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfcd3 expref: 556 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.029233:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c07187d8/0x9383f985bc4bc9c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfcd3 expref: 556 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.029257:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c07187d8/0x9383f985bc4bc9c1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfcd3 expref: 556 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.029268:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x303:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.029271:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x303:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.029276:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000345b80e5/0x9383f985bc4d2b25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.029284:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000345b80e5/0x9383f985bc4d2b25 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.029517:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201209.029533:0:13447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000345b80e5/0x9383f985bc4d2b25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.029542:0:13447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000345b80e5/0x9383f985bc4d2b25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.029553:0:13447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000345b80e5/0x9383f985bc4d2b25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.029561:0:13447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000345b80e5/0x9383f985bc4d2b25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.029816:0:13447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201209.030443:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5227b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+81:3310:x1875064458179968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 27523us (27655us total) trans 4294968780 rc 0/0 00000100:00100000:2.0:1788201209.030451:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4026 00000004:00080000:3.0:1788201209.030500:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04cffabb80/2, rc 0, transno 4294968780 00010000:00010000:2.0:1788201209.030502:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1788201209.030508:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458179968:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788201209.030509:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000345b80e5/0x9383f985bc4d2b25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.030518:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507c400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.030522:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000345b80e5/0x9383f985bc4d2b25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.030536:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000345b80e5/0x9383f985bc4d2b25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.030550:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000345b80e5/0x9383f985bc4d2b25 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.030570:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000345b80e5/0x9383f985bc4d2b25 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.030817:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.030820:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.030822:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.030835:0:13438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d0d4f162/0x9383f985bc4d2b5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.030844:0:13438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0d4f162/0x9383f985bc4d2b5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.030853:0:13438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0d4f162/0x9383f985bc4d2b5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.030861:0:13438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0d4f162/0x9383f985bc4d2b5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.030937:0:13438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201209.031047:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201209.031052:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0d4f162/0x9383f985bc4d2b5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.031060:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507da00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201209.031063:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0d4f162/0x9383f985bc4d2b5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.031071:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0d4f162/0x9383f985bc4d2b5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.031083:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0d4f162/0x9383f985bc4d2b5d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.031090:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0d4f162/0x9383f985bc4d2b5d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.031114:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201209.031115:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201209.031117:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.031222:0:13443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2b48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.031232:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2b48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.031241:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2b48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.031260:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2b48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.031272:0:13443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201209.031406:0:13450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000056e17fb0/0x9383f985bc4d2b4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.031416:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056e17fb0/0x9383f985bc4d2b4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.031424:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056e17fb0/0x9383f985bc4d2b4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.031431:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056e17fb0/0x9383f985bc4d2b4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.031443:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788201209.031570:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+75:3312:x1875064458180480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19449us (19859us total) trans 4294968764 rc 0/0 00000100:00100000:3.0:1788201209.031579:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4032 00000100:00100000:3.0:1788201209.031632:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff055500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+555:2360:x1875064442594432:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 3059us (7688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.031641:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1415 00000100:00100000:0.0:1788201209.032452:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+81:3310:x1875064458181632:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21300us (21386us total) trans 4294968781 rc 0/0 00000100:00100000:0.0:1788201209.032466:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4031 00010000:00010000:0.0:1788201209.032490:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201209.032496:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2b48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.032506:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.032510:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2b48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.032520:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2b48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.032534:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2b48 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.032542:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca2822cc/0x9383f985bc4d2b48 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.032569:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201209.032688:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056e17fb0/0x9383f985bc4d2b4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.032696:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.032700:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056e17fb0/0x9383f985bc4d2b4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.032714:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056e17fb0/0x9383f985bc4d2b4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.032726:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056e17fb0/0x9383f985bc4d2b4f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.032733:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056e17fb0/0x9383f985bc4d2b4f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.032748:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.032759:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.032762:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.032774:0:13444:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000853c0bb8/0x9383f985bc4d2b3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.032783:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000853c0bb8/0x9383f985bc4d2b3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.032792:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000853c0bb8/0x9383f985bc4d2b3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.032800:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000853c0bb8/0x9383f985bc4d2b3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.032815:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201209.032975:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d80f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+75:3310:x1875064458180736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 25812us (25912us total) trans 4294968765 rc 0/0 00000100:00100000:0.0:1788201209.032981:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4029 00000100:00100000:0.0:1788201209.033053:0:13448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cff3b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:13448:1875064458182400:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.033073:0:13448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2b64 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.033088:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201209.033103:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000853c0bb8/0x9383f985bc4d2b3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.033111:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.033115:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000853c0bb8/0x9383f985bc4d2b3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.033123:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000853c0bb8/0x9383f985bc4d2b3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.033134:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000853c0bb8/0x9383f985bc4d2b3a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.033141:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000853c0bb8/0x9383f985bc4d2b3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.033154:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.033156:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.033157:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788201209.033179:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f000df80/2, rc 0, transno 4294968781 00000100:00100000:0.0:1788201209.033188:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458181632:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788201209.033199:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00dd180/2, rc 0, transno 4294968765 00000100:00100000:0.0:1788201209.033203:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458180736:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.033222:0:10484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cff3a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10484:1875064458182528:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.033235:0:10484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d2b6b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.033268:0:6705:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6705:1875064458182784:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.033281:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c576e396/0x9383f985bc4d2b72 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201209.033501:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04cffaaa00/2, rc 0, transno 4294968779 00000100:00100000:1.0:1788201209.033508:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458179840:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201209.033524:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458183680:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201209.033561:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201209.033812:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458183808:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201209.033836:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458183936:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201209.033839:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201209.033873:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201209.033884:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458183680 00000100:00100000:0.0:1788201209.033890:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458183680 00000100:00100000:1.0:1788201209.033895:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201209.033900:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458184064:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201209.033919:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201209.033921:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458183808 00000100:00100000:0.0:1788201209.033924:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458183808 00000100:00100000:0.0:1788201209.033945:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458183936 00000100:00100000:0.0:1788201209.033948:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458183936 00000100:00100000:0.0:1788201209.033973:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458184064 00000100:00100000:0.0:1788201209.033976:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458184064 00000100:00100000:0.0:1788201209.034006:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4041 00000100:00100000:0.0:1788201209.034015:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+84:3312:x1875064458183680:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201209.034039:0:13445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:879 count 1 00010000:00010000:0.0:1788201209.034061:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072b69b02/0x9383f985bc4d2b8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.034077:0:13445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcdffd21/0x9383f985bc4c1fce lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1a77 expref: 554 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.034086:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36f:0x0].0x0 since=35s v=(0 0) 00000100:00100000:1.0:1788201209.034099:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4042 00000100:00100000:1.0:1788201209.034110:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+84:3313:x1875064458183808:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201209.034124:0:13450:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:674 count 1 00010000:00010000:1.0:1788201209.034137:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c13fcde/0x9383f985bc4d2b95 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.034149:0:13450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079234dbb/0x9383f985bc4b7c7b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be21c expref: 554 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.034157:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a2:0x0].0x0 since=62s v=(0 0) 00010000:00010000:1.0:1788201209.034160:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.034164:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c13fcde/0x9383f985bc4d2b95 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.034193:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.034196:0:13450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000079234dbb/0x9383f985bc4b7c7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be21c expref: 554 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.034198:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072b69b02/0x9383f985bc4d2b8e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.034210:0:13450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000079234dbb/0x9383f985bc4b7c7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be21c expref: 554 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.034216:0:13445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fcdffd21/0x9383f985bc4c1fce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1a77 expref: 554 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.034222:0:13450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:13450:1875064458184192:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.034225:0:13445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fcdffd21/0x9383f985bc4c1fce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1a77 expref: 554 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.034234:0:13445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3448000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13445:1875064458184320:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201209.034289:0:13450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c33d5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201209.034405:0:13445:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201209.034423:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4043 00000100:00100000:0.0:1788201209.034430:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+84:3310:x1875064458183936:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201209.034441:0:13443:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:780 count 1 00010000:00010000:0.0:1788201209.034454:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2b9c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x30c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.034465:0:13443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006898bb3d/0x9383f985bc4bd10e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x30c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bff42 expref: 554 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.034477:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30c:0x0].0x0 since=48s v=(0 0) 00010000:00010000:0.0:1788201209.034481:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.034484:0:13443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2b9c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x30c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.034502:0:13443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006898bb3d/0x9383f985bc4bd10e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x30c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bff42 expref: 554 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.034512:0:13443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006898bb3d/0x9383f985bc4bd10e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x30c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bff42 expref: 554 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.034522:0:13443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13443:1875064458184448:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.034543:0:13443:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201209.034811:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458184704:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.034842:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201209.034861:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201209.034866:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458184576:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.034939:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201209.034958:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458184704 00000100:00100000:0.0:1788201209.034962:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458184704 00000100:00100000:0.0:1788201209.034981:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458184576 00000100:00100000:0.0:1788201209.034984:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458184576 00000100:00100000:0.0:1788201209.035008:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4044 00000100:00100000:0.0:1788201209.035015:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+84:3310:x1875064458184064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201209.035030:0:13444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:962 count 1 00010000:00010000:0.0:1788201209.035043:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3effe3a/0x9383f985bc4d2ba3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3c2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.035055:0:13444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000abbd2418/0x9383f985bc4c6201 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c314c expref: 554 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.035063:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c2:0x0].0x0 since=25s v=(0 0) 00010000:00010000:0.0:1788201209.035066:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.035069:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3effe3a/0x9383f985bc4d2ba3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.035087:0:13444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000abbd2418/0x9383f985bc4c6201 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c314c expref: 554 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.035162:0:13444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000abbd2418/0x9383f985bc4c6201 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c314c expref: 554 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.035173:0:13444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13444:1875064458184832:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.035196:0:13444:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1788201209.035226:0:13440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec0fe3ff/0x9383f985bc4b94d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bea6c expref: 71 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.035240:0:13440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff054a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:13440:1875064458181376:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.035403:0:13440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e8bee2d2/0x9383f985bc4d2b41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.035414:0:13440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e8bee2d2/0x9383f985bc4d2b41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.035422:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8bee2d2/0x9383f985bc4d2b41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.035431:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8bee2d2/0x9383f985bc4d2b41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.035440:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8bee2d2/0x9383f985bc4d2b41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.035455:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201209.035467:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201209.035472:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8bee2d2/0x9383f985bc4d2b41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.035480:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507de00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.035485:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8bee2d2/0x9383f985bc4d2b41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.035493:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8bee2d2/0x9383f985bc4d2b41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.035507:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8bee2d2/0x9383f985bc4d2b41 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.035516:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8bee2d2/0x9383f985bc4d2b41 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.035530:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.035531:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.035533:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201209.036436:0:12363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12363:1875064458183040:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201209.036455:0:12363:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f91e6384/0x9383f985bc4d2b79 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.036484:0:13451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4045 00000100:00100000:1.0:1788201209.036498:0:13451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f965f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+76:3313:x1875064458184704:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788201209.036522:0:13451:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:726 count 1 00010000:00010000:1.0:1788201209.036539:0:13451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d2baa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.036553:0:13451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000958ec049/0x9383f985bc4ba63c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf09a expref: 70 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.036560:0:13451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d6:0x0].0x0 since=55s v=(0 0) 00010000:00010000:1.0:1788201209.036564:0:13451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.036567:0:13451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d2baa lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.036594:0:13451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000958ec049/0x9383f985bc4ba63c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf09a expref: 70 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.036605:0:13451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000958ec049/0x9383f985bc4ba63c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf09a expref: 70 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.036618:0:13451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:13451:1875064458184960:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201209.036671:0:13451:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c33d5300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201209.037317:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+77:3310:x1875064458180864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 29340us (30193us total) trans 4294968766 rc 0/0 00000100:00100000:0.0:1788201209.037326:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4030 00000100:00100000:0.0:1788201209.037352:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4046 00000100:00100000:0.0:1788201209.037360:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+76:3313:x1875064458184576:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201209.037375:0:13440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:859 count 1 00010000:00010000:0.0:1788201209.037389:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffa13277/0x9383f985bc4d2bb1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.037400:0:13440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c925fae4/0x9383f985bc4c1062 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c151b expref: 70 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.037406:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35b:0x0].0x0 since=38s v=(0 0) 00000004:00080000:1.0:1788201209.037407:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00df100/2, rc 0, transno 4294968766 00010000:00010000:0.0:1788201209.037410:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.037413:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffa13277/0x9383f985bc4d2bb1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.037418:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458180864:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788201209.037435:0:13440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c925fae4/0x9383f985bc4c1062 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c151b expref: 70 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.037450:0:13440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c925fae4/0x9383f985bc4c1062 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c151b expref: 70 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.037460:0:13440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:13440:1875064458185088:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.037493:0:13440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201209.037573:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458185216:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201209.037606:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201209.037653:0:13446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3449180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:13446:1875064458183296:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.037670:0:13446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2b80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.037785:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201209.037880:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201209.037915:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201209.037947:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201209.038004:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201209.038027:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+76:3312:x1875064458180608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23970us (25987us total) trans 4294968763 rc 0/0 00000100:00100000:2.0:1788201209.038036:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4034 00000100:00100000:3.0:1788201209.038446:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442594816 00000100:00100000:3.0:1788201209.038453:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442594816 00010000:00010000:3.0:1788201209.038723:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000203ea8e/0x9383f985bc4c25e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1cae expref: 555 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.038761:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1416 00000100:00100000:3.0:1788201209.038770:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5382680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+555:2361:x1875064442594816:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.038781:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.038786:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000203ea8e/0x9383f985bc4c25e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x377:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1cae expref: 555 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.038797:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000203ea8e/0x9383f985bc4c25e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x377:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1cae expref: 555 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.038817:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000203ea8e/0x9383f985bc4c25e0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x377:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1cae expref: 555 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.038831:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x377:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.038834:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x377:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.038840:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c576e396/0x9383f985bc4d2b72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.038849:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c576e396/0x9383f985bc4d2b72 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.038886:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.038914:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5382680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+554:2361:x1875064442594816:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 146us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.038920:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1416 00000100:00100000:3.0:1788201209.038973:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442595072 00000100:00100000:3.0:1788201209.038977:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442595072 00010000:00010000:3.0:1788201209.039002:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000080d08ad3/0x9383f985bc4c37d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c22dc expref: 71 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.039014:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442594688 00000100:00100000:3.0:1788201209.039017:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442594688 00010000:00010000:3.0:1788201209.039030:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001bd15a0d/0x9383f985bc4c33a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2146 expref: 554 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.039042:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442594944 00000100:00100000:3.0:1788201209.039045:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442594944 00010000:00010000:3.0:1788201209.039057:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000782a0b8c/0x9383f985bc4c2856 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1d80 expref: 555 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.039067:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442595200 00000100:00100000:3.0:1788201209.039070:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442595200 00010000:00010000:3.0:1788201209.039080:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ecb43c96/0x9383f985bc4b1bd9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc0c0 expref: 556 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.039092:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1417 00000100:00100000:3.0:1788201209.039104:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5380000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+71:2361:x1875064442595072:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.039113:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.039118:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000080d08ad3/0x9383f985bc4c37d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c22dc expref: 71 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.039127:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000080d08ad3/0x9383f985bc4c37d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c22dc expref: 71 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.039143:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080d08ad3/0x9383f985bc4c37d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c22dc expref: 71 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.039153:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.039156:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.039159:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2b80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.039167:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2b80 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.039184:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.039207:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5380000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+70:2361:x1875064442595072:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 103us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.039214:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1417 00000100:00100000:3.0:1788201209.039261:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1418 00000100:00100000:3.0:1788201209.039269:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5383b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+556:2362:x1875064442594688:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.039277:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.039281:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001bd15a0d/0x9383f985bc4c33a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2146 expref: 556 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.039291:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001bd15a0d/0x9383f985bc4c33a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2146 expref: 556 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.039505:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bd15a0d/0x9383f985bc4c33a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2146 expref: 556 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.039515:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x388:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.039518:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x388:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.039522:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d2b6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.039530:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d2b6b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.039547:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.039682:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5383b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+555:2362:x1875064442594688:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 413us (1765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.039689:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1418 00000100:00100000:3.0:1788201209.039735:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1419 00000100:00100000:3.0:1788201209.039741:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5380700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+554:2362:x1875064442594944:12345-192.168.201.30@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201209.040087:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1788201209.040105:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.040110:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000782a0b8c/0x9383f985bc4c2856 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1d80 expref: 554 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.040120:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000782a0b8c/0x9383f985bc4c2856 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1d80 expref: 554 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.040133:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000782a0b8c/0x9383f985bc4c2856 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1d80 expref: 554 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.040143:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.040146:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.040150:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f91e6384/0x9383f985bc4d2b79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.040158:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f91e6384/0x9383f985bc4d2b79 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.040176:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.040199:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5380700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+553:2362:x1875064442594944:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 459us (2252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.040206:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1419 00000100:00100000:3.0:1788201209.040549:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442595328 00000100:00100000:3.0:1788201209.040567:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442595328 00010000:00010000:3.0:1788201209.040644:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f4d0dca6/0x9383f985bc4c41af lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x399:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2624 expref: 70 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.040664:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1420 00000100:00100000:3.0:1788201209.040671:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8105c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+552:2362:x1875064442595200:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.040679:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.040685:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ecb43c96/0x9383f985bc4b1bd9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x229:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc0c0 expref: 552 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.040695:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ecb43c96/0x9383f985bc4b1bd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x229:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc0c0 expref: 552 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.040709:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecb43c96/0x9383f985bc4b1bd9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x229:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc0c0 expref: 552 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.040719:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x229:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.040722:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x229:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.040727:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2b64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.040734:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2b64 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.040762:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.040786:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8105c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+551:2362:x1875064442595200:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 116us (2782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.040793:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1420 00000100:00100000:3.0:1788201209.040882:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1421 00000100:00100000:3.0:1788201209.040889:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5383800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+70:2359:x1875064442595328:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.040897:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.040902:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f4d0dca6/0x9383f985bc4c41af lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x399:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2624 expref: 70 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.040914:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f4d0dca6/0x9383f985bc4c41af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x399:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2624 expref: 70 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.040927:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x399:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.040930:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x399:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.040935:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d2b87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x399:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.040943:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d2b87 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x399:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.040954:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.040975:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5383800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+70:2359:x1875064442595328:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 86us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.040981:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1421 00010000:00010000:3.0:1788201209.041454:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201209.042131:0:12363:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f91e6384/0x9383f985bc4d2b79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.042131:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458185216 00000100:00100000:2.0:1788201209.042138:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458185216 00010000:00010000:1.0:1788201209.042142:0:12363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f91e6384/0x9383f985bc4d2b79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.042151:0:12363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f91e6384/0x9383f985bc4d2b79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.042158:0:12363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f91e6384/0x9383f985bc4d2b79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.042174:0:12363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201209.042211:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4047 00000100:00100000:2.0:1788201209.042219:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+76:3310:x1875064458185216:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201209.042242:0:13447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:654 count 1 00010000:00010000:2.0:1788201209.042275:0:13447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d2bb8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.042290:0:13447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ceaa2075/0x9383f985bc4b6ce5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdcb9 expref: 69 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.042460:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c576e396/0x9383f985bc4d2b72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.042470:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c576e396/0x9383f985bc4d2b72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.042478:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c576e396/0x9383f985bc4d2b72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.042485:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c576e396/0x9383f985bc4d2b72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.042498:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788201209.042694:0:13447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28e:0x0].0x0 since=65s v=(0 0) 00010000:00010000:2.0:1788201209.042698:0:13447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.042703:0:13447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d2bb8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.042733:0:13447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ceaa2075/0x9383f985bc4b6ce5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdcb9 expref: 69 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.042745:0:13447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ceaa2075/0x9383f985bc4b6ce5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdcb9 expref: 69 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.042824:0:13447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff056300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:13447:1875064458185344:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.042945:0:13447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f916c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788201209.042983:0:13441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4d0dca6/0x9383f985bc4c41af lrc: 0/0,0 mode: --/PR res: [0x280000400:0x399:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2624 expref: 69 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.043005:0:13441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff055880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:13441:1875064458183552:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.043022:0:13441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d2b87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.043031:0:13441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d2b87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.043037:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d2b87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.043045:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d2b87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.043051:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d2b87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.043065:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1788201209.043135:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+85:3312:x1875064458182912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 25622us (25682us total) trans 4294968782 rc 0/0 00000100:00100000:1.0:1788201209.043143:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4038 00000100:00100000:2.0:1788201209.043213:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+77:3310:x1875064458183424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16727us (17969us total) trans 4294968767 rc 0/0 00000100:00100000:2.0:1788201209.043219:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4040 00010000:00010000:2.0:1788201209.043236:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788201209.043241:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f91e6384/0x9383f985bc4d2b79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.043681:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.043685:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f91e6384/0x9383f985bc4d2b79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.043694:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f91e6384/0x9383f985bc4d2b79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.043712:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f91e6384/0x9383f985bc4d2b79 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.043719:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f91e6384/0x9383f985bc4d2b79 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.043735:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201209.043739:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c576e396/0x9383f985bc4d2b72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.043746:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.043749:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c576e396/0x9383f985bc4d2b72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.043822:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c576e396/0x9383f985bc4d2b72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201209.043832:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c3449f80/2, rc 0, transno 4294968767 00010000:00010000:2.0:1788201209.043832:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c576e396/0x9383f985bc4d2b72 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.043839:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c576e396/0x9383f985bc4d2b72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.043845:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3449f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458183424:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788201209.043853:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201209.043856:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d2b87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.043863:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.043865:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d2b87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.043977:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d2b87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.043999:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d2b87 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.044007:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d2b87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.044022:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.044023:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.044025:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788201209.044043:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00ddf80/2, rc 0, transno 4294968763 00000100:00100000:2.0:1788201209.044048:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458180608:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788201209.044056:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00dca80/2, rc 0, transno 4294968764 00000100:00100000:2.0:1788201209.044060:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458180480:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788201209.044073:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00de300/2, rc 0, transno 4294968782 00000100:00100000:2.0:1788201209.044091:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458182912:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201209.044394:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+85:3312:x1875064458182656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 27445us (27502us total) trans 4294968783 rc 0/0 00000100:00100000:0.0:1788201209.044403:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4037 00010000:00010000:0.0:1788201209.044423:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.044435:0:13448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2b64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.044445:0:13448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2b64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.044447:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1788201209.044454:0:13448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2b64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.044456:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458185472:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788201209.044461:0:13448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2b64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.044473:0:13448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788201209.044487:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201209.044512:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458185472 00000100:00100000:1.0:1788201209.044518:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458185472 00000100:00100000:1.0:1788201209.044548:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4048 00000100:00100000:1.0:1788201209.044555:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+85:3310:x1875064458185472:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201209.044575:0:12363:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:802 count 1 00010000:00010000:1.0:1788201209.044593:0:12363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d2bbf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.044607:0:12363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000005864a8c/0x9383f985bc4be2b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0554 expref: 550 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.044615:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x322:0x0].0x0 since=45s v=(0 0) 00010000:00010000:1.0:1788201209.044619:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x322:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.044624:0:12363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d2bbf lrc: 4/0,1 mode: --/PW res: [0x240000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.044652:0:12363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000005864a8c/0x9383f985bc4be2b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0554 expref: 550 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.044665:0:12363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000005864a8c/0x9383f985bc4be2b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0554 expref: 550 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.044676:0:12363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12363:1875064458185600:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.044699:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201209.044703:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2b64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.044711:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.044714:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2b64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.044715:0:12363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c33d5240 going to sleep for 11 seconds 00010000:00010000:2.0:1788201209.044722:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2b64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.044733:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2b64 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.044741:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2b64 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.044945:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.044948:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.044949:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201209.044985:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+86:3312:x1875064458181504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29482us (29781us total) trans 4294968784 rc 0/0 00000100:00100000:0.0:1788201209.045001:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4035 00010000:00010000:0.0:1788201209.045019:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.045030:0:10484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d2b6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.045039:0:10484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d2b6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.045048:0:10484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d2b6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.045056:0:10484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d2b6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.045075:0:10484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201209.045413:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201209.045419:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d2b6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.045426:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201209.045429:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d2b6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.045437:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d2b6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.045450:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d2b6b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.045456:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d2b6b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.045474:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201209.045476:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201209.045478:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788201209.045866:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04cff3ad80/2, rc 0, transno 4294968783 00000100:00100000:2.0:1788201209.045890:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cff3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458182656:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788201209.045902:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f000f100/2, rc 0, transno 4294968784 00000100:00100000:2.0:1788201209.045905:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458181504:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201209.046070:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+86:3310:x1875064458182272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29974us (30035us total) trans 4294968785 rc 0/0 00000100:00100000:0.0:1788201209.046078:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4036 00000100:00100000:2.0:1788201209.046094:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3449180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458185728:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201209.046101:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458185856:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.046122:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.046159:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458186240:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.046161:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458185984:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.046181:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.046187:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458185728 00000100:00100000:2.0:1788201209.046191:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458185728 00000100:00100000:2.0:1788201209.046203:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788201209.046214:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04cff39c00/2, rc 0, transno 4294968785 00000100:00100000:0.0:1788201209.046222:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cff39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458182272:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.046224:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458185984 00000100:00100000:2.0:1788201209.046227:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458185984 00000100:00100000:0.0:1788201209.046229:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201209.046234:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458186112:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.046250:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458186240 00000100:00100000:2.0:1788201209.046253:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458186240 00000100:00100000:2.0:1788201209.046283:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4049 00000100:00100000:2.0:1788201209.046368:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+78:3310:x1875064458185984:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.046378:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1788201209.046390:0:13441:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:729 count 1 00000100:00100000:0.0:1788201209.046402:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458186112 00000100:00100000:0.0:1788201209.046405:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458186112 00010000:00010000:2.0:1788201209.046409:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d2bc6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.046420:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4050 00010000:00010000:2.0:1788201209.046424:0:13441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004edd834e/0x9383f985bc4ba89d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf165 expref: 68 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.046425:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+79:3312:x1875064458186240:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788201209.046432:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d9:0x0].0x0 since=55s v=(0 0) 00002000:00080000:0.0:1788201209.046435:0:10484:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:651 count 1 00010000:00010000:2.0:1788201209.046435:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.046439:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d2bc6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.046445:0:10484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d2bcd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.046455:0:10484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f167a11b/0x9383f985bc4b6a6f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdbe7 expref: 68 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.046460:0:13441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004edd834e/0x9383f985bc4ba89d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf165 expref: 68 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.046463:0:10484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28b:0x0].0x0 since=66s v=(0 0) 00010000:00010000:0.0:1788201209.046466:0:10484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.046469:0:10484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d2bcd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.046471:0:13441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004edd834e/0x9383f985bc4ba89d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf165 expref: 68 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.046483:0:13441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff054700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:13441:1875064458186368:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.046485:0:10484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f167a11b/0x9383f985bc4b6a6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdbe7 expref: 68 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.046494:0:10484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f167a11b/0x9383f985bc4b6a6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdbe7 expref: 68 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.046502:0:10484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10484:1875064458186496:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.046519:0:10484:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201209.046519:0:13441:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f919c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201209.046534:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4051 00000100:00100000:2.0:1788201209.046594:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+79:3310:x1875064458186112:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201209.046608:0:13448:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:738 count 1 00010000:00010000:2.0:1788201209.046621:0:13448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d2bd4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.046632:0:13448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0200e31/0x9383f985bc4bb014 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf3e2 expref: 68 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.046639:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e2:0x0].0x0 since=53s v=(0 0) 00010000:00010000:2.0:1788201209.046641:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.046645:0:13448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d2bd4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.046663:0:13448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a0200e31/0x9383f985bc4bb014 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf3e2 expref: 68 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.046672:0:13448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a0200e31/0x9383f985bc4bb014 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf3e2 expref: 68 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.046687:0:13448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff055180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:13448:1875064458186624:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.046710:0:13448:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201209.046749:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201209.046851:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442595456 00000100:00100000:3.0:1788201209.046855:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442595456 00010000:00010000:3.0:1788201209.046881:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000079234dbb/0x9383f985bc4b7c7b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be21c expref: 551 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.046901:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1422 00000100:00100000:3.0:1788201209.046907:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5382680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+551:2362:x1875064442595456:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.046916:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.046921:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000079234dbb/0x9383f985bc4b7c7b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be21c expref: 551 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.046932:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000079234dbb/0x9383f985bc4b7c7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be21c expref: 551 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.046946:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.046949:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.046954:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007c13fcde/0x9383f985bc4d2b95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.046962:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c13fcde/0x9383f985bc4d2b95 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.046977:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.047012:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5382680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+551:2362:x1875064442595456:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 105us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.047020:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1422 00010000:00010000:3.0:1788201209.047061:0:6703:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d2b56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.047071:0:6703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d2b56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.047080:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d2b56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.047087:0:6703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d2b56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.047108:0:6703:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201209.047291:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+80:3312:x1875064458180992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 35008us (35435us total) trans 4294968768 rc 0/0 00010000:00010000:0.0:1788201209.048198:0:13446:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2b80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.048209:0:13446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2b80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.048219:0:13446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2b80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.048227:0:13446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2b80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.048366:0:13446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788201209.048377:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201209.048382:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d2b56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.048391:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.048395:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d2b56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.048404:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d2b56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.048419:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d2b56 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.048428:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004dfe810/0x9383f985bc4d2b56 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.048445:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201209.048448:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2b80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.048454:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.048457:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2b80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.048470:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2b80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.048479:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2b80 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.048486:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2b80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.048496:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.048498:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.048499:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201209.048839:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+81:3310:x1875064458183168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 30109us (30311us total) trans 4294968769 rc 0/0 00000100:00100000:0.0:1788201209.048847:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4039 00000004:00080000:0.0:1788201209.048945:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c344b100/2, rc 0, transno 4294968769 00000100:00100000:0.0:1788201209.048955:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458183168:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.049009:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458186880:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.049035:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201209.049071:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458186880 00000100:00100000:0.0:1788201209.049076:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458186880 00000100:00100000:0.0:1788201209.049205:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4052 00000100:00100000:0.0:1788201209.049214:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+81:3310:x1875064458186880:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201209.049235:0:13442:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:924 count 1 00010000:00010000:0.0:1788201209.049263:0:13442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058fbae95/0x9383f985bc4d2bdb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.049280:0:13442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009fa83a69/0x9383f985bc4c43e6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c26e1 expref: 68 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.049287:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39c:0x0].0x0 since=30s v=(0 0) 00010000:00010000:0.0:1788201209.049290:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.049322:0:13442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058fbae95/0x9383f985bc4d2bdb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.049348:0:13442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009fa83a69/0x9383f985bc4c43e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c26e1 expref: 68 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.049359:0:13442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009fa83a69/0x9383f985bc4c43e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c26e1 expref: 68 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.049371:0:13442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:13442:1875064458187008:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.049424:0:13442:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5900 going to sleep for 11 seconds 00010000:00010000:2.0:1788201209.049709:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788201209.049734:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c20bed80/2, rc 0, transno 4294968768 00000100:00100000:2.0:1788201209.049745:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c20bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458180992:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.049809:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201209.049819:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458186752:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.049906:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201209.049935:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458186752 00000100:00100000:0.0:1788201209.049940:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458186752 00000100:00100000:0.0:1788201209.049964:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4053 00000100:00100000:0.0:1788201209.049971:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff055880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+87:3312:x1875064458185728:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201209.049985:0:6705:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:789 count 1 00010000:00010000:0.0:1788201209.050011:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000608f96c4/0x9383f985bc4d2be2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x315:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.050025:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000818e1b36/0x9383f985bc4bd7f2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x315:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c01bf expref: 550 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.050032:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x315:0x0].0x0 since=47s v=(0 0) 00010000:00010000:0.0:1788201209.050035:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x315:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1788201209.050036:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1788201209.050039:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000608f96c4/0x9383f985bc4d2be2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x315:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.050044:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff057100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458187136:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788201209.050058:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000818e1b36/0x9383f985bc4bd7f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x315:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c01bf expref: 550 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.050066:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201209.050069:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000818e1b36/0x9383f985bc4bd7f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x315:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c01bf expref: 550 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.050079:0:6705:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6705:1875064458187264:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.050090:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458187136 00000100:00100000:2.0:1788201209.050093:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458187136 00000100:00100000:2.0:1788201209.050112:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4054 00000100:00100000:2.0:1788201209.050119:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff054000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+87:3312:x1875064458186752:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201209.050130:0:6706:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:607 count 1 00010000:00010000:2.0:1788201209.050143:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4d2be9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.050155:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d30cfc30/0x9383f985bc4b46ea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcf7d expref: 550 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.050162:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25f:0x0].0x0 since=73s v=(0 0) 00010000:00010000:2.0:1788201209.050165:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.050169:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4d2be9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x25f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.050171:0:6705:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5480 going to sleep for 11 seconds 00010000:00010000:2.0:1788201209.050188:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d30cfc30/0x9383f985bc4b46ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcf7d expref: 550 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.050198:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d30cfc30/0x9383f985bc4b46ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcf7d expref: 550 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.050206:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4055 00000100:00100000:2.0:1788201209.050208:0:6706:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff056680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1875064458187392:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.050212:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff057b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+82:3310:x1875064458187136:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201209.050224:0:13446:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:856 count 1 00000100:00100000:2.0:1788201209.050235:0:6706:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91240 going to sleep for 11 seconds 00010000:00010000:0.0:1788201209.050238:0:13446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d2bf0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.050249:0:13446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d94332e1/0x9383f985bc4c0dec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1450 expref: 68 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.050256:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x358:0x0].0x0 since=38s v=(0 0) 00010000:00010000:0.0:1788201209.050259:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x358:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.050263:0:13446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d2bf0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.050283:0:13446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d94332e1/0x9383f985bc4c0dec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1450 expref: 68 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.050341:0:13446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d94332e1/0x9383f985bc4c0dec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1450 expref: 68 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.050353:0:13446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:13446:1875064458187520:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.050381:0:13446:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201209.050396:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.050422:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458185856 00000100:00100000:2.0:1788201209.050426:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458185856 00000100:00100000:2.0:1788201209.050448:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4056 00000100:00100000:2.0:1788201209.050454:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+88:3313:x1875064458185856:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201209.050465:0:13449:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1020 count 1 00010000:00010000:2.0:1788201209.050478:0:13449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d2bf7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.050491:0:13449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000037a78806/0x9383f985bc4c9037 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4175 expref: 550 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.050497:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3fc:0x0].0x0 since=18s v=(0 0) 00010000:00010000:2.0:1788201209.050500:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.050504:0:13449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d2bf7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.050529:0:13449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000037a78806/0x9383f985bc4c9037 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4175 expref: 550 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.050539:0:13449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000037a78806/0x9383f985bc4c9037 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4175 expref: 550 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.050549:0:13449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff055c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:13449:1875064458187648:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.050572:0:13449:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91180 going to sleep for 11 seconds 00010000:00010000:0.0:1788201209.050937:0:13450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079234dbb/0x9383f985bc4b7c7b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be21c expref: 550 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.050950:0:13450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:13450:1875064458184192:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.050967:0:13450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007c13fcde/0x9383f985bc4d2b95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.050976:0:13450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007c13fcde/0x9383f985bc4d2b95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.050983:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c13fcde/0x9383f985bc4d2b95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.051001:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c13fcde/0x9383f985bc4d2b95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.051010:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c13fcde/0x9383f985bc4d2b95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.051034:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201209.051050:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201209.051056:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c13fcde/0x9383f985bc4d2b95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.051064:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.051067:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c13fcde/0x9383f985bc4d2b95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.051076:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c13fcde/0x9383f985bc4d2b95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.051093:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c13fcde/0x9383f985bc4d2b95 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.051100:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c13fcde/0x9383f985bc4d2b95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.051121:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.051123:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.051124:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201209.051336:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+89:3313:x1875064458183808:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17228us (17495us total) trans 4294968786 rc 0/0 00000100:00100000:0.0:1788201209.051343:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4042 00000004:00080000:1.0:1788201209.051493:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c3448e00/2, rc 0, transno 4294968786 00000100:00100000:1.0:1788201209.051515:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458183808:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.051828:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458187776:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.051870:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201209.052110:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458187776 00000100:00100000:0.0:1788201209.052116:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458187776 00000100:00100000:0.0:1788201209.052155:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4057 00000100:00100000:0.0:1788201209.052162:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff056d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+89:3312:x1875064458187776:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201209.052181:0:13438:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:610 count 1 00010000:00010000:0.0:1788201209.052195:0:13438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d2bfe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x262:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.052208:0:13438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005ff75a68/0x9383f985bc4b4936 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x262:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd079 expref: 549 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.052215:0:13438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x262:0x0].0x0 since=72s v=(0 0) 00010000:00010000:0.0:1788201209.052218:0:13438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x262:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.052221:0:13438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d2bfe lrc: 4/0,1 mode: --/PW res: [0x240000400:0x262:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.052241:0:13438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005ff75a68/0x9383f985bc4b4936 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x262:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd079 expref: 549 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.052270:0:13438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005ff75a68/0x9383f985bc4b4936 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x262:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd079 expref: 549 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.052281:0:13438:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:13438:1875064458187904:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201209.052542:0:13438:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201209.052744:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4033 00000100:00100000:1.0:1788201209.061681:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201209.061696:0:13445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3448000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13445:1875064458184320:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201209.061714:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:0.0:1788201209.061726:0:13445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000072b69b02/0x9383f985bc4d2b8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.061749:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201209.061797:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201209.061851:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442595584 00000100:00100000:3.0:1788201209.061859:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442595584 00000100:00100000:1.0:1788201209.061897:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442595712 00010000:00010000:3.0:1788201209.061897:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fcdffd21/0x9383f985bc4c1fce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1a77 expref: 550 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.061901:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442595712 00010000:00010000:1.0:1788201209.061919:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006898bb3d/0x9383f985bc4bd10e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x30c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bff42 expref: 551 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.061923:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442595840 00000100:00100000:3.0:1788201209.061926:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442595840 00000100:00100000:1.0:1788201209.061938:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442595968 00010000:00010000:3.0:1788201209.061938:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000abbd2418/0x9383f985bc4c6201 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c314c expref: 552 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.061940:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442595968 00010000:00010000:1.0:1788201209.061953:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000958ec049/0x9383f985bc4ba63c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf09a expref: 69 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.061953:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1423 00000100:00100000:3.0:1788201209.061962:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d1f0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+552:2360:x1875064442595584:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.061976:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788201209.061978:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1424 00010000:00010000:3.0:1788201209.061982:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fcdffd21/0x9383f985bc4c1fce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x36f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1a77 expref: 552 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.061985:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0501b36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+552:2360:x1875064442595712:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.062028:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fcdffd21/0x9383f985bc4c1fce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x36f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1a77 expref: 552 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.062053:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcdffd21/0x9383f985bc4c1fce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x36f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1a77 expref: 552 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.062067:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.062071:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.062075:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000072b69b02/0x9383f985bc4d2b8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.062083:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072b69b02/0x9383f985bc4d2b8e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.062103:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.062146:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d1f0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+551:2360:x1875064442595584:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 185us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.062152:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1423 00000100:00100000:3.0:1788201209.062168:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1425 00000100:00100000:3.0:1788201209.062173:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5285880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+550:2359:x1875064442595840:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.062180:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.062185:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000abbd2418/0x9383f985bc4c6201 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c314c expref: 550 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.062194:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000abbd2418/0x9383f985bc4c6201 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c314c expref: 550 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.062197:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201209.062201:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006898bb3d/0x9383f985bc4bd10e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x30c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bff42 expref: 550 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.062212:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.062215:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.062217:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006898bb3d/0x9383f985bc4bd10e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x30c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bff42 expref: 550 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.062219:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3effe3a/0x9383f985bc4d2ba3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.062228:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3effe3a/0x9383f985bc4d2ba3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.062229:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.062232:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.062236:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2b9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.062239:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201209.062245:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2b9c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x30c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.062255:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.062267:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5285880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+550:2359:x1875064442595840:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 82us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.062275:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1425 00000100:00100000:1.0:1788201209.062280:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0501b36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+550:2360:x1875064442595712:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 297us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.062286:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1424 00000100:00100000:3.0:1788201209.062449:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1426 00000100:00100000:3.0:1788201209.062459:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c502ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+69:2360:x1875064442595968:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.062467:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.062472:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000958ec049/0x9383f985bc4ba63c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf09a expref: 69 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.062482:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000958ec049/0x9383f985bc4ba63c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf09a expref: 69 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.062495:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.062498:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.062502:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d2baa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.062510:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d2baa lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.062521:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.062542:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c502ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+69:2360:x1875064442595968:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 86us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.062548:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1426 00000100:00100000:3.0:1788201209.063067:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201209.063133:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201209.063153:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201209.063207:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201209.063268:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:2.0:1788201209.063440:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006898bb3d/0x9383f985bc4bd10e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x30c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bff42 expref: 548 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.063456:0:13443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13443:1875064458184448:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.063476:0:13443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2b9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.063483:0:13443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2b9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.063490:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2b9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.063499:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2b9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.063505:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2b9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.063527:0:13443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201209.063818:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abbd2418/0x9383f985bc4c6201 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c314c expref: 547 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.063831:0:13444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13444:1875064458184832:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.063845:0:13444:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3effe3a/0x9383f985bc4d2ba3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.063853:0:13444:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3effe3a/0x9383f985bc4d2ba3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.063860:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3effe3a/0x9383f985bc4d2ba3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.063868:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3effe3a/0x9383f985bc4d2ba3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.063876:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3effe3a/0x9383f985bc4d2ba3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.063890:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788201209.064051:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+91:3310:x1875064458184064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29035us (30129us total) trans 4294968788 rc 0/0 00000100:00100000:1.0:1788201209.064056:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442596096 00000100:00100000:0.0:1788201209.064060:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4044 00000100:00100000:1.0:1788201209.064062:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442596096 00010000:00010000:0.0:1788201209.064086:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201209.064088:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c925fae4/0x9383f985bc4c1062 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c151b expref: 69 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.064091:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2b9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.064099:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.064103:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2b9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.064103:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442596352 00000100:00100000:1.0:1788201209.064106:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442596352 00010000:00010000:0.0:1788201209.064112:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2b9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.064117:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000005864a8c/0x9383f985bc4be2b1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0554 expref: 547 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.064126:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442596224 00010000:00010000:0.0:1788201209.064128:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2b9c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.064129:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442596224 00010000:00010000:0.0:1788201209.064135:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2b9c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.064139:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ceaa2075/0x9383f985bc4b6ce5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdcb9 expref: 70 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.064148:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442596480 00000100:00100000:1.0:1788201209.064150:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442596480 00010000:00010000:0.0:1788201209.064152:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201209.064156:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3effe3a/0x9383f985bc4d2ba3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.064160:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a0200e31/0x9383f985bc4bb014 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf3e2 expref: 71 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.064163:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.064166:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3effe3a/0x9383f985bc4d2ba3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.064173:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1427 00010000:00010000:0.0:1788201209.064174:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3effe3a/0x9383f985bc4d2ba3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.064179:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8106850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+71:2360:x1875064442596096:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201209.064183:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3effe3a/0x9383f985bc4d2ba3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.064189:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3effe3a/0x9383f985bc4d2ba3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.064189:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201209.064194:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c925fae4/0x9383f985bc4c1062 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x35b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c151b expref: 71 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.064201:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.064203:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.064204:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201209.064204:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c925fae4/0x9383f985bc4c1062 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x35b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c151b expref: 71 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.064219:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35b:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1788201209.064224:0:10484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10484:1875064458186496:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201209.064224:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.064228:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ffa13277/0x9383f985bc4d2bb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.064237:0:10484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d2bcd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.064237:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffa13277/0x9383f985bc4d2bb1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.064253:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201209.064256:0:13445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000072b69b02/0x9383f985bc4d2b8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.064263:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072b69b02/0x9383f985bc4d2b8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.064272:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072b69b02/0x9383f985bc4d2b8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.064280:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072b69b02/0x9383f985bc4d2b8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.064444:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8106850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+71:2360:x1875064442596096:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 263us (1377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.064451:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1427 00000100:00100000:1.0:1788201209.064490:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1428 00000100:00100000:1.0:1788201209.064496:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5380000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+547:2360:x1875064442596352:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201209.064504:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201209.064508:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000005864a8c/0x9383f985bc4be2b1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0554 expref: 547 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.064519:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000005864a8c/0x9383f985bc4be2b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0554 expref: 547 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.064532:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x322:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.064535:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x322:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.064539:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d2bbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.064547:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d2bbf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.064559:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201209.064575:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5380000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+547:2360:x1875064442596352:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 79us (1442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.064581:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1428 00000100:00100000:1.0:1788201209.064594:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1429 00000100:00100000:1.0:1788201209.064600:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5383b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+70:2360:x1875064442596224:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201209.064608:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201209.064612:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ceaa2075/0x9383f985bc4b6ce5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x28e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdcb9 expref: 70 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.064623:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ceaa2075/0x9383f985bc4b6ce5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x28e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdcb9 expref: 70 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.064635:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.064637:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.064641:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d2bb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.064648:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d2bb8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.064659:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201209.064677:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5383b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+70:2360:x1875064442596224:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 77us (1523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.064684:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1429 00000100:00100000:1.0:1788201209.064698:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1430 00000100:00100000:1.0:1788201209.064705:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5380700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+69:2360:x1875064442596480:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201209.064712:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201209.064717:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a0200e31/0x9383f985bc4bb014 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf3e2 expref: 69 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.064732:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a0200e31/0x9383f985bc4bb014 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf3e2 expref: 69 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.064744:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.064747:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.065119:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d2bd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.065130:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d2bd4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.065144:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201209.065195:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788201209.068175:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5380700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+69:2360:x1875064442596480:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 3387us (4924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.068190:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1430 00000100:00100000:1.0:1788201209.068227:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442596736 00000100:00100000:1.0:1788201209.068234:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442596736 00010000:00010000:1.0:1788201209.068263:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f167a11b/0x9383f985bc4b6a6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdbe7 expref: 69 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.068452:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1431 00000100:00100000:1.0:1788201209.068461:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+69:2361:x1875064442596736:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201209.068478:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201209.068485:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f167a11b/0x9383f985bc4b6a6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x28b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdbe7 expref: 69 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.068498:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f167a11b/0x9383f985bc4b6a6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x28b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdbe7 expref: 69 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.068520:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f167a11b/0x9383f985bc4b6a6f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x28b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdbe7 expref: 69 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.068535:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.068540:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.068545:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d2bcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.068554:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d2bcd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.068587:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.069081:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201209.069084:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+91:3310:x1875064458183936:12345-0@lo:6:osp-syn-0-0.0 Request processed in 34653us (35209us total) trans 4294968787 rc 0/0 00000100:00100000:2.0:1788201209.069103:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4043 00010000:00010000:2.0:1788201209.069137:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201209.069144:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072b69b02/0x9383f985bc4d2b8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.069154:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.069158:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072b69b02/0x9383f985bc4d2b8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.069168:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072b69b02/0x9383f985bc4d2b8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.069181:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072b69b02/0x9383f985bc4d2b8e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.069189:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072b69b02/0x9383f985bc4d2b8e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.069206:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.069208:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.069210:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.069246:0:13447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ceaa2075/0x9383f985bc4b6ce5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdcb9 expref: 68 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.069258:0:13447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff056300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:13447:1875064458185344:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.069288:0:13447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d2bb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.069327:0:13447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d2bb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.069334:0:13447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d2bb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.069343:0:13447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d2bb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.069352:0:13447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d2bb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.069370:0:13447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201209.069592:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+82:3310:x1875064458185216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 27372us (31983us total) trans 4294968770 rc 0/0 00000100:00100000:2.0:1788201209.069598:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4047 00010000:00010000:2.0:1788201209.069617:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201209.069622:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d2bb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.069634:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.069637:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d2bb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.069646:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d2bb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.069658:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d2bb8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.069666:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d2bb8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.069681:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.069682:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.069684:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.069690:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.069711:0:13448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0200e31/0x9383f985bc4bb014 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf3e2 expref: 67 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.069721:0:13448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff055180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:13448:1875064458186624:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.069733:0:13448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d2bd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.069742:0:13448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d2bd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.069760:0:13448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d2bd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.069769:0:13448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d2bd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.069776:0:13448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d2bd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.069788:0:13448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201209.069880:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+90:3312:x1875064458183680:12345-0@lo:6:osp-syn-0-0.0 Request processed in 35864us (36316us total) trans 4294968789 rc 0/0 00000100:00100000:0.0:1788201209.069888:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4041 00010000:00010000:0.0:1788201209.069912:0:10484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d2bcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.069912:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+82:3310:x1875064458186112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23371us (23532us total) trans 4294968771 rc 0/0 00000100:00100000:2.0:1788201209.069918:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4051 00010000:00010000:0.0:1788201209.069921:0:10484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d2bcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.069930:0:10484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d2bcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.069934:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201209.069938:0:10484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d2bcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.069938:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d2bd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.069946:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.069949:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d2bd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.069951:0:10484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201209.069957:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d2bd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.069981:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d2bd4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.069999:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d2bd4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.070013:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201209.070016:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d2bcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.070022:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.070026:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d2bcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.070033:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d2bcd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.070043:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d2bcd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.070050:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d2bcd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.070061:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.070063:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.070064:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.070069:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201209.070084:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+82:3312:x1875064458186240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23658us (23879us total) trans 4294968772 rc 0/0 00000100:00100000:2.0:1788201209.070085:0:13441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff054700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:13441:1875064458186368:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.070094:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4050 00010000:00010000:2.0:1788201209.070098:0:13441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d2bc6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.070123:0:6705:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6705:1875064458187264:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.070135:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000608f96c4/0x9383f985bc4d2be2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x315:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.070158:0:13440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c925fae4/0x9383f985bc4c1062 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c151b expref: 66 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.070168:0:13440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:13440:1875064458185088:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.070178:0:13440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ffa13277/0x9383f985bc4d2bb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.070186:0:13440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ffa13277/0x9383f985bc4d2bb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.070192:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffa13277/0x9383f985bc4d2bb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.070200:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffa13277/0x9383f985bc4d2bb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201209.070200:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c2b7dc00/2, rc 0, transno 4294968771 00010000:00010000:0.0:1788201209.070207:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffa13277/0x9383f985bc4d2bb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.070210:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458186112:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788201209.070220:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c2b7d880/2, rc 0, transno 4294968770 00000100:00100000:2.0:1788201209.070223:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458185216:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788201209.070225:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1788201209.070233:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c344b480/2, rc 0, transno 4294968788 00000100:00100000:2.0:1788201209.070242:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458184064:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788201209.070252:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c3448380/2, rc 0, transno 4294968787 00000100:00100000:2.0:1788201209.070255:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458183936:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788201209.070370:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201209.070375:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffa13277/0x9383f985bc4d2bb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.070383:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.070387:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffa13277/0x9383f985bc4d2bb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.070395:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffa13277/0x9383f985bc4d2bb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.070406:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffa13277/0x9383f985bc4d2bb1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.070419:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffa13277/0x9383f985bc4d2bb1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.070432:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.070434:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.070435:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201209.070448:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff054700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458188032:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.070478:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.070502:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201209.070508:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff055500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458188416:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.070524:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.070551:0:6706:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff056680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1875064458187392:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.070563:0:6706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4d2be9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.070579:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458188160:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.070601:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.070621:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201209.070626:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458188288:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.070647:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.070676:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458188032 00000100:00100000:2.0:1788201209.070682:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458188032 00000100:00100000:2.0:1788201209.070712:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458188416 00000100:00100000:2.0:1788201209.070716:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458188416 00000100:00100000:2.0:1788201209.070730:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458188160 00000100:00100000:2.0:1788201209.070733:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458188160 00000100:00100000:2.0:1788201209.070746:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458188288 00000100:00100000:2.0:1788201209.070748:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458188288 00000100:00100000:2.0:1788201209.070764:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4058 00000100:00100000:2.0:1788201209.070770:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff054a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+91:3313:x1875064458188032:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201209.070793:0:13443:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:559 count 1 00010000:00010000:2.0:1788201209.070813:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d2c05 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.070827:0:13443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000038236f1/0x9383f985bc4b20c5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc264 expref: 546 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.070834:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22f:0x0].0x0 since=79s v=(0 0) 00010000:00010000:2.0:1788201209.070838:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.070843:0:13443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d2c05 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.070852:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:2.0:1788201209.070865:0:13443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000038236f1/0x9383f985bc4b20c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc264 expref: 546 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.070866:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:2.0:1788201209.070878:0:13443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000038236f1/0x9383f985bc4b20c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc264 expref: 546 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.070878:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201209.070890:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201209.070891:0:13443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5227100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13443:1875064458188544:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201209.070900:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201209.070936:0:13443:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91240 going to sleep for 11 seconds 00000100:00100000:2.0:1788201209.070951:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4059 00000100:00100000:2.0:1788201209.070958:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+83:3313:x1875064458188416:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201209.070971:0:13447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:588 count 1 00010000:00010000:2.0:1788201209.070984:0:13447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1c58db5/0x9383f985bc4d2c0c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.071008:0:13447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c03fd341/0x9383f985bc4b3811 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bca8a expref: 65 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.071015:0:13447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24c:0x0].0x0 since=76s v=(0 0) 00010000:00010000:2.0:1788201209.071018:0:13447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.071022:0:13447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1c58db5/0x9383f985bc4d2c0c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.071042:0:13447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c03fd341/0x9383f985bc4b3811 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bca8a expref: 65 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.071051:0:13447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c03fd341/0x9383f985bc4b3811 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bca8a expref: 65 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.071062:0:13447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5226300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:13447:1875064458188672:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.071083:0:13447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f919c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201209.071097:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4060 00000100:00100000:3.0:1788201209.071098:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201209.071104:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+91:3310:x1875064458188160:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201209.071115:0:13448:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:777 count 1 00010000:00010000:2.0:1788201209.071130:0:13448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2c13 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x309:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.071145:0:13448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001045e6a6/0x9383f985bc4bcead lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x309:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfe77 expref: 546 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.071152:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x309:0x0].0x0 since=48s v=(0 0) 00010000:00010000:2.0:1788201209.071155:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x309:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.071159:0:13448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2c13 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x309:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.071177:0:13448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001045e6a6/0x9383f985bc4bcead lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x309:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfe77 expref: 546 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.071187:0:13448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001045e6a6/0x9383f985bc4bcead lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x309:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfe77 expref: 546 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.071196:0:13448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5227800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:13448:1875064458188800:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.071221:0:13448:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201209.071244:0:13449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff055c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:13449:1875064458187648:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.071257:0:13449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d2bf7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.071276:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4061 00000100:00100000:2.0:1788201209.071283:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+83:3310:x1875064458188288:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201209.071314:0:13450:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:639 count 1 00010000:00010000:2.0:1788201209.071328:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d2c1a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.071340:0:13450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007adeba37/0x9383f985bc4b6100 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x27f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd891 expref: 65 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.071347:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27f:0x0].0x0 since=67s v=(0 0) 00010000:00010000:2.0:1788201209.071350:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.071354:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d2c1a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.071372:0:13450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007adeba37/0x9383f985bc4b6100 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x27f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd891 expref: 65 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.071381:0:13450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007adeba37/0x9383f985bc4b6100 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x27f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd891 expref: 65 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.071390:0:13450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5226d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:13450:1875064458188928:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.071413:0:13450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91180 going to sleep for 11 seconds 00010000:00010000:1.0:1788201209.072132:0:12363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005864a8c/0x9383f985bc4be2b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0554 expref: 546 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.072147:0:12363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12363:1875064458185600:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201209.072163:0:12363:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d2bbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.072172:0:12363:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d2bbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.072185:0:12363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d2bbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.072194:0:12363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d2bbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.072202:0:12363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d2bbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.072225:0:12363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201209.072446:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201209.072452:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d2bbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.072460:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.072464:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d2bbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.072477:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d2bbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.072492:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d2bbf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.072499:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d2bbf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.072514:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.072516:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.072517:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201209.072531:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+84:3313:x1875064458184576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 35171us (37590us total) trans 4294968773 rc 0/0 00000100:00100000:0.0:1788201209.072539:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4046 00000100:00100000:1.0:1788201209.072724:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+92:3310:x1875064458185472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 28169us (28236us total) trans 4294968790 rc 0/0 00000100:00100000:1.0:1788201209.072731:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4048 00000004:00080000:2.0:1788201209.072838:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c12d0a80/2, rc 0, transno 4294968790 00000100:00100000:2.0:1788201209.072851:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458185472:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788201209.072937:0:13451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000958ec049/0x9383f985bc4ba63c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf09a expref: 65 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.072952:0:13451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:13451:1875064458184960:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201209.073036:0:13451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d2baa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.073046:0:13451:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d2baa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.073053:0:13451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d2baa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.073062:0:13451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d2baa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.073069:0:13451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d2baa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.073094:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442596608 00000100:00100000:3.0:1788201209.073101:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442596608 00010000:00010000:1.0:1788201209.073185:0:13451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1788201209.073231:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c2b7f800/2, rc 0, transno 4294968772 00000100:00100000:0.0:1788201209.073255:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458186240:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788201209.073269:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c3448a80/2, rc 0, transno 4294968789 00000100:00100000:1.0:1788201209.073373:0:13451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f965f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+84:3313:x1875064458184704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 36879us (38528us total) trans 4294968774 rc 0/0 00000100:00100000:1.0:1788201209.073380:0:13451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4045 00000100:00100000:1.0:1788201209.073494:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442597504 00000100:00100000:1.0:1788201209.073498:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442597504 00010000:00010000:1.0:1788201209.073518:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005ff75a68/0x9383f985bc4b4936 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x262:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd079 expref: 546 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.073536:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442596864 00000100:00100000:1.0:1788201209.073540:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442596864 00010000:00010000:3.0:1788201209.073549:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004edd834e/0x9383f985bc4ba89d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf165 expref: 66 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.073551:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009fa83a69/0x9383f985bc4c43e6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c26e1 expref: 66 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.073563:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442597120 00000100:00100000:1.0:1788201209.073566:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442597120 00010000:00010000:1.0:1788201209.073577:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d30cfc30/0x9383f985bc4b46ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcf7d expref: 547 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.073588:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442597376 00000100:00100000:1.0:1788201209.073591:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442597376 00010000:00010000:1.0:1788201209.073602:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000037a78806/0x9383f985bc4c9037 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4175 expref: 548 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.073612:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442596992 00000100:00100000:1.0:1788201209.073615:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442596992 00010000:00010000:1.0:1788201209.073626:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000818e1b36/0x9383f985bc4bd7f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x315:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c01bf expref: 549 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.073637:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442597248 00000100:00100000:1.0:1788201209.073639:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442597248 00010000:00010000:1.0:1788201209.073652:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d94332e1/0x9383f985bc4c0dec lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1450 expref: 67 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.073669:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1432 00000100:00100000:1.0:1788201209.073676:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+549:2361:x1875064442597504:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201209.073687:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201209.073692:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005ff75a68/0x9383f985bc4b4936 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x262:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd079 expref: 549 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.073702:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005ff75a68/0x9383f985bc4b4936 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x262:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd079 expref: 549 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.073721:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x262:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.073725:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x262:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.073730:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d2bfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x262:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.073744:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d2bfe lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x262:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.073895:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201209.073934:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+549:2361:x1875064442597504:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 258us (3081us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.073941:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1432 00000100:00100000:1.0:1788201209.073956:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1433 00000100:00100000:1.0:1788201209.073975:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8105050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+67:2360:x1875064442596864:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201209.073983:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201209.073998:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009fa83a69/0x9383f985bc4c43e6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c26e1 expref: 67 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.074009:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458183680:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788201209.074009:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009fa83a69/0x9383f985bc4c43e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c26e1 expref: 67 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.074016:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1788201209.074022:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.074025:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39c:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1788201209.074028:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5225f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458189056:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788201209.074029:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000058fbae95/0x9383f985bc4d2bdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.074036:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058fbae95/0x9383f985bc4d2bdb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.074052:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201209.074059:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201209.074068:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8105050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+67:2360:x1875064442596864:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 95us (3201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201209.074091:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458189056 00000100:00100000:0.0:1788201209.074095:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458189056 00000100:00100000:0.0:1788201209.074124:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4062 00000100:00100000:0.0:1788201209.074130:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+92:3312:x1875064458189056:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201209.074151:0:10484:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:965 count 1 00010000:00010000:0.0:1788201209.074172:0:10484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d2c21 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3c5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.074185:0:10484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6d9aa55/0x9383f985bc4c6423 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c31fb expref: 548 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.074192:0:10484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c5:0x0].0x0 since=25s v=(0 0) 00010000:00010000:0.0:1788201209.074195:0:10484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.074199:0:10484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d2c21 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.074222:0:10484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d6d9aa55/0x9383f985bc4c6423 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c31fb expref: 548 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.074234:0:10484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d6d9aa55/0x9383f985bc4c6423 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c31fb expref: 548 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.074257:0:10484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10484:1875064458189184:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.074319:0:10484:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5480 going to sleep for 11 seconds 00000004:00080000:0.0:1788201209.074383:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c3449c00/2, rc 0, transno 4294968773 00000100:00100000:0.0:1788201209.074391:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458184576:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788201209.074401:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c344ad80/2, rc 0, transno 4294968774 00000100:00100000:0.0:1788201209.074405:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458184704:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788201209.074438:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788201209.074442:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458189568:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788201209.074444:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d2baa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.074452:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.074455:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d2baa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.074464:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201209.074465:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d2baa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.074482:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d2baa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.074488:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458189568 00010000:00010000:2.0:1788201209.074490:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d2baa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.074491:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458189568 00010000:00010000:2.0:1788201209.074508:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.074510:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201209.074513:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4063 00010000:00010000:2.0:1788201209.074513:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201209.074518:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+84:3312:x1875064458189568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201209.074530:0:13440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:983 count 1 00010000:00010000:0.0:1788201209.074543:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abb16771/0x9383f985bc4d2c28 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3d7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.074544:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201209.074550:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458189696:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788201209.074567:0:13440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a00f84b4/0x9383f985bc4c72fc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3726 expref: 67 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.074576:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.074602:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458189696 00000100:00100000:2.0:1788201209.074606:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458189696 00000100:00100000:2.0:1788201209.074630:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4064 00000100:00100000:2.0:1788201209.074636:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+93:3312:x1875064458189696:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201209.074648:0:13444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:805 count 1 00010000:00010000:2.0:1788201209.074665:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032ae062a/0x9383f985bc4d2c2f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.074676:0:13444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d87db3ef/0x9383f985bc4be4be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0603 expref: 548 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.074682:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x325:0x0].0x0 since=45s v=(0 0) 00010000:00010000:2.0:1788201209.074686:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x325:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.074689:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032ae062a/0x9383f985bc4d2c2f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.074707:0:13444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d87db3ef/0x9383f985bc4be4be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0603 expref: 548 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.074716:0:13444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d87db3ef/0x9383f985bc4be4be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0603 expref: 548 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.074726:0:13444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5226a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13444:1875064458189824:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.074764:0:13444:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f916c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201209.074779:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458189312:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.074800:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.074818:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201209.074823:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458189440:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.074839:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.074867:0:13451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458189312 00000100:00100000:2.0:1788201209.074870:0:13451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458189312 00000100:00100000:2.0:1788201209.074884:0:13451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458189440 00000100:00100000:2.0:1788201209.074887:0:13451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458189440 00000100:00100000:2.0:1788201209.074898:0:13451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4065 00000100:00100000:2.0:1788201209.074903:0:13451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+86:3310:x1875064458189312:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201209.074914:0:13451:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:579 count 1 00010000:00010000:2.0:1788201209.074924:0:13451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d2c36 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x243:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.074935:0:13451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b008522b/0x9383f985bc4b312d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x243:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc80d expref: 67 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.074948:0:13451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x243:0x0].0x0 since=77s v=(0 0) 00010000:00010000:2.0:1788201209.074951:0:13451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x243:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.074955:0:13451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d2c36 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x243:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.075109:0:13451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b008522b/0x9383f985bc4b312d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x243:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc80d expref: 67 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.075120:0:13451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b008522b/0x9383f985bc4b312d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x243:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc80d expref: 67 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.075131:0:13451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff055f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:13451:1875064458189952:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.075153:0:13451:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201209.075168:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4066 00000100:00100000:2.0:1788201209.075175:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5227b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+86:3310:x1875064458189440:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201209.075185:0:6703:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:628 count 1 00010000:00010000:2.0:1788201209.075197:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d2c3d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x274:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.075208:0:6703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002b55b6d7/0x9383f985bc4b57e5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x274:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd588 expref: 67 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.075215:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x274:0x0].0x0 since=70s v=(0 0) 00010000:00010000:2.0:1788201209.075218:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x274:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.075222:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d2c3d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x274:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.075239:0:6703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002b55b6d7/0x9383f985bc4b57e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x274:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd588 expref: 67 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.075247:0:6703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002b55b6d7/0x9383f985bc4b57e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x274:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd588 expref: 67 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.075257:0:6703:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff054e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6703:1875064458190080:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.075290:0:6703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91480 going to sleep for 11 seconds 00010000:00010000:0.0:1788201209.075914:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d7:0x0].0x0 since=22s v=(0 0) 00010000:00010000:0.0:1788201209.075918:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.075922:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abb16771/0x9383f985bc4d2c28 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.076118:0:13440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a00f84b4/0x9383f985bc4c72fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3726 expref: 67 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.076129:0:13440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a00f84b4/0x9383f985bc4c72fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3726 expref: 67 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.076144:0:13440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:13440:1875064458190208:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.076194:0:13440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5b40 going to sleep for 11 seconds 00010000:00010000:0.0:1788201209.076236:0:13442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fa83a69/0x9383f985bc4c43e6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c26e1 expref: 67 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.076248:0:13442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:13442:1875064458187008:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.076264:0:13442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000058fbae95/0x9383f985bc4d2bdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.076274:0:13442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000058fbae95/0x9383f985bc4d2bdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.076286:0:13442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058fbae95/0x9383f985bc4d2bdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.076440:0:13442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058fbae95/0x9383f985bc4d2bdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.076453:0:13442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058fbae95/0x9383f985bc4d2bdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.076475:0:13442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201209.076514:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201209.076520:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058fbae95/0x9383f985bc4d2bdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.076528:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.076531:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058fbae95/0x9383f985bc4d2bdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.076540:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058fbae95/0x9383f985bc4d2bdb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.076555:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058fbae95/0x9383f985bc4d2bdb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.076562:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058fbae95/0x9383f985bc4d2bdb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.076578:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.076580:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.076582:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201209.077036:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+87:3310:x1875064458186880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 27822us (27998us total) trans 4294968775 rc 0/0 00000100:00100000:0.0:1788201209.077045:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4052 00000004:00080000:2.0:1788201209.077067:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c2b7df80/2, rc 0, transno 4294968775 00000100:00100000:2.0:1788201209.077085:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458186880:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.077086:0:13446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:13446:1875064458187520:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.077099:0:13446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d2bf0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.077163:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201209.077175:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458190336:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.077205:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201209.077238:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458190336 00000100:00100000:0.0:1788201209.077243:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458190336 00000100:00100000:0.0:1788201209.078217:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4067 00000100:00100000:0.0:1788201209.078226:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+87:3311:x1875064458190336:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201209.078380:0:12363:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:823 count 1 00010000:00010000:0.0:1788201209.078401:0:12363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010ae58ae/0x9383f985bc4d2c44 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x337:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.078417:0:12363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ed1cf26/0x9383f985bc4bf3ac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x337:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0b2e expref: 66 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.078425:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x337:0x0].0x0 since=42s v=(0 0) 00010000:00010000:0.0:1788201209.078429:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x337:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.078433:0:12363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010ae58ae/0x9383f985bc4d2c44 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x337:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.078457:0:12363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ed1cf26/0x9383f985bc4bf3ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x337:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0b2e expref: 66 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.078468:0:12363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ed1cf26/0x9383f985bc4bf3ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x337:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0b2e expref: 66 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.078480:0:12363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12363:1875064458190464:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.078533:0:12363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201209.079269:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1434 00000100:00100000:3.0:1788201209.079285:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+548:2360:x1875064442597120:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.079320:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.079329:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d30cfc30/0x9383f985bc4b46ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcf7d expref: 548 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.079342:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d30cfc30/0x9383f985bc4b46ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcf7d expref: 548 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.079363:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d30cfc30/0x9383f985bc4b46ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcf7d expref: 548 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.079377:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.079381:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.079387:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4d2be9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.079395:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4d2be9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x25f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.079423:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.079742:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+547:2360:x1875064442597120:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 461us (8859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.079760:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1434 00000100:00100000:3.0:1788201209.079788:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1435 00000100:00100000:3.0:1788201209.079795:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+546:2360:x1875064442597376:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.079803:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.079810:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000037a78806/0x9383f985bc4c9037 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4175 expref: 546 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.079821:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000037a78806/0x9383f985bc4c9037 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4175 expref: 546 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.079833:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037a78806/0x9383f985bc4c9037 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4175 expref: 546 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.079842:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.079845:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.079848:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d2bf7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.079855:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d2bf7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.079882:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201209.080172:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201209.080187:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201209.080423:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1433 00000100:00100000:1.0:1788201209.080446:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442597632 00000100:00100000:1.0:1788201209.080453:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442597632 00010000:00010000:1.0:1788201209.080476:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c03fd341/0x9383f985bc4b3811 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bca8a expref: 66 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.080491:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442597760 00000100:00100000:1.0:1788201209.080494:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442597760 00010000:00010000:1.0:1788201209.080506:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000038236f1/0x9383f985bc4b20c5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc264 expref: 546 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.080521:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1436 00000100:00100000:1.0:1788201209.080528:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+546:2360:x1875064442596992:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201209.080537:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201209.080542:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000818e1b36/0x9383f985bc4bd7f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x315:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c01bf expref: 546 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.080552:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000818e1b36/0x9383f985bc4bd7f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x315:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c01bf expref: 546 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.080566:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000818e1b36/0x9383f985bc4bd7f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x315:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c01bf expref: 546 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.080585:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x315:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.080588:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x315:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.080592:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000608f96c4/0x9383f985bc4d2be2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x315:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.080600:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000608f96c4/0x9383f985bc4d2be2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x315:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.080623:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201209.080652:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+545:2360:x1875064442596992:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 125us (9750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.080659:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1436 00000100:00100000:1.0:1788201209.080675:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1437 00000100:00100000:1.0:1788201209.080682:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+66:2360:x1875064442597248:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201209.080690:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201209.080695:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d94332e1/0x9383f985bc4c0dec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1450 expref: 66 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.080705:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d94332e1/0x9383f985bc4c0dec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1450 expref: 66 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.080720:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000608f96c4/0x9383f985bc4d2be2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.080720:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d94332e1/0x9383f985bc4c0dec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1450 expref: 66 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.080730:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000608f96c4/0x9383f985bc4d2be2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.080736:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x358:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.080739:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x358:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.080740:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000608f96c4/0x9383f985bc4d2be2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.080743:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d2bf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.080759:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000608f96c4/0x9383f985bc4d2be2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.080777:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201209.081044:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff055880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+94:3312:x1875064458185728:12345-0@lo:6:osp-syn-0-0.0 Request processed in 31072us (34919us total) trans 4294968791 rc 0/0 00000100:00100000:0.0:1788201209.081052:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4053 00000100:00100000:0.0:1788201209.081265:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1438 00000100:00100000:0.0:1788201209.081276:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+65:2361:x1875064442596608:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201209.081285:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201209.081291:0:7646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004edd834e/0x9383f985bc4ba89d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf165 expref: 65 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.081445:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1439 00010000:00010000:2.0:1788201209.081461:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4d2be9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.081471:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4d2be9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.081480:0:7646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004edd834e/0x9383f985bc4ba89d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf165 expref: 65 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.081480:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4d2be9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.081488:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4d2be9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.081495:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004edd834e/0x9383f985bc4ba89d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf165 expref: 65 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.081502:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788201209.081505:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.081508:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.081512:0:7646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d2bc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.081520:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d2bc6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.081538:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201209.081642:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff054000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+94:3312:x1875064458186752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 31523us (31791us total) trans 4294968792 rc 0/0 00000100:00100000:0.0:1788201209.081646:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+64:2361:x1875064442596608:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 374us (12567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.081650:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4054 00000100:00100000:0.0:1788201209.081653:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1438 00000100:00100000:0.0:1788201209.081666:0:7646:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 6 min 3 max 56 00010000:00010000:2.0:1788201209.081671:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1788201209.081672:0:7646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_006' 00010000:00010000:2.0:1788201209.081676:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000608f96c4/0x9383f985bc4d2be2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.081690:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.081694:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000608f96c4/0x9383f985bc4d2be2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.081703:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000608f96c4/0x9383f985bc4d2be2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.081715:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000608f96c4/0x9383f985bc4d2be2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.081722:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000608f96c4/0x9383f985bc4d2be2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.081738:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201209.081741:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4d2be9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.081746:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030000 already unused, calling callback (ffffffffc13fbfe0) 00000100:00100000:0.0:1788201209.081841:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+63:2361:x1875064442596736:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 13380us (18571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201209.081849:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1431 00000100:00100000:0.0:1788201209.081946:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1440 00000100:00100000:0.0:1788201209.081954:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+544:2361:x1875064442597760:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201209.081962:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201209.081968:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000038236f1/0x9383f985bc4b20c5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc264 expref: 544 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.081979:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000038236f1/0x9383f985bc4b20c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc264 expref: 544 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.082000:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.082004:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.082009:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d2c05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.082017:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d2c05 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.082030:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201209.082048:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+544:2361:x1875064442597760:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 95us (1860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201209.082055:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1440 00010000:00010000:1.0:1788201209.082195:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d2bf0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.082219:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201209.082234:0:13446:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d2bf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.082242:0:13446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d2bf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.082251:0:13446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d2bf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.082259:0:13446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d2bf0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.082839:0:13446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201209.082900:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201209.082906:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d2bf0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.082915:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bd600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.082918:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d2bf0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.082926:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d2bf0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.082938:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d2bf0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.082945:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d2bf0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.082966:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.082968:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.082970:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.083064:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4d2be9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.083076:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4d2be9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.083088:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4d2be9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.083109:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4d2be9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.083123:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.083125:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.083127:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201209.083729:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff057b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+88:3310:x1875064458187136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 33510us (33654us total) trans 4294968776 rc 0/0 00000100:00100000:1.0:1788201209.083741:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4055 00000100:00100000:3.0:1788201209.087996:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+543:2360:x1875064442597376:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 8181us (17084us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.088012:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1435 00000100:00100000:3.0:1788201209.088466:0:13447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5226300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:13447:1875064458188672:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201209.088492:0:13447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d1c58db5/0x9383f985bc4d2c0c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.088524:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000038236f1/0x9383f985bc4b20c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc264 expref: 542 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.088538:0:13443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5227100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13443:1875064458188544:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201209.088549:0:13443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d2c05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.088569:0:13443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d2c05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.088582:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d2c05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.088593:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d2c05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.088601:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d2c05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.088620:0:13443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201209.088915:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff054a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+94:3313:x1875064458188032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18144us (18435us total) trans 4294968793 rc 0/0 00000100:00100000:3.0:1788201209.088924:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4058 00000004:00080000:3.0:1788201209.088969:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c2b7d180/2, rc 0, transno 4294968792 00000100:00100000:3.0:1788201209.088982:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458186752:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788201209.089005:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c3449180/2, rc 0, transno 4294968791 00000100:00100000:3.0:1788201209.089009:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3449180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458185728:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788201209.089027:0:13449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d2bf7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.089037:0:13449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d2bf7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.089046:0:13449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d2bf7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.089053:0:13449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d2bf7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.089067:0:13449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788201209.089407:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+94:3313:x1875064458185856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 38951us (39009us total) trans 4294968794 rc 0/0 00000100:00100000:3.0:1788201209.089414:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4056 00000100:00100000:3.0:1788201209.089437:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3448000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+62:2361:x1875064442597632:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.089453:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.089459:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c03fd341/0x9383f985bc4b3811 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bca8a expref: 62 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.089473:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c03fd341/0x9383f985bc4b3811 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bca8a expref: 62 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.089493:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c03fd341/0x9383f985bc4b3811 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bca8a expref: 62 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.089508:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.089512:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.089517:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1c58db5/0x9383f985bc4d2c0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.089526:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1c58db5/0x9383f985bc4d2c0c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.089546:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201209.089555:0:13447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d1c58db5/0x9383f985bc4d2c0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.089562:0:13447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1c58db5/0x9383f985bc4d2c0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.089570:0:13447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1c58db5/0x9383f985bc4d2c0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.089577:0:13447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1c58db5/0x9383f985bc4d2c0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.089586:0:13447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1788201209.089705:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+88:3313:x1875064458188416:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18747us (19179us total) trans 4294968777 rc 0/0 00000100:00100000:3.0:1788201209.089712:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4059 00000100:00100000:3.0:1788201209.089749:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3448000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+61:2361:x1875064442597632:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 8297us (9578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.089756:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1439 00000004:00080000:0.0:1788201209.091057:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04ff055500/2, rc 0, transno 4294968777 00000100:00100000:0.0:1788201209.091078:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff055500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458188416:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788201209.091092:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04ff054700/2, rc 0, transno 4294968793 00000100:00100000:0.0:1788201209.091106:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff054700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458188032:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788201209.091118:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c344a300/2, rc 0, transno 4294968794 00000100:00100000:0.0:1788201209.091121:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458185856:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788201209.091189:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201209.091196:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d2c05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.091207:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.091212:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d2c05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.091222:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d2c05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.091238:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d2c05 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.091245:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d2c05 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.091279:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201209.091284:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d2bf7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.091290:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.091423:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d2bf7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.091433:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d2bf7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.091444:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d2bf7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.091452:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d2bf7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.091469:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201209.091473:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1c58db5/0x9383f985bc4d2c0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.091479:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.091482:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1c58db5/0x9383f985bc4d2c0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.091496:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1c58db5/0x9383f985bc4d2c0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.091505:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1c58db5/0x9383f985bc4d2c0c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.091512:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1c58db5/0x9383f985bc4d2c0c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.091524:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.091525:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.091527:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201209.091541:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458190592:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.091720:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201209.091927:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201209.092175:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458190592 00000100:00100000:3.0:1788201209.092183:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458190592 00000100:00100000:1.0:1788201209.092209:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+60:2360:x1875064442597248:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 11526us (21109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.092220:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1437 00000100:00100000:3.0:1788201209.092229:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4068 00000100:00100000:3.0:1788201209.092237:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+88:3311:x1875064458190592:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201209.092239:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442597888 00000100:00100000:1.0:1788201209.092241:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442597888 00010000:00010000:1.0:1788201209.092260:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001045e6a6/0x9383f985bc4bcead lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x309:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfe77 expref: 542 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.092413:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201209.092493:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c8234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458190848:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.092527:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.092552:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201209.092558:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff055c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458190720:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.092579:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.092605:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458190848 00000100:00100000:2.0:1788201209.092609:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458190848 00000100:00100000:2.0:1788201209.092634:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458190720 00000100:00100000:2.0:1788201209.092637:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458190720 00000100:00100000:2.0:1788201209.092657:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4069 00000100:00100000:2.0:1788201209.092663:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c8237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+95:3313:x1875064458190848:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201209.092687:0:6705:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:861 count 1 00010000:00010000:2.0:1788201209.092712:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f21f6f3/0x9383f985bc4d2c4b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.092729:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9db2659/0x9383f985bc4c119d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c158b expref: 542 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.092737:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35d:0x0].0x0 since=37s v=(0 0) 00010000:00010000:2.0:1788201209.092742:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.092746:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f21f6f3/0x9383f985bc4d2c4b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.093164:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4070 00000100:00100000:0.0:1788201209.093175:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c8237100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+95:3313:x1875064458190720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201209.093188:0:13442:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1017 count 1 00010000:00010000:0.0:1788201209.093200:0:13442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d2c52 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.093213:0:13442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004e584953/0x9383f985bc4c8dd6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c40aa expref: 542 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.093221:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f9:0x0].0x0 since=19s v=(0 0) 00010000:00010000:0.0:1788201209.093224:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.093229:0:13442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d2c52 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788201209.093413:0:13445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:994 count 1 00010000:00010000:3.0:1788201209.093429:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f90440/0x9383f985bc4d2c59 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.093433:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1441 00000100:00100000:1.0:1788201209.093442:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8106450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+542:2362:x1875064442597888:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.093442:0:13445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4b84f67/0x9383f985bc4c7bc3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3a44 expref: 59 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.093449:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e2:0x0].0x0 since=21s v=(0 0) 00010000:00010000:1.0:1788201209.093452:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.093452:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.093455:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f90440/0x9383f985bc4d2c59 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.093457:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001045e6a6/0x9383f985bc4bcead lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x309:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfe77 expref: 542 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.093470:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001045e6a6/0x9383f985bc4bcead lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x309:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfe77 expref: 542 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.093475:0:13445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b4b84f67/0x9383f985bc4c7bc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3a44 expref: 59 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.093485:0:13445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b4b84f67/0x9383f985bc4c7bc3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3a44 expref: 59 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.093488:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x309:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.093491:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x309:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.093496:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2c13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x309:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.093498:0:13445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13445:1875064458191360:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201209.093505:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2c13 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x309:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.093518:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201209.093542:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8106450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+542:2362:x1875064442597888:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 103us (1617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.093549:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1441 00010000:00010000:1.0:1788201209.093617:0:13438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ff75a68/0x9383f985bc4b4936 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x262:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd079 expref: 541 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.093631:0:13438:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:13438:1875064458187904:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201209.093651:0:13438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d2bfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.093661:0:13438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d2bfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.093669:0:13438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d2bfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.093678:0:13438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d2bfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.093684:0:13438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d2bfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.093699:0:13438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201209.094005:0:13442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004e584953/0x9383f985bc4c8dd6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c40aa expref: 540 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.094017:0:13442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004e584953/0x9383f985bc4c8dd6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c40aa expref: 540 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.094029:0:13442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:13442:1875064458191232:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.094065:0:13442:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a56c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788201209.094076:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201209.094077:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e9db2659/0x9383f985bc4c119d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c158b expref: 540 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.094081:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d2bfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.094086:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e9db2659/0x9383f985bc4c119d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c158b expref: 540 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.094089:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc600 already unused, calling callback (ffffffffc13fbfe0) 00000100:00100000:3.0:1788201209.094166:0:13445:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c56ba3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201209.094174:0:6705:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c8237800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6705:1875064458191488:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.094198:0:6705:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91e40 going to sleep for 11 seconds 00010000:00010000:0.0:1788201209.094207:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d2bfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.094216:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d2bfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.094219:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.094229:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d2bfe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.094241:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d2bfe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.094823:0:13450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5226d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:13450:1875064458188928:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201209.094839:0:13450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d2c1a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.094963:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.094966:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.094968:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201209.095008:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201209.095051:0:10484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10484:1875064458189184:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.095064:0:10484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d2c21 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.095082:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442598016 00000100:00100000:0.0:1788201209.095088:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442598016 00010000:00010000:0.0:1788201209.095111:0:7646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007adeba37/0x9383f985bc4b6100 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x27f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd891 expref: 60 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.095136:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1442 00000100:00100000:0.0:1788201209.095144:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+60:2361:x1875064442598016:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201209.095153:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201209.095158:0:7646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007adeba37/0x9383f985bc4b6100 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x27f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd891 expref: 60 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.095167:0:7646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007adeba37/0x9383f985bc4b6100 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x27f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd891 expref: 60 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.095187:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007adeba37/0x9383f985bc4b6100 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x27f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd891 expref: 60 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.095197:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.095201:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.095205:0:7646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d2c1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.095209:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff056d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+96:3312:x1875064458187776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 43046us (43337us total) trans 4294968795 rc 0/0 00010000:00010000:0.0:1788201209.095214:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d2c1a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.095217:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4057 00010000:00010000:0.0:1788201209.095232:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201209.095282:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:2.0:1788201209.095487:0:13448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001045e6a6/0x9383f985bc4bcead lrc: 0/0,0 mode: --/PR res: [0x240000400:0x309:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfe77 expref: 540 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201209.095490:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c2b7ed80/2, rc 0, transno 4294968795 00000100:00100000:2.0:1788201209.095499:0:13448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5227800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:13448:1875064458188800:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201209.095500:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458187776:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788201209.095510:0:13448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2c13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.095518:0:13448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2c13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.095525:0:13448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2c13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.095537:0:13448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2c13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.095543:0:13448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2c13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.095556:0:13448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201209.095698:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+96:3310:x1875064458188160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24593us (25095us total) trans 4294968796 rc 0/0 00000100:00100000:2.0:1788201209.095705:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4060 00010000:00010000:2.0:1788201209.095724:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201209.095729:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2c13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.095737:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.095740:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2c13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.095748:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2c13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.095853:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+59:2361:x1875064442598016:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 709us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201209.095861:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1442 00000100:00100000:0.0:1788201209.095881:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442598144 00000100:00100000:0.0:1788201209.095885:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442598144 00010000:00010000:0.0:1788201209.095899:0:7646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d6d9aa55/0x9383f985bc4c6423 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c31fb expref: 540 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.095960:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1443 00000100:00100000:0.0:1788201209.095968:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c8236680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+540:2361:x1875064442598144:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201209.095977:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201209.095982:0:7646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d6d9aa55/0x9383f985bc4c6423 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c31fb expref: 540 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.096003:0:7646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d6d9aa55/0x9383f985bc4c6423 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c31fb expref: 540 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.096017:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6d9aa55/0x9383f985bc4c6423 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c31fb expref: 540 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.096027:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.096030:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.096034:0:7646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d2c21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.096041:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d2c21 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.096057:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201209.096068:0:10484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d2c21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.096076:0:10484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d2c21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.096084:0:10484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d2c21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.096091:0:10484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d2c21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.096106:0:10484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201209.096244:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+96:3312:x1875064458189056:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22113us (22183us total) trans 4294968797 rc 0/0 00000100:00100000:0.0:1788201209.096262:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4062 00000004:00080000:0.0:1788201209.096290:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c5225f80/2, rc 0, transno 4294968797 00000100:00100000:0.0:1788201209.096367:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5225f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458189056:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788201209.096399:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2c13 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.096406:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2c13 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.096422:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201209.096426:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d2c21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.096432:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bce00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.096436:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d2c21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.096444:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d2c21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.096453:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d2c21 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.096460:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d2c21 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.096467:0:13440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:13440:1875064458190208:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.096472:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.096473:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.096475:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.096479:0:13440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000abb16771/0x9383f985bc4d2c28 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.096492:0:13444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5226a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13444:1875064458189824:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.096505:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:2.0:1788201209.096507:0:13444:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000032ae062a/0x9383f985bc4d2c2f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.096581:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c8235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458191744:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.096614:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.096638:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201209.096644:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c8236a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458191616:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.096665:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.096689:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458191744 00000100:00100000:2.0:1788201209.096694:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458191744 00000100:00100000:2.0:1788201209.096715:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458191616 00000100:00100000:2.0:1788201209.096718:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458191616 00000100:00100000:2.0:1788201209.096738:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4071 00000100:00100000:2.0:1788201209.096744:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c8234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+97:3313:x1875064458191744:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201209.096774:0:13443:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:916 count 1 00010000:00010000:2.0:1788201209.096792:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bf3c8de/0x9383f985bc4d2c60 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x394:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.096807:0:13443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d0199212/0x9383f985bc4c3d2c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x394:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c24a3 expref: 539 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.096815:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x394:0x0].0x0 since=31s v=(0 0) 00010000:00010000:2.0:1788201209.096818:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x394:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.096821:0:13443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bf3c8de/0x9383f985bc4d2c60 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x394:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.096841:0:13443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d0199212/0x9383f985bc4c3d2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x394:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c24a3 expref: 539 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.096852:0:13443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d0199212/0x9383f985bc4c3d2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x394:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c24a3 expref: 539 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.096868:0:13443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c8236300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13443:1875064458191872:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.096912:0:13443:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f916c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201209.096929:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4072 00000100:00100000:2.0:1788201209.096937:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c8234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+97:3313:x1875064458191616:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201209.096949:0:13447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:731 count 1 00010000:00010000:2.0:1788201209.096977:0:13447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2c67 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.096999:0:13447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000480eaf38/0x9383f985bc4ba9ed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf1d5 expref: 539 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.097006:0:13447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2db:0x0].0x0 since=54s v=(0 0) 00010000:00010000:2.0:1788201209.097009:0:13447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.097013:0:13447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2c67 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.097032:0:13447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000480eaf38/0x9383f985bc4ba9ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf1d5 expref: 539 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.097042:0:13447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000480eaf38/0x9383f985bc4ba9ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf1d5 expref: 539 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.097052:0:13447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c8237480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:13447:1875064458192000:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.097079:0:13447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91b40 going to sleep for 11 seconds 00010000:00010000:2.0:1788201209.097614:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.098577:0:13441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d2bc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.098590:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d2bc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.098600:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d2bc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.098608:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d2bc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.098633:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201209.100228:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+89:3310:x1875064458185984:12345-0@lo:6:osp-syn-1-0.0 Request processed in 53933us (54041us total) trans 4294968778 rc 0/0 00000100:00100000:2.0:1788201209.100239:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4049 00010000:00010000:2.0:1788201209.100284:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201209.100291:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d2bc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.100641:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.100646:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d2bc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.100657:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d2bc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.100678:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d2bc6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.100686:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d2bc6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.100716:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.100718:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.100720:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201209.101095:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c8235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458191104:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.101140:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.101432:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201209.101441:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c8235880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458190976:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.101473:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.101510:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458191104 00000100:00100000:2.0:1788201209.101519:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458191104 00000100:00100000:2.0:1788201209.101554:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458190976 00000100:00100000:2.0:1788201209.101557:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458190976 00000100:00100000:2.0:1788201209.101577:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4073 00000100:00100000:2.0:1788201209.101585:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c8235c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+99:3311:x1875064458191104:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201209.101613:0:10484:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:646 count 1 00010000:00010000:2.0:1788201209.101636:0:10484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d2c6e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x286:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.101654:0:10484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b133555a/0x9383f985bc4b6616 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x286:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bda43 expref: 539 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.101669:0:10484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x286:0x0].0x0 since=66s v=(0 0) 00010000:00010000:2.0:1788201209.101673:0:10484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x286:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.101678:0:10484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d2c6e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x286:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.101709:0:10484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b133555a/0x9383f985bc4b6616 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x286:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bda43 expref: 539 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.101721:0:10484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b133555a/0x9383f985bc4b6616 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x286:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bda43 expref: 539 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.101733:0:10484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c8235180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10484:1875064458192128:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.101998:0:10484:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201209.102034:0:12363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12363:1875064458190464:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.102040:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:0.0:1788201209.102059:0:12363:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000010ae58ae/0x9383f985bc4d2c44 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x337:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.102097:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c8236680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+539:2361:x1875064442598144:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 6125us (6811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201209.102106:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1443 00000100:00100000:3.0:1788201209.102131:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442598272 00000100:00100000:3.0:1788201209.102136:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442598272 00010000:00010000:3.0:1788201209.102157:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d87db3ef/0x9383f985bc4be4be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0603 expref: 539 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.102175:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1444 00000100:00100000:3.0:1788201209.102181:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+539:2361:x1875064442598272:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.102189:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.102193:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d87db3ef/0x9383f985bc4be4be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0603 expref: 539 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.102206:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d87db3ef/0x9383f985bc4be4be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0603 expref: 539 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.102224:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d87db3ef/0x9383f985bc4be4be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0603 expref: 539 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.102236:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x325:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.102240:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x325:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.102246:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000032ae062a/0x9383f985bc4d2c2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.103153:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032ae062a/0x9383f985bc4d2c2f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.103184:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.103217:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+538:2361:x1875064442598272:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1035us (6710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.103225:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1444 00000100:00100000:3.0:1788201209.103475:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4074 00000100:00100000:3.0:1788201209.103487:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f965dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+99:3311:x1875064458190976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201209.103510:0:6706:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:743 count 1 00010000:00010000:3.0:1788201209.103528:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086186302/0x9383f985bc4d2c75 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.103541:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000000617da6/0x9383f985bc4bb3b0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf516 expref: 537 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.103549:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e7:0x0].0x0 since=53s v=(0 0) 00010000:00010000:3.0:1788201209.103553:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.103557:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086186302/0x9383f985bc4d2c75 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.103657:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000000617da6/0x9383f985bc4bb3b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf516 expref: 537 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.103675:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000000617da6/0x9383f985bc4bb3b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf516 expref: 537 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.103688:0:6706:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1875064458192256:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201209.103722:0:6706:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c56baa80 going to sleep for 11 seconds 00000004:00080000:3.0:1788201209.103827:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04ff055180/2, rc 0, transno 4294968796 00000100:00100000:3.0:1788201209.103840:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458188160:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788201209.103854:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04ff057100/2, rc 0, transno 4294968776 00000100:00100000:3.0:1788201209.103868:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff057100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458187136:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788201209.103887:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c2b7fb80/2, rc 0, transno 4294968778 00000100:00100000:3.0:1788201209.103891:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458185984:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201209.103929:0:13451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff055f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:13451:1875064458189952:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201209.103947:0:13451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d2c36 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x243:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.106365:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442598400 00000100:00100000:0.0:1788201209.106373:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442598400 00010000:00010000:0.0:1788201209.106407:0:7646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b008522b/0x9383f985bc4b312d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x243:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc80d expref: 59 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.106524:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458192384:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201209.106603:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201209.106635:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201209.106640:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458192512:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201209.106660:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201209.106684:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458192384 00000100:00100000:1.0:1788201209.106688:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458192384 00000100:00100000:1.0:1788201209.106706:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458192512 00000100:00100000:1.0:1788201209.106709:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458192512 00000100:00100000:1.0:1788201209.106720:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4075 00000100:00100000:1.0:1788201209.106727:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c502b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+90:3310:x1875064458192384:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788201209.106759:0:13446:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:758 count 1 00010000:00010000:1.0:1788201209.106782:0:13446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002359bf1/0x9383f985bc4d2c7c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.106798:0:13446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000063cc552f/0x9383f985bc4bbfe9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf961 expref: 59 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.106807:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f6:0x0].0x0 since=51s v=(0 0) 00010000:00010000:1.0:1788201209.106811:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.106816:0:13446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002359bf1/0x9383f985bc4d2c7c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.106840:0:13446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000063cc552f/0x9383f985bc4bbfe9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf961 expref: 59 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.106853:0:13446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000063cc552f/0x9383f985bc4bbfe9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf961 expref: 59 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.106865:0:13446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c502bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:13446:1875064458192640:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201209.106918:0:13446:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c33d5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201209.106933:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4076 00000100:00100000:1.0:1788201209.106941:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5028a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+90:3310:x1875064458192512:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788201209.106953:0:13439:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:991 count 1 00010000:00010000:1.0:1788201209.106965:0:13439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c474677/0x9383f985bc4d2c83 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3df:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.106977:0:13439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004bc2e05f/0x9383f985bc4c7962 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3979 expref: 59 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.106983:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3df:0x0].0x0 since=21s v=(0 0) 00010000:00010000:1.0:1788201209.106995:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.106999:0:13439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c474677/0x9383f985bc4d2c83 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.107018:0:13439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004bc2e05f/0x9383f985bc4c7962 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3979 expref: 59 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.107028:0:13439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004bc2e05f/0x9383f985bc4c7962 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3979 expref: 59 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.107038:0:13439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c502ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:13439:1875064458192768:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201209.107064:0:13439:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c33d56c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788201209.107443:0:13450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d2c1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.107455:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d2c1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.107465:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d2c1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.107474:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d2c1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.107492:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788201209.107737:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+91:3310:x1875064458188288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 36453us (37087us total) trans 4294968779 rc 0/0 00000100:00100000:1.0:1788201209.107745:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4061 00000004:00080000:1.0:1788201209.107795:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04ff056300/2, rc 0, transno 4294968779 00000100:00100000:1.0:1788201209.107812:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458188288:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201209.108093:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1445 00000100:00100000:3.0:1788201209.108117:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+59:2361:x1875064442598400:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.108130:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.108137:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b008522b/0x9383f985bc4b312d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x243:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc80d expref: 59 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.108156:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b008522b/0x9383f985bc4b312d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x243:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc80d expref: 59 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.108176:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b008522b/0x9383f985bc4b312d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x243:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc80d expref: 59 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.108191:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x243:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.108194:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x243:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.108200:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d2c36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.108208:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d2c36 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.108227:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201209.108238:0:13451:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d2c36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.108246:0:13451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d2c36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.108254:0:13451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d2c36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.108261:0:13451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d2c36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.108275:0:13451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788201209.108463:0:13451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+91:3310:x1875064458189312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 33558us (33660us total) trans 4294968780 rc 0/0 00000100:00100000:3.0:1788201209.108471:0:13451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4065 00000100:00100000:3.0:1788201209.108507:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+58:2361:x1875064442598400:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 406us (6466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.108513:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1445 00000100:00100000:2.0:1788201209.108722:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201209.108757:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201209.108782:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201209.108829:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201209.108844:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201209.108866:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201209.109163:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201209.109229:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:2.0:1788201209.109478:0:13444:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000032ae062a/0x9383f985bc4d2c2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.109495:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032ae062a/0x9383f985bc4d2c2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.109505:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032ae062a/0x9383f985bc4d2c2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.109512:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032ae062a/0x9383f985bc4d2c2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.109528:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1788201209.109895:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+100:3312:x1875064458189696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 35258us (35316us total) trans 4294968798 rc 0/0 00000100:00100000:2.0:1788201209.109903:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4064 00000100:00100000:2.0:1788201209.109944:0:6705:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c8237800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6705:1875064458191488:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.109962:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005f21f6f3/0x9383f985bc4d2c4b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.109998:0:13443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c8236300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13443:1875064458191872:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.110010:0:13443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003bf3c8de/0x9383f985bc4d2c60 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x394:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.110034:0:13447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c8237480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:13447:1875064458192000:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.110045:0:13447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2c67 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.110060:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788201209.110066:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d2c1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.110075:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.110079:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d2c1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.110088:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d2c1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.110104:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d2c1a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.110110:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d2c1a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.110127:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201209.110131:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d2c36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.110137:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.110140:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d2c36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.110151:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d2c36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.110160:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d2c36 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.110166:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d2c36 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.110177:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201209.110181:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032ae062a/0x9383f985bc4d2c2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.110187:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.110190:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032ae062a/0x9383f985bc4d2c2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.110197:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032ae062a/0x9383f985bc4d2c2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.110206:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032ae062a/0x9383f985bc4d2c2f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.110212:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032ae062a/0x9383f985bc4d2c2f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.110229:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.110230:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.110232:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201209.110479:0:13445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13445:1875064458191360:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201209.110496:0:13445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069f90440/0x9383f985bc4d2c59 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.110533:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442598656 00000100:00100000:3.0:1788201209.110538:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442598656 00010000:00010000:3.0:1788201209.110693:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a00f84b4/0x9383f985bc4c72fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3726 expref: 58 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.110713:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442598528 00000100:00100000:3.0:1788201209.110716:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442598528 00010000:00010000:3.0:1788201209.110729:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002b55b6d7/0x9383f985bc4b57e5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x274:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd588 expref: 59 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.110739:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442598784 00000100:00100000:3.0:1788201209.110741:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442598784 00010000:00010000:3.0:1788201209.110760:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ed1cf26/0x9383f985bc4bf3ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x337:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0b2e expref: 60 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.110777:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442598912 00000100:00100000:3.0:1788201209.110780:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442598912 00010000:00010000:3.0:1788201209.110792:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b4b84f67/0x9383f985bc4c7bc3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3a44 expref: 61 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.110803:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442599040 00000100:00100000:3.0:1788201209.110806:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442599040 00010000:00010000:3.0:1788201209.110818:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e9db2659/0x9383f985bc4c119d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c158b expref: 538 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.110828:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442599168 00000100:00100000:3.0:1788201209.110830:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442599168 00010000:00010000:3.0:1788201209.110840:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004e584953/0x9383f985bc4c8dd6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c40aa expref: 539 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.110849:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442599296 00000100:00100000:3.0:1788201209.110852:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442599296 00010000:00010000:3.0:1788201209.110860:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d0199212/0x9383f985bc4c3d2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x394:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c24a3 expref: 540 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.110869:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442599424 00000100:00100000:3.0:1788201209.110871:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442599424 00010000:00010000:3.0:1788201209.110880:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000480eaf38/0x9383f985bc4ba9ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf1d5 expref: 541 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.110896:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1446 00000100:00100000:3.0:1788201209.110904:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+61:2361:x1875064442598656:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.110917:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.110921:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a00f84b4/0x9383f985bc4c72fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3726 expref: 61 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.110932:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a00f84b4/0x9383f985bc4c72fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3726 expref: 61 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.110948:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a00f84b4/0x9383f985bc4c72fc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3726 expref: 61 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.110960:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.110964:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.110969:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000abb16771/0x9383f985bc4d2c28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.110977:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abb16771/0x9383f985bc4d2c28 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.111010:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.111047:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+60:2361:x1875064442598656:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 142us (2325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.111053:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1446 00000100:00100000:3.0:1788201209.111069:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1447 00000100:00100000:3.0:1788201209.111076:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+59:2361:x1875064442598528:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.111086:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.111091:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002b55b6d7/0x9383f985bc4b57e5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x274:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd588 expref: 59 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.111101:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002b55b6d7/0x9383f985bc4b57e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x274:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd588 expref: 59 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.111114:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x274:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.111117:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x274:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.111122:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d2c3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.111129:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d2c3d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.111140:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.111152:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+59:2361:x1875064442598528:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 78us (2402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.111158:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1447 00000100:00100000:3.0:1788201209.111168:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1448 00000100:00100000:3.0:1788201209.111174:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8104850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+58:2361:x1875064442598784:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.111180:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.111185:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ed1cf26/0x9383f985bc4bf3ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x337:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0b2e expref: 58 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.111200:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ed1cf26/0x9383f985bc4bf3ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x337:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0b2e expref: 58 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.111211:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ed1cf26/0x9383f985bc4bf3ac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x337:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0b2e expref: 58 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.111220:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x337:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.111223:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x337:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.111227:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000010ae58ae/0x9383f985bc4d2c44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x337:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.111235:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010ae58ae/0x9383f985bc4d2c44 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x337:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.111249:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.111273:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8104850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+57:2361:x1875064442598784:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 99us (2490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.111279:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1448 00000100:00100000:3.0:1788201209.111521:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1449 00000100:00100000:3.0:1788201209.111528:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+56:2361:x1875064442598912:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.111536:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.111541:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b4b84f67/0x9383f985bc4c7bc3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3a44 expref: 56 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201209.111805:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c5224380/2, rc 0, transno 4294968798 00000100:00100000:2.0:1788201209.111813:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458189696:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.111896:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458193024:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.111932:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.111959:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201209.111964:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458192896:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.111981:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201209.112013:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.112018:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201209.112027:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458193024 00000100:00100000:2.0:1788201209.112031:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458193024 00000100:00100000:2.0:1788201209.112052:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458192896 00000100:00100000:2.0:1788201209.112054:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458192896 00000100:00100000:2.0:1788201209.112064:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4077 00000100:00100000:2.0:1788201209.112069:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+101:3313:x1875064458193024:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201209.112087:0:13448:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:641 count 1 00010000:00010000:2.0:1788201209.112107:0:13448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b34dacfa/0x9383f985bc4d2c8a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x281:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.112120:0:13448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000089b84766/0x9383f985bc4b623b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x281:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd8fa expref: 541 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.112127:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x281:0x0].0x0 since=67s v=(0 0) 00010000:00010000:2.0:1788201209.112131:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x281:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.112134:0:13448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b34dacfa/0x9383f985bc4d2c8a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x281:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.112157:0:13448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000089b84766/0x9383f985bc4b623b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x281:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd8fa expref: 541 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.112167:0:13448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000089b84766/0x9383f985bc4b623b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x281:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd8fa expref: 541 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.112178:0:13448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:13448:1875064458193152:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.112211:0:13448:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201209.112228:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4078 00000100:00100000:2.0:1788201209.112235:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+101:3313:x1875064458192896:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788201209.112384:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b4b84f67/0x9383f985bc4c7bc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3a44 expref: 56 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.112399:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4b84f67/0x9383f985bc4c7bc3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3a44 expref: 56 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.112409:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.112412:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.112416:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069f90440/0x9383f985bc4d2c59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.112423:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f90440/0x9383f985bc4d2c59 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.112440:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.112456:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+55:2361:x1875064442598912:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 930us (3627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.112462:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1449 00000100:00100000:3.0:1788201209.112477:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1450 00000100:00100000:3.0:1788201209.112483:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+541:2361:x1875064442599040:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.112491:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.112496:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e9db2659/0x9383f985bc4c119d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x35d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c158b expref: 541 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.112512:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e9db2659/0x9383f985bc4c119d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x35d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c158b expref: 541 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.112525:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9db2659/0x9383f985bc4c119d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x35d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c158b expref: 541 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.112536:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.112539:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.112544:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005f21f6f3/0x9383f985bc4d2c4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.112551:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f21f6f3/0x9383f985bc4d2c4b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.112738:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.112820:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+540:2361:x1875064442599040:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 335us (3973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.112827:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1450 00000100:00100000:3.0:1788201209.112842:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1451 00000100:00100000:3.0:1788201209.112849:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+539:2362:x1875064442599168:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.112857:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.112863:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004e584953/0x9383f985bc4c8dd6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c40aa expref: 539 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.112933:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004e584953/0x9383f985bc4c8dd6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c40aa expref: 539 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.112946:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.112949:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.112954:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d2c52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.112961:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d2c52 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.112974:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.113000:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+539:2362:x1875064442599168:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 151us (4132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.113006:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1451 00000100:00100000:3.0:1788201209.113020:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1452 00000100:00100000:3.0:1788201209.113027:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+538:2362:x1875064442599296:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.113035:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.113040:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d0199212/0x9383f985bc4c3d2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x394:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c24a3 expref: 538 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.113051:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d0199212/0x9383f985bc4c3d2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x394:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c24a3 expref: 538 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.113069:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0199212/0x9383f985bc4c3d2c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x394:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c24a3 expref: 538 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.113079:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x394:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.113082:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x394:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.113087:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003bf3c8de/0x9383f985bc4d2c60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x394:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.113095:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bf3c8de/0x9383f985bc4d2c60 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x394:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.113112:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.113124:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+537:2362:x1875064442599296:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 98us (3962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.113130:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1452 00000100:00100000:3.0:1788201209.113142:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1453 00000100:00100000:3.0:1788201209.113149:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+536:2362:x1875064442599424:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.113155:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.113161:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000480eaf38/0x9383f985bc4ba9ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf1d5 expref: 536 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.113171:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000480eaf38/0x9383f985bc4ba9ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf1d5 expref: 536 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.113188:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000480eaf38/0x9383f985bc4ba9ed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf1d5 expref: 536 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.113198:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.113201:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.113205:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2c67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.113213:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2c67 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.113226:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.113237:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+535:2362:x1875064442599424:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 89us (4008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.113243:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1453 00010000:00010000:3.0:1788201209.113278:0:13445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069f90440/0x9383f985bc4d2c59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.113288:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069f90440/0x9383f985bc4d2c59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.113450:0:13440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000abb16771/0x9383f985bc4d2c28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.113460:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abb16771/0x9383f985bc4d2c28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.113469:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abb16771/0x9383f985bc4d2c28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.113478:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abb16771/0x9383f985bc4d2c28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.113492:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201209.114401:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+91:3312:x1875064458189568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 39880us (39932us total) trans 4294968781 rc 0/0 00000100:00100000:0.0:1788201209.114410:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4063 00010000:00010000:0.0:1788201209.114454:0:13442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e584953/0x9383f985bc4c8dd6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c40aa expref: 534 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.114467:0:13442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:13442:1875064458191232:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.114484:0:13442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d2c52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.114493:0:13442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d2c52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.114500:0:13442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d2c52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.114509:0:13442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d2c52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.114517:0:13442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d2c52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.114531:0:13442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:2.0:1788201209.114732:0:13444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:581 count 1 00010000:00010000:2.0:1788201209.114932:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecaefa8a/0x9383f985bc4d2c91 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.114948:0:13444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1a00071/0x9383f985bc4b3268 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc876 expref: 533 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.114957:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x245:0x0].0x0 since=77s v=(0 0) 00010000:00010000:2.0:1788201209.114960:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x245:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.114964:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecaefa8a/0x9383f985bc4d2c91 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.115007:0:13444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c1a00071/0x9383f985bc4b3268 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc876 expref: 533 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.115019:0:13444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c1a00071/0x9383f985bc4b3268 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc876 expref: 533 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.115032:0:13444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13444:1875064458193408:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.115066:0:13444:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91b40 going to sleep for 11 seconds 00010000:00010000:2.0:1788201209.115086:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005f21f6f3/0x9383f985bc4d2c4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.115095:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f21f6f3/0x9383f985bc4d2c4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.115104:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f21f6f3/0x9383f985bc4d2c4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.115111:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f21f6f3/0x9383f985bc4d2c4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.115125:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788201209.115680:0:12363:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000010ae58ae/0x9383f985bc4d2c44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.115690:0:12363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010ae58ae/0x9383f985bc4d2c44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.115699:0:12363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010ae58ae/0x9383f985bc4d2c44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.115705:0:12363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010ae58ae/0x9383f985bc4d2c44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.115714:0:12363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1788201209.116089:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+91:3311:x1875064458190336:12345-0@lo:6:osp-syn-1-0.0 Request processed in 37862us (38882us total) trans 4294968782 rc 0/0 00000100:00100000:0.0:1788201209.116098:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4067 00010000:00010000:3.0:1788201209.116685:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f90440/0x9383f985bc4d2c59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.116695:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069f90440/0x9383f985bc4d2c59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.116707:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:3.0:1788201209.117074:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+91:3311:x1875064458190592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24837us (25354us total) trans 4294968783 rc 0/0 00000100:00100000:3.0:1788201209.117082:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4068 00000100:00100000:1.0:1788201209.117264:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458193280:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201209.117447:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788201209.117498:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c2b7ce00/2, rc 0, transno 4294968780 00000100:00100000:1.0:1788201209.117507:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458189312:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.118076:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458193280 00000100:00100000:0.0:1788201209.118083:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458193280 00000100:00100000:0.0:1788201209.118119:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4079 00000100:00100000:0.0:1788201209.118126:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5029180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+91:3310:x1875064458193280:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201209.118151:0:13440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:998 count 1 00010000:00010000:0.0:1788201209.118172:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd191276/0x9383f985bc4d2c98 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.118191:0:13440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000643cb57a/0x9383f985bc4c7f20 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3b63 expref: 54 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.118200:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e6:0x0].0x0 since=20s v=(0 0) 00010000:00010000:0.0:1788201209.118204:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.118209:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd191276/0x9383f985bc4d2c98 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.118237:0:13440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000643cb57a/0x9383f985bc4c7f20 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3b63 expref: 54 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.118263:0:13440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000643cb57a/0x9383f985bc4c7f20 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3b63 expref: 54 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.118277:0:13440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:13440:1875064458193536:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.118415:0:13440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201209.118475:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201209.118484:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458193664:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.118515:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201209.119369:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458193664 00000100:00100000:3.0:1788201209.119376:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458193664 00000100:00100000:3.0:1788201209.119422:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4080 00000100:00100000:3.0:1788201209.119430:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+92:3310:x1875064458193664:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788201209.119448:0:13445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:636 count 1 00010000:00010000:3.0:1788201209.119465:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d2c9f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.119479:0:13445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c95db0ea/0x9383f985bc4b5e8a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd7bf expref: 54 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.119487:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27c:0x0].0x0 since=68s v=(0 0) 00010000:00010000:3.0:1788201209.119491:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.119495:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d2c9f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.119517:0:13445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c95db0ea/0x9383f985bc4b5e8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd7bf expref: 54 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.119528:0:13445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c95db0ea/0x9383f985bc4b5e8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd7bf expref: 54 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.119547:0:13445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13445:1875064458193792:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201209.119777:0:13445:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2fd9780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201209.120393:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c8237100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+102:3313:x1875064458190720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 27073us (27664us total) trans 4294968799 rc 0/0 00000100:00100000:1.0:1788201209.120407:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4070 00000004:00080000:3.0:1788201209.120931:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04ff055c00/2, rc 0, transno 4294968799 00000100:00100000:3.0:1788201209.120954:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff055c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458190720:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201209.121084:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201209.121098:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c33f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458193920:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201209.121133:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.121795:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c8237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+102:3313:x1875064458190848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29130us (29265us total) trans 4294968800 rc 0/0 00000100:00100000:2.0:1788201209.121804:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4069 00000100:00100000:2.0:1788201209.121825:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458193920 00000100:00100000:2.0:1788201209.121831:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458193920 00000004:00080000:3.0:1788201209.121894:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04c8234700/2, rc 0, transno 4294968800 00000100:00100000:3.0:1788201209.121907:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c8234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458190848:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201209.122132:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c502a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458194048:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201209.122161:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201209.122459:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458194048 00000100:00100000:0.0:1788201209.122464:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458194048 00000100:00100000:0.0:1788201209.122490:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4081 00000100:00100000:0.0:1788201209.122497:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+103:3313:x1875064458193920:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201209.122519:0:12363:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:986 count 1 00010000:00010000:0.0:1788201209.122542:0:12363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d2ca6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.122690:0:12363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5491737/0x9383f985bc4c74df lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c37f8 expref: 533 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.122702:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3da:0x0].0x0 since=22s v=(0 0) 00010000:00010000:0.0:1788201209.122706:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.122711:0:12363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d2ca6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.122740:0:12363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a5491737/0x9383f985bc4c74df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c37f8 expref: 533 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.122762:0:12363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a5491737/0x9383f985bc4c74df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c37f8 expref: 533 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.122774:0:12363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c24a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12363:1875064458194176:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.122840:0:12363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201209.123422:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4082 00000100:00100000:3.0:1788201209.123433:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+103:3313:x1875064458194048:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201209.123449:0:13449:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1003 count 1 00010000:00010000:3.0:1788201209.123463:0:13449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2cad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.123477:0:13449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000006861cf8/0x9383f985bc4c8292 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3c89 expref: 533 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.123485:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3eb:0x0].0x0 since=20s v=(0 0) 00010000:00010000:3.0:1788201209.123488:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.123491:0:13449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2cad lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.123512:0:13449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000006861cf8/0x9383f985bc4c8292 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3c89 expref: 533 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.123522:0:13449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000006861cf8/0x9383f985bc4c8292 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3c89 expref: 533 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.123531:0:13449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:13449:1875064458194304:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201209.123698:0:13449:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2fd9900 going to sleep for 11 seconds 00000004:00080000:3.0:1788201209.123739:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c2b7ea00/2, rc 0, transno 4294968783 00000100:00100000:3.0:1788201209.123759:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458190592:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788201209.123772:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c344bb80/2, rc 0, transno 4294968782 00000100:00100000:3.0:1788201209.123775:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458190336:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788201209.123807:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b55b6d7/0x9383f985bc4b57e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x274:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd588 expref: 54 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.123822:0:6703:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff054e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6703:1875064458190080:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201209.123839:0:6703:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d2c3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.123850:0:6703:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d2c3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.123857:0:6703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d2c3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.123868:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d2c3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.123885:0:6703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d2c3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.123897:0:6703:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:3.0:1788201209.124136:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5227b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+93:3310:x1875064458189440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 48960us (49294us total) trans 4294968784 rc 0/0 00000100:00100000:3.0:1788201209.124144:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4066 00000100:00100000:0.0:1788201209.124503:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c24a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458194432:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.124533:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788201209.124680:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00c3480/2, rc 0, transno 4294968784 00000100:00100000:0.0:1788201209.124690:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458189440:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.124700:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201209.124705:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c24a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458194560:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.124727:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201209.124782:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201209.124790:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c24a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458194688:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.124813:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201209.124837:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458194432 00000100:00100000:0.0:1788201209.124842:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458194432 00000100:00100000:0.0:1788201209.124862:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458194560 00000100:00100000:0.0:1788201209.124864:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458194560 00000100:00100000:0.0:1788201209.124934:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458194688 00000100:00100000:0.0:1788201209.124937:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458194688 00000100:00100000:0.0:1788201209.124949:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4083 00000100:00100000:0.0:1788201209.124955:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c24a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+95:3310:x1875064458194432:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201209.124973:0:13441:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:576 count 1 00010000:00010000:0.0:1788201209.125000:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000232c8587/0x9383f985bc4d2cb4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.125016:0:13441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007f294372/0x9383f985bc4b2eb7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc73b expref: 53 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.125024:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x240:0x0].0x0 since=77s v=(0 0) 00010000:00010000:0.0:1788201209.125028:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x240:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.125032:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000232c8587/0x9383f985bc4d2cb4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.125053:0:13441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007f294372/0x9383f985bc4b2eb7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc73b expref: 53 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.125065:0:13441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007f294372/0x9383f985bc4b2eb7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc73b expref: 53 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.125076:0:13441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c24a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:13441:1875064458194816:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.125105:0:13441:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201209.125682:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201209.125709:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201209.125730:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442599680 00000100:00100000:0.0:1788201209.125734:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442599680 00010000:00010000:0.0:1788201209.125765:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000000617da6/0x9383f985bc4bb3b0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf516 expref: 534 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.125786:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442599552 00000100:00100000:0.0:1788201209.125789:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442599552 00010000:00010000:0.0:1788201209.125802:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b133555a/0x9383f985bc4b6616 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x286:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bda43 expref: 535 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.125819:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1454 00000100:00100000:0.0:1788201209.125825:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c24a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+535:2361:x1875064442599680:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201209.125836:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201209.125841:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000000617da6/0x9383f985bc4bb3b0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf516 expref: 535 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.125851:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000000617da6/0x9383f985bc4bb3b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf516 expref: 535 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.125871:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.125874:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.125880:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000086186302/0x9383f985bc4d2c75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.125888:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086186302/0x9383f985bc4d2c75 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.125903:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201209.125932:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c24a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+535:2361:x1875064442599680:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 106us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201209.125939:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1454 00000100:00100000:0.0:1788201209.125956:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1455 00000100:00100000:0.0:1788201209.125963:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8106050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+534:2361:x1875064442599552:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201209.125970:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201209.125975:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b133555a/0x9383f985bc4b6616 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x286:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bda43 expref: 534 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.125996:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b133555a/0x9383f985bc4b6616 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x286:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bda43 expref: 534 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.126009:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x286:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.126012:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x286:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.126017:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d2c6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x286:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.126025:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d2c6e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x286:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.126037:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201209.126054:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8106050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+534:2361:x1875064442599552:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 92us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201209.126060:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1455 00010000:00010000:0.0:1788201209.126141:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000617da6/0x9383f985bc4bb3b0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf516 expref: 533 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.126155:0:6706:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1875064458192256:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.126171:0:6706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000086186302/0x9383f985bc4d2c75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.126180:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000086186302/0x9383f985bc4d2c75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.126188:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086186302/0x9383f985bc4d2c75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.126196:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086186302/0x9383f985bc4d2c75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.126204:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086186302/0x9383f985bc4d2c75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.126214:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:2.0:1788201209.126507:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4084 00000100:00100000:2.0:1788201209.126516:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c24a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+95:3310:x1875064458194560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201209.126533:0:6705:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:720 count 1 00010000:00010000:2.0:1788201209.126560:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f153a5fa/0x9383f985bc4d2cbb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.126785:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f965dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+104:3311:x1875064458190976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23300us (25310us total) trans 4294968801 rc 0/0 00000100:00100000:0.0:1788201209.126792:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4074 00000100:00100000:0.0:1788201209.126811:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4085 00000100:00100000:0.0:1788201209.126817:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c24a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+95:3313:x1875064458194688:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201209.126829:0:6706:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:925 count 1 00010000:00010000:0.0:1788201209.126840:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3effe3a/0x9383f985bc4d2cc2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.126852:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000066023d76/0x9383f985bc4c448e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x39d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2719 expref: 53 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.126859:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39d:0x0].0x0 since=30s v=(0 0) 00010000:00010000:0.0:1788201209.126863:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.126867:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3effe3a/0x9383f985bc4d2cc2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x39d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.126887:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000066023d76/0x9383f985bc4c448e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x39d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2719 expref: 53 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.126898:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000066023d76/0x9383f985bc4c448e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x39d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2719 expref: 53 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.126910:0:6706:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c24a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1875064458194944:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.126952:0:6706:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5b40 going to sleep for 11 seconds 00010000:00010000:2.0:1788201209.127003:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000421f7910/0x9383f985bc4ba1ce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1beeef expref: 53 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.127012:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d0:0x0].0x0 since=56s v=(0 0) 00010000:00010000:2.0:1788201209.127015:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.127019:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f153a5fa/0x9383f985bc4d2cbb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.127039:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000421f7910/0x9383f985bc4ba1ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1beeef expref: 53 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.127049:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000421f7910/0x9383f985bc4ba1ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1beeef expref: 53 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.127059:0:6705:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1875064458195072:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.127082:0:6705:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91e40 going to sleep for 11 seconds 00010000:00010000:2.0:1788201209.127100:0:13443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003bf3c8de/0x9383f985bc4d2c60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.127114:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bf3c8de/0x9383f985bc4d2c60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.127122:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bf3c8de/0x9383f985bc4d2c60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.127129:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bf3c8de/0x9383f985bc4d2c60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.127138:0:13443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000100:00100000:2.0:1788201209.127264:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c8234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+104:3313:x1875064458191744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 30521us (30650us total) trans 4294968802 rc 0/0 00000100:00100000:2.0:1788201209.127272:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4071 00010000:00010000:2.0:1788201209.127481:0:13447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2c67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.127492:0:13447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2c67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.127502:0:13447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2c67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.127509:0:13447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2c67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.127525:0:13447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00000100:00100000:2.0:1788201209.127881:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c8234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+104:3313:x1875064458191616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 30945us (31215us total) trans 4294968803 rc 0/0 00000100:00100000:2.0:1788201209.127888:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4072 00000004:00080000:2.0:1788201209.127923:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04c8236a00/2, rc 0, transno 4294968803 00000100:00100000:2.0:1788201209.127936:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c8236a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458191616:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788201209.127944:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04c8235f80/2, rc 0, transno 4294968802 00000100:00100000:2.0:1788201209.127948:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c8235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458191744:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788201209.127970:0:10484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b133555a/0x9383f985bc4b6616 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x286:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bda43 expref: 532 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.127984:0:10484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c8235180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10484:1875064458192128:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.128010:0:10484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d2c6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128019:0:10484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d2c6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128026:0:10484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d2c6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128035:0:10484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d2c6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128049:0:10484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d2c6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128058:0:10484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00000100:00100000:2.0:1788201209.128161:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c8235c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+104:3311:x1875064458191104:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26576us (27020us total) trans 4294968804 rc 0/0 00000100:00100000:2.0:1788201209.128167:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4073 00010000:00010000:2.0:1788201209.128265:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:2.0:1788201209.128272:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abb16771/0x9383f985bc4d2c28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128281:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.128285:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abb16771/0x9383f985bc4d2c28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128376:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abb16771/0x9383f985bc4d2c28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128395:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abb16771/0x9383f985bc4d2c28 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128403:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abb16771/0x9383f985bc4d2c28 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128421:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1788201209.128426:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d2c52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128433:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.128437:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d2c52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128445:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d2c52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128454:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d2c52 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128461:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d2c52 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128474:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1788201209.128478:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f21f6f3/0x9383f985bc4d2c4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128485:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.128488:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f21f6f3/0x9383f985bc4d2c4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128495:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f21f6f3/0x9383f985bc4d2c4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128509:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f21f6f3/0x9383f985bc4d2c4b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128517:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f21f6f3/0x9383f985bc4d2c4b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128528:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788201209.128531:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010ae58ae/0x9383f985bc4d2c44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128537:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bca00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.128540:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010ae58ae/0x9383f985bc4d2c44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128547:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010ae58ae/0x9383f985bc4d2c44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128729:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010ae58ae/0x9383f985bc4d2c44 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128738:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010ae58ae/0x9383f985bc4d2c44 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128816:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788201209.128820:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069f90440/0x9383f985bc4d2c59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128828:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.128832:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f90440/0x9383f985bc4d2c59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128840:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f90440/0x9383f985bc4d2c59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128851:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069f90440/0x9383f985bc4d2c59 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128859:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f90440/0x9383f985bc4d2c59 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128870:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788201209.128874:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d2c3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128880:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.128883:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d2c3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128891:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d2c3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128899:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d2c3d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128907:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d2c3d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128917:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788201209.128920:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086186302/0x9383f985bc4d2c75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128926:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3016000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.128929:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086186302/0x9383f985bc4d2c75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128937:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086186302/0x9383f985bc4d2c75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128945:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086186302/0x9383f985bc4d2c75 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128952:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086186302/0x9383f985bc4d2c75 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128962:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788201209.128965:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bf3c8de/0x9383f985bc4d2c60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128971:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.128975:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bf3c8de/0x9383f985bc4d2c60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.128982:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bf3c8de/0x9383f985bc4d2c60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.129000:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bf3c8de/0x9383f985bc4d2c60 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.129007:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bf3c8de/0x9383f985bc4d2c60 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.129019:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201209.129023:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2c67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.129030:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.129033:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2c67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.129040:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2c67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.129048:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2c67 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.129055:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2c67 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.129068:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201209.129072:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d2c6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.129078:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.129081:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d2c6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.129088:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d2c6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.129096:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d2c6e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.129103:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d2c6e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.129113:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.129115:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.129116:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788201209.129145:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00c3b80/2, rc 0, transno 4294968781 00000100:00100000:2.0:1788201209.129160:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458189568:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.129223:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458195200:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.129698:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.129747:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458195200 00000100:00100000:2.0:1788201209.129820:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458195200 00000100:00100000:2.0:1788201209.129854:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4086 00000100:00100000:2.0:1788201209.129861:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+96:3313:x1875064458195200:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201209.129883:0:13443:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:937 count 1 00010000:00010000:2.0:1788201209.129903:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d2cc9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.129920:0:13443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eea19ac3/0x9383f985bc4c4e51 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2a8b expref: 53 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.129928:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a9:0x0].0x0 since=29s v=(0 0) 00010000:00010000:2.0:1788201209.129932:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.129936:0:13443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d2cc9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.129960:0:13443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eea19ac3/0x9383f985bc4c4e51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2a8b expref: 53 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.129971:0:13443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eea19ac3/0x9383f985bc4c4e51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2a8b expref: 53 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.129982:0:13443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13443:1875064458195328:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.130032:0:13443:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91600 going to sleep for 11 seconds 00010000:00010000:2.0:1788201209.130085:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201209.130096:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458195456:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.130122:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.130140:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201209.130145:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458195584:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.130160:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.130176:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458195456 00000100:00100000:2.0:1788201209.130180:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458195456 00000100:00100000:2.0:1788201209.130194:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458195584 00000100:00100000:2.0:1788201209.130196:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458195584 00000100:00100000:2.0:1788201209.130206:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4087 00000100:00100000:2.0:1788201209.130211:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+105:3310:x1875064458195456:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201209.130223:0:13447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:763 count 1 00010000:00010000:2.0:1788201209.130236:0:13447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035e7898d/0x9383f985bc4d2cd0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.130454:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4088 00000100:00100000:1.0:1788201209.130464:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+105:3310:x1875064458195584:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201209.130475:0:13442:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:818 count 1 00010000:00010000:1.0:1788201209.130487:0:13442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c440989/0x9383f985bc4d2cd7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x332:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.130499:0:13442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003638c41d/0x9383f985bc4bef53 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x332:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c09bb expref: 531 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.130507:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x332:0x0].0x0 since=43s v=(0 0) 00010000:00010000:1.0:1788201209.130510:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x332:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.130514:0:13442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c440989/0x9383f985bc4d2cd7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x332:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.130533:0:13442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003638c41d/0x9383f985bc4bef53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x332:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c09bb expref: 531 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.130544:0:13442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003638c41d/0x9383f985bc4bef53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x332:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c09bb expref: 531 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.130567:0:13442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:13442:1875064458195712:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.130656:0:13447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a8acf4d/0x9383f985bc4bc39a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfa95 expref: 531 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.130665:0:13447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2fb:0x0].0x0 since=50s v=(0 0) 00010000:00010000:2.0:1788201209.130668:0:13447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.130671:0:13447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035e7898d/0x9383f985bc4d2cd0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.130690:0:13447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003a8acf4d/0x9383f985bc4bc39a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfa95 expref: 531 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.130699:0:13447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003a8acf4d/0x9383f985bc4bc39a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfa95 expref: 531 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.130714:0:13447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:13447:1875064458195840:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.130814:0:13447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91900 going to sleep for 11 seconds 00010000:00010000:2.0:1788201209.130831:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788201209.131019:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04c8235880/2, rc 0, transno 4294968801 00000100:00100000:3.0:1788201209.131038:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c8235880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458190976:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788201209.131049:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04c8235500/2, rc 0, transno 4294968804 00000100:00100000:3.0:1788201209.131052:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c8235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458191104:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201209.131194:0:13442:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c33d5840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201209.132066:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458196096:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.132103:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.132127:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201209.132132:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458195968:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.132152:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.132172:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458196096 00000100:00100000:2.0:1788201209.132177:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458196096 00000100:00100000:2.0:1788201209.132202:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458195968 00000100:00100000:2.0:1788201209.132205:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458195968 00000100:00100000:2.0:1788201209.132222:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4089 00000100:00100000:2.0:1788201209.132228:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+107:3313:x1875064458196096:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201209.132257:0:10484:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:633 count 1 00010000:00010000:2.0:1788201209.132276:0:10484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2cde lrc: 3/0,1 mode: --/PW res: [0x240000400:0x279:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.132375:0:10484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002f980ac4/0x9383f985bc4b5bab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd6ca expref: 531 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.132386:0:10484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x279:0x0].0x0 since=69s v=(0 0) 00010000:00010000:2.0:1788201209.132390:0:10484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x279:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.132395:0:10484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2cde lrc: 4/0,1 mode: --/PW res: [0x240000400:0x279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.132423:0:10484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002f980ac4/0x9383f985bc4b5bab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd6ca expref: 531 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.132435:0:10484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002f980ac4/0x9383f985bc4b5bab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd6ca expref: 531 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.132446:0:10484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c8237100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10484:1875064458196224:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.132479:0:10484:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201209.132494:0:13451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4090 00000100:00100000:2.0:1788201209.132501:0:13451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+107:3313:x1875064458195968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201209.132512:0:13451:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:978 count 1 00010000:00010000:2.0:1788201209.132524:0:13451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fe5b943/0x9383f985bc4d2ce5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.132536:0:13451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001080dfed/0x9383f985bc4c6ecd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c35c1 expref: 531 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.132543:0:13451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d2:0x0].0x0 since=23s v=(0 0) 00010000:00010000:2.0:1788201209.132546:0:13451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.132549:0:13451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fe5b943/0x9383f985bc4d2ce5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.132686:0:13451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001080dfed/0x9383f985bc4c6ecd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c35c1 expref: 531 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.132702:0:13451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001080dfed/0x9383f985bc4c6ecd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c35c1 expref: 531 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.132712:0:13451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c8237b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:13451:1875064458196352:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.132731:0:13451:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f916c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201209.133947:0:13439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c502ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:13439:1875064458192768:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201209.133980:0:13439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009c474677/0x9383f985bc4d2c83 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.138785:0:13448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:13448:1875064458193152:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.138816:0:13448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b34dacfa/0x9383f985bc4d2c8a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x281:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.142857:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201209.142886:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201209.142920:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201209.142959:0:13446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c502bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:13446:1875064458192640:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201209.143003:0:13446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000002359bf1/0x9383f985bc4d2c7c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.143238:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201209.143276:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201209.143465:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201209.143514:0:13445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13445:1875064458193792:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201209.143535:0:13445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d2c9f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.143543:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201209.143575:0:13449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:13449:1875064458194304:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201209.143589:0:13449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2cad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.143613:0:13526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442599808 00000100:00100000:3.0:1788201209.143619:0:13526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442599808 00010000:00010000:3.0:1788201209.143654:0:13526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004bc2e05f/0x9383f985bc4c7962 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3979 expref: 54 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.143676:0:13526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442600064 00000100:00100000:3.0:1788201209.143679:0:13526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442600064 00010000:00010000:3.0:1788201209.143695:0:13526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c1a00071/0x9383f985bc4b3268 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc876 expref: 532 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.143709:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201209.143710:0:13526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442600320 00000100:00100000:3.0:1788201209.143715:0:13526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442600320 00010000:00010000:3.0:1788201209.143731:0:13526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000643cb57a/0x9383f985bc4c7f20 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3b63 expref: 55 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.143733:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442599936 00000100:00100000:1.0:1788201209.143739:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442599936 00000100:00100000:3.0:1788201209.143748:0:13526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442600192 00000100:00100000:3.0:1788201209.143753:0:13526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442600192 00010000:00010000:3.0:1788201209.143764:0:13526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000063cc552f/0x9383f985bc4bbfe9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf961 expref: 56 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.143776:0:13526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442600448 00000100:00100000:3.0:1788201209.143779:0:13526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442600448 00010000:00010000:3.0:1788201209.143790:0:13526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c95db0ea/0x9383f985bc4b5e8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd7bf expref: 57 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.143806:0:13526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442600704 00000100:00100000:3.0:1788201209.143809:0:13526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442600704 00010000:00010000:3.0:1788201209.143819:0:13526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000006861cf8/0x9383f985bc4c8292 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3c89 expref: 534 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.143830:0:13526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442600576 00000100:00100000:3.0:1788201209.143833:0:13526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442600576 00010000:00010000:3.0:1788201209.143844:0:13526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a5491737/0x9383f985bc4c74df lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c37f8 expref: 535 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.143860:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000089b84766/0x9383f985bc4b623b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x281:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd8fa expref: 535 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.143862:0:13526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1456 00000100:00100000:3.0:1788201209.143889:0:13526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+57:2359:x1875064442599808:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.143905:0:13526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.143911:0:13526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004bc2e05f/0x9383f985bc4c7962 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3979 expref: 57 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.143923:0:13526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004bc2e05f/0x9383f985bc4c7962 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3979 expref: 57 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.143930:0:13444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13444:1875064458193408:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.143947:0:13444:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ecaefa8a/0x9383f985bc4d2c91 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.143951:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bc2e05f/0x9383f985bc4c7962 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3979 expref: 57 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.143974:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.143978:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.143984:0:13526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009c474677/0x9383f985bc4d2c83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.144005:0:13526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c474677/0x9383f985bc4d2c83 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.144038:0:13440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:13440:1875064458193536:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201209.144040:0:13526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201209.144058:0:13440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cd191276/0x9383f985bc4d2c98 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.144087:0:12363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c24a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12363:1875064458194176:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201209.144094:0:13526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+56:2359:x1875064442599808:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 205us (1242us total) trans 0 rc 0/0 00010000:00010000:0.0:1788201209.144102:0:12363:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d2ca6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.144141:0:13439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009c474677/0x9383f985bc4d2c83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.144150:0:13439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c474677/0x9383f985bc4d2c83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.144161:0:13439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c474677/0x9383f985bc4d2c83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.144169:0:13439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c474677/0x9383f985bc4d2c83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.144185:0:13439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201209.144198:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201209.144203:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c474677/0x9383f985bc4d2c83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.144211:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.144216:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c474677/0x9383f985bc4d2c83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.144224:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c474677/0x9383f985bc4d2c83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.144237:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c474677/0x9383f985bc4d2c83 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.144244:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c474677/0x9383f985bc4d2c83 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.144432:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.144435:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.144436:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201209.144683:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5028a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+97:3310:x1875064458192512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 37742us (38021us total) trans 4294968785 rc 0/0 00000100:00100000:2.0:1788201209.144692:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4076 00000004:00080000:2.0:1788201209.144731:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c12d3800/2, rc 0, transno 4294968785 00000100:00100000:2.0:1788201209.144741:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458192512:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.145019:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c8234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458196480:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.145052:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.145087:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458196480 00000100:00100000:2.0:1788201209.145091:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458196480 00000100:00100000:2.0:1788201209.145115:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4091 00000100:00100000:2.0:1788201209.145121:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c8234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+97:3310:x1875064458196480:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201209.145139:0:13439:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:850 count 1 00010000:00010000:2.0:1788201209.145156:0:13439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013c1550e/0x9383f985bc4d2cec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.145171:0:13439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000041c21db3/0x9383f985bc4c0900 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c12ac expref: 56 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.145179:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x352:0x0].0x0 since=39s v=(0 0) 00010000:00010000:2.0:1788201209.145183:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x352:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.145187:0:13439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013c1550e/0x9383f985bc4d2cec lrc: 4/0,1 mode: --/PW res: [0x280000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.145207:0:13439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000041c21db3/0x9383f985bc4c0900 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c12ac expref: 56 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.145219:0:13439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000041c21db3/0x9383f985bc4c0900 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c12ac expref: 56 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.145231:0:13439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c8235c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:13439:1875064458196608:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.145285:0:13439:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201209.145885:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1457 00000100:00100000:1.0:1788201209.145899:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+535:2359:x1875064442600064:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201209.145910:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201209.145917:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c1a00071/0x9383f985bc4b3268 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x245:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc876 expref: 535 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.145930:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c1a00071/0x9383f985bc4b3268 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x245:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc876 expref: 535 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.145947:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1a00071/0x9383f985bc4b3268 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x245:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc876 expref: 535 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.145966:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x245:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.145969:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x245:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.145974:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ecaefa8a/0x9383f985bc4d2c91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.145982:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecaefa8a/0x9383f985bc4d2c91 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.146017:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201209.146046:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+534:2359:x1875064442600064:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 152us (3159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.146053:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1457 00000100:00100000:1.0:1788201209.146068:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1458 00000100:00100000:1.0:1788201209.146075:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+56:2362:x1875064442600320:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201209.146083:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201209.146088:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000643cb57a/0x9383f985bc4c7f20 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3b63 expref: 56 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.146098:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000643cb57a/0x9383f985bc4c7f20 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3b63 expref: 56 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.146112:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000643cb57a/0x9383f985bc4c7f20 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3b63 expref: 56 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.146127:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.146130:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.146134:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd191276/0x9383f985bc4d2c98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.146143:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd191276/0x9383f985bc4d2c98 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.146161:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201209.146177:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+55:2362:x1875064442600320:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 102us (3256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.146183:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1458 00000100:00100000:1.0:1788201209.146195:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1459 00000100:00100000:1.0:1788201209.146201:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+54:2359:x1875064442600192:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201209.146207:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201209.146212:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000063cc552f/0x9383f985bc4bbfe9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf961 expref: 54 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.146223:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000063cc552f/0x9383f985bc4bbfe9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf961 expref: 54 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.146235:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063cc552f/0x9383f985bc4bbfe9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf961 expref: 54 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.146396:0:13444:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ecaefa8a/0x9383f985bc4d2c91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.146407:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecaefa8a/0x9383f985bc4d2c91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.146417:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecaefa8a/0x9383f985bc4d2c91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.146425:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ecaefa8a/0x9383f985bc4d2c91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.146440:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201209.146692:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.146696:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.146700:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000002359bf1/0x9383f985bc4d2c7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.146707:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002359bf1/0x9383f985bc4d2c7c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.146728:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201209.146857:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+53:2359:x1875064442600192:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 548us (3472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.146865:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1459 00000100:00100000:1.0:1788201209.146881:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1460 00000100:00100000:1.0:1788201209.146887:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+52:2361:x1875064442600448:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201209.146896:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201209.146901:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c95db0ea/0x9383f985bc4b5e8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x27c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd7bf expref: 52 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.146911:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c95db0ea/0x9383f985bc4b5e8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x27c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd7bf expref: 52 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.146924:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c95db0ea/0x9383f985bc4b5e8a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x27c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd7bf expref: 52 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.146939:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.146942:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.146947:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d2c9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.146954:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d2c9f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.146971:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201209.146996:0:13445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d2c9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.147004:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d2c9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.147013:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d2c9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.147020:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d2c9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.147034:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788201209.147192:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+98:3310:x1875064458193664:12345-0@lo:6:osp-syn-1-0.0 Request processed in 27762us (28675us total) trans 4294968786 rc 0/0 00000100:00100000:1.0:1788201209.147199:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4080 00010000:00010000:1.0:1788201209.147220:0:13446:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000002359bf1/0x9383f985bc4d2c7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.147230:0:13446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002359bf1/0x9383f985bc4d2c7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.147239:0:13446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002359bf1/0x9383f985bc4d2c7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.147246:0:13446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002359bf1/0x9383f985bc4d2c7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.147448:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+108:3313:x1875064458192896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 35213us (35465us total) trans 4294968805 rc 0/0 00000100:00100000:2.0:1788201209.147455:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4078 00000004:00080000:2.0:1788201209.147495:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00a5180/2, rc 0, transno 4294968805 00000100:00100000:2.0:1788201209.147504:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458192896:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788201209.147551:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201209.147670:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ecaefa8a/0x9383f985bc4d2c91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.147679:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.147683:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecaefa8a/0x9383f985bc4d2c91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.147697:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecaefa8a/0x9383f985bc4d2c91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.147710:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ecaefa8a/0x9383f985bc4d2c91 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.147718:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecaefa8a/0x9383f985bc4d2c91 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.147734:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201209.147737:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d2c9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.147744:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3016600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.147843:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d2c9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.147854:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d2c9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.147865:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d2c9f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.147872:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d2c9f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.147891:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.147893:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.147895:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788201209.147917:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c12d1c00/2, rc 0, transno 4294968786 00000100:00100000:2.0:1788201209.147926:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458193664:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.147931:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201209.147942:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c8235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458196736:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.147973:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.148043:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201209.148050:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c8237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458196864:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.148074:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201209.148094:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201209.148105:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458196736 00000100:00100000:2.0:1788201209.148109:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458196736 00000100:00100000:2.0:1788201209.148132:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458196864 00000100:00100000:2.0:1788201209.148134:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458196864 00000100:00100000:2.0:1788201209.148152:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4092 00000100:00100000:2.0:1788201209.148158:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c8236680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+108:3310:x1875064458196736:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201209.148175:0:13445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:593 count 1 00010000:00010000:2.0:1788201209.148192:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2cf3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.148206:0:13445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca7a906e/0x9383f985bc4b3bc2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcbc5 expref: 533 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.148213:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x251:0x0].0x0 since=75s v=(0 0) 00010000:00010000:2.0:1788201209.148217:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x251:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.148221:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2cf3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.148240:0:13445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ca7a906e/0x9383f985bc4b3bc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcbc5 expref: 533 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.148448:0:13446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788201209.148642:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c502b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+99:3310:x1875064458192384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 41915us (42038us total) trans 4294968787 rc 0/0 00000100:00100000:1.0:1788201209.148650:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4075 00000100:00100000:1.0:1788201209.148668:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4093 00000100:00100000:1.0:1788201209.148675:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c8236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+98:3313:x1875064458196864:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788201209.148688:0:13446:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:655 count 1 00010000:00010000:1.0:1788201209.148701:0:13446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c13fcde/0x9383f985bc4d2cfa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.148712:0:13446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000095eef7c5/0x9383f985bc4b6da2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdcf8 expref: 51 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.148719:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28f:0x0].0x0 since=65s v=(0 0) 00010000:00010000:1.0:1788201209.148722:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.148727:0:13446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c13fcde/0x9383f985bc4d2cfa lrc: 4/0,1 mode: --/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.148746:0:13446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000095eef7c5/0x9383f985bc4b6da2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdcf8 expref: 51 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.148769:0:13446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000095eef7c5/0x9383f985bc4b6da2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdcf8 expref: 51 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.148782:0:13446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c502bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:13446:1875064458197120:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201209.148822:0:13446:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c33d5240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201209.148851:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1461 00000100:00100000:1.0:1788201209.148859:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8106c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+533:2361:x1875064442600704:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201209.148868:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201209.148874:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000006861cf8/0x9383f985bc4c8292 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3c89 expref: 533 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.148885:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000006861cf8/0x9383f985bc4c8292 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3c89 expref: 533 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.148900:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006861cf8/0x9383f985bc4c8292 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3c89 expref: 533 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.148910:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.148913:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.148918:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2cad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.148926:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2cad lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.148943:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201209.148954:0:13449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2cad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.148962:0:13449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2cad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.148970:0:13449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2cad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.148977:0:13449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2cad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.148998:0:13449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788201209.149135:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+109:3313:x1875064458194048:12345-0@lo:6:osp-syn-0-0.0 Request processed in 25705us (26972us total) trans 4294968806 rc 0/0 00000100:00100000:1.0:1788201209.149142:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4082 00000100:00100000:3.0:1788201209.149162:0:13526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1456 00000100:00100000:3.0:1788201209.149190:0:13526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1462 00000100:00100000:3.0:1788201209.149201:0:13526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+532:2361:x1875064442600576:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.149211:0:13526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.149218:0:13526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a5491737/0x9383f985bc4c74df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c37f8 expref: 532 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.149231:0:13526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a5491737/0x9383f985bc4c74df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c37f8 expref: 532 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.149246:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5491737/0x9383f985bc4c74df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c37f8 expref: 532 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.149258:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.149262:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.149267:0:13526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d2ca6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.149280:0:13526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d2ca6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.149316:0:13526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.149337:0:13526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+531:2361:x1875064442600576:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 140us (5631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.149344:0:13526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1462 00000100:00100000:3.0:1788201209.149357:0:13526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1463 00000100:00100000:3.0:1788201209.149364:0:13526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+530:2359:x1875064442599936:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.149371:0:13526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.149376:0:13526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000089b84766/0x9383f985bc4b623b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x281:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd8fa expref: 530 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.149387:0:13526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000089b84766/0x9383f985bc4b623b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x281:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd8fa expref: 530 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.149400:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089b84766/0x9383f985bc4b623b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x281:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd8fa expref: 530 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.149409:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x281:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.149412:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x281:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.149417:0:13526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b34dacfa/0x9383f985bc4d2c8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x281:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.149428:0:13526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b34dacfa/0x9383f985bc4d2c8a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x281:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.149443:0:13526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.149473:0:13526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+529:2359:x1875064442599936:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 110us (6237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.149479:0:13526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1463 00010000:00010000:2.0:1788201209.149566:0:13445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ca7a906e/0x9383f985bc4b3bc2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcbc5 expref: 528 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.149589:0:13445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c8237800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13445:1875064458196992:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.149621:0:13445:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201209.149649:0:6705:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1875064458195072:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.149667:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f153a5fa/0x9383f985bc4d2cbb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.149689:0:13443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13443:1875064458195328:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.149699:0:13443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d2cc9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.149717:0:13447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:13447:1875064458195840:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.149727:0:13447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000035e7898d/0x9383f985bc4d2cd0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201209.149874:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c502a680/2, rc 0, transno 4294968806 00000100:00100000:2.0:1788201209.149896:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c502a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458194048:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788201209.149911:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201209.149918:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002359bf1/0x9383f985bc4d2c7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.149926:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.149931:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002359bf1/0x9383f985bc4d2c7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.149941:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002359bf1/0x9383f985bc4d2c7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.149954:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002359bf1/0x9383f985bc4d2c7c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.149961:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002359bf1/0x9383f985bc4d2c7c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.149979:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201209.149984:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2cad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.149999:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.150003:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2cad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.150016:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2cad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.150028:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2cad lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.150035:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c989edd/0x9383f985bc4d2cad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.150059:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.150061:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.150063:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201209.150075:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458197248:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.150103:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201209.150142:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788201209.150162:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c12d2300/2, rc 0, transno 4294968787 00000100:00100000:3.0:1788201209.150165:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458197248 00000100:00100000:3.0:1788201209.150173:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458197248 00000100:00100000:2.0:1788201209.150174:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458192384:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201209.150218:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4094 00000100:00100000:2.0:1788201209.150222:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458197376:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201209.150230:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+109:3313:x1875064458197248:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.150247:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1788201209.150249:0:13444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:662 count 1 00010000:00010000:3.0:1788201209.150267:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea26b3fb/0x9383f985bc4d2d01 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x296:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.150274:0:13448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b34dacfa/0x9383f985bc4d2c8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.150280:0:13444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004d3b2b95/0x9383f985bc4b730c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdec6 expref: 528 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.150315:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x296:0x0].0x0 since=64s v=(0 0) 00010000:00010000:3.0:1788201209.150318:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x296:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.150322:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea26b3fb/0x9383f985bc4d2d01 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.150342:0:13444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004d3b2b95/0x9383f985bc4b730c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdec6 expref: 528 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.150357:0:13444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004d3b2b95/0x9383f985bc4b730c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdec6 expref: 528 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.150366:0:13444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13444:1875064458197504:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201209.150393:0:13444:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2fd9900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201209.150463:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458197376 00000100:00100000:1.0:1788201209.150468:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458197376 00000100:00100000:1.0:1788201209.150487:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4095 00000100:00100000:1.0:1788201209.150492:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+99:3310:x1875064458197376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788201209.150506:0:13449:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:967 count 1 00010000:00010000:1.0:1788201209.150518:0:13449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d2d08 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3c7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.150530:0:13449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008f45f905/0x9383f985bc4c6630 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c32e2 expref: 50 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.150537:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c7:0x0].0x0 since=24s v=(0 0) 00010000:00010000:1.0:1788201209.150540:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.150545:0:13449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d2d08 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.150562:0:13449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008f45f905/0x9383f985bc4c6630 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c32e2 expref: 50 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.150584:0:13449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008f45f905/0x9383f985bc4c6630 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c32e2 expref: 50 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.150595:0:13449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c502ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:13449:1875064458197632:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201209.150623:0:13449:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c1377cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201209.150643:0:13442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:13442:1875064458195712:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201209.150656:0:13442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003c440989/0x9383f985bc4d2cd7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x332:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.150865:0:13448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b34dacfa/0x9383f985bc4d2c8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.150883:0:13448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b34dacfa/0x9383f985bc4d2c8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.150892:0:13448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b34dacfa/0x9383f985bc4d2c8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.150907:0:13448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201209.151110:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+110:3313:x1875064458193024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 39039us (39176us total) trans 4294968807 rc 0/0 00000100:00100000:2.0:1788201209.151117:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4077 00000004:00080000:2.0:1788201209.151157:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00a6a00/2, rc 0, transno 4294968807 00000100:00100000:2.0:1788201209.151172:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458193024:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.151211:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201209.151220:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458197760:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.151244:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201209.151279:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201209.151284:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b34dacfa/0x9383f985bc4d2c8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.151392:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201209.151434:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201209.151457:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201209.151478:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201209.151497:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:2.0:1788201209.151550:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.151556:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b34dacfa/0x9383f985bc4d2c8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.151566:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b34dacfa/0x9383f985bc4d2c8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.151582:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b34dacfa/0x9383f985bc4d2c8a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.151585:0:10484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c8237100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10484:1875064458196224:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.151598:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b34dacfa/0x9383f985bc4d2c8a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.151609:0:10484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2cde lrc: 3/0,1 mode: --/PW res: [0x240000400:0x279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.151617:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.151621:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.151624:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201209.151675:0:13526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442600960 00000100:00100000:3.0:1788201209.151680:0:13526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442600960 00010000:00010000:3.0:1788201209.151701:0:13526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eea19ac3/0x9383f985bc4c4e51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2a8b expref: 51 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.151719:0:13526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442601216 00000100:00100000:3.0:1788201209.151721:0:13526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442601216 00010000:00010000:3.0:1788201209.151733:0:13526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003638c41d/0x9383f985bc4bef53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x332:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c09bb expref: 529 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.151745:0:13526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442600832 00000100:00100000:3.0:1788201209.151747:0:13526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442600832 00010000:00010000:3.0:1788201209.151760:0:13526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000421f7910/0x9383f985bc4ba1ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1beeef expref: 52 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.151770:0:13526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442601088 00000100:00100000:3.0:1788201209.151772:0:13526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442601088 00010000:00010000:3.0:1788201209.151783:0:13526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003a8acf4d/0x9383f985bc4bc39a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfa95 expref: 530 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.151795:0:13526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442601344 00000100:00100000:3.0:1788201209.151797:0:13526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442601344 00010000:00010000:3.0:1788201209.151806:0:13526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002f980ac4/0x9383f985bc4b5bab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd6ca expref: 531 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.151817:0:13526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1464 00000100:00100000:2.0:1788201209.151824:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458197760 00000100:00100000:3.0:1788201209.151825:0:13526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+52:2361:x1875064442600960:12345-192.168.201.30@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788201209.151831:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458197760 00010000:00010000:3.0:1788201209.151838:0:13526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.151844:0:13526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eea19ac3/0x9383f985bc4c4e51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2a8b expref: 52 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.151858:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4096 00010000:00010000:3.0:1788201209.151858:0:13526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eea19ac3/0x9383f985bc4c4e51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2a8b expref: 52 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.151869:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+110:3310:x1875064458197760:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201209.151885:0:13448:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:720 count 1 00010000:00010000:2.0:1788201209.151899:0:13448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bf3c8de/0x9383f985bc4d2d0f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.151912:0:13448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ccf7af38/0x9383f985bc4ba150 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1beec5 expref: 531 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.151920:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d0:0x0].0x0 since=56s v=(0 0) 00010000:00010000:2.0:1788201209.151924:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.151928:0:13448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bf3c8de/0x9383f985bc4d2d0f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.151939:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eea19ac3/0x9383f985bc4c4e51 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2a8b expref: 52 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.151951:0:13448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ccf7af38/0x9383f985bc4ba150 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1beec5 expref: 531 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.151953:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.151959:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.151968:0:13526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d2cc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.151974:0:13448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ccf7af38/0x9383f985bc4ba150 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1beec5 expref: 531 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.151983:0:13526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d2cc9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.152002:0:13448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0006300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:13448:1875064458197888:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201209.152016:0:13526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.152043:0:13526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+51:2361:x1875064442600960:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 218us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.152047:0:13448:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201209.152052:0:13526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1464 00010000:00010000:2.0:1788201209.152065:0:13443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d2cc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.152074:0:13526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1465 00010000:00010000:2.0:1788201209.152080:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d2cc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.152085:0:13526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+531:2361:x1875064442601216:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.152095:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d2cc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.152105:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d2cc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.152110:0:13526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.152118:0:13526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003638c41d/0x9383f985bc4bef53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x332:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c09bb expref: 531 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.152120:0:13443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201209.152132:0:13526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003638c41d/0x9383f985bc4bef53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x332:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c09bb expref: 531 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.152146:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003638c41d/0x9383f985bc4bef53 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x332:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c09bb expref: 531 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.152157:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x332:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.152160:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x332:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.152164:0:13526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003c440989/0x9383f985bc4d2cd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x332:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.152172:0:13526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c440989/0x9383f985bc4d2cd7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x332:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.152201:0:13526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.152222:0:13526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+530:2361:x1875064442601216:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 138us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.152229:0:13526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1465 00000100:00100000:3.0:1788201209.152243:0:13526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1466 00000100:00100000:3.0:1788201209.152250:0:13526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3449880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+50:2361:x1875064442600832:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.152257:0:13526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.152261:0:13526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000421f7910/0x9383f985bc4ba1ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1beeef expref: 50 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.152270:0:13526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000421f7910/0x9383f985bc4ba1ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1beeef expref: 50 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.152282:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000421f7910/0x9383f985bc4ba1ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1beeef expref: 50 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.152290:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.152308:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.152313:0:13526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f153a5fa/0x9383f985bc4d2cbb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.152320:0:13526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f153a5fa/0x9383f985bc4d2cbb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.152340:0:13526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.152357:0:13526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3449880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+49:2361:x1875064442600832:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 108us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.152364:0:13526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1466 00000100:00100000:3.0:1788201209.152379:0:13526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1467 00000100:00100000:3.0:1788201209.152386:0:13526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3448700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+529:2361:x1875064442601088:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.152394:0:13526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.152398:0:13526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003a8acf4d/0x9383f985bc4bc39a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfa95 expref: 529 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.152407:0:13526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003a8acf4d/0x9383f985bc4bc39a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfa95 expref: 529 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.152419:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a8acf4d/0x9383f985bc4bc39a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfa95 expref: 529 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.152429:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.152431:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.152435:0:13526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000035e7898d/0x9383f985bc4d2cd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.152443:0:13526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035e7898d/0x9383f985bc4d2cd0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.152600:0:13442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003c440989/0x9383f985bc4d2cd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.152610:0:13442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c440989/0x9383f985bc4d2cd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.152619:0:13442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c440989/0x9383f985bc4d2cd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.152626:0:13442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c440989/0x9383f985bc4d2cd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.152641:0:13442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788201209.152944:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+111:3310:x1875064458195584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22482us (22781us total) trans 4294968808 rc 0/0 00000100:00100000:1.0:1788201209.152952:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4088 00000100:00100000:1.0:1788201209.153011:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201209.153111:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8106c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+528:2361:x1875064442600704:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 4252us (9572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.153119:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1461 00000100:00100000:1.0:1788201209.153148:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442601472 00000100:00100000:1.0:1788201209.153152:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442601472 00010000:00010000:1.0:1788201209.153169:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001080dfed/0x9383f985bc4c6ecd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c35c1 expref: 528 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.153185:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1468 00000100:00100000:1.0:1788201209.153191:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+528:2361:x1875064442601344:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201209.153199:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201209.153204:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002f980ac4/0x9383f985bc4b5bab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x279:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd6ca expref: 528 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.153214:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002f980ac4/0x9383f985bc4b5bab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x279:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd6ca expref: 528 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.153228:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f980ac4/0x9383f985bc4b5bab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x279:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd6ca expref: 528 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.153239:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x279:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.153242:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x279:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1788201209.153457:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+100:3313:x1875064458195200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23596us (23760us total) trans 4294968788 rc 0/0 00000100:00100000:2.0:1788201209.153465:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4086 00010000:00010000:2.0:1788201209.153485:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f153a5fa/0x9383f985bc4d2cbb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.153501:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f153a5fa/0x9383f985bc4d2cbb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.153510:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f153a5fa/0x9383f985bc4d2cbb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.153518:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f153a5fa/0x9383f985bc4d2cbb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.153531:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1788201209.153691:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c24a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+100:3310:x1875064458194560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 27176us (28962us total) trans 4294968789 rc 0/0 00000100:00100000:2.0:1788201209.153698:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4084 00000004:00080000:2.0:1788201209.153737:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00a5880/2, rc 0, transno 4294968788 00000100:00100000:2.0:1788201209.153747:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458195200:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788201209.153939:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2cde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.153951:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2cde lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.153977:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201209.154071:0:10484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2cde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.154086:0:10484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2cde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.154094:0:10484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2cde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.154102:0:10484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2cde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.154110:0:10484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1788201209.154245:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+111:3313:x1875064458196096:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22016us (22140us total) trans 4294968809 rc 0/0 00000100:00100000:1.0:1788201209.154667:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4089 00000100:00100000:1.0:1788201209.154721:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+527:2361:x1875064442601344:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1529us (3222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.154728:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1468 00000004:00080000:2.0:1788201209.154961:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c12d3100/2, rc 0, transno 4294968809 00000100:00100000:2.0:1788201209.154972:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458196096:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.155045:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201209.155057:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458198016:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.155090:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201209.155118:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788201209.155125:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d2cc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.155141:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.155145:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d2cc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.155155:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d2cc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.155170:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d2cc9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.155177:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d2cc9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.155196:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788201209.155200:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c440989/0x9383f985bc4d2cd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.155207:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.155210:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c440989/0x9383f985bc4d2cd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.155217:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c440989/0x9383f985bc4d2cd7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.155225:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c440989/0x9383f985bc4d2cd7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.155233:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c440989/0x9383f985bc4d2cd7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.155245:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1788201209.155399:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1469 00000100:00100000:1.0:1788201209.155415:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8105850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+526:2359:x1875064442601472:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201209.155427:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201209.155433:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001080dfed/0x9383f985bc4c6ecd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c35c1 expref: 526 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.155443:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001080dfed/0x9383f985bc4c6ecd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c35c1 expref: 526 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.155464:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.155467:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.155472:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004fe5b943/0x9383f985bc4d2ce5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.155480:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fe5b943/0x9383f985bc4d2ce5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.155495:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201209.155519:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8105850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+526:2359:x1875064442601472:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 111us (2508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.155525:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1469 00000100:00100000:1.0:1788201209.155594:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+48:2361:x1875064442600448:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 8706us (12130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.155601:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1460 00010000:00010000:3.0:1788201209.155896:0:13526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.155920:0:13526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3448700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+525:2361:x1875064442601088:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 3533us (4440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.155927:0:13526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1467 00010000:00010000:2.0:1788201209.156016:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f153a5fa/0x9383f985bc4d2cbb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.156025:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.156028:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f153a5fa/0x9383f985bc4d2cbb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.156037:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f153a5fa/0x9383f985bc4d2cbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.156050:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f153a5fa/0x9383f985bc4d2cbb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.156059:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f153a5fa/0x9383f985bc4d2cbb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.156076:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201209.156079:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2cde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.156086:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.156089:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2cde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.156097:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2cde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.156106:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2cde lrc: 1/0,0 mode: --/PW res: [0x240000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.156113:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2cde lrc: 0/0,0 mode: --/PW res: [0x240000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.156123:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.156125:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.156126:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.156137:0:13447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000035e7898d/0x9383f985bc4d2cd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.156146:0:13447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035e7898d/0x9383f985bc4d2cd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.156155:0:13447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035e7898d/0x9383f985bc4d2cd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.156164:0:13447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035e7898d/0x9383f985bc4d2cd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.156406:0:13441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c24a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:13441:1875064458194816:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.156427:0:13441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000232c8587/0x9383f985bc4d2cb4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.156446:0:13440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cd191276/0x9383f985bc4d2c98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.156455:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd191276/0x9383f985bc4d2c98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.156463:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd191276/0x9383f985bc4d2c98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.156470:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd191276/0x9383f985bc4d2c98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.156512:0:13447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788201209.156741:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+111:3310:x1875064458195456:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26527us (26617us total) trans 4294968810 rc 0/0 00010000:00010000:0.0:1788201209.157148:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788201209.157491:0:13449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c502ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:13449:1875064458197632:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.157945:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4087 00000100:00100000:2.0:1788201209.157972:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458198016 00000100:00100000:2.0:1788201209.157980:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458198016 00000100:00100000:2.0:1788201209.158025:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4097 00000100:00100000:2.0:1788201209.158034:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0005f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+100:3313:x1875064458198016:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201209.158061:0:13447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:827 count 1 00010000:00010000:2.0:1788201209.158083:0:13447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d2d16 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.158101:0:13447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea30b68a/0x9383f985bc4bf6a0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x33b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0c5b expref: 47 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.158110:0:13447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33b:0x0].0x0 since=42s v=(0 0) 00010000:00010000:2.0:1788201209.158114:0:13447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.158118:0:13447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d2d16 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x33b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.158145:0:13447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea30b68a/0x9383f985bc4bf6a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x33b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0c5b expref: 47 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.158158:0:13447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea30b68a/0x9383f985bc4bf6a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x33b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0c5b expref: 47 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.158178:0:13447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0005c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:13447:1875064458198144:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.158236:0:13447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91600 going to sleep for 11 seconds 00010000:00010000:1.0:1788201209.158391:0:13449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d2d08 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.159020:0:13446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c502bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:13446:1875064458197120:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201209.159039:0:13446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007c13fcde/0x9383f985bc4d2cfa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.159185:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201209.159195:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035e7898d/0x9383f985bc4d2cd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.159205:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201209.159210:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035e7898d/0x9383f985bc4d2cd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.159220:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035e7898d/0x9383f985bc4d2cd0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.159240:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035e7898d/0x9383f985bc4d2cd0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.159247:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035e7898d/0x9383f985bc4d2cd0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.159266:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201209.159270:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd191276/0x9383f985bc4d2c98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.159281:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bcc00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201209.159284:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd191276/0x9383f985bc4d2c98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.159385:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd191276/0x9383f985bc4d2c98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.159400:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd191276/0x9383f985bc4d2c98 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.159407:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd191276/0x9383f985bc4d2c98 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.159432:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1788201209.159432:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201209.159435:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201209.159438:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201209.159475:0:13444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13444:1875064458197504:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201209.159492:0:13444:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ea26b3fb/0x9383f985bc4d2d01 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.159578:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201209.159595:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458198272:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201209.159627:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201209.159653:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201209.159671:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201209.159688:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201209.159704:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201209.159718:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201209.159785:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201209.159803:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442601728 00000100:00100000:1.0:1788201209.159807:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442601728 00010000:00010000:1.0:1788201209.159831:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000066023d76/0x9383f985bc4c448e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x39d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2719 expref: 48 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.159849:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442601984 00000100:00100000:1.0:1788201209.159851:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442601984 00010000:00010000:1.0:1788201209.159861:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000095eef7c5/0x9383f985bc4b6da2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdcf8 expref: 49 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.159870:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442602240 00000100:00100000:1.0:1788201209.159873:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442602240 00010000:00010000:1.0:1788201209.159889:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004d3b2b95/0x9383f985bc4b730c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdec6 expref: 525 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.159900:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442601600 00000100:00100000:1.0:1788201209.159902:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442601600 00010000:00010000:1.0:1788201209.159911:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007f294372/0x9383f985bc4b2eb7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc73b expref: 50 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.159920:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442601856 00000100:00100000:1.0:1788201209.159922:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442601856 00010000:00010000:1.0:1788201209.159931:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000041c21db3/0x9383f985bc4c0900 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c12ac expref: 51 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.159940:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442602112 00000100:00100000:1.0:1788201209.159942:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442602112 00010000:00010000:1.0:1788201209.159950:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ca7a906e/0x9383f985bc4b3bc2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcbc5 expref: 526 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.159960:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442602368 00000100:00100000:1.0:1788201209.159962:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442602368 00010000:00010000:1.0:1788201209.159971:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008f45f905/0x9383f985bc4c6630 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c32e2 expref: 52 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.159980:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442602496 00000100:00100000:1.0:1788201209.159983:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442602496 00010000:00010000:1.0:1788201209.160004:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ccf7af38/0x9383f985bc4ba150 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1beec5 expref: 527 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.160018:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1470 00000100:00100000:1.0:1788201209.160027:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+52:2359:x1875064442601728:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201209.160039:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201209.160044:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000066023d76/0x9383f985bc4c448e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x39d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2719 expref: 52 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.160056:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000066023d76/0x9383f985bc4c448e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x39d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2719 expref: 52 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.160078:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.160082:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.160088:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3effe3a/0x9383f985bc4d2cc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.160097:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3effe3a/0x9383f985bc4d2cc2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x39d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.160112:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201209.160144:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+52:2359:x1875064442601728:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 118us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.160151:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1470 00000100:00100000:1.0:1788201209.160169:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1471 00000100:00100000:1.0:1788201209.160176:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3448000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+51:2359:x1875064442601984:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201209.160184:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788201209.160187:0:13526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1472 00010000:00010000:1.0:1788201209.160192:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000095eef7c5/0x9383f985bc4b6da2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x28f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdcf8 expref: 51 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.160203:0:13526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+527:2359:x1875064442602240:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201209.160209:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000095eef7c5/0x9383f985bc4b6da2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x28f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdcf8 expref: 51 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.160216:0:13526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201209.160224:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095eef7c5/0x9383f985bc4b6da2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x28f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdcf8 expref: 51 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.160225:0:13526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004d3b2b95/0x9383f985bc4b730c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x296:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdec6 expref: 527 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.160251:0:13526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004d3b2b95/0x9383f985bc4b730c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x296:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdec6 expref: 527 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.160271:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.160271:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d3b2b95/0x9383f985bc4b730c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x296:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdec6 expref: 527 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.160278:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.160288:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007c13fcde/0x9383f985bc4d2cfa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.160313:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x296:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.160319:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x296:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.160323:0:13526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea26b3fb/0x9383f985bc4d2d01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.160331:0:13526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea26b3fb/0x9383f985bc4d2d01 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.160349:0:13526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201209.160359:0:13444:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ea26b3fb/0x9383f985bc4d2d01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.160367:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea26b3fb/0x9383f985bc4d2d01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.160375:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea26b3fb/0x9383f985bc4d2d01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.160383:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea26b3fb/0x9383f985bc4d2d01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.160396:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201209.160488:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c13fcde/0x9383f985bc4d2cfa lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.160507:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201209.160526:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3448000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+50:2359:x1875064442601984:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 350us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.160532:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1471 00000100:00100000:1.0:1788201209.160545:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1473 00000100:00100000:1.0:1788201209.160551:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3449880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+49:2359:x1875064442601600:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201209.160558:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201209.160563:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007f294372/0x9383f985bc4b2eb7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x240:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc73b expref: 49 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.160575:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007f294372/0x9383f985bc4b2eb7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x240:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc73b expref: 49 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.160587:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f294372/0x9383f985bc4b2eb7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x240:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc73b expref: 49 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.160601:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x240:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.160604:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x240:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.160609:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000232c8587/0x9383f985bc4d2cb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.160616:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000232c8587/0x9383f985bc4d2cb4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.160635:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201209.160653:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3449880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+48:2359:x1875064442601600:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 101us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.160660:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1473 00000100:00100000:1.0:1788201209.160672:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1474 00000100:00100000:1.0:1788201209.160680:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+47:2359:x1875064442601856:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201209.160688:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201209.160692:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000041c21db3/0x9383f985bc4c0900 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x352:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c12ac expref: 47 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.160702:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000041c21db3/0x9383f985bc4c0900 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x352:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c12ac expref: 47 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.160713:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x352:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.160716:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x352:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.160720:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000013c1550e/0x9383f985bc4d2cec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.160728:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013c1550e/0x9383f985bc4d2cec lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.160738:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201209.160754:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+47:2359:x1875064442601856:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 76us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.160760:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1474 00000100:00100000:1.0:1788201209.160773:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1475 00000100:00100000:1.0:1788201209.160779:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3448700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+526:2359:x1875064442602112:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201209.160786:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201209.160792:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ca7a906e/0x9383f985bc4b3bc2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x251:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcbc5 expref: 526 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.160801:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ca7a906e/0x9383f985bc4b3bc2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x251:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcbc5 expref: 526 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.160813:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x251:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.160815:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x251:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.160819:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2cf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x251:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.160825:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2cf3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x251:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.160840:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201209.160857:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3448700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+526:2359:x1875064442602112:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 78us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.160863:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1475 00000100:00100000:1.0:1788201209.161091:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1476 00000100:00100000:1.0:1788201209.161099:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8107050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+46:2359:x1875064442602368:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201209.161107:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201209.161112:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008f45f905/0x9383f985bc4c6630 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c32e2 expref: 46 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.161123:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008f45f905/0x9383f985bc4c6630 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c32e2 expref: 46 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.161136:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f45f905/0x9383f985bc4c6630 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c32e2 expref: 46 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.161146:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.161148:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.161152:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d2d08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.161160:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d2d08 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.161185:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201209.161201:0:13449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d2d08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.161209:0:13449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d2d08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.161217:0:13449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d2d08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.161225:0:13449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d2d08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.161234:0:13449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788201209.161434:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+111:3313:x1875064458197248:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11207us (11329us total) trans 4294968811 rc 0/0 00000100:00100000:3.0:1788201209.161444:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4094 00000004:00080000:3.0:1788201209.161487:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00dc700/2, rc 0, transno 4294968811 00000100:00100000:3.0:1788201209.161501:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458197248:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788201209.161518:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201209.161523:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea26b3fb/0x9383f985bc4d2d01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.161532:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201209.161537:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea26b3fb/0x9383f985bc4d2d01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.161545:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea26b3fb/0x9383f985bc4d2d01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.161557:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea26b3fb/0x9383f985bc4d2d01 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.161565:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea26b3fb/0x9383f985bc4d2d01 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.161574:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+102:3310:x1875064458197376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11078us (11324us total) trans 4294968791 rc 0/0 00000100:00100000:1.0:1788201209.161583:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4095 00010000:00010000:3.0:1788201209.161585:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201209.161591:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d2d08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.161598:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201209.161601:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d2d08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.161608:0:13446:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007c13fcde/0x9383f985bc4d2cfa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.161609:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d2d08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.161633:0:13446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c13fcde/0x9383f985bc4d2cfa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.161635:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d2d08 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.161654:0:13446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c13fcde/0x9383f985bc4d2cfa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.161655:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d2d08 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.161684:0:13446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c13fcde/0x9383f985bc4d2cfa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.161685:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201209.161689:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201209.161691:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201209.161710:0:13446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201209.161714:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201209.161719:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c13fcde/0x9383f985bc4d2cfa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.161726:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201209.161730:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c13fcde/0x9383f985bc4d2cfa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.161738:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c13fcde/0x9383f985bc4d2cfa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.161748:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c13fcde/0x9383f985bc4d2cfa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.161755:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c13fcde/0x9383f985bc4d2cfa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.161768:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201209.161769:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201209.161771:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201209.161786:0:13526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+525:2359:x1875064442602240:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1588us (2131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.161793:0:13526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1472 00000100:00100000:3.0:1788201209.161810:0:13526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1477 00000100:00100000:3.0:1788201209.161819:0:13526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c502bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+524:2361:x1875064442602496:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.161828:0:13526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.161833:0:13526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ccf7af38/0x9383f985bc4ba150 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1beec5 expref: 524 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.161844:0:13526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ccf7af38/0x9383f985bc4ba150 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1beec5 expref: 524 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.161857:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.161860:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.161864:0:13526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003bf3c8de/0x9383f985bc4d2d0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.161872:0:13526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bf3c8de/0x9383f985bc4d2d0f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.161883:0:13526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.161901:0:13526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c502bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+524:2361:x1875064442602496:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 85us (2116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.161907:0:13526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1477 00000100:00100000:1.0:1788201209.162113:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c8236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+102:3313:x1875064458196864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13437us (14036us total) trans 4294968792 rc 0/0 00000100:00100000:1.0:1788201209.162121:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4093 00000100:00100000:1.0:1788201209.162548:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8107050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+45:2359:x1875064442602368:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1447us (2826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.162557:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1476 00000100:00100000:0.0:1788201209.162708:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5029180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+101:3310:x1875064458193280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 44580us (45258us total) trans 4294968790 rc 0/0 00000100:00100000:0.0:1788201209.162716:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4079 00010000:00010000:0.0:1788201209.162744:0:12363:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d2ca6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.162767:0:12363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d2ca6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.162776:0:12363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d2ca6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.162783:0:12363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d2ca6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.162807:0:12363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201209.163032:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201209.163037:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d2ca6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.163046:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bdc00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201209.163050:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d2ca6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.163058:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d2ca6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.163071:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d2ca6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.163078:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d2ca6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.163097:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201209.163099:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201209.163101:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201209.163237:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+111:3313:x1875064458193920:12345-0@lo:6:osp-syn-0-0.0 Request processed in 40740us (42103us total) trans 4294968812 rc 0/0 00000100:00100000:0.0:1788201209.163256:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4081 00010000:00010000:0.0:1788201209.163282:0:13441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000232c8587/0x9383f985bc4d2cb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201209.163378:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04c8237480/2, rc 0, transno 4294968792 00000100:00100000:3.0:1788201209.163393:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c8237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458196864:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788201209.163408:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c33f1c00/2, rc 0, transno 4294968812 00000100:00100000:3.0:1788201209.163412:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c33f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458193920:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788201209.163549:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000232c8587/0x9383f985bc4d2cb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.163567:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000232c8587/0x9383f985bc4d2cb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.163575:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000232c8587/0x9383f985bc4d2cb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.163596:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201209.163735:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c24a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+101:3310:x1875064458194432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 38779us (39200us total) trans 4294968793 rc 0/0 00000100:00100000:0.0:1788201209.163742:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4083 00010000:00010000:0.0:1788201209.163791:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066023d76/0x9383f985bc4c448e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x39d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2719 expref: 44 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.163804:0:6706:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c24a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1875064458194944:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.163825:0:6706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b3effe3a/0x9383f985bc4d2cc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.163835:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b3effe3a/0x9383f985bc4d2cc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.163842:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3effe3a/0x9383f985bc4d2cc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.163850:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3effe3a/0x9383f985bc4d2cc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.163856:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3effe3a/0x9383f985bc4d2cc2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.163864:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788201209.164026:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c24a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+101:3313:x1875064458194688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 37209us (39211us total) trans 4294968794 rc 0/0 00000100:00100000:0.0:1788201209.164032:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4085 00010000:00010000:0.0:1788201209.164736:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201209.164743:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000232c8587/0x9383f985bc4d2cb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.164764:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bd800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.164768:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000232c8587/0x9383f985bc4d2cb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.164777:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000232c8587/0x9383f985bc4d2cb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.164792:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000232c8587/0x9383f985bc4d2cb4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.164799:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000232c8587/0x9383f985bc4d2cb4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.164819:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201209.164824:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3effe3a/0x9383f985bc4d2cc2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.164830:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.164833:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3effe3a/0x9383f985bc4d2cc2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.164840:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3effe3a/0x9383f985bc4d2cc2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.164849:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3effe3a/0x9383f985bc4d2cc2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.164856:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3effe3a/0x9383f985bc4d2cc2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.165030:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.165034:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.165036:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201209.165155:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.165460:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0004000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458198656:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.165491:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.166136:0:13447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0005c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:13447:1875064458198144:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.166158:0:13447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d2d16 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.166181:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201209.166195:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0005880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458198400:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788201209.166216:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c24a3480/2, rc 0, transno 4294968794 00000100:00100000:2.0:1788201209.166229:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201209.166232:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c24a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458194688:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.166413:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458198272 00000100:00100000:0.0:1788201209.166420:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458198272 00000100:00100000:0.0:1788201209.166462:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458198656 00000100:00100000:0.0:1788201209.166464:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458198656 00000100:00100000:0.0:1788201209.166495:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4098 00000100:00100000:0.0:1788201209.166503:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0006a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+112:3312:x1875064458198272:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201209.166527:0:6705:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:944 count 1 00010000:00010000:0.0:1788201209.166548:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2d1d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3b0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.166569:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000029c0d005/0x9383f985bc4c537c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2c44 expref: 523 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.166577:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b0:0x0].0x0 since=28s v=(0 0) 00010000:00010000:0.0:1788201209.166582:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.166586:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2d1d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.166613:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000029c0d005/0x9383f985bc4c537c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2c44 expref: 523 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.166626:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000029c0d005/0x9383f985bc4c537c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2c44 expref: 523 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.166638:0:6705:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c24a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6705:1875064458198784:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.166697:0:6705:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201209.166714:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4099 00000100:00100000:0.0:1788201209.166722:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0004700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+112:3312:x1875064458198656:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201209.166735:0:13444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:935 count 1 00010000:00010000:0.0:1788201209.166863:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d2d24 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.167131:0:13444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000441c5ac3/0x9383f985bc4c4c44 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c29dc expref: 523 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.167145:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a7:0x0].0x0 since=29s v=(0 0) 00010000:00010000:0.0:1788201209.167148:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.167152:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d2d24 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.167173:0:13444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000441c5ac3/0x9383f985bc4c4c44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c29dc expref: 523 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.167183:0:13444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000441c5ac3/0x9383f985bc4c4c44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c29dc expref: 523 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.167194:0:13444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c24a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13444:1875064458198912:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.167219:0:13444:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5300 going to sleep for 11 seconds 00010000:00010000:3.0:1788201209.167350:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201209.167362:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458198528:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788201209.167415:0:13451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001080dfed/0x9383f985bc4c6ecd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c35c1 expref: 523 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.167429:0:13451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c8237b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:13451:1875064458196352:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201209.167444:0:13451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004fe5b943/0x9383f985bc4d2ce5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.167454:0:13451:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004fe5b943/0x9383f985bc4d2ce5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.167462:0:13451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fe5b943/0x9383f985bc4d2ce5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.167472:0:13451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fe5b943/0x9383f985bc4d2ce5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.167480:0:13451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fe5b943/0x9383f985bc4d2ce5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.167494:0:13451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1788201209.168038:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00a4e00/2, rc 0, transno 4294968791 00000100:00100000:2.0:1788201209.168045:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458197376:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788201209.168058:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00a5500/2, rc 0, transno 4294968808 00000100:00100000:2.0:1788201209.168065:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458195584:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788201209.168073:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00a5c00/2, rc 0, transno 4294968810 00000100:00100000:2.0:1788201209.168076:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458195456:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788201209.168085:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c24a2680/2, rc 0, transno 4294968789 00000100:00100000:2.0:1788201209.168088:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c24a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458194560:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788201209.168096:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c24a0a80/2, rc 0, transno 4294968793 00000100:00100000:2.0:1788201209.168109:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c24a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458194432:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788201209.168119:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c12d1f80/2, rc 0, transno 4294968790 00000100:00100000:2.0:1788201209.168122:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458193280:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.168208:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0007800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458199040:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.168234:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.168260:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cfface00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458199552:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.168278:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201209.168414:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458198400 00000100:00100000:0.0:1788201209.168421:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458198400 00000100:00100000:0.0:1788201209.168452:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458199040 00000100:00100000:0.0:1788201209.168455:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458199040 00000100:00100000:0.0:1788201209.168467:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458199552 00000100:00100000:0.0:1788201209.168469:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458199552 00000100:00100000:0.0:1788201209.168484:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4100 00000100:00100000:0.0:1788201209.168490:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+103:3310:x1875064458198400:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201209.168510:0:13440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:549 count 1 00010000:00010000:0.0:1788201209.168528:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2d2b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.168548:0:13440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6f4bda3/0x9383f985bc4b18e5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bbfcb expref: 43 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.168555:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x225:0x0].0x0 since=80s v=(0 0) 00010000:00010000:0.0:1788201209.168559:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x225:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.168563:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2d2b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.168585:0:13440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f6f4bda3/0x9383f985bc4b18e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bbfcb expref: 43 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.168595:0:13440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f6f4bda3/0x9383f985bc4b18e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bbfcb expref: 43 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.168606:0:13440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c24a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:13440:1875064458199680:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.168647:0:13440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201209.168665:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4101 00000100:00100000:0.0:1788201209.168672:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+103:3313:x1875064458199040:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201209.168686:0:12363:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:622 count 1 00010000:00010000:0.0:1788201209.168697:0:12363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2d32 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.168708:0:12363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000845787fd/0x9383f985bc4b538c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x26e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd3e4 expref: 43 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.168720:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26e:0x0].0x0 since=70s v=(0 0) 00010000:00010000:0.0:1788201209.168723:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.168727:0:12363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2d32 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.168745:0:12363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000845787fd/0x9383f985bc4b538c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x26e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd3e4 expref: 43 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.168771:0:12363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000845787fd/0x9383f985bc4b538c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x26e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd3e4 expref: 43 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.168781:0:12363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c24a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12363:1875064458199808:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.168804:0:12363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5e40 going to sleep for 11 seconds 00010000:00010000:0.0:1788201209.168816:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201209.168821:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fe5b943/0x9383f985bc4d2ce5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.168830:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.168835:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fe5b943/0x9383f985bc4d2ce5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.168844:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fe5b943/0x9383f985bc4d2ce5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.168865:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fe5b943/0x9383f985bc4d2ce5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.168998:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fe5b943/0x9383f985bc4d2ce5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.169018:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.169020:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.169022:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201209.169034:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4102 00000100:00100000:0.0:1788201209.169042:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+103:3313:x1875064458199552:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201209.169054:0:13441:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1012 count 1 00010000:00010000:0.0:1788201209.169066:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2d39 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.169077:0:13441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000895b00bc/0x9383f985bc4c8a25 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3f6f expref: 43 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.169084:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f4:0x0].0x0 since=19s v=(0 0) 00010000:00010000:0.0:1788201209.169087:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.169091:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2d39 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.169110:0:13441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000895b00bc/0x9383f985bc4c8a25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3f6f expref: 43 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.169125:0:13441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000895b00bc/0x9383f985bc4c8a25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3f6f expref: 43 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.169135:0:13441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c24a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:13441:1875064458199936:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.169159:0:13441:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201209.169226:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201209.169418:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201209.169429:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458199424:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.169454:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.169481:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458199424 00000100:00100000:2.0:1788201209.169485:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458199424 00000100:00100000:2.0:1788201209.169510:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4103 00000100:00100000:2.0:1788201209.169515:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+104:3313:x1875064458199424:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201209.169525:0:13443:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:752 count 1 00010000:00010000:2.0:1788201209.169538:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecaefa8a/0x9383f985bc4d2d40 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.169550:0:13443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007e030931/0x9383f985bc4bbb12 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf7bd expref: 43 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.169557:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f0:0x0].0x0 since=51s v=(0 0) 00010000:00010000:2.0:1788201209.169560:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.169564:0:13443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecaefa8a/0x9383f985bc4d2d40 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.169584:0:13443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007e030931/0x9383f985bc4bbb12 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf7bd expref: 43 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.169594:0:13443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007e030931/0x9383f985bc4bbb12 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf7bd expref: 43 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.169603:0:13443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffaca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13443:1875064458200064:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.169626:0:13443:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201209.169683:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458199168:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.169707:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.169720:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458200192:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.169737:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.169943:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788201209.169951:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458199296:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.169975:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.169996:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458200320:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.170016:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201209.170053:0:13448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccf7af38/0x9383f985bc4ba150 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1beec5 expref: 522 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.170065:0:13448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0006300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:13448:1875064458197888:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.170081:0:13448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003bf3c8de/0x9383f985bc4d2d0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.170096:0:13448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003bf3c8de/0x9383f985bc4d2d0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.170104:0:13448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bf3c8de/0x9383f985bc4d2d0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.170112:0:13448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bf3c8de/0x9383f985bc4d2d0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.170120:0:13448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bf3c8de/0x9383f985bc4d2d0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.170134:0:13448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788201209.170524:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458199168 00000100:00100000:1.0:1788201209.170530:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458199168 00000100:00100000:1.0:1788201209.170558:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458200192 00000100:00100000:1.0:1788201209.170562:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458200192 00000100:00100000:1.0:1788201209.170572:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458199296 00000100:00100000:1.0:1788201209.170574:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458199296 00000100:00100000:1.0:1788201209.170586:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4104 00000100:00100000:1.0:1788201209.170592:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+106:3310:x1875064458199168:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788201209.170608:0:10484:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:570 count 1 00010000:00010000:1.0:1788201209.170623:0:10484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000456a114c/0x9383f985bc4d2d47 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.170636:0:10484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8d8efe5/0x9383f985bc4b29cb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc597 expref: 43 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.170643:0:10484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23a:0x0].0x0 since=78s v=(0 0) 00010000:00010000:1.0:1788201209.170646:0:10484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.170650:0:10484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000456a114c/0x9383f985bc4d2d47 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.170671:0:10484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d8d8efe5/0x9383f985bc4b29cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc597 expref: 43 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.170681:0:10484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d8d8efe5/0x9383f985bc4b29cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc597 expref: 43 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.170693:0:10484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c502ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10484:1875064458200448:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201209.170729:0:10484:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d033ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201209.172747:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458200320 00000100:00100000:3.0:1788201209.172759:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458200320 00000100:00100000:3.0:1788201209.172801:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4105 00000100:00100000:3.0:1788201209.172809:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+115:3310:x1875064458200192:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201209.172833:0:13450:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:850 count 1 00010000:00010000:3.0:1788201209.172856:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaee9d17/0x9383f985bc4d2d4e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.172873:0:13450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f980cee1/0x9383f985bc4c0897 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1289 expref: 521 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.172881:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x352:0x0].0x0 since=39s v=(0 0) 00010000:00010000:3.0:1788201209.172885:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x352:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.172889:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaee9d17/0x9383f985bc4d2d4e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.172922:0:13450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f980cee1/0x9383f985bc4c0897 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1289 expref: 521 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.172933:0:13450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f980cee1/0x9383f985bc4c0897 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1289 expref: 521 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.172945:0:13450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:13450:1875064458200576:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201209.173017:0:13450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2fd9540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201209.173418:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4106 00000100:00100000:1.0:1788201209.173432:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+106:3310:x1875064458199296:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788201209.173450:0:6706:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:835 count 1 00010000:00010000:1.0:1788201209.173466:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bd623ea/0x9383f985bc4d2d55 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x343:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.173480:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f59007ea/0x9383f985bc4bfd30 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x343:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0e8b expref: 43 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.173487:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x343:0x0].0x0 since=41s v=(0 0) 00010000:00010000:1.0:1788201209.173491:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x343:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.173494:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008bd623ea/0x9383f985bc4d2d55 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x343:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.173519:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f59007ea/0x9383f985bc4bfd30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x343:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0e8b expref: 43 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.173530:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f59007ea/0x9383f985bc4bfd30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x343:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0e8b expref: 43 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.173543:0:6706:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1875064458200704:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201209.173582:0:6706:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d033a840 going to sleep for 11 seconds 00010000:00010000:0.0:1788201209.174556:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca7a906e/0x9383f985bc4b3bc2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcbc5 expref: 521 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.174574:0:13445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c8237800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13445:1875064458196992:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.174594:0:13445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2cf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.174605:0:13445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2cf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.174613:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2cf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.174623:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2cf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.174630:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2cf3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.174660:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788201209.174855:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c8236680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+116:3310:x1875064458196736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26696us (26880us total) trans 4294968814 rc 0/0 00000100:00100000:0.0:1788201209.174863:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4092 00010000:00010000:1.0:1788201209.174938:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201209.174946:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bf3c8de/0x9383f985bc4d2d0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.174955:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201209.174960:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bf3c8de/0x9383f985bc4d2d0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.174970:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bf3c8de/0x9383f985bc4d2d0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.174997:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bf3c8de/0x9383f985bc4d2d0f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.175006:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bf3c8de/0x9383f985bc4d2d0f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.175021:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201209.175025:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2cf3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.175031:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201209.175034:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2cf3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.175042:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2cf3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.175051:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2cf3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.175059:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2cf3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.175069:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201209.175070:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201209.175072:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201209.175261:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4107 00000100:00100000:0.0:1788201209.175272:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+115:3310:x1875064458200320:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201209.175376:0:13445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:932 count 1 00010000:00010000:0.0:1788201209.175394:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092295f0a/0x9383f985bc4d2d5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.175408:0:13445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000016a07e4e/0x9383f985bc4c49ce lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c290a expref: 520 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.175416:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a4:0x0].0x0 since=29s v=(0 0) 00010000:00010000:0.0:1788201209.175420:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.175424:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092295f0a/0x9383f985bc4d2d5c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.175450:0:13445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000016a07e4e/0x9383f985bc4c49ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c290a expref: 520 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.175461:0:13445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000016a07e4e/0x9383f985bc4c49ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c290a expref: 520 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.175480:0:13445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c24a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13445:1875064458200832:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.175533:0:13445:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201209.175552:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201209.175584:0:13442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458198528 00000100:00100000:0.0:1788201209.175590:0:13442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458198528 00000100:00100000:0.0:1788201209.175611:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4108 00000100:00100000:0.0:1788201209.175617:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f965e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+116:3311:x1875064458198528:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201209.175627:0:13442:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:847 count 1 00010000:00010000:0.0:1788201209.175638:0:13442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d2d63 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.175648:0:13442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003dee6d89/0x9383f985bc4c0621 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c11b7 expref: 520 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.175655:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34f:0x0].0x0 since=39s v=(0 0) 00010000:00010000:0.0:1788201209.175658:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.175662:0:13442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d2d63 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.175679:0:13442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003dee6d89/0x9383f985bc4c0621 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c11b7 expref: 520 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.175688:0:13442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003dee6d89/0x9383f985bc4c0621 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c11b7 expref: 520 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.175703:0:13442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c24a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:13442:1875064458200960:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.175722:0:13442:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5900 going to sleep for 11 seconds 00010000:00010000:0.0:1788201209.175853:0:13439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041c21db3/0x9383f985bc4c0900 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c12ac expref: 43 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.175867:0:13439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c8235c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:13439:1875064458196608:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.175940:0:13439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000013c1550e/0x9383f985bc4d2cec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.175950:0:13439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000013c1550e/0x9383f985bc4d2cec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.175957:0:13439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013c1550e/0x9383f985bc4d2cec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.175966:0:13439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013c1550e/0x9383f985bc4d2cec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.175973:0:13439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013c1550e/0x9383f985bc4d2cec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.176000:0:13439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201209.176010:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201209.176016:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013c1550e/0x9383f985bc4d2cec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.176023:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.176026:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013c1550e/0x9383f985bc4d2cec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.176034:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013c1550e/0x9383f985bc4d2cec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.176047:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013c1550e/0x9383f985bc4d2cec lrc: 1/0,0 mode: --/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.176054:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013c1550e/0x9383f985bc4d2cec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.176069:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.176070:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.176071:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201209.176405:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c8234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+107:3310:x1875064458196480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 31282us (31350us total) trans 4294968795 rc 0/0 00000100:00100000:0.0:1788201209.176412:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4091 00000100:00100000:2.0:1788201209.176625:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+117:3310:x1875064458197760:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24757us (25379us total) trans 4294968815 rc 0/0 00000100:00100000:2.0:1788201209.176632:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4096 00000004:00080000:2.0:1788201209.176671:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00a6d80/2, rc 0, transno 4294968813 00000100:00100000:2.0:1788201209.176693:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458195968:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788201209.176707:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788201209.176721:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00a4380/2, rc 0, transno 4294968815 00000100:00100000:2.0:1788201209.176725:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458197760:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788201209.176732:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04c8235180/2, rc 0, transno 4294968814 00000100:00100000:2.0:1788201209.176735:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c8235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458196736:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788201209.176743:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04c8234a80/2, rc 0, transno 4294968795 00000100:00100000:2.0:1788201209.176994:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c8234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458196480:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.177054:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201209.177065:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458201088:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.177170:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.177210:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458201088 00000100:00100000:2.0:1788201209.177215:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458201088 00000100:00100000:2.0:1788201209.177244:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4109 00000100:00100000:2.0:1788201209.177264:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+107:3313:x1875064458201088:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201209.177282:0:13449:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:546 count 1 00000100:00100000:0.0:1788201209.177462:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f4e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458201472:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201209.177491:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201209.177509:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201209.177514:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458201344:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201209.177534:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201209.177558:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458201472 00000100:00100000:0.0:1788201209.177561:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458201472 00000100:00100000:0.0:1788201209.177578:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458201344 00000100:00100000:0.0:1788201209.177580:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458201344 00000100:00100000:0.0:1788201209.177592:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4110 00000100:00100000:0.0:1788201209.177598:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+118:3311:x1875064458201472:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201209.177610:0:13439:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1009 count 1 00010000:00010000:0.0:1788201209.177626:0:13439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d2d6a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.177642:0:13439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bb412d5a/0x9383f985bc4c8746 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3e7a expref: 520 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.177649:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f1:0x0].0x0 since=19s v=(0 0) 00010000:00010000:0.0:1788201209.177653:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.177656:0:13439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d2d6a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.177677:0:13439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bb412d5a/0x9383f985bc4c8746 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3e7a expref: 520 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.177688:0:13439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bb412d5a/0x9383f985bc4c8746 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3e7a expref: 520 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.177699:0:13439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c56f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:13439:1875064458201600:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.177742:0:13439:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201209.177975:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c24a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458201216:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.178011:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.178043:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458201216 00000100:00100000:2.0:1788201209.178046:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458201216 00000100:00100000:2.0:1788201209.178064:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4111 00000100:00100000:2.0:1788201209.178070:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+119:3311:x1875064458201344:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201209.178083:0:13448:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:717 count 1 00010000:00010000:2.0:1788201209.178379:0:13448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2d71 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.178393:0:13448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000730f2365/0x9383f985bc4b9eef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bedfa expref: 520 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.178399:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2cd:0x0].0x0 since=56s v=(0 0) 00010000:00010000:2.0:1788201209.178403:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.178406:0:13448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2d71 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.178434:0:13448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000730f2365/0x9383f985bc4b9eef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bedfa expref: 520 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.178443:0:13448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000730f2365/0x9383f985bc4b9eef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bedfa expref: 520 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.178452:0:13448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5485500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:13448:1875064458201728:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.178479:0:13448:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91a80 going to sleep for 11 seconds 00010000:00010000:2.0:1788201209.178496:0:13449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f153a5fa/0x9383f985bc4d2d78 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.178507:0:13449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000baa94efe/0x9383f985bc4b16d8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bbee4 expref: 42 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.178514:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=81s v=(0 0) 00010000:00010000:2.0:1788201209.178517:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.178520:0:13449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f153a5fa/0x9383f985bc4d2d78 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.178540:0:13449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000baa94efe/0x9383f985bc4b16d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bbee4 expref: 42 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.178550:0:13449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000baa94efe/0x9383f985bc4b16d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bbee4 expref: 42 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.178567:0:13449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5484700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:13449:1875064458201856:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.178588:0:13449:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f910c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201209.178605:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4112 00000100:00100000:2.0:1788201209.178613:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+119:3313:x1875064458201216:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201209.178627:0:13446:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:665 count 1 00010000:00010000:2.0:1788201209.178640:0:13446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b327931f/0x9383f985bc4d2d7f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x299:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.178652:0:13446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a52df845/0x9383f985bc4b7558 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdf8a expref: 520 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.178658:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x299:0x0].0x0 since=63s v=(0 0) 00010000:00010000:2.0:1788201209.178661:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x299:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.178665:0:13446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b327931f/0x9383f985bc4d2d7f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.178683:0:13446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a52df845/0x9383f985bc4b7558 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdf8a expref: 520 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.178692:0:13446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a52df845/0x9383f985bc4b7558 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdf8a expref: 520 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.178703:0:13446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5485180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:13446:1875064458201984:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.178730:0:13446:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201209.179096:0:13451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+119:3313:x1875064458195968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 46592us (46940us total) trans 4294968813 rc 0/0 00000100:00100000:3.0:1788201209.179106:0:13451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4090 00000100:00100000:0.0:1788201209.179456:0:13526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442602624 00000100:00100000:0.0:1788201209.179463:0:13526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442602624 00010000:00010000:0.0:1788201209.179487:0:13526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea30b68a/0x9383f985bc4bf6a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x33b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0c5b expref: 43 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.179530:0:13526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1478 00000100:00100000:0.0:1788201209.179538:0:13526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c24a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+43:2359:x1875064442602624:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201209.179547:0:13526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201209.179552:0:13526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea30b68a/0x9383f985bc4bf6a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x33b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0c5b expref: 43 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.179565:0:13526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea30b68a/0x9383f985bc4bf6a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x33b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0c5b expref: 43 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.179586:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea30b68a/0x9383f985bc4bf6a0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x33b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0c5b expref: 43 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.179607:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.179611:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.179616:0:13526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d2d16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.179625:0:13526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d2d16 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x33b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.179644:0:13526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201209.179671:0:13526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c24a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+42:2359:x1875064442602624:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 134us (10445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201209.179679:0:13526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1478 00010000:00010000:2.0:1788201209.179737:0:13447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d2d16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.179758:0:13447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d2d16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.179768:0:13447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d2d16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.179776:0:13447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d2d16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.179803:0:13447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201209.180063:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0005f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+108:3313:x1875064458198016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22030us (24970us total) trans 4294968796 rc 0/0 00000100:00100000:2.0:1788201209.180070:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4097 00000004:00080000:2.0:1788201209.180121:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f0005500/2, rc 0, transno 4294968796 00000100:00100000:2.0:1788201209.180132:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458198016:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.180189:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201209.180199:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458202112:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.180231:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.180267:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458202112 00000100:00100000:2.0:1788201209.180271:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458202112 00000100:00100000:2.0:1788201209.180327:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4113 00000100:00100000:2.0:1788201209.180335:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+108:3313:x1875064458202112:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201209.180355:0:6703:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:868 count 1 00010000:00010000:2.0:1788201209.180372:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b34dacfa/0x9383f985bc4d2d86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.180386:0:6703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e8b1589c/0x9383f985bc4c1731 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1798 expref: 41 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.180393:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x364:0x0].0x0 since=37s v=(0 0) 00010000:00010000:2.0:1788201209.180396:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x364:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.180399:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b34dacfa/0x9383f985bc4d2d86 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.180418:0:6703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e8b1589c/0x9383f985bc4c1731 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1798 expref: 41 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.180429:0:6703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e8b1589c/0x9383f985bc4c1731 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1798 expref: 41 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.180439:0:6703:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5486680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6703:1875064458202240:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.180475:0:6703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91900 going to sleep for 11 seconds 00010000:00010000:0.0:1788201209.180841:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201209.180849:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d2d16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.180858:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.180863:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d2d16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.180882:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d2d16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.180897:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d2d16 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.180905:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d2d16 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.180923:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.180925:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.180926:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201209.182162:0:12363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c24a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12363:1875064458199808:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.182186:0:12363:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2d32 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.182216:0:13441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c24a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:13441:1875064458199936:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.182228:0:13441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2d39 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.182512:0:6705:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c24a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6705:1875064458198784:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.182526:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2d1d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.193068:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201209.193104:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201209.193152:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201209.197535:0:13440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c24a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:13440:1875064458199680:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.197565:0:13440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2d2b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.197600:0:13444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c24a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13444:1875064458198912:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.197612:0:13444:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d2d24 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.197645:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201209.197766:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442602752 00000100:00100000:2.0:1788201209.197773:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442602752 00010000:00010000:2.0:1788201209.197815:0:7646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000029c0d005/0x9383f985bc4c537c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2c44 expref: 521 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.197842:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442603008 00000100:00100000:2.0:1788201209.197844:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442603008 00010000:00010000:2.0:1788201209.197854:0:7646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000895b00bc/0x9383f985bc4c8a25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3f6f expref: 42 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.197865:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442602880 00000100:00100000:2.0:1788201209.197867:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442602880 00010000:00010000:2.0:1788201209.197874:0:7646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000845787fd/0x9383f985bc4b538c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x26e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd3e4 expref: 43 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.197886:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1479 00000100:00100000:2.0:1788201209.197892:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c24a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+521:2362:x1875064442602752:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.197903:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.197907:0:7646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000029c0d005/0x9383f985bc4c537c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2c44 expref: 521 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.197915:0:7646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000029c0d005/0x9383f985bc4c537c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2c44 expref: 521 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.197933:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029c0d005/0x9383f985bc4c537c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2c44 expref: 521 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.197945:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.197949:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.197953:0:7646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2d1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.197960:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2d1d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.197983:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201209.198012:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2d1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.198021:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2d1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.198031:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2d1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.198037:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2d1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.198053:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201209.198277:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0006a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+119:3312:x1875064458198272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 31774us (33121us total) trans 4294968816 rc 0/0 00000100:00100000:2.0:1788201209.198286:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4098 00000004:00080000:2.0:1788201209.199533:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f0004a80/2, rc 0, transno 4294968816 00000100:00100000:2.0:1788201209.199549:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458198272:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.199608:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c24a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+520:2362:x1875064442602752:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1712us (6545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.199617:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1479 00000100:00100000:2.0:1788201209.199641:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1480 00000100:00100000:2.0:1788201209.199653:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c24a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+43:2362:x1875064442603008:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.199670:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.199677:0:7646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000895b00bc/0x9383f985bc4c8a25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3f6f expref: 43 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.199688:0:7646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000895b00bc/0x9383f985bc4c8a25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3f6f expref: 43 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.199703:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000895b00bc/0x9383f985bc4c8a25 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3f6f expref: 43 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.199714:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.199717:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.199721:0:7646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2d39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.199726:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2d39 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.199742:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201209.199768:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c24a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+42:2362:x1875064442603008:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 120us (6663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.199772:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1480 00000100:00100000:2.0:1788201209.199782:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1481 00000100:00100000:2.0:1788201209.199786:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c24a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+41:2362:x1875064442602880:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.199791:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.199795:0:7646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000845787fd/0x9383f985bc4b538c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x26e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd3e4 expref: 41 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.199801:0:7646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000845787fd/0x9383f985bc4b538c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x26e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd3e4 expref: 41 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.199809:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000845787fd/0x9383f985bc4b538c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x26e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd3e4 expref: 41 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.199815:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.199817:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.199820:0:7646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2d32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.199824:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2d32 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.199835:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201209.199845:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c24a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+40:2362:x1875064442602880:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 60us (6693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.199849:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1481 00010000:00010000:0.0:1788201209.205121:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201209.205134:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2d1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.205149:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.205155:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2d1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.205167:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2d1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.205194:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2d1d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.205202:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c0641cd/0x9383f985bc4d2d1d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.205223:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.205225:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.205226:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.205239:0:12363:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2d32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.205387:0:12363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2d32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.205399:0:12363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2d32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.205407:0:12363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2d32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.205432:0:12363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788201209.205658:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442603136 00000100:00100000:1.0:1788201209.205668:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442603136 00000100:00100000:0.0:1788201209.205902:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+109:3313:x1875064458199040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 37228us (37664us total) trans 4294968797 rc 0/0 00000100:00100000:0.0:1788201209.205912:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4101 00000004:00080000:0.0:1788201209.205968:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f0007800/2, rc 0, transno 4294968797 00000100:00100000:0.0:1788201209.205993:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0007800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458199040:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.206063:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c24a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458202368:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201209.206094:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201209.206127:0:13441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2d39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.206137:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2d39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.206146:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2d39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.206154:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2d39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.206165:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788201209.206289:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+109:3313:x1875064458199552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 37247us (38008us total) trans 4294968798 rc 0/0 00000100:00100000:0.0:1788201209.206535:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4102 00000100:00100000:0.0:1788201209.206550:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458202368 00000100:00100000:0.0:1788201209.206554:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458202368 00000100:00100000:0.0:1788201209.206587:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4114 00000100:00100000:0.0:1788201209.206596:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+119:3313:x1875064458202368:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788201209.206600:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201209.206609:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2d32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.206619:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0c00 already unused, calling callback (ffffffffc13fbfe0) 00002000:00080000:0.0:1788201209.206623:0:13441:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:842 count 1 00010000:00010000:3.0:1788201209.206624:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2d32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.206636:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2d32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.206648:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3effe3a/0x9383f985bc4d2d8d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.206653:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2d32 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.206673:0:13441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6c7fa33/0x9383f985bc4c0285 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1052 expref: 520 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.206674:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2d32 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.206698:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34a:0x0].0x0 since=40s v=(0 0) 00010000:00010000:0.0:1788201209.206704:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.206707:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201209.206709:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3effe3a/0x9383f985bc4d2d8d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.206712:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2d39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.206728:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201209.206731:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2d39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.206739:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2d39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.206749:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2d39 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.206755:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2d39 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.206767:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201209.206769:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201209.206771:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.206846:0:13441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c6c7fa33/0x9383f985bc4c0285 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1052 expref: 520 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.206860:0:13441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c6c7fa33/0x9383f985bc4c0285 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1052 expref: 520 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.206872:0:13441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c548d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:13441:1875064458202496:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.206919:0:13441:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5cc0 going to sleep for 11 seconds 00000004:00080000:0.0:1788201209.206944:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04cfface00/2, rc 0, transno 4294968798 00000100:00100000:0.0:1788201209.206948:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cfface00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458199552:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788201209.206958:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201209.207035:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201209.207501:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201209.207567:0:13443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffaca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13443:1875064458200064:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201209.207586:0:13443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ecaefa8a/0x9383f985bc4d2d40 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.207650:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442603264 00000100:00100000:2.0:1788201209.207656:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442603264 00000100:00100000:3.0:1788201209.207666:0:13450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:13450:1875064458200576:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201209.207682:0:13450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aaee9d17/0x9383f985bc4d2d4e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.207764:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458202624:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.207796:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.207817:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201209.207822:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458202752:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.207839:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.207858:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458202624 00000100:00100000:2.0:1788201209.207861:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458202624 00000100:00100000:2.0:1788201209.207896:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458202752 00000100:00100000:2.0:1788201209.207899:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458202752 00000100:00100000:2.0:1788201209.207912:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4115 00000100:00100000:2.0:1788201209.207919:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+110:3310:x1875064458202624:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201209.207937:0:6705:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:683 count 1 00010000:00010000:2.0:1788201209.207955:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f21f6f3/0x9383f985bc4d2d94 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.207969:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000722dca70/0x9383f985bc4b8446 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be4b5 expref: 40 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.207977:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2ab:0x0].0x0 since=61s v=(0 0) 00010000:00010000:2.0:1788201209.207981:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.207995:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f21f6f3/0x9383f985bc4d2d94 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.208016:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000722dca70/0x9383f985bc4b8446 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be4b5 expref: 40 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.208028:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000722dca70/0x9383f985bc4b8446 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be4b5 expref: 40 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.208040:0:6705:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5484e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1875064458202880:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.208073:0:6705:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f916c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201209.208087:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4116 00000100:00100000:2.0:1788201209.208094:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+110:3310:x1875064458202752:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201209.208105:0:13447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:694 count 1 00010000:00010000:2.0:1788201209.208115:0:13447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ae062a/0x9383f985bc4d2d9b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.208127:0:13447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000073576740/0x9383f985bc4b8cb9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be7be expref: 40 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.208135:0:13447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b6:0x0].0x0 since=59s v=(0 0) 00010000:00010000:2.0:1788201209.208138:0:13447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.208142:0:13447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ae062a/0x9383f985bc4d2d9b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.208158:0:13447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000073576740/0x9383f985bc4b8cb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be7be expref: 40 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.208168:0:13447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000073576740/0x9383f985bc4b8cb9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be7be expref: 40 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.208179:0:13447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5487100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:13447:1875064458203008:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.208199:0:13447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91e40 going to sleep for 11 seconds 00010000:00010000:2.0:1788201209.208227:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f6f4bda3/0x9383f985bc4b18e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bbfcb expref: 40 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.208242:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1482 00000100:00100000:2.0:1788201209.208554:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8104450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+40:2360:x1875064442603264:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.208564:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.208570:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f6f4bda3/0x9383f985bc4b18e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bbfcb expref: 40 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.208582:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f6f4bda3/0x9383f985bc4b18e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bbfcb expref: 40 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.208601:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6f4bda3/0x9383f985bc4b18e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bbfcb expref: 40 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.208613:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x225:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.208617:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x225:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.208622:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2d2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.208630:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2d2b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.208651:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201209.208669:0:13440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2d2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.208678:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2d2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.208687:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2d2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.208695:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2d2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.208716:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201209.209048:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+111:3310:x1875064458198400:12345-0@lo:6:osp-syn-1-0.0 Request processed in 40556us (42818us total) trans 4294968799 rc 0/0 00000100:00100000:2.0:1788201209.209055:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4100 00000004:00080000:2.0:1788201209.209113:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f0005880/2, rc 0, transno 4294968799 00000100:00100000:2.0:1788201209.209122:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0005880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458198400:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.209171:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458203136:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.209195:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.209221:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458203136 00000100:00100000:2.0:1788201209.209225:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458203136 00000100:00100000:2.0:1788201209.209266:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4117 00000100:00100000:2.0:1788201209.209272:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+111:3312:x1875064458203136:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201209.209287:0:12363:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:698 count 1 00010000:00010000:2.0:1788201209.209437:0:12363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d2da2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.209452:0:12363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000025c71411/0x9383f985bc4b9016 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be8d6 expref: 39 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.209460:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2ba:0x0].0x0 since=58s v=(0 0) 00010000:00010000:2.0:1788201209.209464:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.209467:0:12363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d2da2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.209487:0:12363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000025c71411/0x9383f985bc4b9016 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be8d6 expref: 39 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.209498:0:12363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000025c71411/0x9383f985bc4b9016 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be8d6 expref: 39 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.209509:0:12363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5486a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12363:1875064458203264:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.209538:0:12363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201209.209558:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8104450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+39:2360:x1875064442603264:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1310us (2523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.209566:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1482 00000100:00100000:1.0:1788201209.211358:0:10484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c502ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10484:1875064458200448:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201209.211386:0:10484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000456a114c/0x9383f985bc4d2d47 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.211419:0:6706:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1875064458200704:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201209.211430:0:6706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008bd623ea/0x9383f985bc4d2d55 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x343:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.211475:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000441c5ac3/0x9383f985bc4c4c44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c29dc expref: 520 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.211522:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1483 00000100:00100000:1.0:1788201209.211532:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c24a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+520:2360:x1875064442603136:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201209.211547:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201209.211552:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000441c5ac3/0x9383f985bc4c4c44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c29dc expref: 520 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.211566:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000441c5ac3/0x9383f985bc4c4c44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c29dc expref: 520 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.211591:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000441c5ac3/0x9383f985bc4c4c44 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c29dc expref: 520 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.211607:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.211611:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.211617:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d2d24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.211626:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d2d24 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.211654:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201209.211700:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c24a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+519:2360:x1875064442603136:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 169us (14054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.211707:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1483 00010000:00010000:0.0:1788201209.212219:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201209.212228:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2d2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.212364:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.212370:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2d2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.212381:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2d2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.212395:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2d2b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.212403:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2d2b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.212421:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.212422:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.212424:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201209.212459:0:13445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c24a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13445:1875064458200832:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.212474:0:13445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000092295f0a/0x9383f985bc4d2d5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.212532:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201209.212715:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201209.212760:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442603392 00000100:00100000:2.0:1788201209.212767:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442603392 00010000:00010000:2.0:1788201209.212791:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007e030931/0x9383f985bc4bbb12 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf7bd expref: 39 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.212817:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442603648 00000100:00100000:2.0:1788201209.212820:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442603648 00010000:00010000:2.0:1788201209.212832:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f980cee1/0x9383f985bc4c0897 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1289 expref: 519 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.212850:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1484 00000100:00100000:2.0:1788201209.212857:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+39:2361:x1875064442603392:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.212867:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.212871:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007e030931/0x9383f985bc4bbb12 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf7bd expref: 39 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.212883:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007e030931/0x9383f985bc4bbb12 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf7bd expref: 39 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.212898:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e030931/0x9383f985bc4bbb12 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf7bd expref: 39 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.212909:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.212913:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.212918:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ecaefa8a/0x9383f985bc4d2d40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.212927:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecaefa8a/0x9383f985bc4d2d40 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.212944:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201209.212956:0:13443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ecaefa8a/0x9383f985bc4d2d40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.212965:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecaefa8a/0x9383f985bc4d2d40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.212974:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecaefa8a/0x9383f985bc4d2d40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.212980:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecaefa8a/0x9383f985bc4d2d40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.213005:0:13443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201209.213264:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+112:3313:x1875064458199424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 43746us (43807us total) trans 4294968800 rc 0/0 00000100:00100000:2.0:1788201209.213273:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4103 00010000:00010000:2.0:1788201209.213416:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201209.213422:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecaefa8a/0x9383f985bc4d2d40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.213431:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.213435:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecaefa8a/0x9383f985bc4d2d40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.213443:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecaefa8a/0x9383f985bc4d2d40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.213455:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecaefa8a/0x9383f985bc4d2d40 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.213463:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecaefa8a/0x9383f985bc4d2d40 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.213477:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.213479:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.213480:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201209.213522:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+38:2361:x1875064442603392:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 653us (6010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.213530:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1484 00000100:00100000:2.0:1788201209.213545:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1485 00000100:00100000:2.0:1788201209.213551:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+519:2361:x1875064442603648:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.213561:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.213565:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f980cee1/0x9383f985bc4c0897 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x352:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1289 expref: 519 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.213575:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f980cee1/0x9383f985bc4c0897 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x352:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1289 expref: 519 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.213588:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f980cee1/0x9383f985bc4c0897 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x352:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1289 expref: 519 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.213598:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x352:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.213601:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x352:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.213605:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aaee9d17/0x9383f985bc4d2d4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.213614:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaee9d17/0x9383f985bc4d2d4e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.213633:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201209.213651:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+518:2361:x1875064442603648:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 100us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.213657:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1485 00010000:00010000:2.0:1788201209.213677:0:13450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aaee9d17/0x9383f985bc4d2d4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.213686:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaee9d17/0x9383f985bc4d2d4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.213694:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaee9d17/0x9383f985bc4d2d4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.213702:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaee9d17/0x9383f985bc4d2d4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.213716:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201209.213869:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+120:3310:x1875064458200192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 41060us (44130us total) trans 4294968817 rc 0/0 00000100:00100000:2.0:1788201209.213876:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4105 00000004:00080000:2.0:1788201209.213913:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04cffac380/2, rc 0, transno 4294968817 00000100:00100000:2.0:1788201209.213923:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458200192:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788201209.214104:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04cffaed80/2, rc 0, transno 4294968800 00000100:00100000:0.0:1788201209.214116:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458199424:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.214181:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c548fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458203392:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.214214:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201209.214386:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458203392 00000100:00100000:0.0:1788201209.214391:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458203392 00000100:00100000:0.0:1788201209.214424:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4118 00000100:00100000:0.0:1788201209.214430:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+112:3313:x1875064458203392:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201209.214449:0:13440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:691 count 1 00010000:00010000:0.0:1788201209.214467:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c576e396/0x9383f985bc4d2da9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.214481:0:13440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000073d83354/0x9383f985bc4b8a58 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be6ec expref: 37 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.214489:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b3:0x0].0x0 since=60s v=(0 0) 00010000:00010000:0.0:1788201209.214492:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.214496:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c576e396/0x9383f985bc4d2da9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.215040:0:13440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000073d83354/0x9383f985bc4b8a58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be6ec expref: 37 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.215054:0:13440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000073d83354/0x9383f985bc4b8a58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be6ec expref: 37 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.215067:0:13440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c548f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:13440:1875064458203520:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.215117:0:13440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201209.215171:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c548c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458203648:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201209.215195:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201209.215222:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201209.215228:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaee9d17/0x9383f985bc4d2d4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.215237:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.215241:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaee9d17/0x9383f985bc4d2d4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.215427:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442603904 00000100:00100000:2.0:1788201209.215432:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442603904 00010000:00010000:2.0:1788201209.215454:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000016a07e4e/0x9383f985bc4c49ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c290a expref: 518 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.215478:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1486 00000100:00100000:2.0:1788201209.215485:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+518:2361:x1875064442603904:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.215496:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.215501:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000016a07e4e/0x9383f985bc4c49ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c290a expref: 518 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.215603:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000016a07e4e/0x9383f985bc4c49ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c290a expref: 518 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.215622:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016a07e4e/0x9383f985bc4c49ce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c290a expref: 518 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.215636:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.215640:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.215645:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000092295f0a/0x9383f985bc4d2d5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.215652:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092295f0a/0x9383f985bc4d2d5c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.215674:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201209.215688:0:13445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000092295f0a/0x9383f985bc4d2d5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.215697:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092295f0a/0x9383f985bc4d2d5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.215705:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092295f0a/0x9383f985bc4d2d5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.215713:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092295f0a/0x9383f985bc4d2d5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.215726:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201209.215961:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+120:3310:x1875064458200320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 40691us (45942us total) trans 4294968818 rc 0/0 00000100:00100000:2.0:1788201209.215969:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4107 00000100:00100000:2.0:1788201209.215996:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458203648 00000100:00100000:2.0:1788201209.216000:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458203648 00000100:00100000:2.0:1788201209.216025:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4119 00000100:00100000:2.0:1788201209.216033:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+120:3310:x1875064458203648:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201209.216050:0:13445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:749 count 1 00010000:00010000:2.0:1788201209.216067:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035e7898d/0x9383f985bc4d2db0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.216079:0:13445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088f01a06/0x9383f985bc4bb833 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf6c8 expref: 517 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.216092:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2ed:0x0].0x0 since=52s v=(0 0) 00010000:00010000:2.0:1788201209.216096:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.216100:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035e7898d/0x9383f985bc4d2db0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.216124:0:13445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000088f01a06/0x9383f985bc4bb833 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf6c8 expref: 517 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.216136:0:13445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000088f01a06/0x9383f985bc4bb833 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf6c8 expref: 517 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.216147:0:13445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5477100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13445:1875064458203776:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.216181:0:13445:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91240 going to sleep for 11 seconds 00000004:00080000:2.0:1788201209.216219:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04cffae300/2, rc 0, transno 4294968818 00000100:00100000:2.0:1788201209.216230:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458200320:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788201209.216256:0:13444:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d2d24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.216269:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d2d24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.216281:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d2d24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.216287:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1788201209.216288:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d2d24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.216323:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788201209.216394:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaee9d17/0x9383f985bc4d2d4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.216409:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaee9d17/0x9383f985bc4d2d4e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.216417:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaee9d17/0x9383f985bc4d2d4e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.216436:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201209.216440:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092295f0a/0x9383f985bc4d2d5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.216448:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.216452:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092295f0a/0x9383f985bc4d2d5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.216461:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0004700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+121:3312:x1875064458198656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 49738us (50966us total) trans 4294968819 rc 0/0 00000100:00100000:3.0:1788201209.216477:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4099 00010000:00010000:0.0:1788201209.216478:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092295f0a/0x9383f985bc4d2d5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.216491:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092295f0a/0x9383f985bc4d2d5c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.216499:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092295f0a/0x9383f985bc4d2d5c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.216636:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201209.216640:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d2d24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.216647:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.216651:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d2d24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.216659:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d2d24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.216669:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d2d24 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.216676:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d2d24 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.216697:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.216698:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.216700:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788201209.216722:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f0004000/2, rc 0, transno 4294968819 00000100:00100000:0.0:1788201209.216745:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0004000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458198656:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788201209.216758:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201209.216797:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201209.216851:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201209.216894:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201209.216936:0:13448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5485500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:13448:1875064458201728:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.216953:0:13448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2d71 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.217040:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201209.217053:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201209.217064:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201209.217076:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201209.217087:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201209.217115:0:13441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c548d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:13441:1875064458202496:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.217129:0:13441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3effe3a/0x9383f985bc4d2d8d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.217173:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201209.217192:0:13442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c24a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:13442:1875064458200960:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.217202:0:13442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d2d63 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.217224:0:13449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5484700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:13449:1875064458201856:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.217234:0:13449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f153a5fa/0x9383f985bc4d2d78 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.217409:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442603520 00000100:00100000:1.0:1788201209.217415:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442603520 00010000:00010000:1.0:1788201209.217440:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d8d8efe5/0x9383f985bc4b29cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc597 expref: 38 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.217465:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442603776 00000100:00100000:1.0:1788201209.217468:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442603776 00010000:00010000:1.0:1788201209.217477:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f59007ea/0x9383f985bc4bfd30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x343:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0e8b expref: 39 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.217487:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442604032 00000100:00100000:1.0:1788201209.217489:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442604032 00010000:00010000:1.0:1788201209.217497:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003dee6d89/0x9383f985bc4c0621 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c11b7 expref: 518 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.217576:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442604288 00000100:00100000:1.0:1788201209.217580:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442604288 00010000:00010000:1.0:1788201209.217592:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000730f2365/0x9383f985bc4b9eef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bedfa expref: 519 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.217603:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442604544 00000100:00100000:1.0:1788201209.217605:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442604544 00010000:00010000:1.0:1788201209.217630:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a52df845/0x9383f985bc4b7558 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdf8a expref: 520 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.217643:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442604160 00000100:00100000:1.0:1788201209.217647:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442604160 00010000:00010000:1.0:1788201209.217660:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bb412d5a/0x9383f985bc4c8746 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3e7a expref: 521 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.217669:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442604416 00000100:00100000:1.0:1788201209.217672:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442604416 00010000:00010000:1.0:1788201209.217681:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000baa94efe/0x9383f985bc4b16d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bbee4 expref: 40 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.217691:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442604672 00000100:00100000:1.0:1788201209.217693:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442604672 00010000:00010000:1.0:1788201209.217703:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e8b1589c/0x9383f985bc4c1731 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1798 expref: 41 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.217712:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442604800 00000100:00100000:1.0:1788201209.217715:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442604800 00010000:00010000:1.0:1788201209.217724:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c6c7fa33/0x9383f985bc4c0285 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1052 expref: 522 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.217738:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1487 00000100:00100000:1.0:1788201209.217745:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+41:2361:x1875064442603520:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201209.217758:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201209.217762:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d8d8efe5/0x9383f985bc4b29cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc597 expref: 41 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.217774:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d8d8efe5/0x9383f985bc4b29cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc597 expref: 41 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.217790:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8d8efe5/0x9383f985bc4b29cb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc597 expref: 41 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.217803:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.217807:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.217812:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000456a114c/0x9383f985bc4d2d47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.217821:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000456a114c/0x9383f985bc4d2d47 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.217845:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201209.217861:0:10484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000456a114c/0x9383f985bc4d2d47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.217869:0:10484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000456a114c/0x9383f985bc4d2d47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.217878:0:10484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000456a114c/0x9383f985bc4d2d47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.217886:0:10484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000456a114c/0x9383f985bc4d2d47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.218544:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458203904:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.218593:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788201209.219082:0:10484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788201209.219410:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+113:3310:x1875064458199168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 48816us (49700us total) trans 4294968801 rc 0/0 00000100:00100000:1.0:1788201209.219419:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4104 00000100:00100000:1.0:1788201209.219440:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458203904 00000100:00100000:1.0:1788201209.219444:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458203904 00010000:00010000:0.0:1788201209.219855:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201209.219863:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000456a114c/0x9383f985bc4d2d47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.219875:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.219879:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000456a114c/0x9383f985bc4d2d47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.219888:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000456a114c/0x9383f985bc4d2d47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.219906:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000456a114c/0x9383f985bc4d2d47 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.219913:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000456a114c/0x9383f985bc4d2d47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.219930:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.219932:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.219934:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201209.219956:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201209.219970:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458204032:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201209.220029:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201209.220100:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788201209.220133:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f0004380/2, rc 0, transno 4294968801 00000100:00100000:2.0:1788201209.220149:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458199168:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.220173:0:13446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5485180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:13446:1875064458201984:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.220191:0:13446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b327931f/0x9383f985bc4d2d7f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.220216:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1488 00000100:00100000:2.0:1788201209.220225:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+40:2361:x1875064442603776:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.220237:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.220254:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f59007ea/0x9383f985bc4bfd30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x343:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0e8b expref: 40 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.220268:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f59007ea/0x9383f985bc4bfd30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x343:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0e8b expref: 40 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.220284:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f59007ea/0x9383f985bc4bfd30 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x343:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0e8b expref: 40 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.220317:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x343:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.220322:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x343:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.220327:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008bd623ea/0x9383f985bc4d2d55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x343:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.220337:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008bd623ea/0x9383f985bc4d2d55 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x343:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.220360:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201209.220394:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+39:2361:x1875064442603776:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 171us (3543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.220401:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1488 00000100:00100000:2.0:1788201209.220417:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1489 00000100:00100000:2.0:1788201209.220423:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+522:2362:x1875064442604032:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.220431:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.220436:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003dee6d89/0x9383f985bc4c0621 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c11b7 expref: 522 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.220447:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003dee6d89/0x9383f985bc4c0621 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c11b7 expref: 522 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.220460:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dee6d89/0x9383f985bc4c0621 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c11b7 expref: 522 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.220470:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.220473:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.220477:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d2d63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.220485:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d2d63 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.220499:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201209.220512:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+521:2362:x1875064442604032:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 89us (3619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.220518:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1489 00000100:00100000:2.0:1788201209.220529:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1490 00000100:00100000:2.0:1788201209.220535:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8107c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+520:2362:x1875064442604288:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.220541:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.220546:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000730f2365/0x9383f985bc4b9eef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bedfa expref: 520 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.220555:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000730f2365/0x9383f985bc4b9eef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bedfa expref: 520 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.220567:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730f2365/0x9383f985bc4b9eef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bedfa expref: 520 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.220576:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.220579:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.220583:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2d71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.220590:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2d71 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.220606:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201209.220624:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8107c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+519:2362:x1875064442604288:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 89us (3584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.220630:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1490 00000100:00100000:2.0:1788201209.220643:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1491 00000100:00100000:2.0:1788201209.220651:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+518:2362:x1875064442604544:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.220657:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.220664:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a52df845/0x9383f985bc4b7558 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x299:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdf8a expref: 518 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.220674:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a52df845/0x9383f985bc4b7558 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x299:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdf8a expref: 518 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.220686:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a52df845/0x9383f985bc4b7558 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x299:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bdf8a expref: 518 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.220694:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x299:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.220697:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x299:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.220700:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b327931f/0x9383f985bc4d2d7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.220709:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b327931f/0x9383f985bc4d2d7f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.220725:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201209.220744:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+517:2362:x1875064442604544:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 94us (3689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.220750:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1491 00000100:00100000:2.0:1788201209.220764:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1492 00000100:00100000:2.0:1788201209.220771:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+516:2362:x1875064442604160:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.220780:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.220785:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bb412d5a/0x9383f985bc4c8746 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3e7a expref: 516 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.220800:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bb412d5a/0x9383f985bc4c8746 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3e7a expref: 516 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.220826:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.220829:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.220833:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d2d6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.220841:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d2d6a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.220853:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201209.220871:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+516:2362:x1875064442604160:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 100us (3805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.220877:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1492 00000100:00100000:2.0:1788201209.220889:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1493 00000100:00100000:2.0:1788201209.220895:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+38:2362:x1875064442604416:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.220902:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.220908:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000baa94efe/0x9383f985bc4b16d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bbee4 expref: 38 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.220917:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000baa94efe/0x9383f985bc4b16d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bbee4 expref: 38 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.220935:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baa94efe/0x9383f985bc4b16d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bbee4 expref: 38 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.220945:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.220948:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.220952:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f153a5fa/0x9383f985bc4d2d78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.220960:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f153a5fa/0x9383f985bc4d2d78 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.220976:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201209.221004:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+37:2362:x1875064442604416:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 108us (3927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.221011:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1493 00000100:00100000:2.0:1788201209.221024:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1494 00000100:00100000:2.0:1788201209.221031:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+36:2362:x1875064442604672:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.221038:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.221043:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e8b1589c/0x9383f985bc4c1731 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x364:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1798 expref: 36 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.221054:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e8b1589c/0x9383f985bc4c1731 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x364:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1798 expref: 36 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.221071:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x364:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.221073:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x364:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.221078:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b34dacfa/0x9383f985bc4d2d86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.221086:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b34dacfa/0x9383f985bc4d2d86 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.221096:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201209.221109:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+36:2362:x1875064442604672:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 79us (4022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.221115:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1494 00000100:00100000:2.0:1788201209.221125:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1495 00000100:00100000:2.0:1788201209.221131:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+515:2361:x1875064442604800:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.221137:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.221143:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c6c7fa33/0x9383f985bc4c0285 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1052 expref: 515 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.221152:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c6c7fa33/0x9383f985bc4c0285 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1052 expref: 515 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.221164:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6c7fa33/0x9383f985bc4c0285 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1052 expref: 515 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.221179:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.221181:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.221185:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3effe3a/0x9383f985bc4d2d8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.221193:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3effe3a/0x9383f985bc4d2d8d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.221207:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201209.221220:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+514:2361:x1875064442604800:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 89us (4047us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.221225:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1495 00010000:00010000:2.0:1788201209.221247:0:13448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2d71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.221256:0:13448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2d71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.221265:0:13448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2d71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.221272:0:13448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2d71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.221287:0:13448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201209.221516:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+122:3311:x1875064458201344:12345-0@lo:6:osp-syn-0-0.0 Request processed in 43444us (43980us total) trans 4294968820 rc 0/0 00000100:00100000:2.0:1788201209.221523:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4111 00010000:00010000:0.0:1788201209.222065:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201209.222071:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2d71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.222081:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.222085:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2d71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.222095:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2d71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.222107:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2d71 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.222114:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d307c09/0x9383f985bc4d2d71 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.222129:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.222131:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.222133:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201209.222165:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458204032 00000100:00100000:2.0:1788201209.222172:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458204032 00000100:00100000:2.0:1788201209.222200:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4120 00000100:00100000:2.0:1788201209.222205:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5474380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+122:3310:x1875064458203904:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201209.222227:0:13448:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:567 count 1 00010000:00010000:2.0:1788201209.222256:0:13448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001710cf90/0x9383f985bc4d2db7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.222272:0:13448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009757d476/0x9383f985bc4b2716 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc47f expref: 513 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.222280:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x237:0x0].0x0 since=78s v=(0 0) 00010000:00010000:2.0:1788201209.222283:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x237:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.222287:0:13448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001710cf90/0x9383f985bc4d2db7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.222340:0:13448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009757d476/0x9383f985bc4b2716 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc47f expref: 513 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.222352:0:13448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009757d476/0x9383f985bc4b2716 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc47f expref: 513 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.222366:0:13448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5476d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:13448:1875064458204160:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.222413:0:13448:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f919c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201209.222432:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4121 00000100:00100000:2.0:1788201209.222438:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+122:3313:x1875064458204032:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201209.222450:0:13443:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:619 count 1 00010000:00010000:2.0:1788201209.222462:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d2dbe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.222473:0:13443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000086046c3e/0x9383f985bc4b50ad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x26b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd2ef expref: 513 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.222479:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26b:0x0].0x0 since=71s v=(0 0) 00010000:00010000:2.0:1788201209.222482:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.222485:0:13443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d2dbe lrc: 4/0,1 mode: --/PW res: [0x240000400:0x26b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.222506:0:13443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000086046c3e/0x9383f985bc4b50ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x26b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd2ef expref: 513 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.222515:0:13443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000086046c3e/0x9383f985bc4b50ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x26b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd2ef expref: 513 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.222524:0:13443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5476a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13443:1875064458204288:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.222542:0:13443:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91000 going to sleep for 11 seconds 00010000:00010000:2.0:1788201209.222556:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008bd623ea/0x9383f985bc4d2d55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.222569:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008bd623ea/0x9383f985bc4d2d55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.222578:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bd623ea/0x9383f985bc4d2d55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.222585:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008bd623ea/0x9383f985bc4d2d55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.222600:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201209.222788:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+113:3310:x1875064458199296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 49361us (52811us total) trans 4294968802 rc 0/0 00000100:00100000:2.0:1788201209.222796:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4106 00010000:00010000:2.0:1788201209.222816:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201209.222821:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008bd623ea/0x9383f985bc4d2d55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.222828:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.222831:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008bd623ea/0x9383f985bc4d2d55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.222839:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008bd623ea/0x9383f985bc4d2d55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.222852:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008bd623ea/0x9383f985bc4d2d55 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.222861:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008bd623ea/0x9383f985bc4d2d55 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.222876:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.222878:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.222879:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788201209.222907:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04cffad880/2, rc 0, transno 4294968802 00000100:00100000:2.0:1788201209.222913:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458199296:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788201209.222928:0:13446:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b327931f/0x9383f985bc4d2d7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.222936:0:13446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b327931f/0x9383f985bc4d2d7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.222943:0:13446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b327931f/0x9383f985bc4d2d7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.222950:0:13446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b327931f/0x9383f985bc4d2d7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.222963:0:13446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201209.223123:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+123:3313:x1875064458201216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 44510us (45110us total) trans 4294968821 rc 0/0 00000100:00100000:2.0:1788201209.223130:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4112 00000004:00080000:2.0:1788201209.223161:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c24a1c00/2, rc 0, transno 4294968821 00000100:00100000:2.0:1788201209.223172:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c24a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458201216:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.223225:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458204416:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.223254:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.223284:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458204416 00000100:00100000:2.0:1788201209.223289:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458204416 00000100:00100000:2.0:1788201209.223329:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4122 00000100:00100000:2.0:1788201209.223334:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5475500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+123:3313:x1875064458204416:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201209.223347:0:6706:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:570 count 1 00010000:00010000:2.0:1788201209.223361:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2dc5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.223374:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065554486/0x9383f985bc4b2962 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc574 expref: 513 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.223382:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23a:0x0].0x0 since=78s v=(0 0) 00010000:00010000:2.0:1788201209.223385:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.223389:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2dc5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.223407:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000065554486/0x9383f985bc4b2962 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc574 expref: 513 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.223417:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000065554486/0x9383f985bc4b2962 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc574 expref: 513 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.223428:0:6706:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5477480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1875064458204544:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.223447:0:6706:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91300 going to sleep for 11 seconds 00010000:00010000:2.0:1788201209.223479:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8b1589c/0x9383f985bc4c1731 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1798 expref: 35 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.223490:0:6703:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5486680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6703:1875064458202240:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.223505:0:6703:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b34dacfa/0x9383f985bc4d2d86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.223515:0:6703:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b34dacfa/0x9383f985bc4d2d86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.223522:0:6703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b34dacfa/0x9383f985bc4d2d86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.223530:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b34dacfa/0x9383f985bc4d2d86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.223537:0:6703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b34dacfa/0x9383f985bc4d2d86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.223550:0:6703:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788201209.223686:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+113:3313:x1875064458202112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 43352us (43454us total) trans 4294968803 rc 0/0 00000100:00100000:2.0:1788201209.223693:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4113 00000004:00080000:2.0:1788201209.223719:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c5487800/2, rc 0, transno 4294968803 00000100:00100000:2.0:1788201209.223724:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458202112:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.223756:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+513:2361:x1875064442603904:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 8271us (11041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.223763:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1486 00000100:00100000:2.0:1788201209.224475:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201209.224487:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458204928:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.224518:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.224545:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458204672:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.224564:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.224582:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201209.224587:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458204800:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.224606:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.224627:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458204928 00000100:00100000:2.0:1788201209.224632:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458204928 00000100:00100000:2.0:1788201209.224653:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458204672 00000100:00100000:2.0:1788201209.224656:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458204672 00000100:00100000:2.0:1788201209.224665:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458204800 00000100:00100000:2.0:1788201209.224667:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458204800 00000100:00100000:2.0:1788201209.224677:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4123 00000100:00100000:2.0:1788201209.224684:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5475c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+115:3313:x1875064458204928:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201209.224701:0:13450:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1026 count 1 00010000:00010000:2.0:1788201209.224719:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bf3c8de/0x9383f985bc4d2dcc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x402:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.224733:0:13450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003371969b/0x9383f985bc4c9523 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x402:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c434a expref: 34 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.224741:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x402:0x0].0x0 since=18s v=(0 0) 00010000:00010000:2.0:1788201209.224745:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x402:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.224748:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bf3c8de/0x9383f985bc4d2dcc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x402:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.224770:0:13450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003371969b/0x9383f985bc4c9523 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x402:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c434a expref: 34 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.224781:0:13450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003371969b/0x9383f985bc4c9523 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x402:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c434a expref: 34 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.224792:0:13450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c52ec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:13450:1875064458205056:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.224821:0:13450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f910c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201209.224836:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4124 00000100:00100000:2.0:1788201209.224843:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5477800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+115:3310:x1875064458204672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201209.224854:0:6703:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:913 count 1 00010000:00010000:2.0:1788201209.224866:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d2dd3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.224877:0:6703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000010999ceb/0x9383f985bc4c3b1f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c23f4 expref: 34 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.224884:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x391:0x0].0x0 since=32s v=(0 0) 00010000:00010000:2.0:1788201209.224887:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x391:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.224890:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d2dd3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.224914:0:6703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000010999ceb/0x9383f985bc4c3b1f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c23f4 expref: 34 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.224925:0:6703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000010999ceb/0x9383f985bc4c3b1f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c23f4 expref: 34 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.224935:0:6703:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c52eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6703:1875064458205184:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.224970:0:6703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201209.225041:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4125 00000100:00100000:3.0:1788201209.225051:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+115:3310:x1875064458204800:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788201209.225061:0:13446:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:599 count 1 00010000:00010000:3.0:1788201209.225073:0:13446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea26b3fb/0x9383f985bc4d2dda lrc: 3/0,1 mode: --/PW res: [0x280000400:0x257:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.225084:0:13446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001f607d4e/0x9383f985bc4b4117 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcd8c expref: 34 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.225091:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x257:0x0].0x0 since=74s v=(0 0) 00010000:00010000:3.0:1788201209.225094:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x257:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.225098:0:13446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea26b3fb/0x9383f985bc4d2dda lrc: 4/0,1 mode: --/PW res: [0x280000400:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.225114:0:13446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001f607d4e/0x9383f985bc4b4117 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcd8c expref: 34 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.225124:0:13446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001f607d4e/0x9383f985bc4b4117 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcd8c expref: 34 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.225133:0:13446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c8235c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:13446:1875064458205312:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201209.225155:0:13446:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2fd9000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201209.225278:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+34:2361:x1875064442603520:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 7531us (8478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.225290:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1487 00010000:00010000:0.0:1788201209.225706:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201209.225714:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b327931f/0x9383f985bc4d2d7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.225729:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.225733:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b327931f/0x9383f985bc4d2d7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.225743:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b327931f/0x9383f985bc4d2d7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.225761:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b327931f/0x9383f985bc4d2d7f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.225768:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b327931f/0x9383f985bc4d2d7f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.225784:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201209.225788:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b34dacfa/0x9383f985bc4d2d86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.225795:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.225798:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b34dacfa/0x9383f985bc4d2d86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.225806:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b34dacfa/0x9383f985bc4d2d86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.225816:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b34dacfa/0x9383f985bc4d2d86 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.225822:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b34dacfa/0x9383f985bc4d2d86 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.225835:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.225837:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.225839:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.225845:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788201209.225878:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c12d1880/2, rc 0, transno 4294968820 00000100:00100000:0.0:1788201209.225931:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458201344:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788201209.225951:0:13441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3effe3a/0x9383f985bc4d2d8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.225959:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3effe3a/0x9383f985bc4d2d8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.225968:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3effe3a/0x9383f985bc4d2d8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.225975:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3effe3a/0x9383f985bc4d2d8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.226006:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201209.226291:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201209.226451:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3effe3a/0x9383f985bc4d2d8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.226460:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201209.226463:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3effe3a/0x9383f985bc4d2d8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.226472:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3effe3a/0x9383f985bc4d2d8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.226485:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3effe3a/0x9383f985bc4d2d8d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.226493:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3effe3a/0x9383f985bc4d2d8d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.226507:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201209.226509:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201209.226510:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201209.226617:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201209.226630:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c52ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458205440:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201209.226666:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.226729:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458205440 00000100:00100000:2.0:1788201209.226736:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458205440 00000100:00100000:2.0:1788201209.226776:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4126 00000100:00100000:2.0:1788201209.226783:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+125:3312:x1875064458205440:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201209.226804:0:10484:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:834 count 1 00010000:00010000:2.0:1788201209.226821:0:10484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fe5b943/0x9383f985bc4d2de1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.226834:0:10484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008e24ad2a/0x9383f985bc4bfbf5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0e22 expref: 512 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.226840:0:10484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x342:0x0].0x0 since=41s v=(0 0) 00010000:00010000:2.0:1788201209.226844:0:10484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x342:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.226848:0:10484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fe5b943/0x9383f985bc4d2de1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.226871:0:10484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008e24ad2a/0x9383f985bc4bfbf5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0e22 expref: 512 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.226882:0:10484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008e24ad2a/0x9383f985bc4bfbf5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0e22 expref: 512 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.226892:0:10484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c52ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10484:1875064458205568:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.226926:0:10484:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201209.227062:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+125:3313:x1875064458202368:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20466us (20966us total) trans 4294968822 rc 0/0 00000100:00100000:0.0:1788201209.227071:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4114 00010000:00010000:0.0:1788201209.227099:0:13442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d2d63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.227108:0:13442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d2d63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.227117:0:13442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d2d63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.227124:0:13442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d2d63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.227147:0:13442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201209.227388:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201209.227393:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d2d63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.227403:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201209.227407:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d2d63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.227415:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d2d63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.227428:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d2d63 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.227435:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cef54c04/0x9383f985bc4d2d63 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.227451:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201209.227452:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201209.227454:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201209.227555:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f965e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+125:3311:x1875064458198528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 51937us (52001us total) trans 4294968823 rc 0/0 00000100:00100000:0.0:1788201209.227563:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4108 00010000:00010000:0.0:1788201209.227673:0:13449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f153a5fa/0x9383f985bc4d2d78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.227684:0:13449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f153a5fa/0x9383f985bc4d2d78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.227693:0:13449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f153a5fa/0x9383f985bc4d2d78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.227701:0:13449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f153a5fa/0x9383f985bc4d2d78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.227720:0:13449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201209.227862:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+116:3313:x1875064458201088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 50598us (50690us total) trans 4294968804 rc 0/0 00000100:00100000:0.0:1788201209.227868:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4109 00010000:00010000:0.0:1788201209.227889:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201209.227893:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f153a5fa/0x9383f985bc4d2d78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.227900:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.227903:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f153a5fa/0x9383f985bc4d2d78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.227909:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f153a5fa/0x9383f985bc4d2d78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.227922:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f153a5fa/0x9383f985bc4d2d78 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.227929:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f153a5fa/0x9383f985bc4d2d78 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.227943:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.227945:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.227946:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201209.228029:0:6705:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5484e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1875064458202880:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.228046:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005f21f6f3/0x9383f985bc4d2d94 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.228115:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201209.228164:0:13447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5487100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:13447:1875064458203008:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.228178:0:13447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000032ae062a/0x9383f985bc4d2d9b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.228230:0:12363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5486a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12363:1875064458203264:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.228241:0:12363:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d2da2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201209.228419:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f0006680/2, rc 0, transno 4294968823 00000100:00100000:1.0:1788201209.228429:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458198528:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201209.228540:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201209.228636:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201209.228764:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c52edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458205696:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.228798:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.228838:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458205696 00000100:00100000:2.0:1788201209.228845:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458205696 00000100:00100000:2.0:1788201209.228884:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4127 00000100:00100000:2.0:1788201209.228893:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+125:3310:x1875064458205696:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201209.228916:0:13444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:845 count 1 00010000:00010000:2.0:1788201209.228936:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d2de8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.228949:0:13444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d2ed2b84/0x9383f985bc4c0492 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1101 expref: 512 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.228957:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34d:0x0].0x0 since=39s v=(0 0) 00010000:00010000:2.0:1788201209.228961:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.228965:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d2de8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.229001:0:13444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d2ed2b84/0x9383f985bc4c0492 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1101 expref: 512 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.229012:0:13444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d2ed2b84/0x9383f985bc4c0492 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1101 expref: 512 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.229022:0:13444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c52efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13444:1875064458205824:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201209.229052:0:13444:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91d80 going to sleep for 11 seconds 00010000:00010000:0.0:1788201209.229449:0:13439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb412d5a/0x9383f985bc4c8746 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c3e7a expref: 512 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.229463:0:13439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c56f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:13439:1875064458201600:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.229479:0:13439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d2d6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.229488:0:13439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d2d6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.229499:0:13439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d2d6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.229508:0:13439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d2d6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.229515:0:13439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d2d6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.229533:0:13439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201209.229545:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201209.229550:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d2d6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.229559:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.229562:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d2d6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.229571:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d2d6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.229587:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d2d6a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.229594:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000853c0bb8/0x9383f985bc4d2d6a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.229607:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.229609:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.229611:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201209.229832:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+126:3311:x1875064458201472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 52234us (52339us total) trans 4294968824 rc 0/0 00000100:00100000:0.0:1788201209.229840:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4110 00000100:00100000:1.0:1788201209.230023:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442604928 00000100:00100000:1.0:1788201209.230030:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442604928 00010000:00010000:1.0:1788201209.230057:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000722dca70/0x9383f985bc4b8446 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be4b5 expref: 34 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.230080:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442605056 00000100:00100000:1.0:1788201209.230082:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442605056 00010000:00010000:1.0:1788201209.230097:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000073576740/0x9383f985bc4b8cb9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be7be expref: 35 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.230115:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442605184 00000100:00100000:1.0:1788201209.230118:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442605184 00010000:00010000:1.0:1788201209.230131:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000025c71411/0x9383f985bc4b9016 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be8d6 expref: 36 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.230150:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1496 00000100:00100000:1.0:1788201209.230158:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+36:2361:x1875064442604928:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201209.230170:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201209.230175:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000722dca70/0x9383f985bc4b8446 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be4b5 expref: 36 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.230188:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000722dca70/0x9383f985bc4b8446 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be4b5 expref: 36 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.230205:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000722dca70/0x9383f985bc4b8446 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be4b5 expref: 36 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.230216:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.230220:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.230225:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005f21f6f3/0x9383f985bc4d2d94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.230234:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f21f6f3/0x9383f985bc4d2d94 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.230488:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201209.230526:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+35:2361:x1875064442604928:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 369us (2411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.230534:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1496 00000100:00100000:1.0:1788201209.230552:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1497 00000100:00100000:1.0:1788201209.230562:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8104c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+34:2360:x1875064442605056:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201209.230571:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201209.230576:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000073576740/0x9383f985bc4b8cb9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be7be expref: 34 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.230586:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000073576740/0x9383f985bc4b8cb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be7be expref: 34 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.230599:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073576740/0x9383f985bc4b8cb9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be7be expref: 34 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.230608:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.230611:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.230615:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000032ae062a/0x9383f985bc4d2d9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.230622:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ae062a/0x9383f985bc4d2d9b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.230644:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201209.230662:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8104c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+33:2360:x1875064442605056:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 101us (2122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.230668:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1497 00000100:00100000:1.0:1788201209.230702:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1498 00000100:00100000:1.0:1788201209.230709:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+32:2360:x1875064442605184:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201209.230716:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201209.230721:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000025c71411/0x9383f985bc4b9016 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be8d6 expref: 32 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.230731:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000025c71411/0x9383f985bc4b9016 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be8d6 expref: 32 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.230743:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025c71411/0x9383f985bc4b9016 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be8d6 expref: 32 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.230753:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.230756:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.230761:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d2da2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.230769:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d2da2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.230789:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201209.230805:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+31:2360:x1875064442605184:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 96us (2168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.230811:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1498 00000004:00080000:3.0:1788201209.230925:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c24a2d80/2, rc 0, transno 4294968822 00000100:00100000:3.0:1788201209.230937:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c24a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458202368:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788201209.230951:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04cffafb80/2, rc 0, transno 4294968804 00000100:00100000:3.0:1788201209.230964:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458201088:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788201209.231443:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005f21f6f3/0x9383f985bc4d2d94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.231453:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f21f6f3/0x9383f985bc4d2d94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.231464:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f21f6f3/0x9383f985bc4d2d94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.231471:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f21f6f3/0x9383f985bc4d2d94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.231488:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788201209.231739:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+116:3310:x1875064458202624:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23819us (23941us total) trans 4294968805 rc 0/0 00000100:00100000:1.0:1788201209.231748:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4115 00010000:00010000:1.0:1788201209.231770:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201209.231777:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f21f6f3/0x9383f985bc4d2d94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.231785:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201209.231790:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f21f6f3/0x9383f985bc4d2d94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.231800:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f21f6f3/0x9383f985bc4d2d94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.231813:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f21f6f3/0x9383f985bc4d2d94 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.231820:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f21f6f3/0x9383f985bc4d2d94 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.231848:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201209.231850:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201209.231852:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788201209.232036:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c5484380/2, rc 0, transno 4294968805 00000100:00100000:3.0:1788201209.232054:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458202624:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201209.232061:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201209.232076:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458205952:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201209.232109:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788201209.232242:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f4e76680/2, rc 0, transno 4294968824 00000100:00100000:2.0:1788201209.232258:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f4e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458201472:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.232489:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201209.232497:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c52eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458206080:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.232523:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201209.232811:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201209.232822:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458206208:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201209.232850:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201209.233121:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458205952 00000100:00100000:1.0:1788201209.233128:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458205952 00000100:00100000:1.0:1788201209.233165:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458206080 00000100:00100000:1.0:1788201209.233168:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458206080 00000100:00100000:1.0:1788201209.233185:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458206208 00000100:00100000:1.0:1788201209.233188:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458206208 00000100:00100000:1.0:1788201209.233204:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4128 00000100:00100000:1.0:1788201209.233211:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c8237800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+117:3310:x1875064458205952:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788201209.233233:0:13441:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:814 count 1 00010000:00010000:1.0:1788201209.233265:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f1c741f/0x9383f985bc4d2def lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.233283:0:13441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000016f34eba/0x9383f985bc4bec74 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x32e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c08c6 expref: 30 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.233443:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32e:0x0].0x0 since=44s v=(0 0) 00010000:00010000:1.0:1788201209.233448:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.233453:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f1c741f/0x9383f985bc4d2def lrc: 4/0,1 mode: --/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.233480:0:13441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000016f34eba/0x9383f985bc4bec74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x32e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c08c6 expref: 30 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.233492:0:13441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000016f34eba/0x9383f985bc4bec74 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x32e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c08c6 expref: 30 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.233504:0:13441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:13441:1875064458206336:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201209.233558:0:13441:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c1377cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1788201209.233725:0:13447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000032ae062a/0x9383f985bc4d2d9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.233735:0:13447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ae062a/0x9383f985bc4d2d9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.233745:0:13447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ae062a/0x9383f985bc4d2d9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.233753:0:13447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ae062a/0x9383f985bc4d2d9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.233809:0:13447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201209.234041:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+118:3310:x1875064458202752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 25946us (26199us total) trans 4294968806 rc 0/0 00000100:00100000:0.0:1788201209.234050:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4116 00000100:00100000:0.0:1788201209.234070:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4129 00000100:00100000:0.0:1788201209.234078:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+126:3313:x1875064458206080:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201209.234091:0:13447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:974 count 1 00010000:00010000:0.0:1788201209.234106:0:13447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d2df6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.234119:0:13447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e26a693d/0x9383f985bc4c6b85 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c34a9 expref: 511 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.234126:0:13447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3ce:0x0].0x0 since=23s v=(0 0) 00010000:00010000:0.0:1788201209.234130:0:13447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.234134:0:13447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d2df6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.234152:0:13447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e26a693d/0x9383f985bc4c6b85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c34a9 expref: 511 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.234162:0:13447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e26a693d/0x9383f985bc4c6b85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c34a9 expref: 511 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.234174:0:13447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:13447:1875064458206464:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.234198:0:13447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5e40 going to sleep for 11 seconds 00010000:00010000:0.0:1788201209.234214:0:12363:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d2da2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.234223:0:12363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d2da2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.234232:0:12363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d2da2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.234240:0:12363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d2da2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201209.234416:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c5484000/2, rc 0, transno 4294968806 00000100:00100000:3.0:1788201209.234430:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458202752:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201209.234534:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4130 00000100:00100000:3.0:1788201209.234545:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c8237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+117:3312:x1875064458206208:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788201209.234559:0:13442:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:954 count 1 00010000:00010000:3.0:1788201209.234573:0:13442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009362eac0/0x9383f985bc4d2dfd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ba:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.234585:0:13442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4d5801f/0x9383f985bc4c5bda lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2f3f expref: 30 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.234591:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3ba:0x0].0x0 since=26s v=(0 0) 00010000:00010000:3.0:1788201209.234594:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.234598:0:13442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009362eac0/0x9383f985bc4d2dfd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.234617:0:13442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c4d5801f/0x9383f985bc4c5bda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2f3f expref: 30 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.234627:0:13442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c4d5801f/0x9383f985bc4c5bda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2f3f expref: 30 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.234642:0:13442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c8237100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:13442:1875064458206592:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201209.234674:0:13442:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2fd9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201209.234851:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458206720:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201209.234884:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201209.234956:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458206720 00000100:00100000:1.0:1788201209.234962:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458206720 00000100:00100000:1.0:1788201209.235006:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4131 00000100:00100000:1.0:1788201209.235014:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c8236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+118:3310:x1875064458206720:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788201209.235027:0:6705:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:766 count 1 00010000:00010000:1.0:1788201209.235040:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c13fcde/0x9383f985bc4d2e04 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.235051:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000938c0f1e/0x9383f985bc4bc610 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfb98 expref: 30 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.235062:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2fe:0x0].0x0 since=50s v=(0 0) 00010000:00010000:1.0:1788201209.235065:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.235069:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c13fcde/0x9383f985bc4d2e04 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.235089:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000938c0f1e/0x9383f985bc4bc610 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfb98 expref: 30 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.235099:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000938c0f1e/0x9383f985bc4bc610 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfb98 expref: 30 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.235108:0:6705:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1875064458206848:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201209.235137:0:6705:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d033ac00 going to sleep for 11 seconds 00010000:00010000:2.0:1788201209.235228:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201209.235235:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ae062a/0x9383f985bc4d2d9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.235243:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.235258:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ae062a/0x9383f985bc4d2d9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.235268:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ae062a/0x9383f985bc4d2d9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.235288:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ae062a/0x9383f985bc4d2d9b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.235452:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ae062a/0x9383f985bc4d2d9b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.235476:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201209.235480:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d2da2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.235486:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.235488:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d2da2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.235496:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d2da2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.235507:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d2da2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.235513:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.235515:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.235517:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201209.235961:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201209.236036:0:13448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5476d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:13448:1875064458204160:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.236055:0:13448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001710cf90/0x9383f985bc4d2db7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.236160:0:13443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5476a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13443:1875064458204288:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.236173:0:13443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d2dbe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.236221:0:6706:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5477480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1875064458204544:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.236234:0:6706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2dc5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.236453:0:13445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5477100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13445:1875064458203776:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201209.236467:0:13445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000035e7898d/0x9383f985bc4d2db0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.236545:0:13450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c52ec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:13450:1875064458205056:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.236559:0:13450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003bf3c8de/0x9383f985bc4d2dcc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x402:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.236581:0:6703:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c52eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6703:1875064458205184:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.236590:0:6703:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d2dd3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.236611:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442605312 00000100:00100000:2.0:1788201209.236616:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442605312 00010000:00010000:2.0:1788201209.236641:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000088f01a06/0x9383f985bc4bb833 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf6c8 expref: 512 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.236669:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1499 00000100:00100000:2.0:1788201209.236676:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+512:2360:x1875064442605312:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201209.236688:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201209.236693:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000088f01a06/0x9383f985bc4bb833 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf6c8 expref: 512 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.236704:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000088f01a06/0x9383f985bc4bb833 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf6c8 expref: 512 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.236722:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088f01a06/0x9383f985bc4bb833 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bf6c8 expref: 512 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.236735:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.236739:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201209.236744:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000035e7898d/0x9383f985bc4d2db0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.236753:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035e7898d/0x9383f985bc4d2db0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.236774:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201209.236788:0:13445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000035e7898d/0x9383f985bc4d2db0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.236796:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035e7898d/0x9383f985bc4d2db0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.236805:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035e7898d/0x9383f985bc4d2db0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.236814:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035e7898d/0x9383f985bc4d2db0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.236830:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201209.237076:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+127:3310:x1875064458203648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21043us (21878us total) trans 4294968825 rc 0/0 00000100:00100000:2.0:1788201209.237084:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4119 00000004:00080000:2.0:1788201209.237122:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c548c380/2, rc 0, transno 4294968825 00000100:00100000:2.0:1788201209.237127:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c548c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458203648:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201209.237166:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2360:x1875064442605312:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 489us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.237173:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1499 00010000:00010000:0.0:1788201209.237605:0:12363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201209.237612:0:12363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d2da2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.237854:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201209.237861:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035e7898d/0x9383f985bc4d2db0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.237870:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.237874:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035e7898d/0x9383f985bc4d2db0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.237883:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035e7898d/0x9383f985bc4d2db0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.237897:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035e7898d/0x9383f985bc4d2db0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.237905:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035e7898d/0x9383f985bc4d2db0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.237919:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.237921:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.237922:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201209.237958:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+119:3312:x1875064458203136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 28685us (28761us total) trans 4294968807 rc 0/0 00000100:00100000:0.0:1788201209.237966:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4117 00010000:00010000:0.0:1788201209.237995:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201209.238079:0:13440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c548f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:13440:1875064458203520:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201209.238096:0:13440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c576e396/0x9383f985bc4d2da9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201209.238146:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c5487b80/2, rc 0, transno 4294968807 00000100:00100000:3.0:1788201209.238508:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458203136:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.238761:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201209.238777:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c24a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458206976:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.238819:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201209.238886:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458206976 00000100:00100000:1.0:1788201209.238893:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458206976 00000100:00100000:1.0:1788201209.238934:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4132 00000100:00100000:1.0:1788201209.238943:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f965d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+119:3310:x1875064458206976:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788201209.238965:0:13439:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1045 count 1 00010000:00010000:1.0:1788201209.238994:0:13439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d2e0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x415:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.239010:0:13439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb0ee057/0x9383f985bc4ca450 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x415:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c488a expref: 30 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.239018:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x415:0x0].0x0 since=15s v=(0 0) 00010000:00010000:1.0:1788201209.239022:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x415:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.239026:0:13439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d2e0b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x415:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.239052:0:13439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eb0ee057/0x9383f985bc4ca450 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x415:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c488a expref: 30 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.239064:0:13439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eb0ee057/0x9383f985bc4ca450 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x415:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c488a expref: 30 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.239076:0:13439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c24a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:13439:1875064458207104:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201209.239126:0:13439:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d89e1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201209.245573:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201209.245688:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201209.245770:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201209.249520:0:13526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442605440 00000100:00100000:1.0:1788201209.249535:0:13526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442605440 00010000:00010000:1.0:1788201209.249596:0:13526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000073d83354/0x9383f985bc4b8a58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be6ec expref: 31 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.249845:0:13526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442605696 00000100:00100000:1.0:1788201209.249850:0:13526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442605696 00010000:00010000:1.0:1788201209.249870:0:13526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000086046c3e/0x9383f985bc4b50ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x26b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd2ef expref: 511 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.253645:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442605952 00000100:00100000:3.0:1788201209.253661:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442605952 00010000:00010000:3.0:1788201209.253705:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003371969b/0x9383f985bc4c9523 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x402:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c434a expref: 32 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.253740:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1500 00000100:00100000:3.0:1788201209.253750:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+32:2362:x1875064442605440:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.253765:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.253770:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000073d83354/0x9383f985bc4b8a58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be6ec expref: 32 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.253785:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000073d83354/0x9383f985bc4b8a58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be6ec expref: 32 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.253808:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073d83354/0x9383f985bc4b8a58 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be6ec expref: 32 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.253824:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.253829:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.253835:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c576e396/0x9383f985bc4d2da9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.253847:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c576e396/0x9383f985bc4d2da9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.253882:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.253940:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+31:2362:x1875064442605440:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 191us (8377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.253947:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1500 00000100:00100000:3.0:1788201209.253966:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1501 00000100:00100000:3.0:1788201209.253974:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2362:x1875064442605696:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.253995:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.254002:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000086046c3e/0x9383f985bc4b50ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x26b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd2ef expref: 511 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.254012:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000086046c3e/0x9383f985bc4b50ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x26b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd2ef expref: 511 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.254033:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086046c3e/0x9383f985bc4b50ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x26b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd2ef expref: 511 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.254044:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.254047:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.254051:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d2dbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.254059:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d2dbe lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x26b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.254081:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.254103:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+510:2362:x1875064442605696:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 130us (8415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.254110:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1501 00000100:00100000:3.0:1788201209.254125:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1502 00000100:00100000:3.0:1788201209.254132:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+30:2362:x1875064442605952:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.254140:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.254144:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003371969b/0x9383f985bc4c9523 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x402:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c434a expref: 30 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.254154:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003371969b/0x9383f985bc4c9523 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x402:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c434a expref: 30 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.254172:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003371969b/0x9383f985bc4c9523 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x402:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c434a expref: 30 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.254181:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x402:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.254184:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x402:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.254189:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003bf3c8de/0x9383f985bc4d2dcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x402:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.254195:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bf3c8de/0x9383f985bc4d2dcc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x402:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.254212:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.254230:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+29:2362:x1875064442605952:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 99us (8461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.254236:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1502 00000100:00100000:3.0:1788201209.256477:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201209.256536:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201209.256556:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201209.256691:0:13446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c8235c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:13446:1875064458205312:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201209.256714:0:13446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ea26b3fb/0x9383f985bc4d2dda lrc: 3/0,1 mode: --/PW res: [0x280000400:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.256737:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442605568 00000100:00100000:3.0:1788201209.256742:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442605568 00010000:00010000:3.0:1788201209.256771:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009757d476/0x9383f985bc4b2716 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc47f expref: 510 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.256792:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442605824 00000100:00100000:3.0:1788201209.256795:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442605824 00010000:00010000:3.0:1788201209.256807:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000065554486/0x9383f985bc4b2962 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc574 expref: 511 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.256819:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442606080 00000100:00100000:3.0:1788201209.256822:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442606080 00010000:00010000:3.0:1788201209.256834:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000010999ceb/0x9383f985bc4c3b1f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c23f4 expref: 29 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.256848:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1503 00000100:00100000:3.0:1788201209.256856:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c8236680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2362:x1875064442605568:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.256869:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.256873:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009757d476/0x9383f985bc4b2716 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc47f expref: 511 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.256882:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009757d476/0x9383f985bc4b2716 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x237:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc47f expref: 511 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.256897:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009757d476/0x9383f985bc4b2716 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x237:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc47f expref: 511 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.256909:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x237:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.256912:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x237:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.256916:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001710cf90/0x9383f985bc4d2db7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.256923:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001710cf90/0x9383f985bc4d2db7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.256939:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.256976:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c8236680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+510:2362:x1875064442605568:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 121us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.256982:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1503 00000100:00100000:3.0:1788201209.257011:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1504 00000100:00100000:3.0:1788201209.257017:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c7e16850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2362:x1875064442605824:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.257024:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.257029:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000065554486/0x9383f985bc4b2962 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x23a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc574 expref: 509 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.257039:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000065554486/0x9383f985bc4b2962 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x23a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc574 expref: 509 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.257048:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065554486/0x9383f985bc4b2962 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x23a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc574 expref: 509 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.257055:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.257057:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.257060:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2dc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.257069:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2dc5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.257081:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.257095:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c7e16850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2362:x1875064442605824:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 79us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.257101:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1504 00000100:00100000:3.0:1788201209.257137:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1505 00000100:00100000:3.0:1788201209.257143:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c8234000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+29:2362:x1875064442606080:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.257151:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.257156:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000010999ceb/0x9383f985bc4c3b1f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c23f4 expref: 29 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.257165:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000010999ceb/0x9383f985bc4c3b1f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c23f4 expref: 29 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.257179:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010999ceb/0x9383f985bc4c3b1f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c23f4 expref: 29 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.257190:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x391:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.257192:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x391:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.257196:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d2dd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.257209:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d2dd3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.257225:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.257242:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c8234000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:2362:x1875064442606080:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 99us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.257262:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1505 00000100:00100000:3.0:1788201209.257451:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201209.257511:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201209.257525:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201209.257579:0:13442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c8237100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:13442:1875064458206592:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201209.257595:0:13442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009362eac0/0x9383f985bc4d2dfd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.257611:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442606336 00000100:00100000:3.0:1788201209.257615:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442606336 00010000:00010000:3.0:1788201209.257630:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008e24ad2a/0x9383f985bc4bfbf5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0e22 expref: 508 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.257645:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442606208 00000100:00100000:3.0:1788201209.257648:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442606208 00010000:00010000:3.0:1788201209.257658:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001f607d4e/0x9383f985bc4b4117 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcd8c expref: 28 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.257669:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442606464 00000100:00100000:3.0:1788201209.257672:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442606464 00010000:00010000:3.0:1788201209.257683:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d2ed2b84/0x9383f985bc4c0492 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1101 expref: 509 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.257692:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1506 00000100:00100000:3.0:1788201209.257696:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c8236680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2361:x1875064442606336:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.257701:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.257704:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008e24ad2a/0x9383f985bc4bfbf5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x342:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0e22 expref: 509 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.257710:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008e24ad2a/0x9383f985bc4bfbf5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x342:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0e22 expref: 509 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.257719:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x342:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.257721:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x342:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.257723:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004fe5b943/0x9383f985bc4d2de1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x342:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.257728:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fe5b943/0x9383f985bc4d2de1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x342:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.257736:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.257750:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c8236680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2361:x1875064442606336:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 53us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.257756:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1506 00000100:00100000:3.0:1788201209.257768:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1507 00000100:00100000:3.0:1788201209.257774:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c8235c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:2361:x1875064442606208:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.257782:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.257786:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001f607d4e/0x9383f985bc4b4117 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x257:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcd8c expref: 28 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.257795:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001f607d4e/0x9383f985bc4b4117 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x257:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcd8c expref: 28 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.257809:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f607d4e/0x9383f985bc4b4117 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x257:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bcd8c expref: 28 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.257820:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x257:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.257822:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x257:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.257826:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea26b3fb/0x9383f985bc4d2dda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.257833:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea26b3fb/0x9383f985bc4d2dda lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.257849:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.257866:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c8235c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:2361:x1875064442606208:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 93us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.257871:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1507 00000100:00100000:3.0:1788201209.257880:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1508 00000100:00100000:3.0:1788201209.257884:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff057800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2361:x1875064442606464:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.257890:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.257893:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d2ed2b84/0x9383f985bc4c0492 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1101 expref: 508 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.257900:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d2ed2b84/0x9383f985bc4c0492 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1101 expref: 508 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.257908:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.257910:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.257913:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d2de8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.257917:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d2de8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.257923:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.257933:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff057800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2361:x1875064442606464:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 49us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.257936:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1508 00010000:00010000:3.0:1788201209.257948:0:13446:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ea26b3fb/0x9383f985bc4d2dda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.257954:0:13446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea26b3fb/0x9383f985bc4d2dda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.257963:0:13446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea26b3fb/0x9383f985bc4d2dda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.257970:0:13446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea26b3fb/0x9383f985bc4d2dda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.257998:0:13446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201209.258235:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+120:3310:x1875064458204800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 33186us (33627us total) trans 4294968808 rc 0/0 00000100:00100000:3.0:1788201209.258243:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4125 00000100:00100000:3.0:1788201209.258404:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201209.258470:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201209.258489:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201209.258504:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201209.258538:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201209.258553:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442606592 00000100:00100000:3.0:1788201209.258557:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442606592 00010000:00010000:3.0:1788201209.258574:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000016f34eba/0x9383f985bc4bec74 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x32e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c08c6 expref: 27 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.258591:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442606848 00000100:00100000:3.0:1788201209.258594:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442606848 00010000:00010000:3.0:1788201209.258605:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c4d5801f/0x9383f985bc4c5bda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2f3f expref: 28 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.258616:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442607104 00000100:00100000:3.0:1788201209.258618:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442607104 00010000:00010000:3.0:1788201209.258628:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eb0ee057/0x9383f985bc4ca450 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x415:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c488a expref: 29 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.258645:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442606720 00000100:00100000:3.0:1788201209.258647:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442606720 00010000:00010000:3.0:1788201209.258659:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e26a693d/0x9383f985bc4c6b85 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c34a9 expref: 508 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.258671:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442606976 00000100:00100000:3.0:1788201209.258673:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442606976 00010000:00010000:3.0:1788201209.258683:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000938c0f1e/0x9383f985bc4bc610 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfb98 expref: 30 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.258697:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1509 00000100:00100000:3.0:1788201209.258703:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff055880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+30:2361:x1875064442606592:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.258711:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.258715:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000016f34eba/0x9383f985bc4bec74 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x32e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c08c6 expref: 30 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.258725:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000016f34eba/0x9383f985bc4bec74 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x32e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c08c6 expref: 30 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.258737:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.258740:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.258744:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007f1c741f/0x9383f985bc4d2def lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.258752:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f1c741f/0x9383f985bc4d2def lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.258766:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.258795:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff055880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+30:2361:x1875064442606592:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 91us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.258801:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1509 00000100:00100000:3.0:1788201209.258814:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1510 00000100:00100000:3.0:1788201209.258820:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff054000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+29:2361:x1875064442606848:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.258828:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.258832:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c4d5801f/0x9383f985bc4c5bda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2f3f expref: 29 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.258843:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c4d5801f/0x9383f985bc4c5bda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2f3f expref: 29 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.258855:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4d5801f/0x9383f985bc4c5bda lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2f3f expref: 29 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.258866:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.258869:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.258873:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009362eac0/0x9383f985bc4d2dfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.258879:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009362eac0/0x9383f985bc4d2dfd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.258900:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201209.258913:0:13442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009362eac0/0x9383f985bc4d2dfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.258921:0:13442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009362eac0/0x9383f985bc4d2dfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.258928:0:13442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009362eac0/0x9383f985bc4d2dfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.258935:0:13442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009362eac0/0x9383f985bc4d2dfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.258949:0:13442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788201209.259131:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c8237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+120:3312:x1875064458206208:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24589us (26280us total) trans 4294968809 rc 0/0 00000100:00100000:3.0:1788201209.259138:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4130 00000100:00100000:3.0:1788201209.259170:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff054000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:2361:x1875064442606848:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 350us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.259176:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1510 00000100:00100000:3.0:1788201209.259188:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1511 00000100:00100000:3.0:1788201209.259195:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c7e15050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:2361:x1875064442607104:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.259205:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.259211:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eb0ee057/0x9383f985bc4ca450 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x415:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c488a expref: 27 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.259221:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eb0ee057/0x9383f985bc4ca450 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x415:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c488a expref: 27 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.259234:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x415:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.259237:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x415:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.259241:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d2e0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x415:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.259249:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d2e0b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x415:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.259260:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.259277:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c7e15050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:2361:x1875064442607104:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 83us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.259282:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1511 00000100:00100000:3.0:1788201209.259390:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1512 00000100:00100000:3.0:1788201209.259398:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff057b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2361:x1875064442606720:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.259406:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.259411:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e26a693d/0x9383f985bc4c6b85 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c34a9 expref: 508 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.259421:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e26a693d/0x9383f985bc4c6b85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c34a9 expref: 508 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.259437:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.259440:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.259444:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d2df6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.259451:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d2df6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.259462:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.259480:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff057b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2361:x1875064442606720:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 83us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.259486:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1512 00000100:00100000:3.0:1788201209.259498:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1513 00000100:00100000:3.0:1788201209.259504:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff054a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:2361:x1875064442606976:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201209.259512:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201209.259517:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000938c0f1e/0x9383f985bc4bc610 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfb98 expref: 26 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.259527:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000938c0f1e/0x9383f985bc4bc610 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfb98 expref: 26 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.259538:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.259541:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201209.259545:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007c13fcde/0x9383f985bc4d2e04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.259553:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c13fcde/0x9383f985bc4d2e04 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.259565:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201209.259583:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff054a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:2361:x1875064442606976:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 79us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.259589:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1513 00010000:00010000:0.0:1788201209.261776:0:13447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e26a693d/0x9383f985bc4c6b85 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c34a9 expref: 507 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.261799:0:13447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:13447:1875064458206464:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.261822:0:13447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d2df6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.261833:0:13447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d2df6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.261847:0:13447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d2df6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.261857:0:13447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d2df6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.261865:0:13447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d2df6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.261890:0:13447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1788201209.262188:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+127:3313:x1875064458206080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 28110us (29662us total) trans 4294968826 rc 0/0 00000100:00100000:0.0:1788201209.262197:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4129 00000004:00080000:0.0:1788201209.262249:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00dd500/2, rc 0, transno 4294968808 00000100:00100000:0.0:1788201209.262277:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458204800:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788201209.262333:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c3449880/2, rc 0, transno 4294968809 00000100:00100000:0.0:1788201209.262338:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458206208:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788201209.262351:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201209.262357:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea26b3fb/0x9383f985bc4d2dda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.262366:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.262371:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea26b3fb/0x9383f985bc4d2dda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.262386:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea26b3fb/0x9383f985bc4d2dda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.262403:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea26b3fb/0x9383f985bc4d2dda lrc: 1/0,0 mode: --/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.262411:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea26b3fb/0x9383f985bc4d2dda lrc: 0/0,0 mode: --/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.262428:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201209.262433:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009362eac0/0x9383f985bc4d2dfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.262438:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.262441:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009362eac0/0x9383f985bc4d2dfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.262448:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009362eac0/0x9383f985bc4d2dfd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.262458:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009362eac0/0x9383f985bc4d2dfd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.262465:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009362eac0/0x9383f985bc4d2dfd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.262484:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201209.262487:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d2df6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.262494:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.262497:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d2df6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.262504:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d2df6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.262512:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d2df6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.262519:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffa13277/0x9383f985bc4d2df6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.262531:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.262533:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.262535:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201209.262600:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458207232:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.262633:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201209.262658:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201209.262663:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458207360:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.262680:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201209.262705:0:13451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458207232 00000100:00100000:0.0:1788201209.262711:0:13451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458207232 00000100:00100000:0.0:1788201209.262740:0:13451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458207360 00000100:00100000:0.0:1788201209.262743:0:13451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458207360 00000100:00100000:0.0:1788201209.262763:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4133 00000100:00100000:0.0:1788201209.262771:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+121:3312:x1875064458207232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201209.262793:0:12363:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1029 count 1 00010000:00010000:0.0:1788201209.262811:0:12363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000853c0bb8/0x9383f985bc4d2e12 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x405:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.262826:0:12363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000062695f6b/0x9383f985bc4c9799 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x405:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4415 expref: 25 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.262834:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x405:0x0].0x0 since=17s v=(0 0) 00010000:00010000:0.0:1788201209.262838:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x405:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.262842:0:12363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000853c0bb8/0x9383f985bc4d2e12 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x405:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.262864:0:12363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000062695f6b/0x9383f985bc4c9799 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x405:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4415 expref: 25 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.262877:0:12363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000062695f6b/0x9383f985bc4c9799 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x405:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4415 expref: 25 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.262889:0:12363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12363:1875064458207488:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.262939:0:12363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201209.262951:0:13451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4134 00000100:00100000:0.0:1788201209.262958:0:13451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+121:3312:x1875064458207360:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201209.262969:0:13451:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:811 count 1 00010000:00010000:0.0:1788201209.262980:0:13451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092295f0a/0x9383f985bc4d2e19 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.263001:0:13451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c77ff27f/0x9383f985bc4be9fe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x32b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c07f4 expref: 25 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.263008:0:13451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32b:0x0].0x0 since=44s v=(0 0) 00010000:00010000:0.0:1788201209.263011:0:13451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.263015:0:13451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092295f0a/0x9383f985bc4d2e19 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x32b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.263031:0:13451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c77ff27f/0x9383f985bc4be9fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x32b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c07f4 expref: 25 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.263041:0:13451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c77ff27f/0x9383f985bc4be9fe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x32b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c07f4 expref: 25 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.263051:0:13451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:13451:1875064458207616:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201209.263069:0:13451:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5000 going to sleep for 11 seconds 00010000:00010000:1.0:1788201209.263387:0:13440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c576e396/0x9383f985bc4d2da9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.263398:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c576e396/0x9383f985bc4d2da9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.263407:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c576e396/0x9383f985bc4d2da9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.263414:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c576e396/0x9383f985bc4d2da9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.263431:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788201209.263631:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+122:3313:x1875064458203392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 49199us (49415us total) trans 4294968810 rc 0/0 00000100:00100000:1.0:1788201209.263639:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4118 00010000:00010000:1.0:1788201209.263682:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000938c0f1e/0x9383f985bc4bc610 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfb98 expref: 25 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.263694:0:6705:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1875064458206848:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201209.263711:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007c13fcde/0x9383f985bc4d2e04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.263719:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007c13fcde/0x9383f985bc4d2e04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.263729:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c13fcde/0x9383f985bc4d2e04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.263737:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c13fcde/0x9383f985bc4d2e04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.263743:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c13fcde/0x9383f985bc4d2e04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.263751:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788201209.263877:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c8236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+122:3310:x1875064458206720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 28863us (28991us total) trans 4294968811 rc 0/0 00000100:00100000:1.0:1788201209.263884:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4131 00010000:00010000:1.0:1788201209.263913:0:13441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016f34eba/0x9383f985bc4bec74 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x32e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c08c6 expref: 24 pid: 6705 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.263924:0:13441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:13441:1875064458206336:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201209.263936:0:13441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007f1c741f/0x9383f985bc4d2def lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.263944:0:13441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007f1c741f/0x9383f985bc4d2def lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.263950:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f1c741f/0x9383f985bc4d2def lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.263959:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f1c741f/0x9383f985bc4d2def lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.263966:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f1c741f/0x9383f985bc4d2def lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.263975:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1788201209.264087:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c8237800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+122:3310:x1875064458205952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 30876us (31977us total) trans 4294968812 rc 0/0 00000100:00100000:1.0:1788201209.264093:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4128 00010000:00010000:1.0:1788201209.264122:0:13439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb0ee057/0x9383f985bc4ca450 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x415:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c488a expref: 23 pid: 12363 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.264133:0:13439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c24a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:13439:1875064458207104:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201209.264145:0:13439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d2e0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x415:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.264153:0:13439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d2e0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x415:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.264159:0:13439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d2e0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x415:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.264168:0:13439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d2e0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x415:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.264176:0:13439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d2e0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x415:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.264184:0:13439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1788201209.265739:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f965d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+122:3310:x1875064458206976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 26794us (26916us total) trans 4294968813 rc 0/0 00000100:00100000:1.0:1788201209.265749:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4132 00010000:00010000:0.0:1788201209.266198:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788201209.266207:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c576e396/0x9383f985bc4d2da9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.266218:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.266223:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c576e396/0x9383f985bc4d2da9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.266233:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c576e396/0x9383f985bc4d2da9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.266262:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c576e396/0x9383f985bc4d2da9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.266270:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c576e396/0x9383f985bc4d2da9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.266381:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201209.266386:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c13fcde/0x9383f985bc4d2e04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.266393:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.266396:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c13fcde/0x9383f985bc4d2e04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.266404:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c13fcde/0x9383f985bc4d2e04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.266414:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c13fcde/0x9383f985bc4d2e04 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.266421:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c13fcde/0x9383f985bc4d2e04 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.266434:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201209.266437:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f1c741f/0x9383f985bc4d2def lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.266443:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.266446:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f1c741f/0x9383f985bc4d2def lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.266453:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f1c741f/0x9383f985bc4d2def lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.266461:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f1c741f/0x9383f985bc4d2def lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.266468:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f1c741f/0x9383f985bc4d2def lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.266477:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201209.266481:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d2e0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x415:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.266487:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.266489:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d2e0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x415:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.266501:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d2e0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x415:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.266509:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d2e0b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x415:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.266516:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d2e0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x415:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.266536:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.266538:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.266540:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788201209.266577:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c24a3800/2, rc 0, transno 4294968813 00000100:00100000:0.0:1788201209.266596:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c24a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458206976:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788201209.266607:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c3448700/2, rc 0, transno 4294968811 00000100:00100000:0.0:1788201209.266611:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458206720:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788201209.266620:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c3448000/2, rc 0, transno 4294968812 00000100:00100000:0.0:1788201209.266624:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458205952:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788201209.267693:0:13443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d2dbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.267709:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d2dbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.267720:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d2dbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.267729:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d2dbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.267756:0:13443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201209.268030:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+127:3313:x1875064458204032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 45589us (47997us total) trans 4294968827 rc 0/0 00000100:00100000:2.0:1788201209.268039:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4121 00010000:00010000:2.0:1788201209.268091:0:10484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e24ad2a/0x9383f985bc4bfbf5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x342:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c0e22 expref: 506 pid: 6703 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.268106:0:10484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c52ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10484:1875064458205568:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.268126:0:10484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004fe5b943/0x9383f985bc4d2de1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.268136:0:10484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004fe5b943/0x9383f985bc4d2de1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.268143:0:10484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fe5b943/0x9383f985bc4d2de1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.268151:0:10484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fe5b943/0x9383f985bc4d2de1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.268158:0:10484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fe5b943/0x9383f985bc4d2de1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.268166:0:10484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788201209.268687:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201209.268695:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d2dbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.268703:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201209.268708:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d2dbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.268716:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d2dbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.268733:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d2dbe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.268739:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d2dbe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.268758:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201209.268762:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fe5b943/0x9383f985bc4d2de1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.268767:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201209.268769:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fe5b943/0x9383f985bc4d2de1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.268775:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fe5b943/0x9383f985bc4d2de1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.268783:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fe5b943/0x9383f985bc4d2de1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.268789:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fe5b943/0x9383f985bc4d2de1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.268800:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201209.268802:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201209.268803:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201209.268879:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c24a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458207744:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.268929:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788201209.269152:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c52eea00/2, rc 0, transno 4294968826 00000100:00100000:3.0:1788201209.269159:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c52eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458206080:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788201209.269170:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00df480/2, rc 0, transno 4294968827 00000100:00100000:3.0:1788201209.269173:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458204032:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788201209.269184:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c548fb80/2, rc 0, transno 4294968810 00000100:00100000:3.0:1788201209.269191:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c548fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458203392:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201209.269461:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458207744 00000100:00100000:1.0:1788201209.269468:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458207744 00000100:00100000:1.0:1788201209.269514:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4135 00000100:00100000:1.0:1788201209.269522:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+122:3310:x1875064458207744:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788201209.269549:0:13449:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:951 count 1 00010000:00010000:1.0:1788201209.269572:0:13449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d2e20 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3b7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.269590:0:13449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4dea086/0x9383f985bc4c5964 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2e6d expref: 22 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.269598:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b7:0x0].0x0 since=27s v=(0 0) 00010000:00010000:1.0:1788201209.269603:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201209.269607:0:13449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d2e20 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.269640:0:13449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b4dea086/0x9383f985bc4c5964 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2e6d expref: 22 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.269653:0:13449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b4dea086/0x9383f985bc4c5964 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2e6d expref: 22 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201209.269667:0:13449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c24a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:13449:1875064458207872:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201209.269740:0:13449:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d89e1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201209.269909:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+127:3312:x1875064458205440:12345-0@lo:6:osp-syn-0-0.0 Request processed in 43125us (43241us total) trans 4294968828 rc 0/0 00000100:00100000:2.0:1788201209.269917:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4126 00000004:00080000:2.0:1788201209.269952:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c52ed180/2, rc 0, transno 4294968828 00000100:00100000:2.0:1788201209.269956:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c52ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458205440:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788201209.269969:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.269976:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.270005:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2ed2b84/0x9383f985bc4c0492 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1101 expref: 505 pid: 10484 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201209.270018:0:13444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c52efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13444:1875064458205824:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201209.270035:0:13444:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d2de8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.270045:0:13444:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d2de8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.270051:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d2de8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.270060:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d2de8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.270067:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d2de8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.270082:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201209.272593:0:13448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001710cf90/0x9383f985bc4d2db7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.272614:0:13448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001710cf90/0x9383f985bc4d2db7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.272626:0:13448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001710cf90/0x9383f985bc4d2db7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.272634:0:13448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001710cf90/0x9383f985bc4d2db7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201209.272661:0:13448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:1.0:1788201209.273548:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c52edc00/2, rc 0, transno 4294968829 00000100:00100000:1.0:1788201209.273562:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c52edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458205696:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788201209.273584:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201209.273592:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d2de8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.273603:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bdc00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201209.273607:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d2de8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.273618:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d2de8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.273639:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d2de8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.273646:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d2de8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.273669:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201209.273673:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001710cf90/0x9383f985bc4d2db7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.273679:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201209.273682:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001710cf90/0x9383f985bc4d2db7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.273690:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001710cf90/0x9383f985bc4d2db7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.273699:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001710cf90/0x9383f985bc4d2db7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.273705:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001710cf90/0x9383f985bc4d2db7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.273718:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201209.273720:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201209.273722:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201209.273744:0:6703:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d2dd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.273753:0:6703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d2dd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.273762:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d2dd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.273770:0:6703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d2dd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201209.273788:0:6703:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201209.276423:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2dc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.276443:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2dc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.276454:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2dc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.276462:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2dc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.276484:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788201209.276498:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201209.276504:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d2dd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.276512:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.276516:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d2dd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.276525:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d2dd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.276544:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d2dd3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.276552:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d2dd3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.276588:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201209.276592:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2dc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.276600:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.276603:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2dc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.276612:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2dc5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.276624:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2dc5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.276630:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c24951c2/0x9383f985bc4d2dc5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.276644:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.276646:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.276648:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201209.276938:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5475500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+129:3313:x1875064458204416:12345-0@lo:6:osp-syn-0-0.0 Request processed in 53599us (53679us total) trans 4294968831 rc 0/0 00000100:00100000:0.0:1788201209.276948:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4122 00000004:00080000:0.0:1788201209.277023:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c5475f80/2, rc 0, transno 4294968831 00000100:00100000:0.0:1788201209.277029:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458204416:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788201209.277054:0:13450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003bf3c8de/0x9383f985bc4d2dcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x402:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.277069:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bf3c8de/0x9383f985bc4d2dcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x402:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.277078:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bf3c8de/0x9383f985bc4d2dcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x402:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.277085:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bf3c8de/0x9383f985bc4d2dcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x402:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.277099:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201209.277108:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201209.277111:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bf3c8de/0x9383f985bc4d2dcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x402:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.277118:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.277122:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bf3c8de/0x9383f985bc4d2dcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x402:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.277129:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bf3c8de/0x9383f985bc4d2dcc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x402:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.277140:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bf3c8de/0x9383f985bc4d2dcc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x402:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.277148:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bf3c8de/0x9383f985bc4d2dcc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x402:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.277162:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.277165:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.277166:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201209.277606:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5475c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+124:3313:x1875064458204928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 52920us (53085us total) trans 4294968815 rc 0/0 00000100:00100000:0.0:1788201209.277615:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4123 00000004:00080000:0.0:1788201209.277648:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04cffaca80/2, rc 0, transno 4294968815 00000100:00100000:0.0:1788201209.277660:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458204928:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201209.277737:0:13449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c24a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:13449:1875064458207872:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.277760:0:13449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d2e20 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.277810:0:12363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12363:1875064458207488:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.277822:0:12363:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000853c0bb8/0x9383f985bc4d2e12 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x405:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.277868:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201209.277892:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201209.277919:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201209.284500:0:13451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:13451:1875064458207616:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201209.284551:0:13451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000092295f0a/0x9383f985bc4d2e19 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.284614:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442607360 00000100:00100000:0.0:1788201209.284622:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442607360 00010000:00010000:0.0:1788201209.284665:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000062695f6b/0x9383f985bc4c9799 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x405:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4415 expref: 23 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.284706:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442607232 00000100:00100000:0.0:1788201209.284710:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442607232 00010000:00010000:0.0:1788201209.284726:0:7646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b4dea086/0x9383f985bc4c5964 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2e6d expref: 24 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.284744:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442607488 00000100:00100000:0.0:1788201209.284747:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442607488 00010000:00010000:0.0:1788201209.284759:0:7646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c77ff27f/0x9383f985bc4be9fe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x32b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c07f4 expref: 25 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201209.284784:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1514 00000100:00100000:0.0:1788201209.284793:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+25:2361:x1875064442607360:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201209.284808:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201209.284816:0:7646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000062695f6b/0x9383f985bc4c9799 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x405:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4415 expref: 25 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.284828:0:7646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000062695f6b/0x9383f985bc4c9799 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x405:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4415 expref: 25 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.284851:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062695f6b/0x9383f985bc4c9799 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x405:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4415 expref: 25 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.284868:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x405:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.284873:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x405:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.284879:0:7646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000853c0bb8/0x9383f985bc4d2e12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x405:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.284889:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000853c0bb8/0x9383f985bc4d2e12 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x405:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.284912:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201209.284970:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:2361:x1875064442607360:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 178us (7102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201209.284977:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1514 00000100:00100000:0.0:1788201209.285009:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1515 00000100:00100000:0.0:1788201209.285016:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:2361:x1875064442607232:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201209.285024:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201209.285029:0:7646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b4dea086/0x9383f985bc4c5964 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2e6d expref: 23 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.285039:0:7646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b4dea086/0x9383f985bc4c5964 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2e6d expref: 23 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.285053:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4dea086/0x9383f985bc4c5964 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2e6d expref: 23 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.285068:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.285071:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.285076:0:7646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d2e20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.285083:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d2e20 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.285101:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201209.285120:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:2361:x1875064442607232:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 104us (7226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201209.285127:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1515 00000100:00100000:0.0:1788201209.285140:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1516 00000100:00100000:0.0:1788201209.285146:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:2361:x1875064442607488:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201209.285154:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201209.285159:0:7646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c77ff27f/0x9383f985bc4be9fe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x32b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c07f4 expref: 21 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.285169:0:7646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c77ff27f/0x9383f985bc4be9fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x32b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c07f4 expref: 21 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.285181:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c77ff27f/0x9383f985bc4be9fe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x32b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c07f4 expref: 21 pid: 6706 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.285195:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.285198:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201209.285202:0:7646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000092295f0a/0x9383f985bc4d2e19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.285210:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092295f0a/0x9383f985bc4d2e19 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x32b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.285226:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201209.285695:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+128:3310:x1875064458205696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 56799us (56892us total) trans 4294968829 rc 0/0 00000100:00100000:2.0:1788201209.285705:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4127 00010000:00010000:2.0:1788201209.285831:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.285838:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201209.286225:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:2361:x1875064442607488:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 99us (7325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201209.286235:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1516 00010000:00010000:0.0:1788201209.286272:0:12363:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000853c0bb8/0x9383f985bc4d2e12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x405:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.286282:0:12363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000853c0bb8/0x9383f985bc4d2e12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x405:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.286545:0:12363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000853c0bb8/0x9383f985bc4d2e12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x405:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.286556:0:12363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000853c0bb8/0x9383f985bc4d2e12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x405:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.286577:0:12363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201209.286879:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+124:3312:x1875064458207232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24107us (24244us total) trans 4294968816 rc 0/0 00000100:00100000:0.0:1788201209.286887:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4133 00010000:00010000:0.0:1788201209.287043:0:13449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d2e20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.287053:0:13449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d2e20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.287062:0:13449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d2e20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.287069:0:13449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d2e20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.287081:0:13449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788201209.287219:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+124:3310:x1875064458207744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17697us (18289us total) trans 4294968817 rc 0/0 00000100:00100000:0.0:1788201209.287226:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4135 00010000:00010000:0.0:1788201209.287247:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201209.287253:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000853c0bb8/0x9383f985bc4d2e12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x405:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.287261:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201209.287266:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000853c0bb8/0x9383f985bc4d2e12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x405:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.287282:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000853c0bb8/0x9383f985bc4d2e12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x405:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201209.289313:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5474380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+127:3310:x1875064458203904:12345-0@lo:6:osp-syn-0-0.0 Request processed in 67085us (70697us total) trans 4294968830 rc 0/0 00000100:00100000:3.0:1788201209.289327:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4120 00000004:00080000:2.0:1788201209.291543:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c53e9180/2, rc 0, transno 4294968816 00000100:00100000:2.0:1788201209.291574:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458207232:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788201209.291595:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201209.291603:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d2e20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.291617:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.291621:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d2e20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.291633:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d2e20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.291652:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d2e20 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.291660:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c440989/0x9383f985bc4d2e20 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.291697:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.291699:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.291701:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.291794:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000853c0bb8/0x9383f985bc4d2e12 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x405:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.291804:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000853c0bb8/0x9383f985bc4d2e12 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x405:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.291820:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.291821:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.291823:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201209.291835:0:13451:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000092295f0a/0x9383f985bc4d2e19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.291844:0:13451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092295f0a/0x9383f985bc4d2e19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.291854:0:13451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092295f0a/0x9383f985bc4d2e19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.291861:0:13451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092295f0a/0x9383f985bc4d2e19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201209.291887:0:13451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201209.292168:0:13451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+124:3312:x1875064458207360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 29208us (29485us total) trans 4294968818 rc 0/0 00000100:00100000:0.0:1788201209.292178:0:13451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4134 00000004:00080000:2.0:1788201209.292266:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c53eb480/2, rc 0, transno 4294968818 00000100:00100000:2.0:1788201209.292272:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458207360:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788201209.292288:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201209.292336:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092295f0a/0x9383f985bc4d2e19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.292349:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201209.292352:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092295f0a/0x9383f985bc4d2e19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.292360:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092295f0a/0x9383f985bc4d2e19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.292372:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092295f0a/0x9383f985bc4d2e19 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.292379:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092295f0a/0x9383f985bc4d2e19 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.292394:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.292396:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201209.292398:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788201209.293453:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c24a1f80/2, rc 0, transno 4294968817 00000100:00100000:0.0:1788201209.293463:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c24a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458207744:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788201209.293478:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c5474e00/2, rc 0, transno 4294968830 00000100:00100000:0.0:1788201209.293483:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458203904:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201209.296688:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5477800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+123:3310:x1875064458204672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 71836us (72113us total) trans 4294968814 rc 0/0 00000100:00100000:0.0:1788201209.296706:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4124 00000004:00080000:1.0:1788201209.296922:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00de680/2, rc 0, transno 4294968814 00000100:00100000:1.0:1788201209.296944:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458204672:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201209.577674:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c24a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458208000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201209.577757:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788201209.579736:0:12996:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 484837439475ns, next at 485837436473ns, rc = 0 00000100:00100000:3.0:1788201209.581004:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458208000 00000100:00100000:3.0:1788201209.581017:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458208000 00000100:00100000:3.0:1788201209.581071:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788201209.581080:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+123:3311:x1875064458208000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201209.581396:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 13631488 granted 525008896 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201209.587734:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+123:3311:x1875064458208000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6644us (9966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.587759:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788201209.589536:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c24a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458208000:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788201209.701696:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201210.725492:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201211.110503:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff057800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458208128:0@lo:400:kworker.0 00000100:00100000:2.0:1788201211.110595:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201211.110641:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458208640:0@lo:400:kworker.0 00000100:00100000:2.0:1788201211.110668:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201211.110692:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788201211.110699:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff055880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458208256:0@lo:400:kworker.0 00000100:00100000:2.0:1788201211.110723:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201211.110738:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff056680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458208768:0@lo:400:kworker.0 00000100:00100000:2.0:1788201211.110758:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201211.110785:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff054380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458208512:0@lo:400:kworker.0 00000100:00100000:2.0:1788201211.110809:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201211.110826:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201211.110831:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875064458208384:0@lo:400:kworker.0 00000100:00100000:2.0:1788201211.110853:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201211.110881:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458208640 00000100:00100000:0.0:1788201211.110891:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458208640 00000100:00100000:0.0:1788201211.110965:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458208512 00000100:00100000:0.0:1788201211.110969:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458208512 00000100:00100000:0.0:1788201211.110993:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788201211.111003:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+123:3312:x1875064458208640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201211.111067:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+123:3312:x1875064458208640:12345-0@lo:400:kworker.0 Request processed in 66us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201211.111075:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788201211.111094:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788201211.111102:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+127:3311:x1875064458208512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201211.111121:0:12965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458208128 00000100:00100000:3.0:1788201211.111127:0:12965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458208128 00000100:00100000:0.0:1788201211.111135:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+127:3311:x1875064458208512:12345-0@lo:400:kworker.0 Request processed in 34us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201211.111143:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788201211.111164:0:12965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788201211.111175:0:12965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f50b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3312:x1875064458208128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201211.111190:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458208640:0@lo:400:kworker.0 00000100:00100000:3.0:1788201211.111236:0:12965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f50b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3312:x1875064458208128:12345-0@lo:400:kworker.0 Request processed in 64us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201211.111243:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458208256 00000100:00100000:3.0:1788201211.111245:0:12965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788201211.111249:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458208256 00000100:00100000:3.0:1788201211.111331:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458208768 00000100:00100000:3.0:1788201211.111336:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458208768 00000100:00080000:2.0:1788201211.111384:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201211.111389:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201211.111410:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff054380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458208512:0@lo:400:kworker.0 00000100:00100000:0.0:1788201211.111948:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458208384 00000100:00100000:0.0:1788201211.111962:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458208384 00000100:00080000:2.0:1788201211.111999:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201211.112075:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788201211.119147:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788201211.119162:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458208768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201211.119456:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458208768:12345-0@lo:400:kworker.0 Request processed in 299us (8696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201211.119467:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788201211.122351:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788201211.122366:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875064458208384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201211.122450:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875064458208384:12345-0@lo:400:kworker.0 Request processed in 90us (11597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201211.122456:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788201211.122506:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff056680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458208768:0@lo:400:kworker.0 00000100:00100000:0.0:1788201211.122514:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff057800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458208128:0@lo:400:kworker.0 00000100:00100000:0.0:1788201211.122596:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875064458208384:0@lo:400:kworker.0 00000100:00100000:1.0:1788201211.122770:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458208256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201211.122833:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458208256:12345-0@lo:400:kworker.0 Request processed in 10750us (12110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201211.122842:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788201211.122873:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff055880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458208256:0@lo:400:kworker.0 00000001:00080000:1.0:1788201211.746463:0:6732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294968831 is committed 00000001:00080000:1.0:1788201211.749239:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968818 is committed 00010000:00010000:2.0:1788201211.749487:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201212.134610:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201212.134633:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458208896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201212.134702:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201212.134795:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458208896 00000100:00100000:0.0:1788201212.134803:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458208896 00000100:00100000:0.0:1788201212.134862:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788201212.134872:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458208896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201212.134906:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 525008896 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1788201212.134966:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458208896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201212.134973:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788201212.135107:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968831 gen 2 00000004:00080000:2.0:1788201212.135114:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5421880, transno 4294968710 00000004:00080000:2.0:1788201212.135129:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5420380, transno 4294968711 00000004:00080000:2.0:1788201212.135133:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5422300, transno 4294968712 00000004:00080000:2.0:1788201212.135136:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5423800, transno 4294968713 00000004:00080000:2.0:1788201212.135141:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5421c00, transno 4294968714 00000004:00080000:2.0:1788201212.135143:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5422d80, transno 4294968715 00000004:00080000:2.0:1788201212.135146:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5422a00, transno 4294968716 00000004:00080000:2.0:1788201212.135149:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5420700, transno 4294968717 00000004:00080000:2.0:1788201212.135151:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c1a73800, transno 4294968718 00000004:00080000:2.0:1788201212.135155:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5381c00, transno 4294968719 00000004:00080000:2.0:1788201212.135157:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5382d80, transno 4294968720 00000004:00080000:2.0:1788201212.135160:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c1a70380, transno 4294968721 00000004:00080000:2.0:1788201212.135162:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5284700, transno 4294968722 00000004:00080000:2.0:1788201212.135165:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5380a80, transno 4294968723 00000004:00080000:2.0:1788201212.135167:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5285500, transno 4294968724 00000004:00080000:2.0:1788201212.135169:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5380e00, transno 4294968725 00000004:00080000:2.0:1788201212.135172:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c3770380, transno 4294968726 00000004:00080000:2.0:1788201212.135174:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c20bdf80, transno 4294968727 00000004:00080000:2.0:1788201212.135177:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5423100, transno 4294968728 00000004:00080000:2.0:1788201212.135179:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c20bea00, transno 4294968729 00000004:00080000:2.0:1788201212.135182:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c3771c00, transno 4294968730 00000004:00080000:2.0:1788201212.135184:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04d0821500, transno 4294968731 00000004:00080000:2.0:1788201212.135186:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c3770000, transno 4294968732 00000004:00080000:2.0:1788201212.135188:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c20bdc00, transno 4294968733 00000004:00080000:2.0:1788201212.135191:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c20bd180, transno 4294968734 00000004:00080000:2.0:1788201212.135193:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c39c7b80, transno 4294968735 00000004:00080000:2.0:1788201212.135196:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c502b100, transno 4294968736 00000004:00080000:2.0:1788201212.135199:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f000ea00, transno 4294968737 00000004:00080000:2.0:1788201212.135201:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5285180, transno 4294968738 00000004:00080000:2.0:1788201212.135204:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c39c4380, transno 4294968739 00000004:00080000:2.0:1788201212.135207:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f000e300, transno 4294968740 00000004:00080000:2.0:1788201212.135209:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04d0822680, transno 4294968741 00000004:00080000:2.0:1788201212.135211:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04d0821c00, transno 4294968742 00000004:00080000:2.0:1788201212.135213:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04d0820700, transno 4294968743 00000004:00080000:2.0:1788201212.135216:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04c6630700, transno 4294968744 00000004:00080000:2.0:1788201212.135218:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c3419c00, transno 4294968745 00000004:00080000:2.0:1788201212.135220:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5421f80, transno 4294968746 00000004:00080000:2.0:1788201212.135222:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c3418700, transno 4294968747 00000004:00080000:2.0:1788201212.135224:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c20bd500, transno 4294968748 00000004:00080000:2.0:1788201212.135227:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c12d2d80, transno 4294968749 00000004:00080000:2.0:1788201212.135229:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04d0820380, transno 4294968750 00000004:00080000:2.0:1788201212.135231:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c341ad80, transno 4294968751 00000004:00080000:2.0:1788201212.135233:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c12d0700, transno 4294968752 00000004:00080000:2.0:1788201212.135235:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04d80f2d80, transno 4294968753 00000004:00080000:2.0:1788201212.135238:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cff3aa00, transno 4294968754 00000004:00080000:2.0:1788201212.135240:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00c0700, transno 4294968755 00000004:00080000:2.0:1788201212.135242:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04d80f1c00, transno 4294968756 00000004:00080000:2.0:1788201212.135244:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c20bf480, transno 4294968757 00000004:00080000:2.0:1788201212.135246:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04d80f3800, transno 4294968758 00000004:00080000:2.0:1788201212.135248:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cff3a300, transno 4294968759 00000004:00080000:2.0:1788201212.135251:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00df800, transno 4294968760 00000004:00080000:2.0:1788201212.135253:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f000d180, transno 4294968761 00000004:00080000:2.0:1788201212.135256:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00dc380, transno 4294968762 00000004:00080000:2.0:1788201212.135259:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5225500, transno 4294968763 00000004:00080000:2.0:1788201212.135261:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00dfb80, transno 4294968764 00000004:00080000:2.0:1788201212.135263:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f0085180, transno 4294968765 00000004:00080000:2.0:1788201212.135265:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5420a80, transno 4294968766 00000004:00080000:2.0:1788201212.135268:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5381180, transno 4294968767 00000004:00080000:2.0:1788201212.135270:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5381f80, transno 4294968768 00000004:00080000:2.0:1788201212.135273:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5029880, transno 4294968769 00000004:00080000:2.0:1788201212.135276:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cffa9500, transno 4294968770 00000004:00080000:2.0:1788201212.135278:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cffa8380, transno 4294968771 00000004:00080000:2.0:1788201212.135280:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5224000, transno 4294968772 00000004:00080000:2.0:1788201212.135283:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5029f80, transno 4294968773 00000004:00080000:2.0:1788201212.135285:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5227480, transno 4294968774 00000004:00080000:2.0:1788201212.135288:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f0087100, transno 4294968775 00000004:00080000:2.0:1788201212.135290:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f0084700, transno 4294968776 00000004:00080000:2.0:1788201212.135315:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5225180, transno 4294968777 00000004:00080000:2.0:1788201212.135318:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04ff057480, transno 4294968778 00000004:00080000:2.0:1788201212.135321:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cffaaa00, transno 4294968779 00000004:00080000:2.0:1788201212.135324:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cffabb80, transno 4294968780 00000004:00080000:2.0:1788201212.135326:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f000df80, transno 4294968781 00000004:00080000:2.0:1788201212.135329:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00de300, transno 4294968782 00000004:00080000:2.0:1788201212.135331:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cff3ad80, transno 4294968783 00000004:00080000:2.0:1788201212.135333:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f000f100, transno 4294968784 00000004:00080000:2.0:1788201212.135335:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cff39c00, transno 4294968785 00000004:00080000:2.0:1788201212.135337:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c3448e00, transno 4294968786 00000004:00080000:2.0:1788201212.135340:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c3448380, transno 4294968787 00000004:00080000:2.0:1788201212.135342:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c344b480, transno 4294968788 00000004:00080000:2.0:1788201212.135345:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c3448a80, transno 4294968789 00000004:00080000:2.0:1788201212.135347:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c12d0a80, transno 4294968790 00000004:00080000:2.0:1788201212.135349:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c3449180, transno 4294968791 00000004:00080000:2.0:1788201212.135352:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c2b7d180, transno 4294968792 00000004:00080000:2.0:1788201212.135354:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04ff054700, transno 4294968793 00000004:00080000:2.0:1788201212.135356:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c344a300, transno 4294968794 00000004:00080000:2.0:1788201212.135358:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c2b7ed80, transno 4294968795 00000004:00080000:2.0:1788201212.135360:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04ff055180, transno 4294968796 00000004:00080000:2.0:1788201212.135363:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5225f80, transno 4294968797 00000004:00080000:2.0:1788201212.135366:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5224380, transno 4294968798 00000004:00080000:2.0:1788201212.135369:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04ff055c00, transno 4294968799 00000004:00080000:2.0:1788201212.135372:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04c8234700, transno 4294968800 00000004:00080000:2.0:1788201212.135374:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04c8235880, transno 4294968801 00000004:00080000:2.0:1788201212.135376:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04c8235f80, transno 4294968802 00000004:00080000:2.0:1788201212.135378:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04c8236a00, transno 4294968803 00000004:00080000:2.0:1788201212.135380:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04c8235500, transno 4294968804 00000004:00080000:2.0:1788201212.135383:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00a5180, transno 4294968805 00000004:00080000:2.0:1788201212.135385:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c502a680, transno 4294968806 00000004:00080000:2.0:1788201212.135387:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00a6a00, transno 4294968807 00000004:00080000:2.0:1788201212.135389:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00a5500, transno 4294968808 00000004:00080000:2.0:1788201212.135392:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c12d3100, transno 4294968809 00000004:00080000:2.0:1788201212.135394:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00a5c00, transno 4294968810 00000004:00080000:2.0:1788201212.135396:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00dc700, transno 4294968811 00000004:00080000:2.0:1788201212.135398:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c33f1c00, transno 4294968812 00000004:00080000:2.0:1788201212.135400:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00a6d80, transno 4294968813 00000004:00080000:2.0:1788201212.135402:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04c8235180, transno 4294968814 00000004:00080000:2.0:1788201212.135405:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00a4380, transno 4294968815 00000004:00080000:2.0:1788201212.135407:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f0004a80, transno 4294968816 00000004:00080000:2.0:1788201212.135409:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cffac380, transno 4294968817 00000004:00080000:2.0:1788201212.135411:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cffae300, transno 4294968818 00000004:00080000:2.0:1788201212.135414:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f0004000, transno 4294968819 00000004:00080000:2.0:1788201212.135416:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c12d1880, transno 4294968820 00000004:00080000:2.0:1788201212.135418:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c24a1c00, transno 4294968821 00000004:00080000:2.0:1788201212.135420:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c24a2d80, transno 4294968822 00000004:00080000:2.0:1788201212.135423:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f0006680, transno 4294968823 00000004:00080000:2.0:1788201212.135425:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f4e76680, transno 4294968824 00000004:00080000:2.0:1788201212.135428:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c548c380, transno 4294968825 00000004:00080000:2.0:1788201212.135430:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c52eea00, transno 4294968826 00000004:00080000:2.0:1788201212.135433:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00df480, transno 4294968827 00000004:00080000:2.0:1788201212.135435:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c52ed180, transno 4294968828 00000004:00080000:2.0:1788201212.135438:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c52edc00, transno 4294968829 00000004:00080000:2.0:1788201212.135440:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5474e00, transno 4294968830 00000004:00080000:2.0:1788201212.135443:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5475f80, transno 4294968831 00000100:00100000:2.0:1788201212.135454:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458208896:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1788201212.136540:0:12993:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 122 done 00010000:00010000:0.0:1788201212.773534:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201213.331538:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201213.331581:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201213.331615:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201213.331639:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201213.331666:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442608000 00000100:00100000:0.0:1788201213.331676:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442608000 00000100:00100000:0.0:1788201213.331737:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442607872 00000100:00100000:0.0:1788201213.331741:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442607872 00000100:00100000:0.0:1788201213.331767:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 119 00000100:00100000:0.0:1788201213.331789:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:2360:x1875064442608000:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201213.331886:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:2360:x1875064442608000:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 110us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201213.331893:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 119 00000100:00100000:0.0:1788201213.331911:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 120 00000100:00100000:0.0:1788201213.331931:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2360:x1875064442607872:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201213.331974:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2360:x1875064442607872:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 45us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201213.331980:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 120 00000100:00100000:0.0:1788201213.332000:0:12964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442607616 00000100:00100000:0.0:1788201213.332003:0:12964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442607616 00000100:00100000:0.0:1788201213.332028:0:12964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 95 00000100:00100000:0.0:1788201213.332034:0:12964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f50b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442607616:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201213.332057:0:12964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f50b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442607616:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201213.332064:0:12964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 95 00000100:00080000:0.0:1788201213.332092:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201213.332096:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201213.332476:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442607744 00000100:00100000:3.0:1788201213.332481:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442607744 00000100:00100000:3.0:1788201213.332535:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00100000:3.0:1788201213.332544:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2360:x1875064442607744:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201213.332583:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2360:x1875064442607744:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 41us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201213.332589:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00080000:0.0:1788201213.333351:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1788201213.734504:0:12980:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 14 committed 00000100:00100000:2.0:1788201213.734812:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c24a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458209024:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201213.734887:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201213.735022:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c24a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458209408:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201213.735131:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c24a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458209536:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201213.735158:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201213.735324:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201213.735484:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c24a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458209152:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201213.735657:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458209024 00000100:00100000:0.0:1788201213.735665:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458209024 00000100:00100000:0.0:1788201213.735734:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458209536 00000100:00100000:0.0:1788201213.735738:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458209536 00000100:00100000:0.0:1788201213.735760:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4136 00000100:00100000:0.0:1788201213.735768:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3311:x1875064458209024:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201213.735794:0:13446:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:769 count 1 00010000:00010000:0.0:1788201213.735821:0:13446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2e27 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x301:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.735841:0:13446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a4ea0c1/0x9383f985bc4bc886 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfc6a expref: 19 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.735849:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x301:0x0].0x0 since=53s v=(0 0) 00010000:00010000:0.0:1788201213.735854:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x301:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201213.735858:0:13446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2e27 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.735886:0:13446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a4ea0c1/0x9383f985bc4bc886 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfc6a expref: 19 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.735899:0:13446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a4ea0c1/0x9383f985bc4bc886 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfc6a expref: 19 pid: 12363 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201213.735924:0:13446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:13446:1875064458210048:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201213.735983:0:13446:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d89e1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201213.736000:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c24a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458209280:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201213.736033:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4137 00000100:00100000:0.0:1788201213.736040:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3311:x1875064458209536:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201213.736052:0:13445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:882 count 1 00010000:00010000:0.0:1788201213.736064:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2e2e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.736077:0:13445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001bc442d8/0x9383f985bc4c2298 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1b6c expref: 19 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.736083:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x372:0x0].0x0 since=39s v=(0 0) 00010000:00010000:0.0:1788201213.736086:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x372:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201213.736089:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2e2e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.736107:0:13445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001bc442d8/0x9383f985bc4c2298 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1b6c expref: 19 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.736116:0:13445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001bc442d8/0x9383f985bc4c2298 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1b6c expref: 19 pid: 6705 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201213.736127:0:13445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13445:1875064458210176:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201213.736152:0:13445:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d89e1900 going to sleep for 11 seconds 00000100:00080000:2.0:1788201213.737358:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201213.740600:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c24a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458209920:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201213.740658:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201213.740743:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458209408 00000100:00100000:0.0:1788201213.740752:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458209408 00000100:00100000:0.0:1788201213.740801:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458209920 00000100:00100000:0.0:1788201213.740805:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458209920 00000100:00100000:0.0:1788201213.740826:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4138 00000100:00100000:0.0:1788201213.740835:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c24a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+8:3310:x1875064458209408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201213.740868:0:13450:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:667 count 1 00010000:00010000:0.0:1788201213.740894:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c0641cd/0x9383f985bc4d2e35 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.740929:0:13450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea4542f9/0x9383f985bc4b7726 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be055 expref: 19 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.740938:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29b:0x0].0x0 since=67s v=(0 0) 00010000:00010000:0.0:1788201213.740943:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201213.740947:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c0641cd/0x9383f985bc4d2e35 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.740983:0:13450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea4542f9/0x9383f985bc4b7726 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be055 expref: 19 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.740998:0:13450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea4542f9/0x9383f985bc4b7726 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be055 expref: 19 pid: 6703 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201213.741012:0:13450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1a73800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:13450:1875064458210304:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201213.741074:0:13450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c1377cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201213.741090:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201213.741116:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c24a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458209792:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201213.741143:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201213.741174:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458209280 00000100:00100000:0.0:1788201213.741180:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458209792 00000100:00100000:3.0:1788201213.741180:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458209280 00000100:00100000:0.0:1788201213.741187:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458209792 00000100:00100000:0.0:1788201213.741215:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4139 00000100:00100000:3.0:1788201213.741227:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4140 00000100:00100000:3.0:1788201213.741239:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+10:3313:x1875064458209792:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788201213.741254:0:13448:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:890 count 1 00010000:00010000:3.0:1788201213.741269:0:13448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004773894/0x9383f985bc4d2e3c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.741283:0:13448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c399c1d7/0x9383f985bc4c28bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1da3 expref: 19 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.741306:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37a:0x0].0x0 since=38s v=(0 0) 00010000:00010000:3.0:1788201213.741310:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201213.741314:0:13448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004773894/0x9383f985bc4d2e3c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.741335:0:13448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c399c1d7/0x9383f985bc4c28bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1da3 expref: 19 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.741468:0:13448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c399c1d7/0x9383f985bc4c28bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1da3 expref: 19 pid: 12363 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201213.741472:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c24a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+10:3310:x1875064458209920:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201213.741487:0:13448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff054e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:13448:1875064458210432:192.168.201.30@tcp:104: 00002000:00080000:0.0:1788201213.741495:0:13449:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:712 count 1 00010000:00010000:0.0:1788201213.741512:0:13449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d2e43 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.741525:0:13449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ac096df/0x9383f985bc4b9b3e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1becbf expref: 19 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201213.741527:0:13448:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c3362a80 going to sleep for 11 seconds 00010000:00010000:0.0:1788201213.741535:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c8:0x0].0x0 since=61s v=(0 0) 00010000:00010000:0.0:1788201213.741539:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201213.741543:0:13449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d2e43 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.741565:0:13449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ac096df/0x9383f985bc4b9b3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1becbf expref: 19 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.741575:0:13449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ac096df/0x9383f985bc4b9b3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1becbf expref: 19 pid: 6706 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201213.741585:0:13449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c20bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:13449:1875064458210560:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201213.741615:0:13449:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1f35000 going to sleep for 11 seconds 00000100:00100000:2.0:1788201213.741730:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201213.741763:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c24a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458209664:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201213.741790:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201213.741933:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458209152 00000100:00100000:1.0:1788201213.741938:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458209152 00000100:00100000:1.0:1788201213.741972:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458209664 00000100:00100000:1.0:1788201213.741975:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458209664 00000100:00100000:1.0:1788201213.742001:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4141 00000100:00100000:1.0:1788201213.742009:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3312:x1875064458209152:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788201213.742024:0:13438:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1038 count 1 00000100:00100000:3.0:1788201213.742033:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:1.0:1788201213.742038:0:13438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d2e4a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x40e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.742053:0:13438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd9a6a0c/0x9383f985bc4c9efb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x40e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c468b expref: 19 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.742061:0:13438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40e:0x0].0x0 since=20s v=(0 0) 00000100:00100000:3.0:1788201213.742066:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:1.0:1788201213.742068:0:13438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201213.742074:0:13438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d2e4a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x40e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.742098:0:13438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bd9a6a0c/0x9383f985bc4c9efb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x40e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c468b expref: 19 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.742108:0:13438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bd9a6a0c/0x9383f985bc4c9efb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x40e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c468b expref: 19 pid: 12363 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201213.742120:0:13438:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3448e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13438:1875064458210688:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201213.742151:0:13438:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d81400c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201213.742191:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4142 00000100:00100000:2.0:1788201213.742200:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3312:x1875064458209664:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201213.742213:0:13444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:897 count 1 00010000:00010000:2.0:1788201213.742240:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074f6abf6/0x9383f985bc4d2e51 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.742253:0:13444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d955f207/0x9383f985bc4c2e7d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1f8d expref: 19 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.742259:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x381:0x0].0x0 since=37s v=(0 0) 00010000:00010000:2.0:1788201213.742262:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x381:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201213.742266:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074f6abf6/0x9383f985bc4d2e51 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.742286:0:13444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d955f207/0x9383f985bc4c2e7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1f8d expref: 19 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.742327:0:13444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d955f207/0x9383f985bc4c2e7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1f8d expref: 19 pid: 6705 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201213.742667:0:13444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c52ef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13444:1875064458210816:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201213.742698:0:13444:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c33d5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201213.742747:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4143 00000100:00100000:2.0:1788201213.742754:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1a70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3313:x1875064458209280:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201213.742766:0:10484:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:596 count 1 00010000:00010000:2.0:1788201213.742778:0:10484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d2e58 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x254:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.742789:0:10484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005ad27485/0x9383f985bc4b3ea1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x254:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bccb3 expref: 19 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.742796:0:10484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x254:0x0].0x0 since=79s v=(0 0) 00010000:00010000:2.0:1788201213.742799:0:10484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x254:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201213.742803:0:10484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d2e58 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x254:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.742821:0:10484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005ad27485/0x9383f985bc4b3ea1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x254:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bccb3 expref: 19 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.742830:0:10484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ad27485/0x9383f985bc4b3ea1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x254:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bccb3 expref: 19 pid: 6703 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201213.742839:0:10484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c52eea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10484:1875064458210944:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201213.742862:0:10484:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c33d5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201213.743214:0:13446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:13446:1875064458210048:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201213.743236:0:13446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2e27 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201213.743267:0:13445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13445:1875064458210176:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201213.743279:0:13445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2e2e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201213.743321:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442608128 00000100:00100000:3.0:1788201213.743326:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442608128 00010000:00010000:3.0:1788201213.743352:0:7646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a4ea0c1/0x9383f985bc4bc886 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfc6a expref: 20 pid: 12363 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201213.743374:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442608256 00000100:00100000:3.0:1788201213.743378:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442608256 00010000:00010000:3.0:1788201213.743389:0:7646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001bc442d8/0x9383f985bc4c2298 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1b6c expref: 21 pid: 6705 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201213.743415:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1517 00000100:00100000:3.0:1788201213.743424:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff055f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:2361:x1875064442608128:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201213.743434:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201213.743440:0:7646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a4ea0c1/0x9383f985bc4bc886 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x301:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfc6a expref: 21 pid: 12363 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.743453:0:7646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a4ea0c1/0x9383f985bc4bc886 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x301:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfc6a expref: 21 pid: 12363 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.743472:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a4ea0c1/0x9383f985bc4bc886 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x301:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bfc6a expref: 21 pid: 12363 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.743484:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x301:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201213.743488:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x301:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201213.743493:0:7646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2e27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.743501:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2e27 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.743521:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201213.745499:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff055f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:2361:x1875064442608128:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 2065us (3456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201213.745513:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1517 00000100:00100000:3.0:1788201213.745545:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1518 00000100:00100000:3.0:1788201213.745556:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c7e16450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:2361:x1875064442608256:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201213.745573:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201213.745580:0:7646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 000000001bc442d8/0x9383f985bc4c2298 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x372:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1b6c expref: 19 pid: 6705 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.745598:0:7646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001bc442d8/0x9383f985bc4c2298 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x372:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1b6c expref: 19 pid: 6705 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.745623:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bc442d8/0x9383f985bc4c2298 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x372:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1b6c expref: 19 pid: 6705 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.745636:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x372:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788201213.745640:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x372:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201213.745645:0:7646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2e2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.745654:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2e2e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.745679:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201213.745705:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c7e16450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+18:2361:x1875064442608256:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 151us (3641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201213.745712:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1518 00010000:00010000:3.0:1788201213.745777:0:13446:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2e27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.745803:0:13446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2e27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.745813:0:13446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2e27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.745821:0:13446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2e27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.745846:0:13446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201213.745936:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201213.745944:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2e27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.745954:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201213.745959:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2e27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.745970:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2e27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.745984:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2e27 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.745992:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072b69b02/0x9383f985bc4d2e27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.746011:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201213.746013:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201213.746015:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201213.746443:0:13445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2e2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.746453:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2e2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.746467:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2e2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.746475:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2e2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.746490:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201213.746947:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+14:3311:x1875064458209024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11177us (12058us total) trans 4294968819 rc 0/0 00000100:00100000:3.0:1788201213.746957:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4136 00000100:00100000:2.0:1788201213.747020:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+14:3311:x1875064458209536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10978us (11859us total) trans 4294968820 rc 0/0 00000100:00100000:2.0:1788201213.747028:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4137 00010000:00010000:2.0:1788201213.747058:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201213.747063:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2e2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.747073:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201213.747077:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2e2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.747085:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2e2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.747098:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2e2e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.747106:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cef54c04/0x9383f985bc4d2e2e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.747125:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201213.747126:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201213.747128:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201213.756452:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968818 gen 2 00000004:00080000:2.0:1788201213.756461:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5382300, transno 4294968701 00000004:00080000:2.0:1788201213.756477:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5380380, transno 4294968702 00000004:00080000:2.0:1788201213.756479:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c3772d80, transno 4294968703 00000004:00080000:2.0:1788201213.756481:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c3772300, transno 4294968704 00000004:00080000:2.0:1788201213.756483:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c3771f80, transno 4294968705 00000004:00080000:2.0:1788201213.756484:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c3772680, transno 4294968706 00000004:00080000:2.0:1788201213.756486:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5382a00, transno 4294968707 00000004:00080000:2.0:1788201213.756488:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5284a80, transno 4294968708 00000004:00080000:2.0:1788201213.756490:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c3770a80, transno 4294968709 00000004:00080000:2.0:1788201213.756491:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5286300, transno 4294968710 00000004:00080000:2.0:1788201213.756493:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5287b80, transno 4294968711 00000004:00080000:2.0:1788201213.756495:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5284e00, transno 4294968712 00000004:00080000:2.0:1788201213.756496:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c12d3b80, transno 4294968713 00000004:00080000:2.0:1788201213.756498:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c12d1180, transno 4294968714 00000004:00080000:2.0:1788201213.756500:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c12d0e00, transno 4294968715 00000004:00080000:2.0:1788201213.756501:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c12d0380, transno 4294968716 00000004:00080000:2.0:1788201213.756502:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c12d0000, transno 4294968717 00000004:00080000:2.0:1788201213.756504:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c20bc700, transno 4294968718 00000004:00080000:2.0:1788201213.756505:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c20bca80, transno 4294968719 00000004:00080000:2.0:1788201213.756507:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c341b480, transno 4294968720 00000004:00080000:2.0:1788201213.756509:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5383100, transno 4294968721 00000004:00080000:2.0:1788201213.756511:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c341aa00, transno 4294968722 00000004:00080000:2.0:1788201213.756512:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c3418a80, transno 4294968723 00000004:00080000:2.0:1788201213.756514:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04d0822a00, transno 4294968724 00000004:00080000:2.0:1788201213.756516:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c12d2680, transno 4294968725 00000004:00080000:2.0:1788201213.756518:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c2200000, transno 4294968726 00000004:00080000:2.0:1788201213.756519:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c1a71f80, transno 4294968727 00000004:00080000:2.0:1788201213.756521:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04d0821180, transno 4294968728 00000004:00080000:2.0:1788201213.756523:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f4deb800, transno 4294968729 00000004:00080000:2.0:1788201213.756525:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04d1f0df80, transno 4294968730 00000004:00080000:2.0:1788201213.756526:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f4de9180, transno 4294968731 00000004:00080000:2.0:1788201213.756528:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f4de8700, transno 4294968732 00000004:00080000:2.0:1788201213.756529:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04d0822300, transno 4294968733 00000004:00080000:2.0:1788201213.756531:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04d0820000, transno 4294968734 00000004:00080000:2.0:1788201213.756532:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04d0823100, transno 4294968735 00000004:00080000:2.0:1788201213.756534:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cff38a80, transno 4294968736 00000004:00080000:2.0:1788201213.756535:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cff38000, transno 4294968737 00000004:00080000:2.0:1788201213.756537:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cff3b800, transno 4294968738 00000004:00080000:2.0:1788201213.756538:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cff38e00, transno 4294968739 00000004:00080000:2.0:1788201213.756540:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00c2d80, transno 4294968740 00000004:00080000:2.0:1788201213.756541:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cff39500, transno 4294968741 00000004:00080000:2.0:1788201213.756542:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00c0000, transno 4294968742 00000004:00080000:2.0:1788201213.756544:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cff39f80, transno 4294968743 00000004:00080000:2.0:1788201213.756545:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00c0a80, transno 4294968744 00000004:00080000:2.0:1788201213.756547:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cff39180, transno 4294968745 00000004:00080000:2.0:1788201213.756549:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5028700, transno 4294968746 00000004:00080000:2.0:1788201213.756550:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cff38380, transno 4294968747 00000004:00080000:2.0:1788201213.756551:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04d1f0d880, transno 4294968748 00000004:00080000:2.0:1788201213.756553:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5226680, transno 4294968749 00000004:00080000:2.0:1788201213.756555:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5224e00, transno 4294968750 00000004:00080000:2.0:1788201213.756556:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04d1f0ed80, transno 4294968751 00000004:00080000:2.0:1788201213.756558:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f0086d80, transno 4294968752 00000004:00080000:2.0:1788201213.756559:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c20bd880, transno 4294968753 00000004:00080000:2.0:1788201213.756561:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5383480, transno 4294968754 00000004:00080000:2.0:1788201213.756563:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cffa8e00, transno 4294968755 00000004:00080000:2.0:1788201213.756565:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04d1f0c700, transno 4294968756 00000004:00080000:2.0:1788201213.756567:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cffa9180, transno 4294968757 00000004:00080000:2.0:1788201213.756568:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cffa8a80, transno 4294968758 00000004:00080000:2.0:1788201213.756570:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cffaa680, transno 4294968759 00000004:00080000:2.0:1788201213.756572:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cffab480, transno 4294968760 00000004:00080000:2.0:1788201213.756573:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5381880, transno 4294968761 00000004:00080000:2.0:1788201213.756575:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00dea00, transno 4294968762 00000004:00080000:2.0:1788201213.756576:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00ddf80, transno 4294968763 00000004:00080000:2.0:1788201213.756578:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00dca80, transno 4294968764 00000004:00080000:2.0:1788201213.756579:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00dd180, transno 4294968765 00000004:00080000:2.0:1788201213.756581:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00df100, transno 4294968766 00000004:00080000:2.0:1788201213.756583:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c3449f80, transno 4294968767 00000004:00080000:2.0:1788201213.756584:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c20bed80, transno 4294968768 00000004:00080000:2.0:1788201213.756585:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c344b100, transno 4294968769 00000004:00080000:2.0:1788201213.756587:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c2b7d880, transno 4294968770 00000004:00080000:2.0:1788201213.756589:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c2b7dc00, transno 4294968771 00000004:00080000:2.0:1788201213.756590:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c2b7f800, transno 4294968772 00000004:00080000:2.0:1788201213.756591:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c3449c00, transno 4294968773 00000004:00080000:2.0:1788201213.756593:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c344ad80, transno 4294968774 00000004:00080000:2.0:1788201213.756594:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c2b7df80, transno 4294968775 00000004:00080000:2.0:1788201213.756596:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04ff057100, transno 4294968776 00000004:00080000:2.0:1788201213.756598:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04ff055500, transno 4294968777 00000004:00080000:2.0:1788201213.756599:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c2b7fb80, transno 4294968778 00000004:00080000:2.0:1788201213.756600:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04ff056300, transno 4294968779 00000004:00080000:2.0:1788201213.756602:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c2b7ce00, transno 4294968780 00000004:00080000:2.0:1788201213.756603:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00c3b80, transno 4294968781 00000004:00080000:2.0:1788201213.756605:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c344bb80, transno 4294968782 00000004:00080000:2.0:1788201213.756606:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c2b7ea00, transno 4294968783 00000004:00080000:2.0:1788201213.756607:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00c3480, transno 4294968784 00000004:00080000:2.0:1788201213.756609:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c12d3800, transno 4294968785 00000004:00080000:2.0:1788201213.756611:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c12d1c00, transno 4294968786 00000004:00080000:2.0:1788201213.756613:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c12d2300, transno 4294968787 00000004:00080000:2.0:1788201213.756615:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00a5880, transno 4294968788 00000004:00080000:2.0:1788201213.756616:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c24a2680, transno 4294968789 00000004:00080000:2.0:1788201213.756618:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c12d1f80, transno 4294968790 00000004:00080000:2.0:1788201213.756620:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00a4e00, transno 4294968791 00000004:00080000:2.0:1788201213.756621:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04c8237480, transno 4294968792 00000004:00080000:2.0:1788201213.756623:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c24a0a80, transno 4294968793 00000004:00080000:2.0:1788201213.756624:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c24a3480, transno 4294968794 00000004:00080000:2.0:1788201213.756626:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04c8234a80, transno 4294968795 00000004:00080000:2.0:1788201213.756627:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f0005500, transno 4294968796 00000004:00080000:2.0:1788201213.756628:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f0007800, transno 4294968797 00000004:00080000:2.0:1788201213.756630:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cfface00, transno 4294968798 00000004:00080000:2.0:1788201213.756631:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f0005880, transno 4294968799 00000004:00080000:2.0:1788201213.756632:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cffaed80, transno 4294968800 00000004:00080000:2.0:1788201213.756634:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f0004380, transno 4294968801 00000004:00080000:2.0:1788201213.756635:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cffad880, transno 4294968802 00000004:00080000:2.0:1788201213.756637:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5487800, transno 4294968803 00000004:00080000:2.0:1788201213.756638:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cffafb80, transno 4294968804 00000004:00080000:2.0:1788201213.756640:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5484380, transno 4294968805 00000004:00080000:2.0:1788201213.756642:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5484000, transno 4294968806 00000004:00080000:2.0:1788201213.756643:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5487b80, transno 4294968807 00000004:00080000:2.0:1788201213.756645:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00dd500, transno 4294968808 00000004:00080000:2.0:1788201213.756648:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c3449880, transno 4294968809 00000004:00080000:2.0:1788201213.756650:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c548fb80, transno 4294968810 00000004:00080000:2.0:1788201213.756652:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c3448700, transno 4294968811 00000004:00080000:2.0:1788201213.756654:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c3448000, transno 4294968812 00000004:00080000:2.0:1788201213.756657:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c24a3800, transno 4294968813 00000004:00080000:2.0:1788201213.756659:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00de680, transno 4294968814 00000004:00080000:2.0:1788201213.756662:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cffaca80, transno 4294968815 00000004:00080000:2.0:1788201213.756665:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c53e9180, transno 4294968816 00000004:00080000:2.0:1788201213.756667:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c24a1f80, transno 4294968817 00000004:00080000:2.0:1788201213.756670:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c53eb480, transno 4294968818 00000100:00100000:2.0:1788201213.756681:0:3311:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9e03c24a1500 x1875064458209536/t4294968820(4294968820) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201268 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788201213.756692:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c24a1500/2, rc 0, transno 4294968820 00000100:00100000:2.0:1788201213.756698:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c24a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458209536:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788201213.756713:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c24a0000/2, rc 0, transno 4294968819 00000100:00100000:2.0:1788201213.756716:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c24a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458209024:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788201213.758783:0:12995:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 7 changes, 8 in progress, 6 in flight, 118 done 00000100:00100000:0.0:1788201213.758918:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201213.758939:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458211200:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201213.759132:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201213.759156:0:13448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff054e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:13448:1875064458210432:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201213.759159:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1788201213.759186:0:13448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000004773894/0x9383f985bc4d2e3c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201213.759191:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201213.759207:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201213.759222:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442608384 00000100:00100000:3.0:1788201213.759227:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442608384 00000100:00100000:0.0:1788201213.759254:0:13450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1a73800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:13450:1875064458210304:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201213.759256:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4542f9/0x9383f985bc4b7726 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be055 expref: 18 pid: 6703 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.759268:0:13450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002c0641cd/0x9383f985bc4d2e35 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201213.759280:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442608640 00000100:00100000:3.0:1788201213.759283:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442608640 00000100:00100000:0.0:1788201213.759284:0:13526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442608512 00000100:00100000:0.0:1788201213.759286:0:13526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442608512 00010000:00010000:0.0:1788201213.759471:0:13526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005ad27485/0x9383f985bc4b3ea1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x254:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bccb3 expref: 20 pid: 6703 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201213.759496:0:13526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1519 00000100:00100000:0.0:1788201213.759506:0:13526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3449c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:2359:x1875064442608384:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201213.759519:0:13526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201213.759525:0:13526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000ea4542f9/0x9383f985bc4b7726 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x29b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be055 expref: 20 pid: 6703 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.759538:0:13526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea4542f9/0x9383f985bc4b7726 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x29b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be055 expref: 20 pid: 6703 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.759560:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea4542f9/0x9383f985bc4b7726 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x29b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1be055 expref: 20 pid: 6703 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.759579:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29b:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788201213.759584:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201213.759589:0:13526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c0641cd/0x9383f985bc4d2e35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.759594:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c399c1d7/0x9383f985bc4c28bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1da3 expref: 19 pid: 12363 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.759605:0:13526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c0641cd/0x9383f985bc4d2e35 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201213.759618:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1520 00010000:00010000:0.0:1788201213.759625:0:13526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201213.759625:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:2359:x1875064442608512:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201213.759632:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201213.759637:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 000000005ad27485/0x9383f985bc4b3ea1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x254:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bccb3 expref: 19 pid: 6703 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.759647:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005ad27485/0x9383f985bc4b3ea1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x254:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bccb3 expref: 19 pid: 6703 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.759660:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x254:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788201213.759663:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x254:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201213.759666:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d2e58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x254:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.759674:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d2e58 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x254:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201213.759677:0:13526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3449c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:2359:x1875064442608384:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 172us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201213.759685:0:13526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1519 00010000:00010000:3.0:1788201213.759686:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201213.759702:0:13526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1521 00000100:00100000:3.0:1788201213.759704:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+18:2359:x1875064442608512:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 81us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201213.759708:0:13526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+18:2359:x1875064442608640:12345-192.168.201.30@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788201213.759710:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1520 00010000:00010000:0.0:1788201213.759716:0:13526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201213.759720:0:13526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000c399c1d7/0x9383f985bc4c28bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1da3 expref: 17 pid: 12363 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.759730:0:13526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c399c1d7/0x9383f985bc4c28bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1da3 expref: 17 pid: 12363 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.759743:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c399c1d7/0x9383f985bc4c28bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1da3 expref: 17 pid: 12363 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.759753:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37a:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788201213.759757:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201213.759761:0:13526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000004773894/0x9383f985bc4d2e3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.759773:0:13526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004773894/0x9383f985bc4d2e3c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.759790:0:13526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201213.759808:0:13526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:2359:x1875064442608640:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 100us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201213.759815:0:13526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1521 00000100:00100000:0.0:1788201213.759836:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458211200 00000100:00100000:0.0:1788201213.759839:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458211200 00000100:00100000:0.0:1788201213.759863:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4144 00000100:00100000:0.0:1788201213.759869:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c20bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3313:x1875064458211200:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201213.759891:0:13441:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:780 count 1 00010000:00010000:0.0:1788201213.759923:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2e5f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.759939:0:13441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0925199/0x9383f985bc4bd177 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x30c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bff65 expref: 15 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.759946:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30c:0x0].0x0 since=53s v=(0 0) 00010000:00010000:0.0:1788201213.760233:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201213.760238:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2e5f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.760265:0:13441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f0925199/0x9383f985bc4bd177 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x30c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bff65 expref: 15 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.760283:0:13441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f0925199/0x9383f985bc4bd177 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x30c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bff65 expref: 15 pid: 10484 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201213.760389:0:13441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c20bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:13441:1875064458211328:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201213.760435:0:13441:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c1377cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201213.760449:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1788201213.760456:0:13450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002c0641cd/0x9383f985bc4d2e35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201213.760464:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3449f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458211072:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788201213.760469:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c0641cd/0x9383f985bc4d2e35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.760482:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c0641cd/0x9383f985bc4d2e35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.760491:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c0641cd/0x9383f985bc4d2e35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201213.760502:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201213.760512:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201213.761215:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c24a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+14:3310:x1875064458209408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20379us (25890us total) trans 4294968821 rc 0/0 00000100:00100000:0.0:1788201213.761225:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4138 00000100:00100000:0.0:1788201213.761245:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458211072 00000100:00100000:0.0:1788201213.761251:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458211072 00000100:00100000:0.0:1788201213.761277:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4145 00000100:00100000:0.0:1788201213.761284:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+14:3310:x1875064458211072:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201213.761346:0:13450:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1020 count 1 00010000:00010000:0.0:1788201213.761362:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2e66 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.761377:0:13450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000027eb6b0e/0x9383f985bc4c90b5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c419f expref: 15 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.761385:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3fc:0x0].0x0 since=23s v=(0 0) 00010000:00010000:0.0:1788201213.761388:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201213.761392:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2e66 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.761415:0:13450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000027eb6b0e/0x9383f985bc4c90b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c419f expref: 15 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.761425:0:13450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000027eb6b0e/0x9383f985bc4c90b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c419f expref: 15 pid: 12363 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201213.761436:0:13450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c20bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:13450:1875064458211456:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201213.761474:0:13450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d0098a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201213.761506:0:13449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c20bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:13449:1875064458210560:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201213.761524:0:13449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d2e43 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.761540:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201213.761546:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c0641cd/0x9383f985bc4d2e35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.761555:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201213.761559:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c0641cd/0x9383f985bc4d2e35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.761567:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c0641cd/0x9383f985bc4d2e35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.761583:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c0641cd/0x9383f985bc4d2e35 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.761590:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c0641cd/0x9383f985bc4d2e35 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.761597:0:13448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000004773894/0x9383f985bc4d2e3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.761608:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201213.761610:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201213.761611:0:13448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004773894/0x9383f985bc4d2e3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.761613:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788201213.761618:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c24a2300/2, rc 0, transno 4294968821 00010000:00010000:3.0:1788201213.761621:0:13448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004773894/0x9383f985bc4d2e3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.761630:0:13448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004773894/0x9383f985bc4d2e3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201213.761636:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c24a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458209408:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788201213.761646:0:13448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201213.761664:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201213.761669:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004773894/0x9383f985bc4d2e3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.761676:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201213.761681:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004773894/0x9383f985bc4d2e3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.761694:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004773894/0x9383f985bc4d2e3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.761705:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004773894/0x9383f985bc4d2e3c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.761712:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004773894/0x9383f985bc4d2e3c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.761725:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201213.761726:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201213.761728:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201213.761741:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458211584:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201213.761768:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201213.761900:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458211584 00000100:00100000:1.0:1788201213.761914:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458211584 00000100:00100000:3.0:1788201213.761958:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+16:3313:x1875064458209792:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20720us (20812us total) trans 4294968822 rc 0/0 00000100:00100000:1.0:1788201213.761959:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4146 00000100:00100000:1.0:1788201213.761974:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c20bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3313:x1875064458211584:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201213.761974:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4140 00002000:00080000:1.0:1788201213.761992:0:12363:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:562 count 1 00010000:00010000:1.0:1788201213.762009:0:12363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002359bf1/0x9383f985bc4d2e6d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x232:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201213.762011:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c24a1c00/2, rc 0, transno 4294968822 00000100:00100000:3.0:1788201213.762027:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c24a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458209792:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788201213.762028:0:12363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bcb14b1f/0x9383f985bc4b23a4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x232:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc352 expref: 15 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.762040:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x232:0x0].0x0 since=84s v=(0 0) 00010000:00010000:1.0:1788201213.762044:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x232:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201213.762047:0:12363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002359bf1/0x9383f985bc4d2e6d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x232:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.762072:0:12363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bcb14b1f/0x9383f985bc4b23a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x232:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc352 expref: 15 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.762084:0:12363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bcb14b1f/0x9383f985bc4b23a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x232:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc352 expref: 15 pid: 6706 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201213.762096:0:12363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3448000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12363:1875064458211712:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201213.762133:0:12363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201213.762416:0:13444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c52ef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13444:1875064458210816:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201213.762432:0:13444:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000074f6abf6/0x9383f985bc4d2e51 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.762459:0:10484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ad27485/0x9383f985bc4b3ea1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x254:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bccb3 expref: 15 pid: 6703 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201213.762470:0:10484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c52eea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10484:1875064458210944:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201213.762479:0:10484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d2e58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.762491:0:10484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d2e58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.762498:0:10484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d2e58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.762505:0:10484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d2e58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.762512:0:10484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d2e58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.762535:0:10484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201213.762621:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201213.762628:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d2e58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.762638:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bd600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201213.762643:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d2e58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.762652:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d2e58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.762665:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d2e58 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.762672:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d2e58 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.762693:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201213.762695:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201213.762698:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201213.762802:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201213.762839:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201213.762871:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201213.762888:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1a70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3313:x1875064458209280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20134us (21796us total) trans 4294968823 rc 0/0 00000100:00100000:0.0:1788201213.762896:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4143 00000100:00100000:3.0:1788201213.762898:0:13438:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3448e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13438:1875064458210688:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201213.762920:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442608896 00000100:00100000:1.0:1788201213.762926:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442608896 00010000:00010000:3.0:1788201213.762926:0:13438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d2e4a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x40e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201213.762947:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442608768 00000100:00100000:3.0:1788201213.762952:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442608768 00010000:00010000:1.0:1788201213.762954:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d955f207/0x9383f985bc4c2e7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1f8d expref: 15 pid: 6705 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.762974:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ac096df/0x9383f985bc4b9b3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1becbf expref: 16 pid: 6706 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201213.762987:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442609024 00000100:00100000:1.0:1788201213.762992:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442609024 00000100:00100000:3.0:1788201213.763004:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1522 00010000:00010000:1.0:1788201213.763009:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bd9a6a0c/0x9383f985bc4c9efb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x40e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c468b expref: 17 pid: 12363 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201213.763017:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff054e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+17:2360:x1875064442608896:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201213.763031:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201213.763037:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000d955f207/0x9383f985bc4c2e7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x381:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1f8d expref: 17 pid: 6705 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201213.763041:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1523 00000100:00100000:1.0:1788201213.763053:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff057b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+17:2361:x1875064442608768:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201213.763057:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d955f207/0x9383f985bc4c2e7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x381:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1f8d expref: 17 pid: 6705 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.763064:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201213.763073:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 000000008ac096df/0x9383f985bc4b9b3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1becbf expref: 17 pid: 6706 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.763079:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d955f207/0x9383f985bc4c2e7d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x381:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c1f8d expref: 17 pid: 6705 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.763091:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ac096df/0x9383f985bc4b9b3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1becbf expref: 17 pid: 6706 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.763094:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x381:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788201213.763102:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x381:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201213.763109:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000074f6abf6/0x9383f985bc4d2e51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.763114:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ac096df/0x9383f985bc4b9b3e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1becbf expref: 16 pid: 6706 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201213.763117:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1524 00010000:00010000:3.0:1788201213.763121:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074f6abf6/0x9383f985bc4d2e51 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201213.763128:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff054a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:2362:x1875064442609024:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201213.763139:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201213.763139:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788201213.763147:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201213.763148:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201213.763149:0:7646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000bd9a6a0c/0x9383f985bc4c9efb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x40e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c468b expref: 15 pid: 12363 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.763154:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d2e43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.763164:0:7646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bd9a6a0c/0x9383f985bc4c9efb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x40e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c468b expref: 15 pid: 12363 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201213.763172:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff054e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:2360:x1875064442608896:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 160us (371us total) trans 0 rc 0/0 00010000:00010000:1.0:1788201213.763187:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d2e43 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201213.763191:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1522 00010000:00010000:0.0:1788201213.763202:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd9a6a0c/0x9383f985bc4c9efb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x40e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c468b expref: 15 pid: 12363 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.763214:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40e:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788201213.763217:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201213.763219:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201213.763222:0:7646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d2e4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201213.763228:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c24a2a00/2, rc 0, transno 4294968823 00010000:00010000:0.0:1788201213.763230:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d2e4a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x40e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201213.763233:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c24a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458209280:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788201213.763249:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201213.763251:0:13444:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000074f6abf6/0x9383f985bc4d2e51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.763259:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074f6abf6/0x9383f985bc4d2e51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201213.763267:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff054a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:2362:x1875064442609024:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 142us (397us total) trans 0 rc 0/0 00010000:00010000:3.0:1788201213.763268:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074f6abf6/0x9383f985bc4d2e51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201213.763273:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1524 00010000:00010000:3.0:1788201213.763276:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074f6abf6/0x9383f985bc4d2e51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.763289:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201213.763308:0:13449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d2e43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.763393:0:13449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d2e43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.763402:0:13449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d2e43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.763409:0:13449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d2e43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.763422:0:13449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788201213.763435:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+16:3312:x1875064458209664:12345-0@lo:6:osp-syn-1-0.0 Request processed in 21236us (21643us total) trans 4294968824 rc 0/0 00000100:00100000:3.0:1788201213.763445:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4142 00000100:00100000:1.0:1788201213.763466:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff057b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:2361:x1875064442608768:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 414us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201213.763474:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1523 00000100:00100000:1.0:1788201213.763508:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201213.763520:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff057100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458211968:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201213.763561:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201213.763588:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458211840:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201213.763618:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201213.763653:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458211968 00000100:00100000:1.0:1788201213.763657:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458211968 00000100:00100000:1.0:1788201213.763685:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458211840 00000100:00100000:1.0:1788201213.763688:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458211840 00000100:00100000:1.0:1788201213.763711:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4147 00000100:00100000:1.0:1788201213.763719:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3311:x1875064458211968:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201213.763726:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4148 00000100:00100000:3.0:1788201213.763736:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3311:x1875064458211840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788201213.763739:0:13440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:795 count 1 00002000:00080000:3.0:1788201213.763753:0:13442:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:610 count 1 00010000:00010000:1.0:1788201213.763758:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f6beb5f/0x9383f985bc4d2e74 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.763768:0:13442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c989edd/0x9383f985bc4d2e7b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x262:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.763775:0:13440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000db874ec1/0x9383f985bc4bdd47 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c038d expref: 11 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201213.763797:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c24a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+18:3310:x1875064458209920:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22574us (23137us total) trans 4294968825 rc 0/0 00010000:00010000:3.0:1788201213.763804:0:13442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea7ba111/0x9383f985bc4b49b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x262:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd09c expref: 11 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201213.763811:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4139 00010000:00010000:1.0:1788201213.763815:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31b:0x0].0x0 since=51s v=(0 0) 00010000:00010000:3.0:1788201213.763818:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x262:0x0].0x0 since=77s v=(0 0) 00010000:00010000:1.0:1788201213.763821:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201213.763824:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x262:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201213.763827:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f6beb5f/0x9383f985bc4d2e74 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.763830:0:13442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c989edd/0x9383f985bc4d2e7b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x262:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.763835:0:13438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d2e4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.763849:0:13438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d2e4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.763856:0:13438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d2e4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.763863:0:13438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d2e4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.763865:0:13440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000db874ec1/0x9383f985bc4bdd47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c038d expref: 11 pid: 10484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.763866:0:13442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea7ba111/0x9383f985bc4b49b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x262:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd09c expref: 11 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.763883:0:13438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788201213.763886:0:13442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea7ba111/0x9383f985bc4b49b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x262:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd09c expref: 11 pid: 6706 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201213.763901:0:13442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff055500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:13442:1875064458212224:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201213.763912:0:13440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000db874ec1/0x9383f985bc4bdd47 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c038d expref: 11 pid: 10484 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201213.763926:0:13440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3448a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:13440:1875064458212096:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201213.763965:0:13440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201213.764230:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3312:x1875064458209152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22221us (22499us total) trans 4294968826 rc 0/0 00000100:00100000:0.0:1788201213.764238:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4141 00010000:00010000:0.0:1788201213.764257:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201213.764262:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074f6abf6/0x9383f985bc4d2e51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.764271:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201213.764276:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074f6abf6/0x9383f985bc4d2e51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.764285:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074f6abf6/0x9383f985bc4d2e51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.764389:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074f6abf6/0x9383f985bc4d2e51 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.764399:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074f6abf6/0x9383f985bc4d2e51 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.764415:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201213.764419:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d2e43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.764427:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201213.764431:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d2e43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.764439:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d2e43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.764448:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d2e43 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.764456:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca2822cc/0x9383f985bc4d2e43 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.764469:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201213.764473:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d2e4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.764479:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201213.764482:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d2e4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.764490:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d2e4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x40e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.764499:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d2e4a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x40e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.764507:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d2e4a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x40e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.764519:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201213.764521:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201213.764523:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201213.764529:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788201213.764552:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c24a0380/2, rc 0, transno 4294968826 00000100:00100000:0.0:1788201213.764573:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c24a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458209152:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788201213.764585:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c24a3b80/2, rc 0, transno 4294968824 00000100:00100000:0.0:1788201213.764589:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c24a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458209664:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788201213.764605:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788201213.764619:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c24a2d80/2, rc 0, transno 4294968825 00000100:00100000:0.0:1788201213.764623:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c24a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458209920:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201213.765025:0:13442:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c33626c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201213.765042:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201213.765053:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3449180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458212352:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201213.765086:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201213.765118:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458212480:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201213.765139:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201213.765170:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458212352 00000100:00100000:1.0:1788201213.765176:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458212352 00000100:00100000:1.0:1788201213.765402:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458212480 00000100:00100000:1.0:1788201213.765407:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458212480 00000100:00100000:1.0:1788201213.765431:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4149 00000100:00100000:1.0:1788201213.765438:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+19:3313:x1875064458212352:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788201213.765457:0:13447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:792 count 1 00010000:00010000:1.0:1788201213.765476:0:13447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8727954/0x9383f985bc4d2e82 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x318:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.765492:0:13447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000080ffd43d/0x9383f985bc4bdae6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x318:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c02bb expref: 11 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.765506:0:13447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x318:0x0].0x0 since=51s v=(0 0) 00010000:00010000:1.0:1788201213.765510:0:13447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x318:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201213.765514:0:13447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8727954/0x9383f985bc4d2e82 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x318:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.765537:0:13447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000080ffd43d/0x9383f985bc4bdae6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x318:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c02bb expref: 11 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.765549:0:13447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000080ffd43d/0x9383f985bc4bdae6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x318:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c02bb expref: 11 pid: 12363 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201213.765564:0:13447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:13447:1875064458212608:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201213.765565:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4150 00000100:00100000:3.0:1788201213.765580:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+19:3313:x1875064458212480:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788201213.765596:0:13446:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:955 count 1 00000100:00100000:1.0:1788201213.765598:0:13447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5900 going to sleep for 11 seconds 00010000:00010000:3.0:1788201213.765613:0:13446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004933b680/0x9383f985bc4d2e89 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3bb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.765628:0:13446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c59587bb/0x9383f985bc4c5cac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2f85 expref: 11 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.765636:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3bb:0x0].0x0 since=31s v=(0 0) 00010000:00010000:3.0:1788201213.765640:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201213.765656:0:13446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004933b680/0x9383f985bc4d2e89 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.765677:0:13446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c59587bb/0x9383f985bc4c5cac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2f85 expref: 11 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.765687:0:13446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c59587bb/0x9383f985bc4c5cac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2f85 expref: 11 pid: 12363 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201213.765698:0:13446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff054700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:13446:1875064458212736:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201213.765724:0:13446:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c3362540 going to sleep for 11 seconds 00000100:00100000:2.0:1788201213.768263:0:13441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c20bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:13441:1875064458211328:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201213.768314:0:13441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2e5f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201213.768424:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201213.768512:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201213.768523:0:13450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c20bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:13450:1875064458211456:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201213.768542:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442609280 00010000:00010000:1.0:1788201213.768544:0:13450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2e66 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201213.768549:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442609280 00010000:00010000:2.0:1788201213.768585:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000027eb6b0e/0x9383f985bc4c90b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c419f expref: 12 pid: 12363 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201213.768615:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442609152 00000100:00100000:2.0:1788201213.768618:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442609152 00010000:00010000:2.0:1788201213.768629:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f0925199/0x9383f985bc4bd177 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x30c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bff65 expref: 13 pid: 10484 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201213.768649:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1525 00000100:00100000:2.0:1788201213.768659:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c7e14850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:2362:x1875064442609280:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201213.768673:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201213.768679:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000027eb6b0e/0x9383f985bc4c90b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c419f expref: 13 pid: 12363 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.768692:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000027eb6b0e/0x9383f985bc4c90b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c419f expref: 13 pid: 12363 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.768714:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027eb6b0e/0x9383f985bc4c90b5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c419f expref: 13 pid: 12363 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.768728:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201213.768733:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201213.768739:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2e66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.768749:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2e66 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.768778:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201213.768818:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c7e14850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:2362:x1875064442609280:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 159us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201213.768825:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1525 00000100:00100000:2.0:1788201213.768869:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1526 00000100:00100000:2.0:1788201213.768876:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:2362:x1875064442609152:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201213.768886:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201213.768891:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f0925199/0x9383f985bc4bd177 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x30c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bff65 expref: 11 pid: 10484 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.768902:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f0925199/0x9383f985bc4bd177 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x30c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bff65 expref: 11 pid: 10484 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.768927:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0925199/0x9383f985bc4bd177 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x30c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bff65 expref: 11 pid: 10484 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.768937:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201213.768940:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201213.768944:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2e5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.768989:0:13450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2e66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.769000:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2e66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.769016:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2e66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.769026:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2e66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.769043:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201213.769177:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2e5f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.769201:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201213.769226:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2362:x1875064442609152:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 349us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201213.769233:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1526 00010000:00010000:2.0:1788201213.769260:0:13441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2e5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.769270:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2e5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.769280:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2e5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.769289:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2e5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.769326:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788201213.769709:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+21:3310:x1875064458211072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8423us (9205us total) trans 4294968827 rc 0/0 00000100:00100000:1.0:1788201213.769717:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4145 00000100:00100000:2.0:1788201213.769877:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c20bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3313:x1875064458211200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10007us (10670us total) trans 4294968828 rc 0/0 00000100:00100000:2.0:1788201213.769885:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4144 00010000:00010000:2.0:1788201213.769904:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201213.769921:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2e66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.769931:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201213.769935:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2e66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.770383:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2e66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.770403:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2e66 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.770411:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069265cef/0x9383f985bc4d2e66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.770431:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201213.770435:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2e5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.770441:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201213.770444:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2e5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.770452:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2e5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.770461:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2e5f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.770468:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4f65cd4/0x9383f985bc4d2e5f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.770481:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201213.770484:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201213.770485:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788201213.770522:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c344b100/2, rc 0, transno 4294968828 00000100:00100000:2.0:1788201213.770529:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458211200:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788201213.771891:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788201213.771940:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c3449f80/2, rc 0, transno 4294968827 00000100:00100000:0.0:1788201213.772396:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3449f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458211072:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201213.777773:0:13440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3448a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:13440:1875064458212096:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201213.777779:0:12363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3448000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12363:1875064458211712:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201213.777812:0:13440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005f6beb5f/0x9383f985bc4d2e74 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.777812:0:12363:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000002359bf1/0x9383f985bc4d2e6d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x232:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201213.784060:0:13442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff055500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:13442:1875064458212224:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201213.784061:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201213.784092:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1788201213.784096:0:13442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004c989edd/0x9383f985bc4d2e7b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x262:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201213.784115:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201213.784139:0:13446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff054700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:13446:1875064458212736:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201213.784154:0:13446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004933b680/0x9383f985bc4d2e89 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201213.784180:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442609536 00000100:00100000:3.0:1788201213.784187:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442609536 00000100:00100000:0.0:1788201213.784194:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201213.784220:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442609792 00010000:00010000:3.0:1788201213.784223:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea7ba111/0x9383f985bc4b49b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x262:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd09c expref: 10 pid: 6706 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201213.784226:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442609792 00010000:00010000:0.0:1788201213.784249:0:7646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c59587bb/0x9383f985bc4c5cac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2f85 expref: 11 pid: 12363 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201213.784258:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442609408 00000100:00100000:3.0:1788201213.784263:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442609408 00000100:00100000:0.0:1788201213.784279:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442609664 00010000:00010000:3.0:1788201213.784284:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000db874ec1/0x9383f985bc4bdd47 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c038d expref: 12 pid: 10484 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201213.784285:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442609664 00000100:00100000:1.0:1788201213.784375:0:13447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:13447:1875064458212608:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201213.784392:0:13447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c8727954/0x9383f985bc4d2e82 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x318:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201213.784519:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1527 00000100:00100000:3.0:1788201213.784533:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c20bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:2362:x1875064442609536:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201213.784547:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201213.784553:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea7ba111/0x9383f985bc4b49b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x262:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd09c expref: 13 pid: 6706 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.784566:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea7ba111/0x9383f985bc4b49b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x262:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd09c expref: 13 pid: 6706 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.784587:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea7ba111/0x9383f985bc4b49b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x262:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bd09c expref: 13 pid: 6706 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.784602:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x262:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201213.784606:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x262:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201213.784612:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004c989edd/0x9383f985bc4d2e7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x262:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.784621:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c989edd/0x9383f985bc4d2e7b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x262:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.784643:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201213.784689:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c20bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:2362:x1875064442609536:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 160us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201213.784696:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1527 00000100:00100000:3.0:1788201213.784714:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1528 00000100:00100000:3.0:1788201213.784720:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c20bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:2362:x1875064442609792:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201213.784727:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201213.784732:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c59587bb/0x9383f985bc4c5cac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2f85 expref: 11 pid: 12363 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.784743:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c59587bb/0x9383f985bc4c5cac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2f85 expref: 11 pid: 12363 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.784754:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c59587bb/0x9383f985bc4c5cac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c2f85 expref: 11 pid: 12363 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.784763:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201213.784766:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201213.784770:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004933b680/0x9383f985bc4d2e89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.784783:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004933b680/0x9383f985bc4d2e89 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.784860:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201213.784882:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c20bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2362:x1875064442609792:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 162us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201213.784889:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1528 00000100:00100000:3.0:1788201213.784917:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1529 00000100:00100000:3.0:1788201213.784926:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c20bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:2362:x1875064442609408:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201213.784934:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201213.784939:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000db874ec1/0x9383f985bc4bdd47 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x31b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c038d expref: 9 pid: 10484 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.784949:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000db874ec1/0x9383f985bc4bdd47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x31b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c038d expref: 9 pid: 10484 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.784961:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db874ec1/0x9383f985bc4bdd47 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x31b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c038d expref: 9 pid: 10484 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.784972:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201213.784975:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201213.784979:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005f6beb5f/0x9383f985bc4d2e74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.784992:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f6beb5f/0x9383f985bc4d2e74 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.785025:0:7646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000080ffd43d/0x9383f985bc4bdae6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x318:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c02bb expref: 8 pid: 12363 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201213.785052:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1530 00000100:00100000:0.0:1788201213.785061:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c20bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2362:x1875064442609664:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201213.785071:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201213.785072:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201213.785078:0:7646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000080ffd43d/0x9383f985bc4bdae6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x318:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c02bb expref: 8 pid: 12363 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.785091:0:7646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000080ffd43d/0x9383f985bc4bdae6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x318:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c02bb expref: 8 pid: 12363 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201213.785099:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c20bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2362:x1875064442609408:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 172us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201213.785106:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1529 00010000:00010000:0.0:1788201213.785110:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080ffd43d/0x9383f985bc4bdae6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x318:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c02bb expref: 8 pid: 12363 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.785123:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x318:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201213.785127:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x318:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201213.785132:0:7646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8727954/0x9383f985bc4d2e82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x318:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.785140:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8727954/0x9383f985bc4d2e82 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x318:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.785160:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201213.785184:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c20bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2362:x1875064442609664:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 125us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201213.785192:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1530 00010000:00010000:0.0:1788201213.785221:0:13447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c8727954/0x9383f985bc4d2e82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.785230:0:13447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8727954/0x9383f985bc4d2e82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.785240:0:13447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8727954/0x9383f985bc4d2e82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.785246:0:13446:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004933b680/0x9383f985bc4d2e89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.785249:0:13447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8727954/0x9383f985bc4d2e82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.785266:0:13446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004933b680/0x9383f985bc4d2e89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.785277:0:13447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201213.785277:0:13446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004933b680/0x9383f985bc4d2e89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.785288:0:13446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004933b680/0x9383f985bc4d2e89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.785323:0:13446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788201213.785742:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+21:3313:x1875064458212480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20165us (20600us total) trans 4294968829 rc 0/0 00000100:00100000:3.0:1788201213.785752:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4150 00000100:00100000:0.0:1788201213.785756:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+21:3313:x1875064458212352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20316us (20668us total) trans 4294968830 rc 0/0 00000100:00100000:0.0:1788201213.785765:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4149 00010000:00010000:3.0:1788201213.785776:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201213.785784:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8727954/0x9383f985bc4d2e82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.785790:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201213.785796:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004933b680/0x9383f985bc4d2e89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.785805:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201213.785809:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004933b680/0x9383f985bc4d2e89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.785818:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004933b680/0x9383f985bc4d2e89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.785830:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004933b680/0x9383f985bc4d2e89 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.785838:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004933b680/0x9383f985bc4d2e89 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.785857:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201213.785859:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201213.785860:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201213.787430:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201213.787436:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8727954/0x9383f985bc4d2e82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.787446:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8727954/0x9383f985bc4d2e82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.787462:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8727954/0x9383f985bc4d2e82 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.787470:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8727954/0x9383f985bc4d2e82 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.787490:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201213.787493:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201213.787496:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788201213.787542:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c344a300/2, rc 0, transno 4294968829 00000100:00100000:3.0:1788201213.787550:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458212480:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788201213.787562:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c3449180/2, rc 0, transno 4294968830 00000100:00100000:3.0:1788201213.787566:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3449180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458212352:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788201213.787590:0:13442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004c989edd/0x9383f985bc4d2e7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.787599:0:13442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c989edd/0x9383f985bc4d2e7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.787609:0:13442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c989edd/0x9383f985bc4d2e7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.787617:0:13442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c989edd/0x9383f985bc4d2e7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.787638:0:13442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201213.788051:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3311:x1875064458211840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24315us (24430us total) trans 4294968831 rc 0/0 00000100:00100000:3.0:1788201213.788059:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4148 00000004:00080000:3.0:1788201213.788157:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04ff055f80/2, rc 0, transno 4294968831 00000100:00100000:3.0:1788201213.788161:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458211840:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788201213.788829:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201213.788838:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c989edd/0x9383f985bc4d2e7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.788850:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201213.788854:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c989edd/0x9383f985bc4d2e7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.788863:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c989edd/0x9383f985bc4d2e7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.788878:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c989edd/0x9383f985bc4d2e7b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.788885:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c989edd/0x9383f985bc4d2e7b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.788899:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201213.788901:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201213.788902:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201213.790481:0:13440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005f6beb5f/0x9383f985bc4d2e74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.790500:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f6beb5f/0x9383f985bc4d2e74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.790517:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f6beb5f/0x9383f985bc4d2e74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.790524:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f6beb5f/0x9383f985bc4d2e74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.790552:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201213.790824:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201213.790831:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f6beb5f/0x9383f985bc4d2e74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.790845:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201213.790849:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f6beb5f/0x9383f985bc4d2e74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.790858:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f6beb5f/0x9383f985bc4d2e74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.790875:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f6beb5f/0x9383f985bc4d2e74 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.790883:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f6beb5f/0x9383f985bc4d2e74 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.790915:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201213.790918:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201213.790920:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201213.792979:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3311:x1875064458211968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 29252us (29408us total) trans 4294968832 rc 0/0 00000100:00100000:1.0:1788201213.792992:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4147 00000004:00080000:2.0:1788201213.793196:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04ff057100/2, rc 0, transno 4294968832 00000100:00100000:2.0:1788201213.793204:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff057100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458211968:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201213.796708:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201213.796983:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442609920 00000100:00100000:3.0:1788201213.796994:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442609920 00010000:00010000:3.0:1788201213.797035:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bcb14b1f/0x9383f985bc4b23a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x232:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc352 expref: 6 pid: 6706 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201213.797113:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1531 00000100:00100000:3.0:1788201213.797138:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c20bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2359:x1875064442609920:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201213.797154:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201213.797160:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bcb14b1f/0x9383f985bc4b23a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x232:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc352 expref: 6 pid: 6706 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.797174:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bcb14b1f/0x9383f985bc4b23a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x232:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc352 expref: 6 pid: 6706 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.797198:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcb14b1f/0x9383f985bc4b23a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x232:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bc352 expref: 6 pid: 6706 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.797212:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x232:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201213.797217:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x232:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201213.797222:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000002359bf1/0x9383f985bc4d2e6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.797231:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002359bf1/0x9383f985bc4d2e6d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.797258:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201213.797341:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c20bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2359:x1875064442609920:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 206us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201213.797349:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1531 00010000:00010000:3.0:1788201213.801540:0:12363:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000002359bf1/0x9383f985bc4d2e6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.801559:0:12363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002359bf1/0x9383f985bc4d2e6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.801572:0:12363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002359bf1/0x9383f985bc4d2e6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.801581:0:12363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002359bf1/0x9383f985bc4d2e6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.801646:0:12363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201213.801978:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c20bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3313:x1875064458211584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 40006us (40206us total) trans 4294968833 rc 0/0 00000100:00100000:3.0:1788201213.801989:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4146 00010000:00010000:0.0:1788201213.802498:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201213.802506:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002359bf1/0x9383f985bc4d2e6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.802516:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201213.802520:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002359bf1/0x9383f985bc4d2e6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.802536:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002359bf1/0x9383f985bc4d2e6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.802554:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002359bf1/0x9383f985bc4d2e6d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.802561:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002359bf1/0x9383f985bc4d2e6d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.802705:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788201213.802805:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c3448700/2, rc 0, transno 4294968833 00000100:00100000:3.0:1788201213.802813:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458211584:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788201213.802866:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201213.802870:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201213.802872:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201213.830014:0:13664:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 102a: check resend (request lost) with multiple modify RPCs in flight ========================================================== 14:33:32 (1788201212) 00000100:00100000:3.0:1788201213.922700:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201213.922790:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442610048 00000100:00100000:0.0:1788201213.922799:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442610048 00000100:00100000:0.0:1788201213.922859:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5024 00000100:00100000:0.0:1788201213.922870:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:13659:x1875064442610048:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1788201213.923474:0:13379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201213.923501:0:13379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2e90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c49d3 expref: -99 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.923569:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2e97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.923583:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2e97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.923597:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2e97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201213.923789:0:13379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1788201213.923794:0:13379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201213.923870:0:13379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2e97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.924377:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2e90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c49d3 expref: 7 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.924988:0:13379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2e97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c49d3 expref: 6 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201213.924998:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c2fc5200) 00010000:00010000:0.0:1788201213.925001:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201213.925004:0:13379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c37d0400, rc 0) 00000100:00100000:0.0:1788201213.925135:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:13659:x1875064442610048:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 2266us (2443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201213.925143:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5024 00000100:00100000:3.0:1788201213.933134:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201213.939119:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442610176 00000100:00100000:1.0:1788201213.939135:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442610176 00000100:00100000:1.0:1788201213.939257:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5025 00000100:00100000:1.0:1788201213.939268:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:13659:x1875064442610176:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1788201213.939289:0:12969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201213.939323:0:12969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d2e9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c49da expref: -99 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.939690:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2ea5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.939710:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2ea5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.939721:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2ea5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.939737:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2eac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.939744:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2eac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.939751:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2eac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.940690:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2ea5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.940702:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2ea5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.940709:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2ea5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.940715:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201213.940718:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2ea5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.940725:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2ea5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.940738:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c2fc5200) 00010000:00010000:1.0:1788201213.940742:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201213.940747:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2ea5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.940753:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2ea5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.940766:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2eac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.940773:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2eac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.940779:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2eac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.942480:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201213.942495:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2eac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.942510:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2eac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.942526:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc2d93176 (ffff9e03c5173300) 00010000:00010000:1.0:1788201213.942529:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201213.942532:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2eac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.942540:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2eac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.942599:0:12969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d2e9e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c49da expref: 7 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.942612:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c2fc5200) 00010000:00010000:1.0:1788201213.942614:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201213.942618:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d2e9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c49da expref: 7 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.942627:0:12969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3400, rc 0) 00000100:00100000:1.0:1788201213.942712:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:13659:x1875064442610176:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 3445us (9587us total) trans 0 rc 301/301 00000100:00100000:1.0:1788201213.942721:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5025 00000100:00100000:3.0:1788201213.949563:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201213.949679:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201213.955335:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442610304 00000100:00100000:1.0:1788201213.955349:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442610304 00000100:00100000:1.0:1788201213.955569:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442610560 00000100:00100000:1.0:1788201213.955573:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442610560 00000100:00100000:1.0:1788201213.955602:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5026 00000100:00100000:1.0:1788201213.955611:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2361:x1875064442610304:12345-192.168.201.30@tcp:41:lfs.0 00000004:00000024:1.0:1788201213.955655:0:12968:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788201213.955730:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2361:x1875064442610304:12345-192.168.201.30@tcp:41:lfs.0 Request processed in 120us (6178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201213.955739:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5026 00000100:00100000:1.0:1788201213.955760:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5027 00000100:00100000:1.0:1788201213.955768:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:13659:x1875064442610560:12345-192.168.201.30@tcp:36:lfs.0 00010000:00010000:1.0:1788201213.956543:0:12968:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201213.956571:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2e97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c49d3 expref: 6 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.956597:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c2fc5200) 00010000:00010000:1.0:1788201213.956616:0:12968:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201213.957191:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2eb3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.957207:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2eb3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.957218:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2eb3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.957232:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2eba lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.957240:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2eba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.957246:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2eba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201213.961660:0:12968:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3e9:0x0]: returning size 512 00010000:00010000:1.0:1788201213.961680:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2eb3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.961691:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2eb3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.961700:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2eb3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.961707:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201213.961713:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2eb3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.961721:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2eb3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.961737:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173c00) 00010000:00010000:1.0:1788201213.961740:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201213.961745:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2eb3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.961752:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2eb3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201213.961771:0:12968:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000adacb0bb reply state 00000000a361f5d9 transno 8589938607 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2eba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201213.961781:0:12968:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201213.962560:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:13659:x1875064442610560:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 6788us (12876us total) trans 8589938607 rc 0/0 00000100:00100000:1.0:1788201213.962570:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5027 00010000:00010000:2.0:1788201213.972483:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2eba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.972498:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2eba lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.972506:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2eba lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.972512:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201213.972516:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2eba lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.972523:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2eba lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.972538:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc2d93176 (ffff9e03c5173f00) 00010000:00010000:2.0:1788201213.972542:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201213.972546:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2eba lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201213.972553:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2eba lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201213.989072:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201213.989180:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442610688 00000100:00100000:1.0:1788201213.989189:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442610688 00000100:00100000:1.0:1788201213.990479:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5028 00000100:00100000:1.0:1788201213.990498:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:13662:x1875064442610688:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1788201213.990525:0:12969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201213.990550:0:12969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2ec1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c49e1 expref: -99 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.990615:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d2ec8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.990630:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d2ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.990641:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d2ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201213.990707:0:12969:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1788201213.990711:0:12969:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201213.990735:0:12969:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d2ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.990760:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2ec1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c49e1 expref: 8 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.990778:0:12969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d2ec8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c49e1 expref: 7 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201213.990787:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173c00) 00010000:00010000:1.0:1788201213.990791:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201213.990794:0:12969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3400, rc 0) 00000100:00100000:1.0:1788201213.990859:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:13662:x1875064442610688:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 369us (1794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201213.990867:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5028 00000100:00100000:3.0:1788201213.993626:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201213.993656:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442610944 00000100:00100000:3.0:1788201213.993665:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442610944 00000100:00100000:3.0:1788201213.993717:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5029 00000100:00100000:3.0:1788201213.993727:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:13662:x1875064442610944:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788201213.993745:0:12971:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201213.993765:0:12971:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016c00/0x9383f985bc4d2ecf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c49e8 expref: -99 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.993832:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017a00/0x9383f985bc4d2ed6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.993845:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017a00/0x9383f985bc4d2ed6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.993861:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017a00/0x9383f985bc4d2ed6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.993875:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d2edd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.993882:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d2edd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.993890:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d2edd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201213.994024:0:12971:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3e9:0x0]: returning size 512 00010000:00010000:3.0:1788201213.994115:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017a00/0x9383f985bc4d2ed6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.994123:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017a00/0x9383f985bc4d2ed6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.994130:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017a00/0x9383f985bc4d2ed6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.994137:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201213.994142:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017a00/0x9383f985bc4d2ed6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.994150:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017a00/0x9383f985bc4d2ed6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.994162:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173c00) 00010000:00010000:3.0:1788201213.994165:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201213.994170:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017a00/0x9383f985bc4d2ed6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.994177:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017a00/0x9383f985bc4d2ed6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.994188:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d2edd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.994195:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d2edd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.994201:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d2edd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.994207:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3016600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201213.994209:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d2edd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.994215:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d2edd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.994222:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc2d93176 (ffff9e03c33e8900) 00010000:00010000:3.0:1788201213.994224:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201213.994227:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d2edd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.994233:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d2edd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.994270:0:12971:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016c00/0x9383f985bc4d2ecf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c49e8 expref: 9 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.994285:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173c00) 00010000:00010000:3.0:1788201213.994288:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201213.994314:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016c00/0x9383f985bc4d2ecf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c49e8 expref: 9 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201213.994325:0:12971:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c3016c00, rc 0) 00000100:00100000:3.0:1788201213.995687:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:13662:x1875064442610944:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 652us (757us total) trans 8589938608 rc 301/301 00000100:00100000:3.0:1788201213.995703:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5029 00000100:00100000:0.0:1788201214.005963:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201214.006006:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442611200 00000100:00100000:0.0:1788201214.006016:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442611200 00000100:00100000:0.0:1788201214.006064:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5030 00000100:00100000:0.0:1788201214.006073:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c20bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:13662:x1875064442611200:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1788201214.006095:0:12968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201214.006115:0:12968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1200/0x9383f985bc4d2eeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c49ef expref: -99 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.006182:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2ef2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.006196:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2ef2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.006208:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2ef2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.006223:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2ef9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.006231:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.006238:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.008532:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d2f00 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.008552:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d2f00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.008563:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d2f00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201214.008577:0:12968:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3e9:0x0]: returning size 512 00010000:00010000:0.0:1788201214.008696:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2ef2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.008705:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2ef2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.008712:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2ef2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.008718:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201214.008723:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2ef2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.008729:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2ef2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.008740:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173c00) 00010000:00010000:0.0:1788201214.008743:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201214.008747:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2ef2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.008753:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2ef2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.008764:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.008771:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2ef9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.008776:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.008781:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201214.008784:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.008790:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2ef9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.008798:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc2d93176 (ffff9e03c2fc5400) 00010000:00010000:0.0:1788201214.008800:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201214.008804:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2ef9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.008810:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2ef9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.009082:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1200/0x9383f985bc4d2eeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c49ef expref: 11 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.009097:0:12968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d2f00 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c49ef expref: 10 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.009104:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:0.0:1788201214.009107:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201214.009109:0:12968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c37d1600, rc 0) 00000100:00100000:0.0:1788201214.009178:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c20bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:13662:x1875064442611200:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 3105us (3224us total) trans 8589938609 rc 0/0 00000100:00100000:0.0:1788201214.009187:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5030 00000100:00100000:3.0:1788201214.014124:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201214.018973:0:13381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442611456 00000100:00100000:1.0:1788201214.018988:0:13381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442611456 00000100:00100000:1.0:1788201214.019057:0:13381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1008 00000100:00100000:1.0:1788201214.019066:0:13381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:13662:x1875064442611456:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:1.0:1788201214.019336:0:13381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:13662:x1875064442611456:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 270us (5220us total) trans 8589938610 rc 0/0 00000100:00100000:1.0:1788201214.019345:0:13381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1008 00000100:00100000:1.0:1788201214.026122:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201214.028546:0:12973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442611584 00000100:00100000:0.0:1788201214.028560:0:12973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442611584 00000100:00100000:0.0:1788201214.028917:0:12973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1009 00000100:00100000:0.0:1788201214.028928:0:12973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:13662:x1875064442611584:12345-192.168.201.30@tcp:33:lfs.0 00000004:00200000:0.0:1788201214.029025:0:12973:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3e9:0x0]: returning size 512 00000004:00200000:0.0:1788201214.029030:0:12973:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:0.0:1788201214.029120:0:12973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:13662:x1875064442611584:12345-192.168.201.30@tcp:33:lfs.0 Request processed in 193us (3007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201214.029128:0:12973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1009 00000100:00100000:2.0:1788201214.031563:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201214.033968:0:13381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442611840 00000100:00100000:1.0:1788201214.033982:0:13381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442611840 00000100:00100000:1.0:1788201214.034034:0:13381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1010 00000100:00100000:1.0:1788201214.034043:0:13381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:13662:x1875064442611840:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:1.0:1788201214.034290:0:13381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:13662:x1875064442611840:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 247us (2734us total) trans 8589938611 rc 0/0 00000100:00100000:1.0:1788201214.034320:0:13381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1010 00000100:00100000:2.0:1788201214.119718:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201214.119870:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442611968 00000100:00100000:0.0:1788201214.119889:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442611968 00000100:00100000:0.0:1788201214.119996:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5031 00000100:00100000:0.0:1788201214.120006:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:13665:x1875064442611968:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:0.0:1788201214.120031:0:13406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201214.120051:0:13406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1200/0x9383f985bc4d2f0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c49f6 expref: -99 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.120115:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2f15 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.120129:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2f15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.120140:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2f15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.120155:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2f1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.120162:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2f1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.120169:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2f1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.120278:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0a00/0x9383f985bc4d2f23 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.120287:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0a00/0x9383f985bc4d2f23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.120328:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0a00/0x9383f985bc4d2f23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201214.120508:0:13406:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3e9:0x0]: returning size 512 00000004:00200000:0.0:1788201214.120512:0:13406:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201214.120537:0:13406:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0a00/0x9383f985bc4d2f23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.120549:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2f15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.120555:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2f15 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.120561:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2f15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.120567:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201214.120570:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2f15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.120577:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2f15 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.120590:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173c00) 00010000:00010000:0.0:1788201214.120592:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201214.120597:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2f15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.120604:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2f15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.120618:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2f1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.120629:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2f1c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.120635:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2f1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.120640:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201214.120643:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2f1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.120650:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2f1c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.120657:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc2d93176 (ffff9e03c2fc5400) 00010000:00010000:0.0:1788201214.120659:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201214.120662:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2f1c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.120667:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2f1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.120699:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1200/0x9383f985bc4d2f0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c49f6 expref: 14 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.120713:0:13406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0a00/0x9383f985bc4d2f23 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c49f6 expref: 13 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.120721:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:0.0:1788201214.120724:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788201214.120727:0:13406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c37d0a00, rc 0) 00000100:00100000:0.0:1788201214.120836:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:13665:x1875064442611968:12345-192.168.201.30@tcp:101:touch.0 Request processed in 830us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201214.120844:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5031 00000100:00100000:2.0:1788201214.126680:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201214.127074:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442612224 00000100:00100000:1.0:1788201214.127084:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442612224 00000100:00100000:1.0:1788201214.127184:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5032 00000100:00100000:1.0:1788201214.127196:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:13665:x1875064442612224:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:1.0:1788201214.127218:0:12969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201214.127222:0:12969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788201214.127246:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d2f00 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c49ef expref: 13 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.127264:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:1.0:1788201214.127269:0:12969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201214.127281:0:12969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2f2a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c49fd expref: -99 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.127465:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2f31 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.127483:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2f31 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.127493:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2f31 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.127510:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2f38 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.127518:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2f38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.127525:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2f38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201214.128448:0:12969:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x416:0x0], index 0: 0 00010000:00010000:1.0:1788201214.128625:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d2f3f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.128637:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d2f3f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.128646:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d2f3f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.128683:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2f31 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.128691:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2f31 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.128697:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2f31 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.128704:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201214.128708:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2f31 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.128715:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2f31 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.128726:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:1.0:1788201214.128729:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201214.128733:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2f31 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.128739:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2f31 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201214.128752:0:12969:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d087e495 reply state 00000000b6fd2ab5 transno 8589938612 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2f38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201214.128760:0:12969:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201214.129259:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2f2a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c49fd expref: 15 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.129276:0:12969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d2f3f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c49fd expref: 14 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.129284:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ea:0x0].0x0 (ffff9e03c5173400) 00010000:00010000:1.0:1788201214.129287:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201214.129290:0:12969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2400, rc 0) 00000100:00100000:1.0:1788201214.129518:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:13665:x1875064442612224:12345-192.168.201.30@tcp:101:touch.0 Request processed in 2322us (2846us total) trans 8589938612 rc 0/0 00000100:00100000:1.0:1788201214.129527:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5032 00010000:00010000:0.0:1788201214.132790:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2f38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.132808:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2f38 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.132817:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2f38 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.132824:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201214.132829:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2f38 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.132837:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2f38 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.132855:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0xcda302ea (ffff9e03c5173300) 00010000:00010000:0.0:1788201214.132858:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201214.132864:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2f38 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.132870:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2f38 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201214.135403:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201214.135501:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442612480 00000100:00100000:0.0:1788201214.135511:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442612480 00000100:00100000:0.0:1788201214.135565:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5033 00000100:00100000:0.0:1788201214.135574:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:13665:x1875064442612480:12345-192.168.201.30@tcp:36:touch.0 00010000:00010000:0.0:1788201214.135631:0:13379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201214.135656:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d2f3f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c49fd expref: 14 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.135675:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ea:0x0].0x0 (ffff9e03c5173400) 00010000:00010000:0.0:1788201214.135687:0:13379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201214.135741:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d2f4d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.135754:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d2f4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.135763:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d2f4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201214.135920:0:13379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fbb44829 reply state 000000001c38126e transno 8589938613 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d2f4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201214.135930:0:13379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201214.136025:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:13665:x1875064442612480:12345-192.168.201.30@tcp:36:touch.0 Request processed in 451us (631us total) trans 8589938613 rc 0/0 00000100:00100000:0.0:1788201214.136033:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5033 00000100:00100000:2.0:1788201214.140565:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1788201214.140702:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d2f4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.140715:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d2f4d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.140722:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d2f4d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.140728:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201214.140733:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d2f4d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.140741:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d2f4d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.140757:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ea:0x0].0x0 (ffff9e03c2fc5c00) 00010000:00010000:3.0:1788201214.140761:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201214.140766:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d2f4d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.140772:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d2f4d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201214.141151:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442612608 00000100:00100000:0.0:1788201214.141160:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442612608 00000100:00100000:0.0:1788201214.141247:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5034 00000100:00100000:0.0:1788201214.141257:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:13665:x1875064442612608:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:0.0:1788201214.141281:0:13406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201214.141371:0:13406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1200/0x9383f985bc4d2f54 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4a04 expref: -99 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.141515:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1200/0x9383f985bc4d2f54 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a04 expref: 15 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.141529:0:13406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1200/0x9383f985bc4d2f54 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a04 expref: 15 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.141547:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ea:0x0].0x0 (ffff9e03c2fc5400) 00010000:00010000:0.0:1788201214.141550:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788201214.141553:0:13406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c37d1200, rc 0) 00000100:00100000:0.0:1788201214.141662:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:13665:x1875064442612608:12345-192.168.201.30@tcp:101:touch.0 Request processed in 406us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201214.141670:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5034 00000100:00100000:2.0:1788201214.145258:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201214.145589:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442612736 00000100:00100000:0.0:1788201214.145599:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442612736 00000100:00100000:0.0:1788201214.145694:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4151 00000100:00100000:0.0:1788201214.145705:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5475500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2360:x1875064442612736:12345-192.168.201.30@tcp:2:touch.0 00000100:00100000:0.0:1788201214.147090:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5475500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+506:2360:x1875064442612736:12345-192.168.201.30@tcp:2:touch.0 Request processed in 1381us (1834us total) trans 4294968832 rc 0/0 00000100:00100000:0.0:1788201214.147101:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4151 00000100:00100000:3.0:1788201214.149750:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201214.150175:0:13381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442612992 00000100:00100000:1.0:1788201214.150185:0:13381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442612992 00000100:00100000:1.0:1788201214.150279:0:13381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1011 00000100:00100000:1.0:1788201214.150318:0:13381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:13665:x1875064442612992:12345-192.168.201.30@tcp:35:touch.0 00000100:00100000:1.0:1788201214.150673:0:13381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:13665:x1875064442612992:12345-192.168.201.30@tcp:35:touch.0 Request processed in 384us (932us total) trans 8589938614 rc 0/0 00000100:00100000:1.0:1788201214.150681:0:13381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1011 00000100:00100000:2.0:1788201214.165445:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201214.165580:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442613248 00000100:00100000:1.0:1788201214.165591:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442613248 00000100:00100000:1.0:1788201214.165655:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5035 00000100:00100000:1.0:1788201214.165666:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:13666:x1875064442613248:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:1.0:1788201214.165691:0:12969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201214.165712:0:12969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2f5b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4a0b expref: -99 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.165841:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2f62 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.165855:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2f62 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.165866:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2f62 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.165894:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d2f69 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.165916:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d2f69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.165923:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d2f69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201214.166670:0:12969:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x416:0x0], index 1: 0 00010000:00010000:1.0:1788201214.166819:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2f70 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.166830:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2f70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.166838:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2f70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.166868:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2f62 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.166874:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2f62 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.167169:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2f62 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.167175:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201214.167180:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2f62 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.167187:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2f62 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.167204:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:1.0:1788201214.167207:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201214.167211:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2f62 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.167218:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2f62 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201214.167232:0:12969:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c7471b5 reply state 000000008c973cca transno 8589938615 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d2f69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201214.167240:0:12969:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201214.167422:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d2f5b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a0b expref: 19 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.167440:0:12969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2f70 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a0b expref: 18 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.167447:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3eb:0x0].0x0 (ffff9e03c5173600) 00010000:00010000:2.0:1788201214.167449:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201214.167452:0:12969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3e00, rc 0) 00000100:00100000:2.0:1788201214.167543:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:13666:x1875064442613248:12345-192.168.201.30@tcp:101:touch.0 Request processed in 1878us (2106us total) trans 8589938615 rc 0/0 00000100:00100000:2.0:1788201214.167552:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5035 00010000:00010000:0.0:1788201214.171950:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d2f69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.171967:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d2f69 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.171976:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d2f69 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.171982:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201214.171987:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d2f69 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.171994:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d2f69 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.172022:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x15fcbbea (ffff9e03c5173000) 00010000:00010000:0.0:1788201214.172026:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201214.172030:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d2f69 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.172037:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d2f69 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201214.174071:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201214.174258:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442613504 00000100:00100000:3.0:1788201214.174268:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442613504 00000100:00100000:3.0:1788201214.174361:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5036 00000100:00100000:3.0:1788201214.174372:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+18:13666:x1875064442613504:12345-192.168.201.30@tcp:36:touch.0 00010000:00010000:3.0:1788201214.174439:0:12971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201214.174822:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d2f70 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a0b expref: 18 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.174842:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3eb:0x0].0x0 (ffff9e03c5173600) 00010000:00010000:3.0:1788201214.174853:0:12971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201214.174927:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016c00/0x9383f985bc4d2f7e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.174940:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016c00/0x9383f985bc4d2f7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.174950:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016c00/0x9383f985bc4d2f7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201214.175190:0:12971:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000028e0cd1b reply state 00000000b2e5997e transno 8589938616 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016c00/0x9383f985bc4d2f7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201214.175214:0:12971:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201214.175429:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:13666:x1875064442613504:12345-192.168.201.30@tcp:36:touch.0 Request processed in 1058us (1364us total) trans 8589938616 rc 0/0 00000100:00100000:3.0:1788201214.175438:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5036 00000100:00100000:2.0:1788201214.181845:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201214.182170:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442613632 00000100:00100000:0.0:1788201214.182180:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442613632 00000100:00100000:0.0:1788201214.182244:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5037 00000100:00100000:0.0:1788201214.182254:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:13666:x1875064442613632:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:0.0:1788201214.182278:0:13406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201214.182327:0:13406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2f85 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4a12 expref: -99 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.182399:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2f85 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a12 expref: 20 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.182414:0:13406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2f85 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a12 expref: 20 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.182439:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3eb:0x0].0x0 (ffff9e03c33e8900) 00010000:00010000:0.0:1788201214.182442:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788201214.182446:0:13406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c37d1c00, rc 0) 00000100:00100000:0.0:1788201214.182514:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:13666:x1875064442613632:12345-192.168.201.30@tcp:101:touch.0 Request processed in 262us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201214.182521:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5037 00010000:00010000:3.0:1788201214.183675:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016c00/0x9383f985bc4d2f7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.183688:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016c00/0x9383f985bc4d2f7e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.183695:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016c00/0x9383f985bc4d2f7e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.183701:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3016c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201214.183706:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016c00/0x9383f985bc4d2f7e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.183713:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016c00/0x9383f985bc4d2f7e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.183726:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3eb:0x0].0x0 (ffff9e03c33e8900) 00010000:00010000:3.0:1788201214.183729:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201214.183733:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016c00/0x9383f985bc4d2f7e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.183740:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016c00/0x9383f985bc4d2f7e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201214.187289:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201214.187894:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442613760 00000100:00100000:3.0:1788201214.187913:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442613760 00000100:00100000:3.0:1788201214.187961:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4152 00000100:00100000:3.0:1788201214.187971:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5477100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2359:x1875064442613760:12345-192.168.201.30@tcp:2:touch.0 00000100:00100000:2.0:1788201214.189205:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5477100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2359:x1875064442613760:12345-192.168.201.30@tcp:2:touch.0 Request processed in 1229us (1919us total) trans 4294968834 rc 0/0 00000100:00100000:2.0:1788201214.189215:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4152 00000100:00100000:2.0:1788201214.199643:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201214.199739:0:12972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442614016 00000100:00100000:3.0:1788201214.199750:0:12972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442614016 00000100:00100000:3.0:1788201214.199822:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1012 00000100:00100000:3.0:1788201214.199834:0:12972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c67d9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:13666:x1875064442614016:12345-192.168.201.30@tcp:35:touch.0 00000100:00100000:3.0:1788201214.200361:0:12972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c67d9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:13666:x1875064442614016:12345-192.168.201.30@tcp:35:touch.0 Request processed in 528us (728us total) trans 8589938617 rc 0/0 00000100:00100000:3.0:1788201214.200369:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1012 00000100:00100000:3.0:1788201214.251136:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201214.251512:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442614272 00000100:00100000:2.0:1788201214.251523:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442614272 00000100:00100000:2.0:1788201214.251587:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5038 00000100:00100000:2.0:1788201214.251598:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:13667:x1875064442614272:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:2.0:1788201214.251624:0:12969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201214.251647:0:12969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d2f8c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4a19 expref: -99 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.251769:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d2f93 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.251797:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d2f93 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.251808:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d2f93 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.251824:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d2f9a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.251832:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d2f9a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.251838:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d2f9a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201214.252526:0:12969:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x417:0x0], index 0: 0 00010000:00010000:2.0:1788201214.252685:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d2fa1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.252696:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d2fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.252705:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d2fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.252740:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d2f93 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.252747:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d2f93 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.252753:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d2f93 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.252760:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bd600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201214.252764:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d2f93 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.252771:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d2f93 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.252783:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:2.0:1788201214.252786:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201214.252791:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d2f93 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.252798:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d2f93 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201214.252812:0:12969:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a27d3422 reply state 00000000bfaa10ba transno 8589938618 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d2f9a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201214.252821:0:12969:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201214.252852:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d2f8c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a19 expref: 23 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.252865:0:12969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d2fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a19 expref: 22 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.252873:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ec:0x0].0x0 (ffff9e03c33ed700) 00010000:00010000:2.0:1788201214.253606:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201214.253609:0:12969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bc200, rc 0) 00000100:00100000:2.0:1788201214.253689:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:13667:x1875064442614272:12345-192.168.201.30@tcp:101:touch.0 Request processed in 2092us (2560us total) trans 8589938618 rc 0/0 00000100:00100000:2.0:1788201214.253697:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5038 00010000:00010000:0.0:1788201214.260830:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d2f9a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.260849:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d2f9a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.260857:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d2f9a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.260864:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201214.260870:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d2f9a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.261067:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d2f9a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.261085:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x5e5674ea (ffff9e03c33ed200) 00010000:00010000:0.0:1788201214.261089:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201214.261094:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d2f9a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.261100:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d2f9a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201214.261862:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201214.262225:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442614528 00000100:00100000:0.0:1788201214.262235:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442614528 00000100:00100000:0.0:1788201214.262326:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5039 00000100:00100000:0.0:1788201214.262337:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:13667:x1875064442614528:12345-192.168.201.30@tcp:36:touch.0 00010000:00010000:0.0:1788201214.262402:0:12971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201214.262420:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d2fa1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a19 expref: 22 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.262434:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ec:0x0].0x0 (ffff9e03c33ed700) 00010000:00010000:0.0:1788201214.262442:0:12971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201214.262497:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2faf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.262509:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2faf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.262519:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2faf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201214.262648:0:12971:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043268c16 reply state 00000000338d6fb2 transno 8589938619 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2faf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201214.262657:0:12971:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201214.262755:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:13667:x1875064442614528:12345-192.168.201.30@tcp:36:touch.0 Request processed in 419us (897us total) trans 8589938619 rc 0/0 00000100:00100000:0.0:1788201214.262763:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5039 00010000:00010000:3.0:1788201214.265686:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2faf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.265704:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2faf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.265712:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2faf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.265718:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201214.265722:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2faf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.265730:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2faf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.265745:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ec:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:3.0:1788201214.265748:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201214.265752:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2faf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.265759:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d2faf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201214.268280:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201214.268744:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442614656 00000100:00100000:1.0:1788201214.268755:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442614656 00000100:00100000:1.0:1788201214.268827:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5040 00000100:00100000:1.0:1788201214.268838:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff054380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:13667:x1875064442614656:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:1.0:1788201214.268862:0:13379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201214.268895:0:13379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2fb6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4a20 expref: -99 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.268963:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2fb6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a20 expref: 23 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.268978:0:13379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2fb6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a20 expref: 23 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.268998:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ec:0x0].0x0 (ffff9e03c5173d00) 00010000:00010000:1.0:1788201214.269001:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201214.269005:0:13379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3c00, rc 0) 00000100:00100000:1.0:1788201214.269061:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff054380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:13667:x1875064442614656:12345-192.168.201.30@tcp:101:touch.0 Request processed in 224us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201214.269068:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5040 00000100:00100000:2.0:1788201214.273228:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201214.273348:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442614784 00000100:00100000:0.0:1788201214.273357:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442614784 00000100:00100000:0.0:1788201214.273423:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4153 00000100:00100000:0.0:1788201214.273434:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+506:2360:x1875064442614784:12345-192.168.201.30@tcp:2:touch.0 00000100:00100000:0.0:1788201214.273764:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+507:2360:x1875064442614784:12345-192.168.201.30@tcp:2:touch.0 Request processed in 331us (543us total) trans 4294968833 rc 0/0 00000100:00100000:0.0:1788201214.273773:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4153 00000100:00100000:2.0:1788201214.278402:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201214.278647:0:13381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442615040 00000100:00100000:1.0:1788201214.278658:0:13381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442615040 00000100:00100000:1.0:1788201214.278713:0:13381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1013 00000100:00100000:1.0:1788201214.278724:0:13381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:13667:x1875064442615040:12345-192.168.201.30@tcp:35:touch.0 00000100:00100000:1.0:1788201214.279089:0:13381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:13667:x1875064442615040:12345-192.168.201.30@tcp:35:touch.0 Request processed in 366us (695us total) trans 8589938620 rc 0/0 00000100:00100000:1.0:1788201214.279096:0:13381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1013 00000100:00100000:2.0:1788201214.296987:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201214.297151:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442615296 00000100:00100000:1.0:1788201214.297162:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442615296 00000100:00100000:1.0:1788201214.297226:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5041 00000100:00100000:1.0:1788201214.297237:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5476d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:13668:x1875064442615296:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:1.0:1788201214.297263:0:12968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201214.297284:0:12968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2fbd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4a27 expref: -99 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.297478:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d2fc4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.297492:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d2fc4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.297504:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d2fc4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.297519:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2fcb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.297527:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2fcb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.297534:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2fcb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201214.298556:0:12968:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x417:0x0], index 1: 0 00010000:00010000:1.0:1788201214.298724:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d2fd2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.298736:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d2fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.298744:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d2fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.298775:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d2fc4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.298795:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d2fc4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.298801:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d2fc4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.298806:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201214.298811:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d2fc4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.298818:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d2fc4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.298833:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:1.0:1788201214.298836:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201214.298840:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d2fc4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.298847:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d2fc4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201214.298862:0:12968:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000003bbfd6 reply state 00000000cd020748 transno 8589938621 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2fcb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201214.298871:0:12968:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201214.299188:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2fbd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a27 expref: 27 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.299205:0:12968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d2fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a27 expref: 26 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.299212:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ed:0x0].0x0 (ffff9e03c5173200) 00010000:00010000:1.0:1788201214.299214:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201214.299217:0:12968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2c00, rc 0) 00000100:00100000:1.0:1788201214.299286:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5476d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:13668:x1875064442615296:12345-192.168.201.30@tcp:101:touch.0 Request processed in 2050us (2307us total) trans 8589938621 rc 0/0 00000100:00100000:1.0:1788201214.299346:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5041 00010000:00010000:0.0:1788201214.302200:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2fcb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.302219:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2fcb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.302227:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2fcb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.302233:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201214.302238:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2fcb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.302246:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2fcb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.302260:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0xa6b02dea (ffff9e03c5173100) 00010000:00010000:0.0:1788201214.302264:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201214.302268:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2fcb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.302274:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d2fcb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201214.306246:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201214.306586:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442615552 00000100:00100000:0.0:1788201214.306596:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442615552 00000100:00100000:0.0:1788201214.306652:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5042 00000100:00100000:0.0:1788201214.306663:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:13668:x1875064442615552:12345-192.168.201.30@tcp:36:touch.0 00010000:00010000:0.0:1788201214.306721:0:13406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201214.306746:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d2fd2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a27 expref: 26 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.306768:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ed:0x0].0x0 (ffff9e03c5173200) 00010000:00010000:0.0:1788201214.306777:0:13406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201214.306847:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d2fe0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.306859:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d2fe0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.306868:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d2fe0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201214.307077:0:13406:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000061355136 reply state 0000000019a45c77 transno 8589938622 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d2fe0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201214.307087:0:13406:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201214.307179:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:13668:x1875064442615552:12345-192.168.201.30@tcp:36:touch.0 Request processed in 518us (942us total) trans 8589938622 rc 0/0 00000100:00100000:0.0:1788201214.307186:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5042 00010000:00010000:3.0:1788201214.310379:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d2fe0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.310397:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d2fe0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.310405:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d2fe0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.310411:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201214.310415:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d2fe0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.310422:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d2fe0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.310438:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ed:0x0].0x0 (ffff9e03c2fc5d00) 00010000:00010000:3.0:1788201214.310441:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201214.310445:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d2fe0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.310451:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d2fe0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201214.312811:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201214.312925:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442615680 00000100:00100000:1.0:1788201214.312934:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442615680 00000100:00100000:1.0:1788201214.312996:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5043 00000100:00100000:1.0:1788201214.313015:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:13668:x1875064442615680:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:1.0:1788201214.313041:0:12969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201214.313064:0:12969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2fe7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4a2e expref: -99 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.313125:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2fe7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a2e expref: 27 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.313140:0:12969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2fe7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a2e expref: 27 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.313158:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ed:0x0].0x0 (ffff9e03c5173e00) 00010000:00010000:1.0:1788201214.313162:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201214.313165:0:12969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2200, rc 0) 00000100:00100000:1.0:1788201214.313227:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:13668:x1875064442615680:12345-192.168.201.30@tcp:101:touch.0 Request processed in 222us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201214.313234:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5043 00000100:00100000:2.0:1788201214.317264:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201214.317578:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442615808 00000100:00100000:0.0:1788201214.317588:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442615808 00000100:00100000:0.0:1788201214.317649:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4154 00000100:00100000:0.0:1788201214.317659:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2359:x1875064442615808:12345-192.168.201.30@tcp:2:touch.0 00000100:00100000:0.0:1788201214.318172:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2359:x1875064442615808:12345-192.168.201.30@tcp:2:touch.0 Request processed in 513us (917us total) trans 4294968835 rc 0/0 00000100:00100000:0.0:1788201214.318180:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4154 00000100:00100000:2.0:1788201214.321187:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201214.321268:0:12972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442616064 00000100:00100000:3.0:1788201214.321278:0:12972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442616064 00000100:00100000:3.0:1788201214.321356:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1014 00000100:00100000:3.0:1788201214.321367:0:12972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:13668:x1875064442616064:12345-192.168.201.30@tcp:35:touch.0 00000100:00100000:3.0:1788201214.321704:0:12972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:13668:x1875064442616064:12345-192.168.201.30@tcp:35:touch.0 Request processed in 337us (524us total) trans 8589938623 rc 0/0 00000100:00100000:3.0:1788201214.321712:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1014 00000100:00100000:2.0:1788201214.338227:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201214.338693:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442616320 00000100:00100000:1.0:1788201214.338704:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442616320 00000100:00100000:1.0:1788201214.338823:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5044 00000100:00100000:1.0:1788201214.338834:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c26e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:13669:x1875064442616320:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:1.0:1788201214.338860:0:12968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201214.338894:0:12968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d2fee lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4a35 expref: -99 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.339222:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d2ff5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.339237:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d2ff5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.339250:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d2ff5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.339268:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d2ffc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.339275:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d2ffc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.339282:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d2ffc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201214.340173:0:12968:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x418:0x0], index 0: 0 00010000:00010000:1.0:1788201214.340544:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d3003 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.340557:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d3003 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.340564:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d3003 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.340596:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d2ff5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.340602:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d2ff5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.340608:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d2ff5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.340614:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201214.340618:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d2ff5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.340625:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d2ff5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.340635:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:1.0:1788201214.340638:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201214.340642:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d2ff5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.340647:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d2ff5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201214.340660:0:12968:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b2b79824 reply state 00000000b5fe5d5d transno 8589938624 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d2ffc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201214.340669:0:12968:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201214.340700:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d2fee lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a35 expref: 31 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.340714:0:12968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d3003 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a35 expref: 30 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.340721:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ee:0x0].0x0 (ffff9e03c5173a00) 00010000:00010000:1.0:1788201214.340723:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201214.340725:0:12968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2e00, rc 0) 00000100:00100000:1.0:1788201214.341217:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c26e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+31:13669:x1875064442616320:12345-192.168.201.30@tcp:101:touch.0 Request processed in 2383us (2998us total) trans 8589938624 rc 0/0 00000100:00100000:1.0:1788201214.341226:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5044 00000100:00100000:2.0:1788201214.347768:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201214.348407:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442616576 00000100:00100000:3.0:1788201214.348417:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442616576 00000100:00100000:3.0:1788201214.348480:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5045 00000100:00100000:3.0:1788201214.348489:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c26e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+31:13669:x1875064442616576:12345-192.168.201.30@tcp:36:touch.0 00010000:00010000:3.0:1788201214.348543:0:13379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201214.348566:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d3003 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a35 expref: 31 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.348584:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ee:0x0].0x0 (ffff9e03c5173a00) 00010000:00010000:3.0:1788201214.348594:0:13379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201214.348642:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d3011 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.348654:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d3011 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.348663:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d3011 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201214.348773:0:13379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000079d4b2eb reply state 00000000858f1d6f transno 8589938625 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d3011 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201214.349122:0:13379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201214.349215:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c26e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+32:13669:x1875064442616576:12345-192.168.201.30@tcp:36:touch.0 Request processed in 726us (1455us total) trans 8589938625 rc 0/0 00000100:00100000:3.0:1788201214.349223:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5045 00010000:00010000:1.0:1788201214.354909:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d2ffc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.354927:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d2ffc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.354936:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d2ffc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.354942:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201214.354947:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d2ffc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.354954:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d2ffc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.354969:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0xef09e6ea (ffff9e03c5173900) 00010000:00010000:1.0:1788201214.354973:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201214.354977:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d2ffc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.354984:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d2ffc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.355233:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d3011 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.355242:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d3011 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.355249:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d3011 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.355254:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3016600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201214.355257:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d3011 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.355263:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d3011 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.355272:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ee:0x0].0x0 (ffff9e03c33e8f00) 00010000:00010000:3.0:1788201214.355274:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201214.355277:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d3011 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.355283:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d3011 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201214.356059:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201214.356388:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442616704 00000100:00100000:3.0:1788201214.356399:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442616704 00000100:00100000:3.0:1788201214.356457:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5046 00000100:00100000:3.0:1788201214.356467:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c26e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+30:13669:x1875064442616704:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:3.0:1788201214.356493:0:12971:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201214.356512:0:12971:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016c00/0x9383f985bc4d3018 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4a3c expref: -99 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.356573:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016c00/0x9383f985bc4d3018 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a3c expref: 31 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.356586:0:12971:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016c00/0x9383f985bc4d3018 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a3c expref: 31 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.356602:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ee:0x0].0x0 (ffff9e03c33e8500) 00010000:00010000:3.0:1788201214.356605:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201214.356608:0:12971:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c3016c00, rc 0) 00000100:00100000:3.0:1788201214.356661:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c26e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+31:13669:x1875064442616704:12345-192.168.201.30@tcp:101:touch.0 Request processed in 196us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201214.356668:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5046 00000100:00100000:2.0:1788201214.361636:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201214.361717:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442616832 00000100:00100000:0.0:1788201214.361726:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442616832 00000100:00100000:0.0:1788201214.361788:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4155 00000100:00100000:0.0:1788201214.361797:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c26e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+507:2361:x1875064442616832:12345-192.168.201.30@tcp:2:touch.0 00000100:00100000:0.0:1788201214.362252:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c26e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2361:x1875064442616832:12345-192.168.201.30@tcp:2:touch.0 Request processed in 454us (623us total) trans 4294968834 rc 0/0 00000100:00100000:0.0:1788201214.362260:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4155 00000100:00100000:2.0:1788201214.365874:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201214.366077:0:12973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442617088 00000100:00100000:3.0:1788201214.366086:0:12973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442617088 00000100:00100000:3.0:1788201214.366181:0:12973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1015 00000100:00100000:3.0:1788201214.366192:0:12973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c26e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+31:13669:x1875064442617088:12345-192.168.201.30@tcp:35:touch.0 00000100:00100000:3.0:1788201214.366581:0:12973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c26e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+32:13669:x1875064442617088:12345-192.168.201.30@tcp:35:touch.0 Request processed in 390us (714us total) trans 8589938626 rc 0/0 00000100:00100000:3.0:1788201214.366589:0:12973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1015 00000100:00100000:0.0:1788201214.378158:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201214.378245:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442617344 00000100:00100000:1.0:1788201214.378254:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442617344 00000100:00100000:1.0:1788201214.378339:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5047 00000100:00100000:1.0:1788201214.378347:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c20bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+32:13671:x1875064442617344:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:1.0:1788201214.378378:0:12968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201214.378395:0:12968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d301f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4a43 expref: -99 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.378512:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d3026 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.378526:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d3026 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.378538:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d3026 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.378552:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d302d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.378559:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d302d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.378567:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d302d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201214.379061:0:12968:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x418:0x0], index 1: 0 00010000:00010000:1.0:1788201214.379197:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d3034 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.379205:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d3034 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.379210:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d3034 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.379233:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d3026 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.379241:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d3026 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.379245:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d3026 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.379249:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201214.379252:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d3026 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.379256:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d3026 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.379263:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:1.0:1788201214.379265:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201214.379268:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d3026 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.379272:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d3026 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201214.379281:0:12968:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000744918bd reply state 0000000028211216 transno 8589938627 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d302d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201214.379287:0:12968:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201214.379350:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d301f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a43 expref: 35 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.379360:0:12968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d3034 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a43 expref: 34 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.379368:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ef:0x0].0x0 (ffff9e03c5173b00) 00010000:00010000:1.0:1788201214.379370:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201214.379371:0:12968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2000, rc 0) 00000100:00100000:1.0:1788201214.379430:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c20bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+35:13671:x1875064442617344:12345-192.168.201.30@tcp:101:touch.0 Request processed in 1084us (1283us total) trans 8589938627 rc 0/0 00000100:00100000:1.0:1788201214.379435:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5047 00010000:00010000:1.0:1788201214.381816:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d302d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.381832:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d302d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.381839:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d302d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.381843:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201214.381847:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d302d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.381852:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d302d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.381862:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x37639fea (ffff9e03c5173900) 00010000:00010000:1.0:1788201214.381864:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201214.381867:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d302d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.381870:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d302d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201214.383140:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201214.383768:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442617600 00000100:00100000:3.0:1788201214.383778:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442617600 00000100:00100000:2.0:1788201214.383980:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5048 00000100:00100000:2.0:1788201214.383988:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c20bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+34:13671:x1875064442617600:12345-192.168.201.30@tcp:36:touch.0 00010000:00010000:2.0:1788201214.384110:0:13379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201214.384129:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d3034 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a43 expref: 34 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.384141:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ef:0x0].0x0 (ffff9e03c5173b00) 00010000:00010000:2.0:1788201214.384149:0:13379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201214.384193:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3042 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.384202:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3042 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.384211:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3042 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201214.384367:0:13379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000cf2de66 reply state 000000006be185ff transno 8589938628 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3042 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201214.384437:0:13379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201214.384615:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c20bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+35:13671:x1875064442617600:12345-192.168.201.30@tcp:36:touch.0 Request processed in 626us (1482us total) trans 8589938628 rc 0/0 00000100:00100000:2.0:1788201214.384621:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5048 00010000:00010000:3.0:1788201214.385734:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3042 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.385746:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3042 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.385757:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3042 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.385763:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bca00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201214.385767:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3042 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.385774:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3042 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.385785:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ef:0x0].0x0 (ffff9e03c33ede00) 00010000:00010000:3.0:1788201214.385788:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201214.385791:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3042 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201214.385797:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3042 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201214.386866:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201214.387021:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442617728 00000100:00100000:2.0:1788201214.387029:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442617728 00000100:00100000:2.0:1788201214.387083:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5049 00000100:00100000:2.0:1788201214.387093:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+34:13671:x1875064442617728:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:2.0:1788201214.387119:0:13406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201214.387138:0:13406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d3049 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4a4a expref: -99 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.387195:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d3049 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a4a expref: 35 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.387206:0:13406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d3049 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a4a expref: 35 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.387221:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ef:0x0].0x0 (ffff9e03c33ed000) 00010000:00010000:2.0:1788201214.387223:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201214.387226:0:13406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bcc00, rc 0) 00000100:00100000:2.0:1788201214.387267:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+35:13671:x1875064442617728:12345-192.168.201.30@tcp:101:touch.0 Request processed in 176us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201214.387271:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5049 00000100:00100000:0.0:1788201214.389776:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201214.389846:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442617856 00000100:00100000:2.0:1788201214.389854:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442617856 00000100:00100000:2.0:1788201214.389917:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4156 00000100:00100000:2.0:1788201214.389926:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442617856:12345-192.168.201.30@tcp:2:touch.0 00000100:00100000:2.0:1788201214.390181:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2360:x1875064442617856:12345-192.168.201.30@tcp:2:touch.0 Request processed in 257us (411us total) trans 4294968836 rc 0/0 00000100:00100000:2.0:1788201214.390186:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4156 00000100:00100000:3.0:1788201214.391835:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201214.391929:0:13381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442618112 00000100:00100000:1.0:1788201214.391936:0:13381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442618112 00000100:00100000:1.0:1788201214.391978:0:13381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1016 00000100:00100000:1.0:1788201214.391984:0:13381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+35:13671:x1875064442618112:12345-192.168.201.30@tcp:35:touch.0 00000100:00100000:1.0:1788201214.392212:0:13381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+36:13671:x1875064442618112:12345-192.168.201.30@tcp:35:touch.0 Request processed in 227us (379us total) trans 8589938629 rc 0/0 00000100:00100000:1.0:1788201214.392224:0:13381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1016 00000100:00100000:1.0:1788201214.398993:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201214.400555:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442618368 00000100:00100000:0.0:1788201214.400570:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442618368 00000100:00100000:0.0:1788201214.400639:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5050 00000100:00100000:0.0:1788201214.400648:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+36:13672:x1875064442618368:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:0.0:1788201214.400673:0:12968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201214.400694:0:12968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1400/0x9383f985bc4d3050 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4a51 expref: -99 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.400816:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1800/0x9383f985bc4d3057 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.400831:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1800/0x9383f985bc4d3057 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.400843:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1800/0x9383f985bc4d3057 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.400854:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0e00/0x9383f985bc4d305e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.400858:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0e00/0x9383f985bc4d305e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.400862:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0e00/0x9383f985bc4d305e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201214.401629:0:12968:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x419:0x0], index 0: 0 00010000:00010000:0.0:1788201214.401744:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0800/0x9383f985bc4d3065 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.401752:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0800/0x9383f985bc4d3065 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.401757:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0800/0x9383f985bc4d3065 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.401781:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1800/0x9383f985bc4d3057 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.401788:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1800/0x9383f985bc4d3057 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.401794:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1800/0x9383f985bc4d3057 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.401800:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201214.401805:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1800/0x9383f985bc4d3057 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.401811:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1800/0x9383f985bc4d3057 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.401822:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:0.0:1788201214.401826:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201214.401830:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1800/0x9383f985bc4d3057 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.401837:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1800/0x9383f985bc4d3057 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201214.401850:0:12968:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f85231f reply state 00000000a999918f transno 8589938630 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0e00/0x9383f985bc4d305e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201214.401856:0:12968:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201214.401881:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1400/0x9383f985bc4d3050 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a51 expref: 39 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.401905:0:12968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0800/0x9383f985bc4d3065 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a51 expref: 38 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.401912:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f0:0x0].0x0 (ffff9e03c2fc5000) 00010000:00010000:0.0:1788201214.401914:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201214.401917:0:12968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c37d0800, rc 0) 00000100:00100000:0.0:1788201214.401984:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+39:13672:x1875064442618368:12345-192.168.201.30@tcp:101:touch.0 Request processed in 1337us (3001us total) trans 8589938630 rc 0/0 00000100:00100000:0.0:1788201214.401993:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5050 00000100:00100000:0.0:1788201214.404211:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:1.0:1788201214.404326:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0e00/0x9383f985bc4d305e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.404338:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0e00/0x9383f985bc4d305e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.404345:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0e00/0x9383f985bc4d305e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.404352:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201214.404356:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0e00/0x9383f985bc4d305e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.404363:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0e00/0x9383f985bc4d305e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.404388:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x7fbd58ea (ffff9e03c2fc5600) 00010000:00010000:1.0:1788201214.404391:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201214.404395:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0e00/0x9383f985bc4d305e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201214.404405:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0e00/0x9383f985bc4d305e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201214.404872:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442618624 00000100:00100000:2.0:1788201214.404881:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442618624 00000100:00100000:2.0:1788201214.404971:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5051 00000100:00100000:2.0:1788201214.404980:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+38:13672:x1875064442618624:12345-192.168.201.30@tcp:36:touch.0 00010000:00010000:2.0:1788201214.405032:0:13379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201214.405046:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0800/0x9383f985bc4d3065 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a51 expref: 38 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.405054:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f0:0x0].0x0 (ffff9e03c2fc5000) 00010000:00010000:2.0:1788201214.405059:0:13379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201214.405103:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3073 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.405112:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3073 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.405126:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3073 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201214.405233:0:13379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006dd0a884 reply state 0000000060773c31 transno 8589938631 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3073 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201214.405240:0:13379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201214.405331:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+39:13672:x1875064442618624:12345-192.168.201.30@tcp:36:touch.0 Request processed in 350us (1126us total) trans 8589938631 rc 0/0 00000100:00100000:2.0:1788201214.405337:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5051 00010000:00010000:2.0:1788201214.406787:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3073 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.406799:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3073 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.406805:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3073 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.406812:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bd800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201214.406816:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3073 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.406823:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3073 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.406835:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f0:0x0].0x0 (ffff9e03c33ed100) 00010000:00010000:2.0:1788201214.406838:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201214.406842:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3073 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201214.406848:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3073 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201214.407178:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201214.407241:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442618752 00000100:00100000:0.0:1788201214.407248:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442618752 00000100:00100000:0.0:1788201214.407288:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5052 00000100:00100000:0.0:1788201214.407326:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+38:13672:x1875064442618752:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:0.0:1788201214.407347:0:12969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201214.407364:0:12969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0000/0x9383f985bc4d307a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4a58 expref: -99 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.407414:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0000/0x9383f985bc4d307a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a58 expref: 39 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.407427:0:12969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0000/0x9383f985bc4d307a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a58 expref: 39 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201214.407443:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f0:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:0.0:1788201214.407445:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788201214.407448:0:12969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c37d0000, rc 0) 00000100:00100000:0.0:1788201214.407498:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+39:13672:x1875064442618752:12345-192.168.201.30@tcp:101:touch.0 Request processed in 174us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201214.407505:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5052 00000100:00100000:1.0:1788201214.410104:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201214.410174:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442618880 00000100:00100000:0.0:1788201214.410181:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442618880 00000100:00100000:0.0:1788201214.410244:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4157 00000100:00100000:0.0:1788201214.410251:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2361:x1875064442618880:12345-192.168.201.30@tcp:2:touch.0 00000100:00100000:0.0:1788201214.410551:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2361:x1875064442618880:12345-192.168.201.30@tcp:2:touch.0 Request processed in 299us (452us total) trans 4294968835 rc 0/0 00000100:00100000:0.0:1788201214.410562:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4157 00000100:00100000:2.0:1788201214.412288:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201214.412640:0:12973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442619136 00000100:00100000:3.0:1788201214.412649:0:12973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442619136 00000100:00100000:0.0:1788201214.412828:0:12973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1017 00000100:00100000:0.0:1788201214.412841:0:12973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c26e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+39:13672:x1875064442619136:12345-192.168.201.30@tcp:35:touch.0 00000100:00100000:0.0:1788201214.413252:0:12973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c26e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+40:13672:x1875064442619136:12345-192.168.201.30@tcp:35:touch.0 Request processed in 413us (969us total) trans 8589938632 rc 0/0 00000100:00100000:0.0:1788201214.413261:0:12973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1017 00000100:00100000:1.0:1788201214.694032:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201214.694055:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458212864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201214.694127:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201214.694177:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458212864 00000100:00100000:0.0:1788201214.694186:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458212864 00000100:00100000:0.0:1788201214.694245:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788201214.694255:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+20:3311:x1875064458212864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201214.694289:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 13631488 granted 525008896 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201214.694353:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+20:3311:x1875064458212864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201214.694361:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788201214.698035:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458212864:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788201214.822385:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201215.206877:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201215.207225:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442619264 00000100:00100000:1.0:1788201215.207237:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442619264 00000100:00100000:1.0:1788201215.207334:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5053 00000100:00100000:1.0:1788201215.207346:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+40:13684:x1875064442619264:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1788201215.207375:0:12968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201215.207398:0:12968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d3081 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4a5f expref: -99 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.207482:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3088 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.207496:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3088 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.207509:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3088 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.207528:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d308f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.207540:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d308f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.207548:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d308f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.207649:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d3096 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.207658:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d3096 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.207667:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d3096 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201215.207701:0:12968:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3eb:0x0]: returning size 0 00000004:00200000:1.0:1788201215.207706:0:12968:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201215.207740:0:12968:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d3096 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.207752:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d3096 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.207760:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3088 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.207780:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3088 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.207787:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3088 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.207797:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201215.207801:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3088 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.207808:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3088 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.207820:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:1.0:1788201215.207823:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201215.207828:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3088 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.207834:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3088 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.207847:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d308f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.207854:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d308f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.207860:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d308f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.207866:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201215.207868:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d308f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.207873:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d308f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.207897:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x15fcbbea (ffff9e03c5173b00) 00010000:00010000:1.0:1788201215.207900:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201215.207903:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d308f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.207909:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d308f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.207939:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d3081 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a5f expref: 42 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.207952:0:12968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d3096 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a5f expref: 41 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.207959:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3eb:0x0].0x0 (ffff9e03c33e8900) 00010000:00010000:1.0:1788201215.207961:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201215.207963:0:12968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3800, rc 0) 00000100:00100000:1.0:1788201215.208019:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+41:13684:x1875064442619264:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 676us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201215.208027:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5053 00000100:00080000:2.0:1788201215.209136:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201215.216946:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201215.218357:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442619392 00000100:00100000:0.0:1788201215.218369:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442619392 00000100:00100000:0.0:1788201215.218433:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4158 00000100:00100000:0.0:1788201215.218444:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2362:x1875064442619392:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1788201215.218462:0:13446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201215.218485:0:13446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4dea086/0x9383f985bc4d309d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4a66 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201215.218513:0:13446:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x416:0x0] initial LVB size: 0, mtime: 0x6a95c8fe, atime: 0x6a95c8fe, ctime: 0x6a95c8fe, blocks: 0x1 00010000:00010000:0.0:1788201215.218531:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x416:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1788201215.218537:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x416:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201215.218546:0:13446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4dea086/0x9383f985bc4d309d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a66 expref: 9 pid: 13446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.218564:0:13446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4dea086/0x9383f985bc4d309d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a66 expref: 9 pid: 13446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.218577:0:13446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c37d1800, rc 0) 00000100:00100000:0.0:1788201215.218645:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:2362:x1875064442619392:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 202us (1707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201215.218653:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4158 00000100:00080000:3.0:1788201215.220018:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201215.222117:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201215.222202:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442619520 00000100:00100000:1.0:1788201215.222212:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442619520 00000100:00100000:1.0:1788201215.222274:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5054 00000100:00100000:1.0:1788201215.222284:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+41:13685:x1875064442619520:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1788201215.222325:0:13379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201215.222347:0:13379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d30a4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4a6d expref: -99 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.222414:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d30ab lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.222426:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d30ab lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.222437:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d30ab lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.222451:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d30b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.222458:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d30b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.222475:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d30b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.222565:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d30b9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.222573:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d30b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.222580:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d30b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201215.222611:0:13379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3ec:0x0]: returning size 0 00000004:00200000:1.0:1788201215.222616:0:13379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201215.222633:0:13379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d30b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.222647:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d30b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.222654:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d30ab lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.222661:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d30ab lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.222668:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d30ab lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.222673:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201215.222677:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d30ab lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.222685:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d30ab lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.222695:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:1.0:1788201215.222699:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201215.222703:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d30ab lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.222710:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d30ab lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.222724:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d30b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.222729:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d30b2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.222736:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d30b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.222740:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201215.222743:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d30b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.222749:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d30b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.222755:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x5e5674ea (ffff9e03c5173b00) 00010000:00010000:1.0:1788201215.222757:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201215.222760:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d30b2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.222779:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d30b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.222809:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d30a4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a6d expref: 43 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.222822:0:13379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d30b9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a6d expref: 42 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.222828:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ec:0x0].0x0 (ffff9e03c5173d00) 00010000:00010000:1.0:1788201215.222830:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201215.222833:0:13379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3000, rc 0) 00000100:00100000:1.0:1788201215.222903:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+42:13685:x1875064442619520:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 620us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201215.222914:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5054 00000100:00100000:0.0:1788201215.232012:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201215.232047:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201215.232071:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201215.232096:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201215.232118:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442619648 00000100:00100000:0.0:1788201215.232127:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442619648 00000100:00100000:0.0:1788201215.232168:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442619776 00000100:00100000:0.0:1788201215.232170:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442619776 00000100:00100000:0.0:1788201215.232185:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442620032 00000100:00100000:0.0:1788201215.232187:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442620032 00000100:00100000:0.0:1788201215.232202:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5055 00000100:00100000:0.0:1788201215.232211:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+44:13686:x1875064442619648:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1788201215.232232:0:13406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201215.232253:0:13406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d30c0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4a74 expref: -99 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232350:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d30c7 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232364:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d30c7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232375:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d30c7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232390:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d30ce lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232396:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d30ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232403:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d30ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232493:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d30d5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232502:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d30d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232509:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d30d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201215.232540:0:13406:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3ed:0x0]: returning size 0 00000004:00200000:0.0:1788201215.232544:0:13406:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201215.232565:0:13406:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d30d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232576:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d30d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232589:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d30c7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232595:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d30c7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232601:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d30c7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232607:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201215.232610:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d30c7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232617:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d30c7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232628:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:0.0:1788201215.232631:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201215.232636:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d30c7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232643:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d30c7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232654:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d30ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232660:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d30ce lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232665:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d30ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232671:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201215.232674:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d30ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232681:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d30ce lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232689:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0xa6b02dea (ffff9e03c2fc5900) 00010000:00010000:0.0:1788201215.232692:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201215.232695:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d30ce lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232702:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d30ce lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232730:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d30c0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a74 expref: 46 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232742:0:13406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d30d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a74 expref: 45 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232749:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ed:0x0].0x0 (ffff9e03c5173e00) 00010000:00010000:0.0:1788201215.232752:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201215.232754:0:13406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c37d0400, rc 0) 00000100:00100000:0.0:1788201215.232810:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+45:13686:x1875064442619648:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 599us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201215.232817:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5055 00000100:00100000:0.0:1788201215.232836:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5056 00000100:00100000:0.0:1788201215.232843:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+44:13683:x1875064442619776:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1788201215.232852:0:13406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201215.232859:0:13406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d30dc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4a7b expref: -99 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232900:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d30e3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232910:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d30e3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232917:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d30e3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232929:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d30ea lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232937:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d30ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232944:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d30ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232988:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d30f1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.232998:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d30f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.233005:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d30f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201215.233025:0:13406:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3ea:0x0]: returning size 0 00000004:00200000:0.0:1788201215.233028:0:13406:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201215.233038:0:13406:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d30f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.233046:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d30f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.233052:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d30e3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.233057:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d30e3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.233063:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d30e3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.233069:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201215.233073:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d30e3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.233080:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d30e3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.233088:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:0.0:1788201215.233091:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201215.233094:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d30e3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.233101:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d30e3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.233115:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d30ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.233122:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d30ea lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.233128:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d30ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.233134:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201215.233137:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d30ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.233144:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d30ea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.233151:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0xcda302ea (ffff9e03c2fc5800) 00010000:00010000:0.0:1788201215.233154:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201215.233157:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d30ea lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.233164:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d30ea lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.233185:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d30dc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a7b expref: 46 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.233196:0:13406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d30f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a7b expref: 45 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.233210:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ea:0x0].0x0 (ffff9e03c2fc5400) 00010000:00010000:0.0:1788201215.233212:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201215.233215:0:13406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c37d0200, rc 0) 00000100:00100000:0.0:1788201215.233238:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+45:13683:x1875064442619776:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 395us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201215.233245:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5056 00000100:00100000:0.0:1788201215.233262:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5057 00000100:00100000:0.0:1788201215.233270:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+44:13684:x1875064442620032:12345-192.168.201.30@tcp:36:chmod.0 00000020:02000000:0.0:1788201215.233277:0:13406:0:(tgt_handler.c:406:tgt_handle_request0()) *** cfs_fail_loc=159, val=0*** 00000100:00100000:1.0:1788201215.236413:0:13442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442620160 00000100:00100000:1.0:1788201215.236429:0:13442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442620160 00000100:00100000:1.0:1788201215.236499:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4159 00000100:00100000:1.0:1788201215.236509:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2359:x1875064442620160:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1788201215.236527:0:13442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201215.236549:0:13442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d30f8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4a82 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201215.236576:0:13442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x417:0x0] initial LVB size: 0, mtime: 0x6a95c8fe, atime: 0x6a95c8fe, ctime: 0x6a95c8fe, blocks: 0x1 00010000:00010000:1.0:1788201215.236596:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x417:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1788201215.236601:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x417:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201215.236609:0:13442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d30f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a82 expref: 510 pid: 13442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.236626:0:13442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d30f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a82 expref: 510 pid: 13442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.236639:0:13442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3200, rc 0) 00000100:00100000:1.0:1788201215.236699:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35604eb4-baf9-45be-a20a-4883a2cd8cf9+510:2359:x1875064442620160:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 191us (4601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201215.236706:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4159 00000100:00080000:2.0:1788201215.236765:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201215.241857:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201215.241903:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201215.241927:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201215.241953:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442620288 00000100:00100000:1.0:1788201215.241962:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442620288 00000100:00100000:1.0:1788201215.242000:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442620416 00000100:00100000:1.0:1788201215.242004:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442620416 00000100:00100000:1.0:1788201215.242013:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442620672 00000100:00100000:1.0:1788201215.242015:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442620672 00000100:00100000:1.0:1788201215.242028:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5058 00000100:00100000:1.0:1788201215.242035:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+47:13687:x1875064442620288:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1788201215.242055:0:12971:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201215.242076:0:12971:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d30ff lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4a89 expref: -99 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242134:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3106 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242147:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3106 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242157:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3106 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242170:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d310d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242176:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d310d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242181:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d310d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242265:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d3114 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242274:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d3114 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242279:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d3114 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201215.242329:0:12971:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3ee:0x0]: returning size 0 00000004:00200000:1.0:1788201215.242335:0:12971:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201215.242352:0:12971:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d3114 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242362:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d3114 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242370:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3106 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242377:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3106 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242383:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3106 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242389:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201215.242392:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3106 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242400:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3106 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242411:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:1.0:1788201215.242415:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201215.242419:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3106 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242425:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3106 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242435:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d310d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242441:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d310d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242447:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d310d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242452:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201215.242455:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d310d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242460:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d310d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242466:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0xef09e6ea (ffff9e03c5173200) 00010000:00010000:1.0:1788201215.242469:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201215.242471:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d310d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242477:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d310d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242505:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d30ff lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a89 expref: 49 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242519:0:12971:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d3114 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a89 expref: 48 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242525:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ee:0x0].0x0 (ffff9e03c33e8500) 00010000:00010000:1.0:1788201215.242527:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201215.242530:0:12971:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2000, rc 0) 00000100:00100000:1.0:1788201215.242588:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+48:13687:x1875064442620288:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 552us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201215.242595:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5058 00000100:00100000:1.0:1788201215.242613:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5059 00000100:00100000:1.0:1788201215.242620:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+47:13688:x1875064442620416:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1788201215.242628:0:12971:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201215.242635:0:12971:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d311b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4a90 expref: -99 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242660:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3122 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242669:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3122 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242675:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3122 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242686:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d3129 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242697:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d3129 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242703:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d3129 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242746:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d3130 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242755:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d3130 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242762:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d3130 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201215.242779:0:12971:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3ef:0x0]: returning size 0 00000004:00200000:1.0:1788201215.242781:0:12971:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201215.242790:0:12971:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d3130 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242798:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d3130 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242803:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3122 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242808:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3122 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242814:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3122 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242822:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201215.242825:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3122 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242830:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3122 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242837:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:1.0:1788201215.242840:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201215.242843:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3122 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242850:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3122 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242861:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d3129 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242869:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d3129 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242875:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d3129 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242896:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201215.242899:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d3129 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242905:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d3129 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242918:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x37639fea (ffff9e03c5173100) 00010000:00010000:1.0:1788201215.242920:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201215.242923:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d3129 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242929:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d3129 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242952:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d311b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a90 expref: 49 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242965:0:12971:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d3130 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a90 expref: 48 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.242973:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ef:0x0].0x0 (ffff9e03c33ed000) 00010000:00010000:1.0:1788201215.242976:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201215.242978:0:12971:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3e00, rc 0) 00000100:00100000:1.0:1788201215.243002:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+48:13688:x1875064442620416:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 383us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201215.243009:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5059 00000100:00100000:1.0:1788201215.243024:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5060 00000100:00100000:1.0:1788201215.243032:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+47:13685:x1875064442620672:12345-192.168.201.30@tcp:36:chmod.0 00000020:02000000:1.0:1788201215.243041:0:12971:0:(tgt_handler.c:406:tgt_handle_request0()) *** cfs_fail_loc=159, val=0*** 00000100:00100000:1.0:1788201215.243046:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+47:13685:x1875064442620672:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 16us (1119us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788201215.243052:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5060 00000100:00100000:2.0:1788201215.246238:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201215.246335:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442620800 00000100:00100000:1.0:1788201215.246345:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442620800 00000100:00100000:1.0:1788201215.246399:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4160 00000100:00100000:1.0:1788201215.246409:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c26e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+510:2360:x1875064442620800:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1788201215.246428:0:12363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201215.246448:0:12363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000456a114c/0x9383f985bc4d3137 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4a97 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201215.246485:0:12363:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x416:0x0] initial LVB size: 0, mtime: 0x6a95c8fe, atime: 0x6a95c8fe, ctime: 0x6a95c8fe, blocks: 0x1 00010000:00010000:1.0:1788201215.246503:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x416:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1788201215.246508:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x416:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201215.246517:0:12363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000456a114c/0x9383f985bc4d3137 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a97 expref: 511 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.246532:0:12363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000456a114c/0x9383f985bc4d3137 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a97 expref: 511 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201215.246545:0:12363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2400, rc 0) 00000100:00100000:1.0:1788201215.246596:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c26e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2360:x1875064442620800:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 189us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201215.246602:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4160 00000100:00100000:1.0:1788201215.249447:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201215.249686:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442620928 00000100:00100000:2.0:1788201215.249696:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442620928 00000100:00100000:2.0:1788201215.249755:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4161 00000100:00100000:2.0:1788201215.249765:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2359:x1875064442620928:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1788201215.249785:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201215.249808:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8637c64/0x9383f985bc4d313e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4a9e expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201215.249835:0:13443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x418:0x0] initial LVB size: 0, mtime: 0x6a95c8fe, atime: 0x6a95c8fe, ctime: 0x6a95c8fe, blocks: 0x1 00010000:00010000:2.0:1788201215.249854:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x418:0x0].0x0 since=490s v=(0 0) 00010000:00010000:2.0:1788201215.249859:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x418:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201215.249868:0:13443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8637c64/0x9383f985bc4d313e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a9e expref: 512 pid: 13443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.249896:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e8637c64/0x9383f985bc4d313e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a9e expref: 512 pid: 13443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.249911:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bc200, rc 0) 00000100:00100000:2.0:1788201215.249964:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+512:2359:x1875064442620928:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 200us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201215.249972:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4161 00000100:00100000:0.0:1788201215.252156:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+46:13684:x1875064442620032:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 18878us (20074us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201215.252168:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5057 00000100:00100000:0.0:1788201215.256682:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201215.256753:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201215.256774:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201215.256838:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201215.256859:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201215.256878:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201215.256912:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201215.256931:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201215.257033:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442621056 00000100:00100000:3.0:1788201215.257043:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442621056 00000100:00100000:3.0:1788201215.257087:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442621312 00000100:00100000:3.0:1788201215.257090:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442621312 00000100:00100000:3.0:1788201215.257110:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4162 00000100:00100000:3.0:1788201215.257120:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f965e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2360:x1875064442621056:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1788201215.257142:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201215.257162:0:13448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d3145 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4aa5 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201215.257187:0:13448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x418:0x0] initial LVB size: 0, mtime: 0x6a95c8fe, atime: 0x6a95c8fe, ctime: 0x6a95c8fe, blocks: 0x1 00010000:00010000:3.0:1788201215.257205:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x418:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1788201215.257209:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x418:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201215.257217:0:13448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d3145 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4aa5 expref: 11 pid: 13448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201215.257233:0:13448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d3145 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4aa5 expref: 11 pid: 13448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201215.257244:0:13448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c3016600, rc 0) 00000100:00100000:3.0:1788201215.257317:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f965e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:2360:x1875064442621056:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 175us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201215.257323:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4162 00000100:00100000:3.0:1788201215.257434:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4163 00000100:00100000:3.0:1788201215.257441:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2361:x1875064442621312:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1788201215.257447:0:13448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201215.257469:0:13448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aaee9d17/0x9383f985bc4d314c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4ad6 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201215.257480:0:13448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x417:0x0] initial LVB size: 0, mtime: 0x6a95c8fe, atime: 0x6a95c8fe, ctime: 0x6a95c8fe, blocks: 0x1 00010000:00010000:3.0:1788201215.257488:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x417:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1788201215.257491:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x417:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201215.257497:0:13448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aaee9d17/0x9383f985bc4d314c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ad6 expref: 11 pid: 13448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201215.257508:0:13448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aaee9d17/0x9383f985bc4d314c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ad6 expref: 11 pid: 13448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201215.257515:0:13448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c3017a00, rc 0) 00000100:00100000:3.0:1788201215.257533:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:2361:x1875064442621312:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 93us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201215.257538:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4163 00000100:00100000:0.0:1788201215.257664:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442621568 00000100:00100000:0.0:1788201215.257668:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442621568 00000100:00100000:0.0:1788201215.257730:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442621824 00000100:00100000:0.0:1788201215.257734:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442621824 00000100:00100000:3.0:1788201215.257760:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442622080 00000100:00100000:3.0:1788201215.257764:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442622080 00000100:00100000:3.0:1788201215.257789:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5061 00000100:00100000:3.0:1788201215.257796:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+48:13683:x1875064442621568:12345-192.168.201.30@tcp:36:chmod.0 00000020:02000000:3.0:1788201215.257807:0:12969:0:(tgt_handler.c:406:tgt_handle_request0()) *** cfs_fail_loc=159, val=0*** 00000100:00100000:3.0:1788201215.257811:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+48:13683:x1875064442621568:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 17us (934us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201215.257817:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5061 00000100:00100000:3.0:1788201215.257831:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5062 00000100:00100000:3.0:1788201215.257837:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+47:13689:x1875064442621824:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1788201215.257845:0:12969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201215.257858:0:12969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016000/0x9383f985bc4d3153 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4ae4 expref: -99 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201215.257931:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d315a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201215.257944:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d315a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201215.257954:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d315a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201215.257968:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d3161 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201215.257974:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d3161 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201215.257980:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d3161 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201215.258072:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016400/0x9383f985bc4d3168 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201215.258081:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016400/0x9383f985bc4d3168 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201215.258088:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016400/0x9383f985bc4d3168 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201215.258119:0:12969:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f0:0x0]: returning size 0 00000004:00200000:3.0:1788201215.258123:0:12969:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201215.258141:0:12969:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016400/0x9383f985bc4d3168 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201215.258155:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016400/0x9383f985bc4d3168 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201215.258162:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d315a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201215.258168:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d315a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201215.258175:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d315a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201215.258181:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201215.258184:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d315a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201215.258191:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d315a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201215.258202:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:3.0:1788201215.258204:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201215.258208:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d315a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201215.258213:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d315a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201215.258224:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d3161 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201215.258229:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d3161 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201215.258235:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d3161 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201215.258240:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201215.258242:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d3161 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201215.258248:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d3161 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201215.258254:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x7fbd58ea (ffff9e03c33e8c00) 00010000:00010000:3.0:1788201215.258256:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201215.258258:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d3161 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201215.258262:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d3161 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201215.258287:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016000/0x9383f985bc4d3153 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ae4 expref: 49 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201215.258319:0:12969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016400/0x9383f985bc4d3168 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ae4 expref: 48 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201215.258326:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f0:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:3.0:1788201215.258328:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201215.258330:0:12969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c3016400, rc 0) 00000100:00100000:3.0:1788201215.258356:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+48:13689:x1875064442621824:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 520us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201215.258366:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5062 00000100:00100000:3.0:1788201215.258381:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5063 00000100:00100000:3.0:1788201215.258388:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+47:13687:x1875064442622080:12345-192.168.201.30@tcp:36:chmod.0 00000020:02000000:3.0:1788201215.258395:0:12969:0:(tgt_handler.c:406:tgt_handle_request0()) *** cfs_fail_loc=159, val=0*** 00000100:00100000:3.0:1788201215.258398:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+47:13687:x1875064442622080:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 13us (1468us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201215.258403:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5063 00000100:00100000:2.0:1788201215.259092:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442621184 00000100:00100000:2.0:1788201215.259098:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442621184 00000100:00100000:2.0:1788201215.259122:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442622208 00000100:00100000:2.0:1788201215.259125:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442622208 00000100:00100000:2.0:1788201215.259133:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442621696 00000100:00100000:2.0:1788201215.259135:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442621696 00000100:00100000:2.0:1788201215.259145:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 857 00000100:00100000:2.0:1788201215.259151:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+49:2359:x1875064442621184:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:2.0:1788201215.259172:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201215.259181:0:6715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d316f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4aac expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259209:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3176 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259218:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3176 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259226:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3176 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259236:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d317d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259242:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d317d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259248:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d317d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259336:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3184 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259344:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3184 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259350:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3184 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201215.259363:0:6715:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f0:0x0]: returning size 0 00000004:00200000:2.0:1788201215.259365:0:6715:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201215.259378:0:6715:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3184 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259387:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3184 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259393:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3176 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259399:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3176 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259404:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3176 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259409:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bd800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201215.259412:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3176 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259419:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3176 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259426:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:2.0:1788201215.259429:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201215.259432:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3176 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259437:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3176 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259446:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d317d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259450:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d317d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259675:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d317d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259683:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bdc00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201215.259686:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d317d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259692:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d317d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259700:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x7fbd58ea (ffff9e03c33edd00) 00010000:00010000:2.0:1788201215.259702:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201215.259705:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d317d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259710:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d317d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259734:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d316f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4aac expref: 51 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259745:0:6715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3184 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4aac expref: 50 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259751:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f0:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:2.0:1788201215.259753:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201215.259756:0:6715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bca00, rc 0) 00010000:00010000:2.0:1788201215.259761:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201215.259833:0:6715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d318b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4ab3 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259859:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3192 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259867:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3192 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259875:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3192 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259899:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3199 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xc81711ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259906:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3199 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259912:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3199 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259938:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3192 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259946:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3192 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259951:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3192 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259956:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bda00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201215.259958:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3192 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259963:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3192 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259971:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:2.0:1788201215.259974:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201215.259976:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3192 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.259982:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3192 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260003:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3199 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260009:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3199 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260014:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3199 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260018:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bd600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201215.260021:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3199 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260026:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3199 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260032:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0xc81711ea (ffff9e03c33eda00) 00010000:00010000:2.0:1788201215.260034:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201215.260036:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3199 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260041:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3199 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260059:0:6715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d318b lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ab3 expref: 51 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260067:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:2.0:1788201215.260069:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201215.260072:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d318b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ab3 expref: 51 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260079:0:6715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bc600, rc -2) 00000100:00100000:2.0:1788201215.260129:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+50:2359:x1875064442621184:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 977us (3375us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201215.260137:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 857 00000100:00100000:2.0:1788201215.260157:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 858 00000100:00100000:2.0:1788201215.260165:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+49:2361:x1875064442622208:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:2.0:1788201215.260182:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201215.260191:0:6715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d31a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4aeb expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260216:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d31a7 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260222:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d31a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260227:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d31a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260235:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d31ae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260239:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d31ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260243:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d31ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260279:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d31b5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260284:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d31b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260288:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d31b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201215.260318:0:6715:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3eb:0x0]: returning size 0 00000004:00200000:2.0:1788201215.260322:0:6715:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201215.260333:0:6715:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d31b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260342:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d31b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260348:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d31a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260354:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d31a7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260359:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d31a7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260364:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201215.260367:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d31a7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260372:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d31a7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260380:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:2.0:1788201215.260382:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201215.260384:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d31a7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260389:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d31a7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260398:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d31ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260403:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d31ae lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260408:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d31ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260413:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201215.260415:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d31ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260420:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d31ae lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260426:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x15fcbbea (ffff9e03c33ed900) 00010000:00010000:2.0:1788201215.260427:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201215.260430:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d31ae lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260435:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d31ae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260452:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d31a0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4aeb expref: 51 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260462:0:6715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d31b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4aeb expref: 50 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260469:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3eb:0x0].0x0 (ffff9e03c33e8900) 00010000:00010000:2.0:1788201215.260472:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201215.260474:0:6715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5064e00, rc 0) 00010000:00010000:2.0:1788201215.260478:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201215.260486:0:6715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d31bc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4af2 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260509:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d31c3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260517:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d31c3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260524:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d31c3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260535:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d31ca lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260542:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d31ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260549:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d31ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260597:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d31d1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260605:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d31d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260613:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d31d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201215.260627:0:6715:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3ec:0x0]: returning size 0 00000004:00200000:2.0:1788201215.260629:0:6715:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201215.260639:0:6715:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d31d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260651:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d31d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260657:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d31c3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260662:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d31c3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260667:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d31c3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260672:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201215.260674:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d31c3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260680:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d31c3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260686:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:2.0:1788201215.260689:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201215.260691:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d31c3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260697:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d31c3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260705:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d31ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260711:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d31ca lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260717:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d31ca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260723:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201215.260726:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d31ca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260732:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d31ca lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260738:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x5e5674ea (ffff9e03c33ede00) 00010000:00010000:2.0:1788201215.260740:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201215.260743:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d31ca lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260748:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d31ca lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260921:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d31bc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4af2 expref: 52 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260936:0:6715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d31d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4af2 expref: 51 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.260943:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ec:0x0].0x0 (ffff9e03c5173d00) 00010000:00010000:2.0:1788201215.260945:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201215.261166:0:6715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5065000, rc 0) 00010000:00010000:2.0:1788201215.261174:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201215.261186:0:6715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d31d8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4af9 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261212:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d31df lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261220:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d31df lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261226:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d31df lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261236:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d31e6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261241:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d31e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261247:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d31e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261290:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d31ed lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261315:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d31ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261321:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d31ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201215.261334:0:6715:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3ee:0x0]: returning size 0 00000004:00200000:2.0:1788201215.261337:0:6715:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201215.261345:0:6715:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d31ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261356:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d31ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261362:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d31df lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261368:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d31df lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261373:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d31df lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261378:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201215.261380:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d31df lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261386:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d31df lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261392:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:2.0:1788201215.261393:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201215.261396:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d31df lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261400:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d31df lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261408:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d31e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261414:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d31e6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261420:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d31e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261424:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201215.261427:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d31e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261432:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d31e6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261437:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0xef09e6ea (ffff9e03c33ed700) 00010000:00010000:2.0:1788201215.261439:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201215.261441:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d31e6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261445:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d31e6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261474:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d31d8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4af9 expref: 53 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261483:0:6715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d31ed lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4af9 expref: 52 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261489:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ee:0x0].0x0 (ffff9e03c33e8500) 00010000:00010000:2.0:1788201215.261490:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201215.261492:0:6715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5065c00, rc 0) 00010000:00010000:2.0:1788201215.261496:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201215.261501:0:6715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064a00/0x9383f985bc4d31f4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4b00 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261518:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d31fb lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261525:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d31fb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261532:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d31fb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261540:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d3202 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261546:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d3202 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261552:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d3202 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261588:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d3209 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261595:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d3209 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261600:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d3209 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201215.261610:0:6715:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f0:0x0]: returning size 0 00000004:00200000:2.0:1788201215.261613:0:6715:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201215.261620:0:6715:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d3209 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261630:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d3209 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261641:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d31fb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261647:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d31fb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261653:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d31fb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261658:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201215.261661:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d31fb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261668:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d31fb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261675:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:2.0:1788201215.261680:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201215.261683:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d31fb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261689:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d31fb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261697:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d3202 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261702:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d3202 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261708:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d3202 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261715:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201215.261718:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d3202 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261723:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d3202 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261728:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x7fbd58ea (ffff9e03c33ed200) 00010000:00010000:2.0:1788201215.261730:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201215.261732:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d3202 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261737:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d3202 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261754:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064a00/0x9383f985bc4d31f4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b00 expref: 54 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261762:0:6715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d3209 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b00 expref: 53 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261768:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f0:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:2.0:1788201215.261770:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201215.261773:0:6715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5065200, rc 0) 00010000:00010000:2.0:1788201215.261777:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201215.261784:0:6715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d3210 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4b07 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261807:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3217 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261815:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3217 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261822:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3217 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261830:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d321e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xc81711ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261834:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d321e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261838:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d321e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261854:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3217 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261857:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3217 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261860:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3217 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261863:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201215.261865:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3217 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261871:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3217 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261875:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:2.0:1788201215.261876:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201215.261877:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3217 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261894:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3217 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261903:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d321e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261912:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d321e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261918:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d321e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261922:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201215.261924:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d321e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261930:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d321e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261937:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0xc81711ea (ffff9e03c33edb00) 00010000:00010000:2.0:1788201215.261939:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201215.261942:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d321e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261948:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d321e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261969:0:6715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d3210 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b07 expref: 54 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261978:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:2.0:1788201215.261979:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201215.261983:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d3210 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b07 expref: 54 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.261991:0:6715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5064200, rc -2) 00000100:00100000:2.0:1788201215.262044:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+53:2361:x1875064442622208:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 1879us (5205us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201215.262052:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 858 00000100:00100000:2.0:1788201215.262078:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 859 00000100:00100000:2.0:1788201215.262088:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+52:2361:x1875064442621696:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:2.0:1788201215.262105:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201215.262113:0:6715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3225 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4add expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.262134:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d322c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.262141:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d322c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.262151:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d322c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.262162:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3233 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xad7e02ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.262168:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3233 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.262174:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3233 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.262198:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d322c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.262204:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d322c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.262210:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d322c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.262215:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201215.262217:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d322c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.262222:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d322c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.262229:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:2.0:1788201215.262231:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201215.262234:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d322c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.262240:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d322c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.262248:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3233 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.262254:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3233 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.262259:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3233 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.262264:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201215.262266:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3233 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.262272:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3233 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.262278:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0xad7e02ea (ffff9e03c33edf00) 00010000:00010000:2.0:1788201215.262281:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201215.262283:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3233 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.262290:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3233 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.262331:0:6715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3225 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4add expref: 53 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.262343:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:2.0:1788201215.262345:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201215.262347:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3225 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4add expref: 53 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201215.262354:0:6715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031000, rc -2) 00000100:00100000:2.0:1788201215.262378:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+52:2361:x1875064442621696:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 292us (5518us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201215.262384:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 859 00000100:00100000:0.0:1788201215.267921:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201215.267960:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201215.268003:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201215.268031:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442622976 00000100:00100000:0.0:1788201215.268041:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442622976 00000100:00100000:0.0:1788201215.268089:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4164 00000100:00100000:0.0:1788201215.268099:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+512:2362:x1875064442622976:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1788201215.268118:0:13449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201215.268139:0:13449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069265cef/0x9383f985bc4d323a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4b1c expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201215.268164:0:13449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x419:0x0] initial LVB size: 0, mtime: 0x6a95c8fe, atime: 0x6a95c8fe, ctime: 0x6a95c8fe, blocks: 0x1 00010000:00010000:0.0:1788201215.268183:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x419:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1788201215.268188:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x419:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201215.268197:0:13449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069265cef/0x9383f985bc4d323a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b1c expref: 513 pid: 13449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.268214:0:13449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000069265cef/0x9383f985bc4d323a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b1c expref: 513 pid: 13449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.268226:0:13449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c37d0c00, rc 0) 00000100:00100000:0.0:1788201215.268279:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+513:2362:x1875064442622976:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 181us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201215.268286:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4164 00000100:00100000:0.0:1788201215.268410:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442622592 00000100:00100000:0.0:1788201215.268414:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442622592 00000100:00100000:0.0:1788201215.268443:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442622720 00000100:00100000:0.0:1788201215.268446:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442622720 00000100:00100000:3.0:1788201215.269720:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201215.270095:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5064 00000100:00100000:0.0:1788201215.270110:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+53:13686:x1875064442622592:12345-192.168.201.30@tcp:36:chmod.0 00000020:02000000:0.0:1788201215.270127:0:12971:0:(tgt_handler.c:406:tgt_handle_request0()) *** cfs_fail_loc=159, val=0*** 00000100:00100000:0.0:1788201215.270132:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+53:13686:x1875064442622592:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 29us (2223us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201215.270138:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5064 00000100:00100000:0.0:1788201215.270157:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5065 00000100:00100000:0.0:1788201215.270163:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+52:13688:x1875064442622720:12345-192.168.201.30@tcp:36:chmod.0 00000020:02000000:0.0:1788201215.270169:0:12971:0:(tgt_handler.c:406:tgt_handle_request0()) *** cfs_fail_loc=159, val=0*** 00000100:00100000:0.0:1788201215.270172:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+52:13688:x1875064442622720:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 11us (2214us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201215.270177:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5065 00000100:00100000:0.0:1788201215.272849:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442622848 00000100:00100000:0.0:1788201215.272860:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442622848 00000100:00100000:0.0:1788201215.272930:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 860 00000100:00100000:0.0:1788201215.275229:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+52:2361:x1875064442622848:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:0.0:1788201215.275268:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201215.275288:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d3241 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4b15 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201215.275535:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201215.276144:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442623232 00000100:00100000:3.0:1788201215.276153:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442623232 00000100:00100000:3.0:1788201215.276193:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5066 00000100:00100000:3.0:1788201215.276200:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c26e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+53:13689:x1875064442623232:12345-192.168.201.30@tcp:36:chmod.0 00000020:02000000:3.0:1788201215.276208:0:12969:0:(tgt_handler.c:406:tgt_handle_request0()) *** cfs_fail_loc=159, val=0*** 00000100:00100000:3.0:1788201215.276213:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c26e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+53:13689:x1875064442623232:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 14us (680us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201215.276218:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5066 00010000:00010000:0.0:1788201215.279165:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d3248 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.279181:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d3248 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.279191:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d3248 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.279210:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d324f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xa05302ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.279216:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d324f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.279222:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d324f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.279280:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d3248 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.279288:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d3248 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.279413:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d3248 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.279420:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201215.279424:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d3248 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.279432:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d3248 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.279444:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:0.0:1788201215.279447:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201215.279452:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d3248 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.279589:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d3248 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.279603:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d324f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.279609:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d324f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.279616:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d324f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.279622:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201215.279625:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d324f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.279632:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d324f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.279640:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0xa05302ea (ffff9e03c2fc5700) 00010000:00010000:0.0:1788201215.279643:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201215.279646:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d324f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.279651:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d324f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.279685:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d3241 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b15 expref: 53 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.279696:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:0.0:1788201215.279699:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201215.279703:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d3241 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b15 expref: 53 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201215.279712:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c37d1000, rc -2) 00000100:00100000:0.0:1788201215.279835:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+52:2361:x1875064442622848:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 4621us (10117us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201215.279846:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 860 00010000:00010000:3.0:1788201215.845761:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201216.229623:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c20bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458213248:0@lo:400:kworker.0 00000100:00100000:2.0:1788201216.229655:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c20bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458213120:0@lo:400:kworker.0 00000100:00100000:0.0:1788201216.229781:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5475500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458213376:0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.229856:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458212992:0@lo:400:kworker.0 00000100:00100000:2.0:1788201216.230800:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201216.230872:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458213632:0@lo:400:kworker.0 00000100:00100000:2.0:1788201216.230902:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201216.232397:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458213120 00000100:00100000:2.0:1788201216.232410:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458213120 00000100:00080000:2.0:1788201216.232455:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201216.232507:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458213632 00000100:00100000:2.0:1788201216.232511:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458213632 00000100:00100000:2.0:1788201216.232547:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788201216.232558:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c26e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458213120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201216.233099:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c26e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458213120:12345-0@lo:400:kworker.0 Request processed in 542us (2299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201216.233108:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788201216.233130:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788201216.233137:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c26e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458213632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201216.233170:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c26e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458213632:12345-0@lo:400:kworker.0 Request processed in 34us (2267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201216.233177:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788201216.233220:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c20bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458213120:0@lo:400:kworker.0 00000100:00100000:2.0:1788201216.233235:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458213632:0@lo:400:kworker.0 00000100:00100000:3.0:1788201216.233323:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201216.233376:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458213248 00000100:00100000:3.0:1788201216.233381:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458213248 00000100:00100000:3.0:1788201216.233417:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788201216.233424:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458213248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201216.233463:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458213248:12345-0@lo:400:kworker.0 Request processed in 40us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201216.233473:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788201216.233503:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c20bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458213248:0@lo:400:kworker.0 00000100:00080000:2.0:1788201216.233684:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201216.234937:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201216.235204:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458213376 00000100:00100000:3.0:1788201216.235212:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458213376 00000100:00080000:0.0:1788201216.235687:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201216.235933:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788201216.235947:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458213376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201216.236024:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458213376:12345-0@lo:400:kworker.0 Request processed in 82us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201216.236032:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788201216.236072:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5475500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458213376:0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.240849:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201216.240932:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458213504:0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.241004:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201216.241147:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458213504 00000100:00100000:0.0:1788201216.241155:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458213504 00000100:00100000:0.0:1788201216.241235:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788201216.241245:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+20:3311:x1875064458213504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201216.241337:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+20:3311:x1875064458213504:12345-0@lo:400:kworker.0 Request processed in 93us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201216.241344:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:2.0:1788201216.241544:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201216.241634:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458213504:0@lo:400:kworker.0 00000100:00100000:3.0:1788201216.241903:0:12965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458212992 00000100:00100000:3.0:1788201216.241908:0:12965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458212992 00000100:00100000:0.0:1788201216.242101:0:12963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788201216.242111:0:12963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f50b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458212992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201216.242168:0:12963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f50b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458212992:12345-0@lo:400:kworker.0 Request processed in 59us (1328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201216.242176:0:12963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788201216.242258:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458212992:0@lo:400:kworker.0 00000001:00080000:1.0:1788201216.794029:0:6732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294968835 is committed 00000001:00080000:0.0:1788201216.807241:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968835 is committed 00000001:00080000:0.0:1788201216.807255:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968830 is committed 00000001:00080000:0.0:1788201216.807267:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968832 is committed 00000001:00080000:0.0:1788201216.807278:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968836 is committed 00000001:00080000:0.0:1788201216.807318:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968833 is committed 00010000:00010000:3.0:1788201216.871676:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201217.254647:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201217.254669:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c26e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458213760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201217.254745:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201217.254791:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458213760 00000100:00100000:2.0:1788201217.254797:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458213760 00000100:00100000:2.0:1788201217.254835:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788201217.254843:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c26e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458213760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201217.254885:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 525008896 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1788201217.254927:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c26e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458213760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201217.254934:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788201217.255092:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c26e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458213760:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788201217.893501:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201218.457280:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201218.457372:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201218.457400:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201218.457406:0:12964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442623360 00000100:00100000:0.0:1788201218.457416:0:12964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442623360 00000100:00100000:3.0:1788201218.457434:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201218.457463:0:12964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 97 00000100:00100000:0.0:1788201218.457474:0:12964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f50b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442623360:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201218.457485:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442623616 00000100:00100000:3.0:1788201218.457488:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442623616 00000100:00100000:3.0:1788201218.457524:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442623744 00000100:00100000:3.0:1788201218.457527:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442623744 00000100:00100000:0.0:1788201218.457545:0:12964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f50b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442623360:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 73us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201218.457546:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 123 00000100:00100000:0.0:1788201218.457552:0:12964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 97 00000100:00100000:3.0:1788201218.457554:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5475500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2362:x1875064442623616:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201218.457600:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 124 00000100:00100000:3.0:1788201218.457600:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5475500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2362:x1875064442623616:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 48us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201218.457606:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 123 00000100:00100000:0.0:1788201218.457607:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2362:x1875064442623744:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201218.457645:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2362:x1875064442623744:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 38us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201218.457651:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 124 00000100:00100000:2.0:1788201218.457688:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442623488 00000100:00100000:2.0:1788201218.457693:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442623488 00000100:00100000:2.0:1788201218.457732:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 58 00000100:00100000:2.0:1788201218.457739:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+52:2362:x1875064442623488:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201218.457790:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+52:2362:x1875064442623488:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 52us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201218.457797:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 58 00000100:00080000:2.0:1788201218.457815:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201218.457820:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201218.457822:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788201218.855699:0:12980:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938632 is committed 00010000:00010000:3.0:1788201218.918666:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201219.813644:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201219.813677:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458213888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201219.813771:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201219.813936:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458213888 00000100:00100000:0.0:1788201219.813947:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458213888 00000100:00100000:0.0:1788201219.814027:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788201219.814038:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c26e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458213888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201219.814084:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 13631488 granted 525008896 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201219.814138:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c26e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458213888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201219.814147:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:2.0:1788201219.814339:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201219.814370:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968833 gen 2 00000004:00080000:2.0:1788201219.814377:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c24a0000, transno 4294968819 00000004:00080000:2.0:1788201219.814392:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c24a1500, transno 4294968820 00000004:00080000:2.0:1788201219.814396:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c24a2300, transno 4294968821 00000004:00080000:2.0:1788201219.814399:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c24a1c00, transno 4294968822 00000004:00080000:2.0:1788201219.814402:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c24a2a00, transno 4294968823 00000004:00080000:2.0:1788201219.814405:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c24a3b80, transno 4294968824 00000004:00080000:2.0:1788201219.814408:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c24a2d80, transno 4294968825 00000004:00080000:2.0:1788201219.814411:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c24a0380, transno 4294968826 00000004:00080000:2.0:1788201219.814414:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c3449f80, transno 4294968827 00000004:00080000:2.0:1788201219.814416:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c344b100, transno 4294968828 00000004:00080000:2.0:1788201219.814419:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c344a300, transno 4294968829 00000004:00080000:2.0:1788201219.814421:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c3449180, transno 4294968830 00000004:00080000:2.0:1788201219.814424:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04ff055f80, transno 4294968831 00000004:00080000:2.0:1788201219.814427:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04ff057100, transno 4294968832 00000004:00080000:2.0:1788201219.814429:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c3448700, transno 4294968833 00000100:00100000:2.0:1788201219.814442:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458213888:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1788201219.814994:0:12995:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 15 done 00010000:00010000:3.0:1788201219.941694:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201220.965610:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201221.349787:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c26e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458214144:0@lo:400:kworker.0 00000100:00100000:1.0:1788201221.349861:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201221.349923:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458214656:0@lo:400:kworker.0 00000100:00100000:1.0:1788201221.349942:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201221.349961:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201221.349967:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c26e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458214272:0@lo:400:kworker.0 00000100:00100000:1.0:1788201221.349987:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201221.350050:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c26e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458214016:0@lo:400:kworker.0 00000100:00100000:0.0:1788201221.350083:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201221.350112:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c20bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458214528:0@lo:400:kworker.0 00000100:00100000:0.0:1788201221.350136:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201221.350153:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201221.350159:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c20bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458214400:0@lo:400:kworker.0 00000100:00100000:0.0:1788201221.350179:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201221.350240:0:12963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458214016 00000100:00100000:1.0:1788201221.350248:0:12963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458214016 00000100:00100000:1.0:1788201221.350319:0:12963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788201221.350328:0:12963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f50b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458214016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201221.350373:0:12963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f50b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458214016:12345-0@lo:400:kworker.0 Request processed in 46us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201221.350380:0:12963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788201221.350407:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458214528 00000100:00100000:1.0:1788201221.350410:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458214528 00000100:00100000:1.0:1788201221.350437:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458214400 00000100:00100000:1.0:1788201221.350441:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458214400 00000100:00100000:1.0:1788201221.350461:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788201221.350467:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458214528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201221.350509:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458214528:12345-0@lo:400:kworker.0 Request processed in 42us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201221.350515:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788201221.350526:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788201221.350531:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458214400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201221.350555:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458214400:12345-0@lo:400:kworker.0 Request processed in 25us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201221.350560:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788201221.350649:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c20bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458214400:0@lo:400:kworker.0 00000100:00100000:0.0:1788201221.350659:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c26e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458214016:0@lo:400:kworker.0 00000100:00100000:0.0:1788201221.350666:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c20bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458214528:0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.350750:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458214144 00000100:00100000:2.0:1788201221.350755:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458214144 00000100:00100000:2.0:1788201221.350801:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458214656 00000100:00100000:2.0:1788201221.350805:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458214656 00000100:00100000:2.0:1788201221.350831:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458214272 00000100:00100000:2.0:1788201221.350835:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458214272 00000100:00100000:2.0:1788201221.350851:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788201221.350857:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3449f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458214144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.350903:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3449f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458214144:12345-0@lo:400:kworker.0 Request processed in 46us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201221.350909:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788201221.350923:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788201221.350929:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458214656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.350955:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458214656:12345-0@lo:400:kworker.0 Request processed in 26us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201221.350960:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788201221.350972:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788201221.350977:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458214272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.351004:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458214272:12345-0@lo:400:kworker.0 Request processed in 27us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201221.351010:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1788201221.351039:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201221.351044:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201221.351046:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201221.351065:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c26e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458214272:0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.351076:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c26e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458214144:0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.351084:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458214656:0@lo:400:kworker.0 00010000:00010000:3.0:1788201221.989644:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201222.375554:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201222.375581:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458214784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201222.375666:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201222.375965:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458214784 00000100:00100000:0.0:1788201222.375974:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458214784 00000100:00100000:0.0:1788201222.376040:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788201222.376049:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458214784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201222.376085:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 525008896 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1788201222.376142:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458214784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201222.376149:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788201222.376657:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458214784:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788201223.015778:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201223.576724:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201223.576786:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201223.576827:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201223.576871:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201223.576978:0:12964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442623872 00000100:00100000:3.0:1788201223.576989:0:12964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442623872 00000100:00100000:3.0:1788201223.577065:0:12964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 99 00000100:00100000:3.0:1788201223.577076:0:12964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f50b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2361:x1875064442623872:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201223.577154:0:12964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f50b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2361:x1875064442623872:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 80us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201223.577162:0:12964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 99 00000100:00100000:3.0:1788201223.577197:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442624256 00000100:00100000:3.0:1788201223.577200:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442624256 00000100:00100000:3.0:1788201223.577234:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442624128 00000100:00100000:3.0:1788201223.577237:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442624128 00000100:00100000:3.0:1788201223.577258:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 127 00000100:00100000:3.0:1788201223.577265:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2361:x1875064442624256:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201223.577338:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2361:x1875064442624256:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 73us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201223.577344:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 127 00000100:00100000:3.0:1788201223.577356:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 128 00000100:00100000:3.0:1788201223.577363:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c26e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2361:x1875064442624128:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201223.577406:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c26e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2361:x1875064442624128:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 44us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201223.577412:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 128 00000100:00080000:2.0:1788201223.578078:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201223.578086:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201223.578100:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442624000 00000100:00100000:2.0:1788201223.578106:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442624000 00000100:00100000:2.0:1788201223.578165:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 62 00000100:00100000:2.0:1788201223.578172:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:2361:x1875064442624000:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201223.578251:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:2361:x1875064442624000:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 80us (1538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201223.578257:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 62 00000100:00080000:3.0:1788201223.579374:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788201224.037495:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201224.935651:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201224.935675:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458214912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201224.935762:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201224.935907:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458214912 00000100:00100000:2.0:1788201224.935914:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458214912 00000100:00100000:2.0:1788201224.935990:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788201224.936000:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c26e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458214912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201224.936038:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 13631488 granted 525008896 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201224.936088:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c26e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458214912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201224.936095:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788201224.936145:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458214912:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788201224.936279:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788201225.061750:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201225.106099:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201225.106251:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442624384 00000100:00100000:2.0:1788201225.106263:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442624384 00000100:00080000:0.0:1788201225.106348:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201225.106372:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 861 00000100:00100000:2.0:1788201225.106383:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c26e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:2359:x1875064442624384:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:2.0:1788201225.106422:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201225.106447:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d3256 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4b23 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201225.106798:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-116, rc=-116) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d3256 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b23 expref: 27 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201225.106812:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c33ed200) 00010000:00010000:2.0:1788201225.106815:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201225.106819:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d3256 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b23 expref: 27 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201225.106835:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031800, rc -116) 00000100:00100000:2.0:1788201225.106910:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c26e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:2359:x1875064442624384:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 528us (822us total) trans 0 rc -116/-116 00000100:00100000:2.0:1788201225.106919:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 861 00010000:00010000:3.0:1788201226.087594:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201226.469817:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458215424:0@lo:400:kworker.0 00000100:00100000:3.0:1788201226.469862:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458215296:0@lo:400:kworker.0 00000100:00100000:0.0:1788201226.469899:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201226.469966:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201226.469981:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788201226.470017:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788201226.470026:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c20bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458215168:0@lo:400:kworker.0 00000100:00100000:3.0:1788201226.470052:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201226.470165:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458215424 00000100:00100000:1.0:1788201226.470174:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458215424 00000100:00100000:1.0:1788201226.470240:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788201226.470249:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458215424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201226.470330:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458215424:12345-0@lo:400:kworker.0 Request processed in 82us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201226.470337:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:1.0:1788201226.470355:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201226.470373:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458215296 00000100:00100000:1.0:1788201226.470377:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458215296 00000100:00100000:1.0:1788201226.470401:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458215168 00000100:00100000:1.0:1788201226.470403:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458215168 00000100:00100000:1.0:1788201226.470419:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788201226.470424:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458215296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201226.470455:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458215296:12345-0@lo:400:kworker.0 Request processed in 30us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201226.470463:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788201226.470475:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788201226.470485:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875064458215168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201226.470513:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875064458215168:12345-0@lo:400:kworker.0 Request processed in 30us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201226.470518:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1788201226.470534:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201226.470792:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c20bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458215040:0@lo:400:kworker.0 00000100:00100000:0.0:1788201226.470832:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201226.470869:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458215552:0@lo:400:kworker.0 00000100:00100000:0.0:1788201226.470898:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201226.470933:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458215424:0@lo:400:kworker.0 00000100:00100000:3.0:1788201226.470965:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875064458215680:0@lo:400:kworker.0 00000100:00100000:3.0:1788201226.471015:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201226.471035:0:12963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458215040 00000100:00100000:2.0:1788201226.471042:0:12963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458215040 00000100:00100000:2.0:1788201226.471081:0:12963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788201226.471088:0:12963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f50b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458215040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.471127:0:12963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f50b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458215040:12345-0@lo:400:kworker.0 Request processed in 40us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201226.471132:0:12963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788201226.471158:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458215552 00000100:00100000:2.0:1788201226.471161:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458215552 00000100:00100000:2.0:1788201226.471187:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788201226.471192:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458215552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.471217:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458215552:12345-0@lo:400:kworker.0 Request processed in 25us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201226.471226:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:2.0:1788201226.471241:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201226.471361:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458215680 00000100:00100000:0.0:1788201226.471365:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458215680 00000100:00100000:0.0:1788201226.471395:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788201226.471401:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875064458215680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201226.471559:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c20bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458215040:0@lo:400:kworker.0 00000100:00100000:1.0:1788201226.471570:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458215552:0@lo:400:kworker.0 00000100:00100000:3.0:1788201226.472740:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458215296:0@lo:400:kworker.0 00000100:00100000:0.0:1788201226.480508:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875064458215680:12345-0@lo:400:kworker.0 Request processed in 9092us (9479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201226.480527:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788201226.485489:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c20bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458215168:0@lo:400:kworker.0 00000100:00100000:3.0:1788201226.485535:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875064458215680:0@lo:400:kworker.0 00010000:00010000:0.0:1788201227.109486:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201227.495204:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201227.495227:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458215808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201227.495289:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201227.495344:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458215808 00000100:00100000:1.0:1788201227.495352:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458215808 00000100:00100000:1.0:1788201227.495398:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788201227.495406:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458215808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201227.495441:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 525008896 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1788201227.495552:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458215808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201227.495559:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788201227.495658:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5514700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458215808:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788201228.133590:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201228.690898:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201228.692954:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201228.692997:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201228.693155:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442624768 00000100:00100000:2.0:1788201228.693166:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442624768 00000100:00100000:2.0:1788201228.693248:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 131 00000100:00100000:2.0:1788201228.693259:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2359:x1875064442624768:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201228.693368:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2359:x1875064442624768:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 111us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201228.693377:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 131 00000100:00100000:0.0:1788201228.693693:0:12964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442624512 00000100:00100000:0.0:1788201228.693698:0:12964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442624512 00000100:00100000:0.0:1788201228.693739:0:12964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 101 00000100:00100000:0.0:1788201228.693747:0:12964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f950dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442624512:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201228.693779:0:12964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f950dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442624512:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 33us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201228.693784:0:12964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 101 00000100:00080000:3.0:1788201228.694158:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201228.700490:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201228.700941:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442624896 00000100:00100000:2.0:1788201228.700963:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442624896 00000100:00100000:2.0:1788201228.701043:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 132 00000100:00100000:2.0:1788201228.701055:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2360:x1875064442624896:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201228.701147:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2360:x1875064442624896:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 94us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201228.701156:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 132 00000100:00080000:3.0:1788201228.702212:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201228.702374:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442624640 00000100:00100000:1.0:1788201228.702397:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442624640 00000100:00100000:1.0:1788201228.702476:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 66 00000100:00100000:1.0:1788201228.702486:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:2360:x1875064442624640:12345-192.168.201.30@tcp:400:kworker.0 00000100:00080000:3.0:1788201228.702672:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201228.702943:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:2360:x1875064442624640:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 458us (12053us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201228.702960:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 66 00010000:00010000:3.0:1788201229.157535:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201229.716980:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201229.719283:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442625024 00000100:00100000:2.0:1788201229.719317:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442625024 00000100:00100000:2.0:1788201229.719493:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 862 00000100:00100000:2.0:1788201229.719505:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c543f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:2362:x1875064442625024:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:2.0:1788201229.719568:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201229.721606:0:6715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d325d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4b2a expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201229.721994:0:6715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-116, rc=-116) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d325d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b2a expref: 27 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201229.722011:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e03c33ed800) 00010000:00010000:2.0:1788201229.722015:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201229.722022:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d325d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b2a expref: 27 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201229.722043:0:6715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031a00, rc -116) 00000100:00100000:2.0:1788201229.722140:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c543f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:2362:x1875064442625024:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 2637us (5169us total) trans 0 rc -116/-116 00000100:00100000:2.0:1788201229.722150:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 862 00000100:00100000:0.0:1788201230.053594:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458215936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201230.053701:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201230.053947:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458215936 00000100:00100000:2.0:1788201230.053956:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458215936 00000100:00100000:2.0:1788201230.054029:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788201230.054038:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458215936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201230.054074:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 13631488 granted 525008896 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788201230.054146:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201230.061340:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458215936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6966us (7302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201230.061354:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788201230.064406:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458215936:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788201230.181532:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201231.205546:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201231.589872:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c543f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458216064:0@lo:400:kworker.0 00000100:00100000:2.0:1788201231.589949:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201231.590076:0:12963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458216064 00000100:00100000:1.0:1788201231.590083:0:12963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458216064 00000100:00100000:1.0:1788201231.590141:0:12963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788201231.590150:0:12963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f950f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458216064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201231.590281:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c543c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458216192:0@lo:400:kworker.0 00000100:00100000:0.0:1788201231.590324:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201231.590345:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201231.590349:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c543e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458216320:0@lo:400:kworker.0 00000100:00100000:0.0:1788201231.590361:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201231.590377:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c543ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458216448:0@lo:400:kworker.0 00000100:00100000:0.0:1788201231.590392:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201231.590410:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458216448 00000100:00100000:0.0:1788201231.590413:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458216448 00000100:00100000:0.0:1788201231.590441:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788201231.590446:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458216448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201231.590472:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458216448:12345-0@lo:400:kworker.0 Request processed in 27us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201231.590477:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788201231.590516:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c543ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458216448:0@lo:400:kworker.0 00000100:00080000:0.0:1788201231.590546:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201231.590571:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458216192 00000100:00100000:0.0:1788201231.590574:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458216192 00000100:00100000:0.0:1788201231.590613:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458216320 00000100:00100000:0.0:1788201231.590617:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458216320 00000100:00100000:0.0:1788201231.590637:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788201231.590644:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458216192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201231.590685:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458216192:12345-0@lo:400:kworker.0 Request processed in 41us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201231.590694:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788201231.590707:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788201231.590712:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458216320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201231.590741:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458216320:12345-0@lo:400:kworker.0 Request processed in 28us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201231.590746:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788201231.590777:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c543e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458216320:0@lo:400:kworker.0 00000100:00100000:0.0:1788201231.590788:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c543c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458216192:0@lo:400:kworker.0 00000100:00080000:0.0:1788201231.590801:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201231.591177:0:12963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f950f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458216064:12345-0@lo:400:kworker.0 Request processed in 1026us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201231.591185:0:12963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788201231.591334:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201231.591345:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c543c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875064458216704:0@lo:400:kworker.0 00000100:00100000:3.0:1788201231.591378:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201231.591408:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458216704 00000100:00100000:3.0:1788201231.591412:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458216704 00000100:00100000:3.0:1788201231.591444:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788201231.591451:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c543e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875064458216704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201231.591488:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c543e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875064458216704:12345-0@lo:400:kworker.0 Request processed in 36us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201231.591493:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788201231.591520:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c543c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875064458216704:0@lo:400:kworker.0 00000100:00100000:0.0:1788201231.591630:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201231.591639:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c543c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458216576:0@lo:400:kworker.0 00000100:00100000:0.0:1788201231.591669:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201231.591739:0:13442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458216576 00000100:00100000:1.0:1788201231.591744:0:13442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458216576 00000100:00100000:1.0:1788201231.591774:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788201231.591779:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458216576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201231.591810:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458216576:12345-0@lo:400:kworker.0 Request processed in 32us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201231.591814:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788201231.591886:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c543c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458216576:0@lo:400:kworker.0 00000100:00100000:2.0:1788201231.591945:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c543f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458216064:0@lo:400:kworker.0 00000100:00100000:2.0:1788201231.810925:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201231.811040:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201231.811082:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201231.811133:0:12964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442625152 00000100:00100000:0.0:1788201231.811143:0:12964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442625152 00000100:00100000:0.0:1788201231.811209:0:12964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 103 00000100:00100000:0.0:1788201231.811221:0:12964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f950fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442625152:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201231.811321:0:12964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f950fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442625152:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 74us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201231.811330:0:12964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 103 00000100:00100000:1.0:1788201231.812181:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442625408 00000100:00100000:1.0:1788201231.812188:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442625408 00000100:00100000:3.0:1788201231.812318:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442625536 00000100:00100000:3.0:1788201231.812323:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442625536 00000100:00100000:1.0:1788201231.812370:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 135 00000100:00100000:1.0:1788201231.812379:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2362:x1875064442625408:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201231.812427:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2362:x1875064442625408:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 49us (1525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201231.812434:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 135 00000100:00080000:0.0:1788201231.812740:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201231.812746:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201231.813207:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 136 00000100:00100000:3.0:1788201231.813217:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5439180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2362:x1875064442625536:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201231.813364:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5439180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2362:x1875064442625536:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 149us (2281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201231.813372:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 136 00000100:00100000:2.0:1788201231.814550:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201231.814761:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442625280 00000100:00100000:0.0:1788201231.814769:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442625280 00000100:00100000:0.0:1788201231.814863:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:0.0:1788201231.814872:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c543ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:2358:x1875064442625280:12345-192.168.201.30@tcp:38:kworker.0 00010000:02000400:0.0:1788201231.814898:0:12968:0:(ldlm_lib.c:964:target_handle_reconnect()) lustre-MDT0000: Client 35604eb4-baf9-45be-a20a-4883a2cd8cf9 (at 192.168.201.30@tcp) reconnecting 00000100:00080000:2.0:1788201231.823046:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788201231.828097:0:12968:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp t4294967305 exp ffff9e04fae42000 cur 507 last 1788201231 00000004:00100000:0.0:1788201231.828144:0:12968:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli 192.168.201.30@tcp supports cksum type 77, return 77 00000100:00080000:0.0:1788201231.828171:0:12968:0:(import.c:65:import_set_state_nolock()) ffff9e04fae46000 : changing import state from FULL to RECOVER 00000100:00080000:0.0:1788201231.828181:0:12968:0:(import.c:65:import_set_state_nolock()) ffff9e04fae46000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201231.828275:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c543ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:2358:x1875064442625280:12345-192.168.201.30@tcp:38:kworker.0 Request processed in 13402us (13728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201231.828287:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:2.0:1788201231.846512:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201231.846628:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442622592 00000100:00100000:0.0:1788201231.846640:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442622592 00000100:00100000:0.0:1788201231.846710:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5067 00000100:00100000:0.0:1788201231.846721:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5391f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:13686:x1875064442622592:12345-192.168.201.30@tcp:36:chmod.0 00000004:00080000:0.0:1788201231.846784:0:12969:0:(mdt_internal.h:1254:mdt_check_resent()) @@@ no reply data found for RESENT req, rc = 0 req@ffff9e03c5391f80 x1875064442622592/t0(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:352/0 lens 488/3152 e 0 to 0 dl 1788201242 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788201231.846797:0:12969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201231.846827:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d30d5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a74 expref: 26 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.846850:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ed:0x0].0x0 (ffff9e03c5173e00) 00010000:00010000:0.0:1788201231.846855:0:12969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201231.846887:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d3264 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.846900:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d3264 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.847254:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d3264 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201231.847715:0:12969:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae430cc4 reply state 000000007b634bb5 transno 8589938633 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d3264 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201231.847725:0:12969:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201231.847826:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5391f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:13686:x1875064442622592:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 1105us (1321us total) trans 8589938633 rc 0/0 00000100:00100000:0.0:1788201231.847835:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5067 00000100:00100000:2.0:1788201231.854751:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201231.854832:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201231.855158:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:0.0:1788201231.855197:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d3264 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.855209:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d3264 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.855216:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d3264 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.855222:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201231.855227:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d3264 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.855236:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d3264 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.855252:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ed:0x0].0x0 (ffff9e03c5173e00) 00010000:00010000:0.0:1788201231.855254:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788201231.855258:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d3264 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.855270:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d3264 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201231.861694:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442622720 00000100:00100000:3.0:1788201231.861712:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442622720 00000100:00100000:3.0:1788201231.861773:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442623232 00000100:00100000:3.0:1788201231.861777:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442623232 00000100:00100000:3.0:1788201231.861806:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5068 00000100:00100000:3.0:1788201231.861816:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5393b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:13688:x1875064442622720:12345-192.168.201.30@tcp:36:chmod.0 00000004:00080000:3.0:1788201231.861876:0:12971:0:(mdt_internal.h:1254:mdt_check_resent()) @@@ no reply data found for RESENT req, rc = 0 req@ffff9e03c5393b80 x1875064442622720/t0(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:352/0 lens 488/3152 e 0 to 0 dl 1788201242 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788201231.861888:0:12971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201231.861927:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d3130 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a90 expref: 27 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.861947:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ef:0x0].0x0 (ffff9e03c33ed000) 00010000:00010000:3.0:1788201231.861952:0:12971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201231.861979:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016000/0x9383f985bc4d326b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.861992:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016000/0x9383f985bc4d326b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.862001:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016000/0x9383f985bc4d326b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201231.862242:0:12971:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000484eea4a reply state 000000002291bd7c transno 8589938634 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016000/0x9383f985bc4d326b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201231.862252:0:12971:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201231.862372:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5393b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:13688:x1875064442622720:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 556us (7630us total) trans 8589938634 rc 0/0 00000100:00100000:3.0:1788201231.862379:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5068 00000100:00100000:3.0:1788201231.862399:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5069 00000100:00100000:3.0:1788201231.862406:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5391500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:13689:x1875064442623232:12345-192.168.201.30@tcp:36:chmod.0 00000004:00080000:3.0:1788201231.862430:0:12971:0:(mdt_internal.h:1254:mdt_check_resent()) @@@ no reply data found for RESENT req, rc = 0 req@ffff9e03c5391500 x1875064442623232/t0(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:352/0 lens 496/3152 e 0 to 0 dl 1788201242 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788201231.862443:0:12971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788201231.862455:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d3209 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b00 expref: 27 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.862471:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3184 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4aac expref: 26 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.862483:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016400/0x9383f985bc4d3168 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ae4 expref: 25 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.862491:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f0:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:3.0:1788201231.862495:0:12971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201231.862508:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d3272 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.862516:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d3272 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.862523:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d3272 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201231.862644:0:12971:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007f59ea32 reply state 00000000fa288280 transno 8589938635 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d3272 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201231.862652:0:12971:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201231.862690:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5391500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:13689:x1875064442623232:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 284us (7858us total) trans 8589938635 rc 0/0 00000100:00100000:3.0:1788201231.862696:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5069 00000100:00100000:2.0:1788201231.873789:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201231.873823:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201231.873852:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201231.873900:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201231.873943:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201231.874026:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:2.0:1788201231.874064:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016000/0x9383f985bc4d326b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201231.874076:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016000/0x9383f985bc4d326b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201231.874084:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016000/0x9383f985bc4d326b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201231.874090:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3016000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201231.874095:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016000/0x9383f985bc4d326b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201231.874103:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016000/0x9383f985bc4d326b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201231.874120:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ef:0x0].0x0 (ffff9e03c33ed000) 00010000:00010000:2.0:1788201231.874123:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788201231.874128:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016000/0x9383f985bc4d326b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201231.874138:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016000/0x9383f985bc4d326b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201231.874174:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442626688 00000100:00100000:2.0:1788201231.874183:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442626688 00000100:00100000:2.0:1788201231.874229:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442626560 00000100:00100000:2.0:1788201231.874232:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442626560 00000100:00100000:2.0:1788201231.874248:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442626816 00000100:00100000:2.0:1788201231.874251:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442626816 00000100:00100000:2.0:1788201231.874270:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4165 00000100:00100000:2.0:1788201231.874279:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5392a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:2361:x1875064442626688:12345-192.168.201.30@tcp:2:chmod.0 00002000:00010000:2.0:1788201231.874559:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x418:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788201231.874563:0:13444:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x418:0x0] updating lvb mtime from disk: 1788201214 -> 1788201214 00002000:00010000:2.0:1788201231.874565:0:13444:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x418:0x0] updating lvb atime from disk: 1788201214 -> 1788201214 00002000:00010000:2.0:1788201231.874568:0:13444:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x418:0x0] updating lvb ctime from disk: 1788201214 -> 1788201215 00002000:00010000:2.0:1788201231.874570:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x418:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788201231.874631:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5392a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2361:x1875064442626688:12345-192.168.201.30@tcp:2:chmod.0 Request processed in 353us (729us total) trans 4294968837 rc 0/0 00000100:00100000:2.0:1788201231.874639:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4165 00000100:00100000:2.0:1788201231.874655:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4166 00000100:00100000:2.0:1788201231.874661:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5392300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:2359:x1875064442626560:12345-192.168.201.30@tcp:2:chmod.0 00002000:00010000:2.0:1788201231.874727:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x417:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788201231.874730:0:13444:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x417:0x0] updating lvb mtime from disk: 1788201214 -> 1788201214 00002000:00010000:2.0:1788201231.874732:0:13444:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x417:0x0] updating lvb atime from disk: 1788201214 -> 1788201214 00002000:00010000:2.0:1788201231.874735:0:13444:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x417:0x0] updating lvb ctime from disk: 1788201214 -> 1788201215 00002000:00010000:2.0:1788201231.874737:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x417:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788201231.874756:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5392300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2359:x1875064442626560:12345-192.168.201.30@tcp:2:chmod.0 Request processed in 94us (812us total) trans 4294968838 rc 0/0 00000100:00100000:2.0:1788201231.874762:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4166 00000100:00100000:2.0:1788201231.874773:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4167 00000100:00100000:2.0:1788201231.874779:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2359:x1875064442626816:12345-192.168.201.30@tcp:2:chmod.0 00002000:00010000:2.0:1788201231.874898:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788201231.874901:0:13444:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb mtime from disk: 1788201214 -> 1788201214 00002000:00010000:2.0:1788201231.874903:0:13444:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb atime from disk: 1788201214 -> 1788201214 00002000:00010000:2.0:1788201231.874905:0:13444:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb ctime from disk: 1788201214 -> 1788201215 00002000:00010000:2.0:1788201231.874907:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x419:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788201231.874925:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35604eb4-baf9-45be-a20a-4883a2cd8cf9+510:2359:x1875064442626816:12345-192.168.201.30@tcp:2:chmod.0 Request processed in 146us (900us total) trans 4294968836 rc 0/0 00000100:00100000:2.0:1788201231.874930:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4167 00000100:00100000:2.0:1788201231.874959:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442622080 00000100:00100000:2.0:1788201231.874963:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442622080 00000100:00100000:2.0:1788201231.874980:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442621568 00000100:00100000:2.0:1788201231.874982:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442621568 00000100:00100000:2.0:1788201231.874989:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442620032 00000100:00100000:2.0:1788201231.874991:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442620032 00000100:00100000:2.0:1788201231.874998:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442620672 00000100:00100000:2.0:1788201231.875000:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442620672 00000100:00100000:2.0:1788201231.875010:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5070 00000100:00100000:2.0:1788201231.875015:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5390e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:13687:x1875064442622080:12345-192.168.201.30@tcp:36:chmod.0 00000004:00080000:2.0:1788201231.875052:0:13379:0:(mdt_internal.h:1254:mdt_check_resent()) @@@ no reply data found for RESENT req, rc = 0 req@ffff9e03c5390e00 x1875064442622080/t0(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:352/0 lens 488/3152 e 0 to 0 dl 1788201242 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788201231.875064:0:13379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201231.875080:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d3114 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a89 expref: 28 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201231.875094:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ee:0x0].0x0 (ffff9e03c33e8500) 00010000:00010000:2.0:1788201231.875098:0:13379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201231.875120:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3279 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201231.875133:0:13379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d31ed lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4af9 expref: 27 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201231.875141:0:13379:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3279 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201231.875173:0:13379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d31ed lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4af9 expref: 27 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201231.875186:0:13379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d31ed lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4af9 expref: 27 pid: 6715 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201231.875201:0:13379:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c51a1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:13379:1875064458216832:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201231.875251:0:13379:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f9471540 going to sleep for 11 seconds 00000100:00100000:3.0:1788201231.876104:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5071 00000100:00100000:3.0:1788201231.876118:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5393800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:13683:x1875064442621568:12345-192.168.201.30@tcp:36:chmod.0 00000004:00080000:3.0:1788201231.876160:0:12971:0:(mdt_internal.h:1254:mdt_check_resent()) @@@ no reply data found for RESENT req, rc = 0 req@ffff9e03c5393800 x1875064442621568/t0(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:352/0 lens 488/3152 e 0 to 0 dl 1788201242 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788201231.876171:0:12971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201231.876187:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d30f1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a7b expref: 27 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.876202:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ea:0x0].0x0 (ffff9e03c2fc5400) 00010000:00010000:3.0:1788201231.876205:0:12971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201231.876226:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d3280 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.876236:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d3280 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.876245:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d3280 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201231.876459:0:12971:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000469e93ee reply state 00000000343cc904 transno 8589938636 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d3280 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201231.876469:0:12971:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201231.876557:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5393800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:13683:x1875064442621568:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 443us (2776us total) trans 8589938636 rc 0/0 00000100:00100000:3.0:1788201231.876564:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5071 00000100:00100000:3.0:1788201231.876587:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5072 00000100:00100000:3.0:1788201231.876605:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5390380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:13684:x1875064442620032:12345-192.168.201.30@tcp:36:chmod.0 00000004:00080000:3.0:1788201231.876632:0:12971:0:(mdt_internal.h:1254:mdt_check_resent()) @@@ no reply data found for RESENT req, rc = 0 req@ffff9e03c5390380 x1875064442620032/t0(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:352/0 lens 488/3152 e 0 to 0 dl 1788201242 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788201231.876641:0:12971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201231.876653:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d3096 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a5f expref: 27 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.876665:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3eb:0x0].0x0 (ffff9e03c33e8900) 00010000:00010000:3.0:1788201231.876668:0:12971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201231.876682:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017400/0x9383f985bc4d3287 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.876691:0:12971:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d31b5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4aeb expref: 26 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.876697:0:12971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017400/0x9383f985bc4d3287 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.876723:0:12971:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d31b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4aeb expref: 26 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.876733:0:12971:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d31b5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4aeb expref: 26 pid: 6715 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201231.876746:0:12971:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c543c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:12971:1875064458216960:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201231.876782:0:12971:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c3362600 going to sleep for 11 seconds 00010000:00010000:0.0:1788201231.877534:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d3272 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.877545:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d3272 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.877552:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d3272 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.877559:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201231.877563:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d3272 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.877571:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d3272 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.877582:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f0:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:0.0:1788201231.877584:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788201231.877588:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d3272 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.877603:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d3272 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201231.877639:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5073 00000100:00100000:0.0:1788201231.877652:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5392d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+25:13685:x1875064442620672:12345-192.168.201.30@tcp:36:chmod.0 00000004:00080000:0.0:1788201231.877693:0:12969:0:(mdt_internal.h:1254:mdt_check_resent()) @@@ no reply data found for RESENT req, rc = 0 req@ffff9e03c5392d80 x1875064442620672/t0(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:352/0 lens 488/3152 e 0 to 0 dl 1788201242 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788201231.877704:0:12969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201231.877719:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d30b9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a6d expref: 25 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.877729:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ec:0x0].0x0 (ffff9e03c5173d00) 00010000:00010000:0.0:1788201231.877732:0:12969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201231.877753:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d328e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.877764:0:12969:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d31d1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4af2 expref: 24 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.877772:0:12969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d328e lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.877795:0:12969:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d31d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4af2 expref: 24 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.877803:0:12969:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d31d1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4af2 expref: 24 pid: 6715 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201231.877813:0:12969:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:12969:1875064458217088:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201231.877864:0:12969:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c33d59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201231.879178:0:13379:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c51a1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:13379:1875064458216832:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201231.879251:0:13379:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3279 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201231.895205:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201231.895366:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442626944 00000100:00100000:0.0:1788201231.895381:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442626944 00010000:00010000:0.0:1788201231.895436:0:7646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d31ed lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4af9 expref: 25 pid: 6715 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201231.895502:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1532 00000100:00100000:0.0:1788201231.895514:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c7e16050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+25:2359:x1875064442626944:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201231.895535:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201231.895544:0:7646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d31ed lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4af9 expref: 25 pid: 6715 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.895559:0:7646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d31ed lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4af9 expref: 25 pid: 6715 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.895586:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d31ed lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4af9 expref: 25 pid: 6715 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.895617:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ee:0x0].0x0 (ffff9e03c33e8500) 00010000:00010000:0.0:1788201231.895623:0:7646:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3279 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.895634:0:7646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3279 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.895643:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3279 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.895677:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201231.895745:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c7e16050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:2359:x1875064442626944:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 232us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201231.895754:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1532 00010000:00010000:3.0:1788201231.896040:0:13379:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3279 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.896050:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3279 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201231.896428:0:13379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ae333a4 reply state 000000005f07d538 transno 8589938637 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3279 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201231.896440:0:13379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201231.896546:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5390e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+25:13687:x1875064442622080:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 21529us (41388us total) trans 8589938637 rc 0/0 00000100:00100000:3.0:1788201231.896554:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5070 00000100:00100000:2.0:1788201231.899064:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201231.899342:0:12971:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c543c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:12971:1875064458216960:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201231.899378:0:12971:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017400/0x9383f985bc4d3287 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.899410:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d3280 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.899425:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d3280 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.899434:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d3280 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.899441:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201231.899448:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d3280 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.899457:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d3280 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.899489:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ea:0x0].0x0 (ffff9e03c2fc5400) 00010000:00010000:0.0:1788201231.899493:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788201231.899498:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d3280 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.899505:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d3280 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201231.899759:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442627072 00000100:00100000:3.0:1788201231.899770:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442627072 00000100:00100000:3.0:1788201231.899834:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4168 00000100:00100000:3.0:1788201231.899844:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+510:2359:x1875064442627072:12345-192.168.201.30@tcp:2:chmod.0 00002000:00010000:3.0:1788201231.900118:0:6703:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788201231.900122:0:6703:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb mtime from disk: 1788201214 -> 1788201214 00002000:00010000:3.0:1788201231.900124:0:6703:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb atime from disk: 1788201214 -> 1788201214 00002000:00010000:3.0:1788201231.900126:0:6703:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb ctime from disk: 1788201214 -> 1788201215 00002000:00010000:3.0:1788201231.900128:0:6703:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x416:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788201231.900207:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2359:x1875064442627072:12345-192.168.201.30@tcp:2:chmod.0 Request processed in 364us (1164us total) trans 4294968837 rc 0/0 00000100:00100000:3.0:1788201231.900216:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4168 00000100:00100000:1.0:1788201231.914652:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201231.914759:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201231.914823:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201231.914880:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442627328 00000100:00100000:3.0:1788201231.914892:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442627328 00000100:00100000:3.0:1788201231.914961:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4169 00000100:00100000:3.0:1788201231.914972:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2359:x1875064442627328:12345-192.168.201.30@tcp:2:chmod.0 00002000:00010000:3.0:1788201231.915193:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788201231.915197:0:13445:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb mtime from disk: 1788201214 -> 1788201214 00002000:00010000:3.0:1788201231.915199:0:13445:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb atime from disk: 1788201214 -> 1788201214 00002000:00010000:3.0:1788201231.915201:0:13445:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb ctime from disk: 1788201214 -> 1788201215 00002000:00010000:3.0:1788201231.915203:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x418:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788201231.915264:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35604eb4-baf9-45be-a20a-4883a2cd8cf9+512:2359:x1875064442627328:12345-192.168.201.30@tcp:2:chmod.0 Request processed in 294us (505us total) trans 4294968838 rc 0/0 00000100:00100000:3.0:1788201231.915272:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4169 00010000:00010000:0.0:1788201231.918798:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3279 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.918818:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3279 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.918825:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3279 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.918831:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201231.918837:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3279 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.918843:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3279 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.918860:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ee:0x0].0x0 (ffff9e03c33e8500) 00010000:00010000:0.0:1788201231.918863:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788201231.918868:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3279 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.918873:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3279 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201231.920164:0:12969:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:12969:1875064458217088:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201231.920193:0:12969:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d328e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201231.922216:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442627200 00000100:00100000:2.0:1788201231.922231:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442627200 00010000:00010000:3.0:1788201231.922724:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d31b5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4aeb expref: 23 pid: 6715 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201231.922776:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442627456 00000100:00100000:3.0:1788201231.922781:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442627456 00010000:00010000:3.0:1788201231.922798:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d31d1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4af2 expref: 24 pid: 6715 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201231.922828:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1533 00000100:00100000:3.0:1788201231.922838:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3448380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:2360:x1875064442627200:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201231.922855:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201231.922862:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d31b5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4aeb expref: 24 pid: 6715 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.922877:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d31b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4aeb expref: 24 pid: 6715 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.922922:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d31b5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4aeb expref: 24 pid: 6715 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.922941:0:8524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3eb:0x0].0x0 (ffff9e03c33e8900) 00010000:00010000:3.0:1788201231.922946:0:8524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017400/0x9383f985bc4d3287 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.922956:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017400/0x9383f985bc4d3287 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.922964:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017400/0x9383f985bc4d3287 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.922991:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201231.923076:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3448380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:2360:x1875064442627200:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 238us (8433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201231.923084:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1533 00000100:00100000:3.0:1788201231.923103:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1534 00000100:00100000:3.0:1788201231.923110:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:2360:x1875064442627456:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201231.923119:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201231.923124:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d31d1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4af2 expref: 22 pid: 6715 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.923135:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d31d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4af2 expref: 22 pid: 6715 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.923147:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d31d1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4af2 expref: 22 pid: 6715 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.923157:0:8524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ec:0x0].0x0 (ffff9e03c5173d00) 00010000:00010000:3.0:1788201231.923163:0:8524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d328e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.923170:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d328e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.923177:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d328e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.923193:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201231.923212:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:2360:x1875064442627456:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 102us (8388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201231.923218:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1534 00010000:00010000:3.0:1788201231.923422:0:12969:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d328e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.923431:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d328e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201231.925217:0:12969:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1cf9cbd reply state 000000008d329081 transno 8589938638 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d328e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201231.925236:0:12969:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201231.925365:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5392d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:13685:x1875064442620672:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 47714us (51508us total) trans 8589938638 rc 0/0 00000100:00100000:3.0:1788201231.925374:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5073 00010000:00010000:1.0:1788201231.925783:0:12971:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017400/0x9383f985bc4d3287 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.925793:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017400/0x9383f985bc4d3287 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201231.926087:0:12971:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000717b7c4 reply state 00000000c86ebcbd transno 8589938639 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017400/0x9383f985bc4d3287 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201231.926096:0:12971:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201231.926157:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5390380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:13684:x1875064442620032:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 49553us (52333us total) trans 8589938639 rc 0/0 00000100:00100000:1.0:1788201231.926165:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5072 00000100:00100000:3.0:1788201231.935378:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:1.0:1788201231.935456:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017400/0x9383f985bc4d3287 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.935469:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017400/0x9383f985bc4d3287 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.935477:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017400/0x9383f985bc4d3287 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.935488:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201231.935493:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017400/0x9383f985bc4d3287 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.935501:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017400/0x9383f985bc4d3287 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.935519:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3eb:0x0].0x0 (ffff9e03c33e8900) 00010000:00010000:1.0:1788201231.935522:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788201231.935526:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017400/0x9383f985bc4d3287 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.935532:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017400/0x9383f985bc4d3287 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.935632:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d328e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.935641:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d328e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.935647:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d328e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.935652:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201231.935655:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d328e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.935661:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d328e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.935672:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ec:0x0].0x0 (ffff9e03c5173d00) 00010000:00010000:0.0:1788201231.935674:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788201231.935677:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d328e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201231.935683:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d328e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201231.935950:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442627584 00000100:00100000:2.0:1788201231.935959:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442627584 00000100:00100000:2.0:1788201231.936019:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4170 00000100:00100000:2.0:1788201231.936029:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c543c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2361:x1875064442627584:12345-192.168.201.30@tcp:2:chmod.0 00002000:00010000:2.0:1788201231.936245:0:13446:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x416:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788201231.936249:0:13446:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x416:0x0] updating lvb mtime from disk: 1788201214 -> 1788201214 00002000:00010000:2.0:1788201231.936251:0:13446:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x416:0x0] updating lvb atime from disk: 1788201214 -> 1788201214 00002000:00010000:2.0:1788201231.936254:0:13446:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x416:0x0] updating lvb ctime from disk: 1788201214 -> 1788201215 00002000:00010000:2.0:1788201231.936256:0:13446:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x416:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788201231.936355:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c543c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:2361:x1875064442627584:12345-192.168.201.30@tcp:2:chmod.0 Request processed in 326us (986us total) trans 4294968839 rc 0/0 00000100:00100000:2.0:1788201231.936363:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4170 00000100:00100000:3.0:1788201231.937650:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201231.937769:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442627712 00000100:00100000:0.0:1788201231.937779:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442627712 00000100:00100000:0.0:1788201231.937825:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4171 00000100:00100000:0.0:1788201231.937834:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c543ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35604eb4-baf9-45be-a20a-4883a2cd8cf9+512:2360:x1875064442627712:12345-192.168.201.30@tcp:2:chmod.0 00002000:00010000:0.0:1788201231.938029:0:13450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788201231.938033:0:13450:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb mtime from disk: 1788201214 -> 1788201214 00002000:00010000:0.0:1788201231.938036:0:13450:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb atime from disk: 1788201214 -> 1788201214 00002000:00010000:0.0:1788201231.938039:0:13450:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb ctime from disk: 1788201214 -> 1788201215 00002000:00010000:0.0:1788201231.938041:0:13450:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x417:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788201231.938090:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c543ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35604eb4-baf9-45be-a20a-4883a2cd8cf9+513:2360:x1875064442627712:12345-192.168.201.30@tcp:2:chmod.0 Request processed in 257us (447us total) trans 4294968839 rc 0/0 00000100:00100000:0.0:1788201231.938099:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4171 00000100:00100000:1.0:1788201231.977216:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201231.977434:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442627840 00000100:00100000:0.0:1788201231.977445:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442627840 00000100:00100000:1.0:1788201231.977642:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5074 00000100:00100000:1.0:1788201231.977653:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:13709:x1875064442627840:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:1.0:1788201231.977682:0:12968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201231.977705:0:12968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d3295 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4b31 expref: -99 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.977773:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d329c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.977787:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d329c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.977798:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d329c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.977814:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d32a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.977821:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d32a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.977827:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d32a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.978178:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d32aa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.978189:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d32aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.978196:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d32aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201231.978226:0:12968:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3ea:0x0]: returning size 0 00000004:00200000:1.0:1788201231.978231:0:12968:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201231.978263:0:12968:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d32aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.978275:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d32aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.978283:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d329c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.978290:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d329c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.978323:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d329c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.978330:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201231.978334:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d329c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.978342:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d329c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.978354:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:1.0:1788201231.978358:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201231.978362:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d329c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.978368:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d329c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.978381:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d32a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.978388:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d32a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.978394:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d32a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.978400:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201231.978402:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d32a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.978408:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d32a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.978415:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0xcda302ea (ffff9e03c5173200) 00010000:00010000:1.0:1788201231.978418:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201231.978420:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d32a3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.978427:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d32a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.978455:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d3295 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b31 expref: 23 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.978468:0:12968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d32aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b31 expref: 22 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201231.978476:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ea:0x0].0x0 (ffff9e03c2fc5400) 00010000:00010000:1.0:1788201231.978478:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201231.978481:0:12968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3800, rc 0) 00000100:00100000:1.0:1788201231.978545:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:13709:x1875064442627840:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 894us (1338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201231.978552:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5074 00000100:00100000:3.0:1788201232.000667:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201232.000896:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442627968 00000100:00100000:2.0:1788201232.000978:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442627968 00000100:00100000:2.0:1788201232.001080:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5075 00000100:00100000:2.0:1788201232.001091:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c543d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:13710:x1875064442627968:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:2.0:1788201232.001114:0:13379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201232.001138:0:13379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d32b1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4b38 expref: -99 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.001206:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d32b8 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.001221:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d32b8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.001232:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d32b8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.001245:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d32bf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.001256:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d32bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.001262:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d32bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.001731:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d32c6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.001742:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d32c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.001749:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d32c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201232.001783:0:13379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3eb:0x0]: returning size 0 00000004:00200000:2.0:1788201232.001787:0:13379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201232.001819:0:13379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d32c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.001830:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d32c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.001839:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d32b8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.001845:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d32b8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.001853:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d32b8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.001863:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201232.001868:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d32b8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.001875:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d32b8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.001886:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:2.0:1788201232.001889:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201232.001893:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d32b8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.001899:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d32b8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.001924:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d32bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.001930:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d32bf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.001937:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d32bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.001942:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201232.001945:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d32bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.001951:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d32bf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.001962:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x15fcbbea (ffff9e03c33ed800) 00010000:00010000:2.0:1788201232.001965:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201232.001967:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d32bf lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.001973:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d32bf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.002010:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d32b1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b38 expref: 24 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.002025:0:13379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d32c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b38 expref: 23 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.002032:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3eb:0x0].0x0 (ffff9e03c33e8900) 00010000:00010000:2.0:1788201232.002034:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201232.002037:0:13379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031800, rc 0) 00000100:00100000:2.0:1788201232.002111:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c543d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:13710:x1875064442627968:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 1021us (1455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201232.002119:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5075 00000100:00100000:3.0:1788201232.025730:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201232.025956:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442628096 00000100:00100000:1.0:1788201232.025967:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442628096 00000100:00100000:1.0:1788201232.026080:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5076 00000100:00100000:1.0:1788201232.026092:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c543ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:13711:x1875064442628096:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:1.0:1788201232.026114:0:12971:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201232.026135:0:12971:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d32cd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4b3f expref: -99 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.026204:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d32d4 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.026218:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d32d4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.026229:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d32d4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.026246:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d32db lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.026253:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d32db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.026260:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d32db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.026738:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d32e2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.026749:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d32e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.026756:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d32e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201232.026790:0:12971:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3ec:0x0]: returning size 0 00000004:00200000:1.0:1788201232.026795:0:12971:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201232.026813:0:12971:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d32e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.026825:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d32e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.026833:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d32d4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.026840:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d32d4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.026850:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d32d4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.026857:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201232.026861:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d32d4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.026869:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d32d4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.026881:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:1.0:1788201232.026884:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201232.026888:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d32d4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.026894:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d32d4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.026905:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d32db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.026911:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d32db lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.026917:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d32db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.026922:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201232.026925:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d32db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.026935:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d32db lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.026942:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x5e5674ea (ffff9e03c5173200) 00010000:00010000:1.0:1788201232.026944:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201232.026947:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d32db lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.026952:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d32db lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.026981:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d32cd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b3f expref: 25 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.026994:0:12971:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d32e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b3f expref: 24 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.027001:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ec:0x0].0x0 (ffff9e03c5173d00) 00010000:00010000:1.0:1788201232.027003:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201232.027006:0:12971:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3a00, rc 0) 00000100:00100000:1.0:1788201232.027077:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c543ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:13711:x1875064442628096:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 986us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201232.027086:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5076 00000100:00100000:1.0:1788201232.039416:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201232.039699:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442628224 00000100:00100000:0.0:1788201232.039710:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442628224 00000100:00100000:0.0:1788201232.039833:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 863 00000100:00100000:0.0:1788201232.039844:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f977dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:2359:x1875064442628224:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:0.0:1788201232.039903:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201232.039941:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d32e9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4b46 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.040000:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d32f0 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.040014:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d32f0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.040027:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d32f0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.040043:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0800/0x9383f985bc4d32f7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.040050:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0800/0x9383f985bc4d32f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.040069:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0800/0x9383f985bc4d32f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.040462:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0e00/0x9383f985bc4d32fe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.040483:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0e00/0x9383f985bc4d32fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.040492:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0e00/0x9383f985bc4d32fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201232.040512:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3ed:0x0]: returning size 0 00000004:00200000:0.0:1788201232.040517:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201232.040539:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0e00/0x9383f985bc4d32fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.040551:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0e00/0x9383f985bc4d32fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.040559:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d32f0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.040580:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d32f0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.040771:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d32f0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.040779:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201232.040783:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d32f0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.040791:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d32f0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.040802:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:0.0:1788201232.040805:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201232.040810:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d32f0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.040816:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1600/0x9383f985bc4d32f0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.040828:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0800/0x9383f985bc4d32f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.040834:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0800/0x9383f985bc4d32f7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.040839:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0800/0x9383f985bc4d32f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.040845:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201232.040847:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0800/0x9383f985bc4d32f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.040855:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0800/0x9383f985bc4d32f7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.040862:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0xa6b02dea (ffff9e03c2fc5000) 00010000:00010000:0.0:1788201232.040863:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201232.040866:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0800/0x9383f985bc4d32f7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.040871:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0800/0x9383f985bc4d32f7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.040901:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d32e9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b46 expref: 26 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.040914:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0e00/0x9383f985bc4d32fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b46 expref: 25 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.040922:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ed:0x0].0x0 (ffff9e03c5173e00) 00010000:00010000:0.0:1788201232.040924:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201232.040926:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c37d0e00, rc 0) 00010000:00010000:0.0:1788201232.040932:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201232.040940:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d3305 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4b4d expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.040968:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1400/0x9383f985bc4d330c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.040975:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1400/0x9383f985bc4d330c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.040983:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1400/0x9383f985bc4d330c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.040994:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d3313 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.041000:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d3313 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.041005:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d3313 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.041229:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d331a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.041239:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d331a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.041246:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d331a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201232.041260:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3ee:0x0]: returning size 0 00000004:00200000:0.0:1788201232.041263:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201232.041273:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d331a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.041285:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d331a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.041291:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1400/0x9383f985bc4d330c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.046546:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1400/0x9383f985bc4d330c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.046556:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1400/0x9383f985bc4d330c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.046573:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201232.046578:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1400/0x9383f985bc4d330c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.046597:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1400/0x9383f985bc4d330c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.046617:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:0.0:1788201232.046621:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201232.046626:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1400/0x9383f985bc4d330c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.046633:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1400/0x9383f985bc4d330c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.046661:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d3313 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.046667:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d3313 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.046675:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d3313 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.046681:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201232.046684:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d3313 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.046690:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d3313 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.046698:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0xef09e6ea (ffff9e03c2fc5700) 00010000:00010000:0.0:1788201232.046700:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201232.046703:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d3313 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.046709:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d3313 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.046766:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d3305 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b4d expref: 27 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.046780:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d331a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b4d expref: 26 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.046789:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ee:0x0].0x0 (ffff9e03c33e8500) 00010000:00010000:0.0:1788201232.046791:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201232.046794:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c37d1000, rc 0) 00010000:00010000:0.0:1788201232.046807:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201232.046827:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d3321 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4b54 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.046876:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d3328 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.046888:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d3328 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.046898:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d3328 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.046933:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d332f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.046941:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d332f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.046948:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d332f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.047346:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d3336 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.047356:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d3336 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.047364:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d3336 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201232.047383:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3ef:0x0]: returning size 0 00000004:00200000:0.0:1788201232.047387:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201232.047403:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d3336 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.047417:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d3336 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.047424:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d3328 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.047431:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d3328 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.047437:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d3328 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.047443:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201232.047447:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d3328 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.047454:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d3328 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.047462:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:0.0:1788201232.047464:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201232.047468:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d3328 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.047473:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d3328 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.047483:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d332f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.047488:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d332f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.047495:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d332f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.047500:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201232.047503:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d332f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.047509:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d332f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.047516:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x37639fea (ffff9e03c2fc5600) 00010000:00010000:0.0:1788201232.047518:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201232.047521:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d332f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.047527:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d332f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.047549:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d3321 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b54 expref: 28 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.047561:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d3336 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b54 expref: 27 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.047568:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ef:0x0].0x0 (ffff9e03c33ed000) 00010000:00010000:0.0:1788201232.047570:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201232.047572:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc7a00, rc 0) 00010000:00010000:0.0:1788201232.047578:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201232.048846:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d333d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4b5b expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.048932:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d3344 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.048943:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d3344 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.048953:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d3344 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.048966:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d334b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.048972:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d334b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.048979:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d334b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.049437:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d3352 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.049447:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d3352 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.049455:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d3352 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201232.049485:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f0:0x0]: returning size 0 00000004:00200000:0.0:1788201232.049490:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201232.049507:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d3352 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.049522:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d3352 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.049529:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d3344 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.049536:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d3344 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.049543:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d3344 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.049548:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201232.049552:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d3344 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.049558:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d3344 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.049698:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:0.0:1788201232.049701:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201232.049705:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d3344 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.049711:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d3344 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.049724:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d334b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.049730:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d334b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.049737:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d334b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.049742:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201232.049745:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d334b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.049751:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d334b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.049757:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x7fbd58ea (ffff9e03c2fc5d00) 00010000:00010000:0.0:1788201232.049760:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201232.049762:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d334b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.049767:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d334b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.049796:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d333d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b5b expref: 29 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.049809:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d3352 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b5b expref: 28 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.049816:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f0:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:0.0:1788201232.049818:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201232.049820:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc6a00, rc 0) 00010000:00010000:0.0:1788201232.049827:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201232.049836:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d3359 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4b62 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.049861:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d3360 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.049868:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d3360 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.049874:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d3360 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.049883:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d3367 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xc81711ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.049889:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d3367 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.049894:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d3367 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.050036:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d3360 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.050043:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d3360 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.050048:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d3360 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.050263:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201232.050268:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d3360 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.050279:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d3360 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.050288:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:0.0:1788201232.050290:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201232.050319:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d3360 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.050326:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d3360 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.050337:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d3367 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.050343:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d3367 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.050348:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d3367 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.050353:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201232.050355:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d3367 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.050360:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d3367 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.050367:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0xc81711ea (ffff9e03c2fc5f00) 00010000:00010000:0.0:1788201232.050369:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201232.050371:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d3367 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.050378:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d3367 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.050401:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d3359 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b62 expref: 29 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.050410:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:0.0:1788201232.050412:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201232.050415:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d3359 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b62 expref: 29 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.050424:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc7400, rc -2) 00000100:00100000:0.0:1788201232.050764:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f977dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:2359:x1875064442628224:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 10918us (11355us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201232.050775:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 863 00000100:00100000:3.0:1788201232.054677:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201232.054762:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201232.054834:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442628480 00000100:00100000:2.0:1788201232.054846:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442628480 00000100:00100000:2.0:1788201232.054902:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 864 00000100:00100000:2.0:1788201232.054927:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c543d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:2360:x1875064442628480:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:2.0:1788201232.054965:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201232.054988:0:6715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d336e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4b85 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.055511:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3375 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.055533:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3375 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.055547:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3375 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.055580:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d337c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x53c502ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.055596:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d337c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.055604:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d337c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.055831:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3375 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.055837:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3375 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.055842:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3375 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.055847:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201232.055851:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3375 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.055858:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3375 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.055868:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:2.0:1788201232.055870:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201232.055874:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3375 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.055877:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3375 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.055886:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d337c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.055890:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d337c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.055893:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d337c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.055896:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201232.055897:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d337c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.055901:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d337c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.057890:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x53c502ea (ffff9e03c33ed800) 00010000:00010000:2.0:1788201232.057894:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201232.057900:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d337c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201232.058793:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442628352 00000100:00100000:1.0:1788201232.058805:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442628352 00000100:00100000:1.0:1788201232.058878:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5077 00000100:00100000:1.0:1788201232.058888:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c543d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+30:13714:x1875064442628352:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:2.0:1788201232.059047:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d337c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.059233:0:6715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d336e lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b85 expref: 30 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.059244:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:2.0:1788201232.059248:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201232.059252:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d336e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b85 expref: 30 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.059264:0:6715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0030a00, rc -2) 00000100:00100000:2.0:1788201232.059360:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c543d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+29:2360:x1875064442628480:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 4434us (4595us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201232.059368:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 864 00010000:00010000:1.0:1788201232.060256:0:12968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201232.060277:0:12968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3383 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4b7e expref: -99 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.060358:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d338a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.060372:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d338a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.060382:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d338a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.060397:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d3391 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.060405:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d3391 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.060411:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d3391 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.066252:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d3398 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.066273:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d3398 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.066285:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d3398 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201232.066996:0:12968:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3ed:0x0]: returning size 0 00000004:00200000:1.0:1788201232.067003:0:12968:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201232.067025:0:12968:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d3398 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.067039:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d3398 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.067049:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d338a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.067126:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d338a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.067133:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d338a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.067140:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201232.067144:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d338a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.067151:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d338a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.067165:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:1.0:1788201232.067168:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201232.067172:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d338a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.067178:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d338a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.067193:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d3391 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.067204:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d3391 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.067210:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d3391 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.067215:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201232.067217:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d3391 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.067222:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d3391 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.067229:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0xa6b02dea (ffff9e03c5173200) 00010000:00010000:1.0:1788201232.067232:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201232.067235:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d3391 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.067240:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d3391 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.067278:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3383 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b7e expref: 30 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.067289:0:12968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d3398 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b7e expref: 29 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.068138:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ed:0x0].0x0 (ffff9e03c5173e00) 00010000:00010000:1.0:1788201232.068141:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201232.068146:0:12968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3600, rc 0) 00000100:00100000:1.0:1788201232.068238:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c543d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+29:13714:x1875064442628352:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 9349us (13716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201232.068248:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5077 00000100:00100000:3.0:1788201232.083449:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201232.083526:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201232.083683:0:13526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442628736 00000100:00100000:1.0:1788201232.083705:0:13526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442628736 00000100:00100000:1.0:1788201232.083783:0:13526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:1.0:1788201232.083794:0:13526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c543ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+29:2362:x1875064442628736:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201232.083811:0:13526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201232.083835:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d3398 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b7e expref: 29 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.083855:0:13526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ed:0x0].0x0 (ffff9e03c5173e00) 00010000:00010000:1.0:1788201232.083861:0:13526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201232.083915:0:13526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c543ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:2362:x1875064442628736:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 123us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201232.083923:0:13526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:2.0:1788201232.084339:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442628608 00000100:00100000:2.0:1788201232.084344:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442628608 00000100:00100000:2.0:1788201232.084386:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5078 00000100:00100000:2.0:1788201232.084393:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c543f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:13715:x1875064442628608:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:2.0:1788201232.084412:0:13379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201232.084431:0:13379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d339f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4b8c expref: -99 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.084494:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d33a6 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.084508:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d33a6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.084519:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d33a6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.084534:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d33ad lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.084541:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d33ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.084547:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d33ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.084912:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d33b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.084923:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d33b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.084930:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d33b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201232.084962:0:13379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3ee:0x0]: returning size 0 00000004:00200000:2.0:1788201232.084967:0:13379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201232.084985:0:13379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d33b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.084995:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d33b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.085003:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d33a6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.085012:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d33a6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.085018:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d33a6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.085023:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201232.085027:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d33a6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.085034:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d33a6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.085043:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:2.0:1788201232.085045:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201232.085049:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d33a6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.085055:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d33a6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.085064:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d33ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.085070:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d33ad lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.085075:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d33ad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.085080:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201232.085083:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d33ad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.085088:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d33ad lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.085094:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0xef09e6ea (ffff9e03c33ed800) 00010000:00010000:2.0:1788201232.085097:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201232.085099:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d33ad lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.085104:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d33ad lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.085132:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d339f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b8c expref: 30 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.085146:0:13379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d33b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b8c expref: 29 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.085154:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ee:0x0].0x0 (ffff9e03c33e8500) 00010000:00010000:2.0:1788201232.085156:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201232.085159:0:13379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031a00, rc 0) 00000100:00100000:2.0:1788201232.085210:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c543f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+29:13715:x1875064442628608:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 817us (1684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201232.085218:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5078 00000100:00100000:3.0:1788201232.091547:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201232.091654:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442628864 00000100:00100000:2.0:1788201232.091671:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442628864 00000100:00100000:2.0:1788201232.091755:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:2.0:1788201232.091766:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c543c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+29:2361:x1875064442628864:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201232.091785:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201232.091809:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d33b4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b8c expref: 29 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.091828:0:13458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ee:0x0].0x0 (ffff9e03c33e8500) 00010000:00010000:2.0:1788201232.091834:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201232.091919:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c543c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:2361:x1875064442628864:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 155us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201232.091927:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:1.0:1788201232.104520:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201232.104565:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442628992 00000100:00100000:1.0:1788201232.104575:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442628992 00000100:00100000:1.0:1788201232.104653:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5079 00000100:00100000:1.0:1788201232.104668:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:13716:x1875064442628992:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:1.0:1788201232.104693:0:12971:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201232.104716:0:12971:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d33bb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4b93 expref: -99 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.104786:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d33c2 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.104803:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d33c2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.104816:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d33c2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.104834:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d33c9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.104842:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d33c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.104850:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d33c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.105367:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d33d0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.105377:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d33d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.105383:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d33d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201232.105412:0:12971:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3ef:0x0]: returning size 0 00000004:00200000:1.0:1788201232.105415:0:12971:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201232.105433:0:12971:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d33d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.105442:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d33d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.105451:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d33c2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.105456:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d33c2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.105462:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d33c2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.105469:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201232.105474:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d33c2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.105482:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d33c2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.105498:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:1.0:1788201232.105502:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201232.105506:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d33c2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.105513:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d33c2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.105531:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d33c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.105537:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d33c9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.105544:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d33c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.105550:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201232.105554:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d33c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.105562:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d33c9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.105573:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x37639fea (ffff9e03c5173100) 00010000:00010000:1.0:1788201232.105576:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201232.105580:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d33c9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.105585:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d33c9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.112034:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d33bb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b93 expref: 30 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.112055:0:12971:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d33d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b93 expref: 29 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.112065:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ef:0x0].0x0 (ffff9e03c33ed000) 00010000:00010000:1.0:1788201232.112069:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201232.112073:0:12971:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2e00, rc 0) 00000100:00100000:1.0:1788201232.112222:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+29:13716:x1875064442628992:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 7557us (7709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201232.112232:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5079 00000100:00100000:0.0:1788201232.128618:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201232.129128:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442629120 00000100:00100000:1.0:1788201232.129146:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442629120 00000100:00100000:1.0:1788201232.129248:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:1.0:1788201232.129263:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+29:2360:x1875064442629120:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201232.129283:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201232.129351:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d33d0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b93 expref: 29 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.129375:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ef:0x0].0x0 (ffff9e03c33ed000) 00010000:00010000:1.0:1788201232.129382:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201232.129467:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:2360:x1875064442629120:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 207us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201232.129483:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000001:00080000:0.0:1788201232.152448:0:6732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294968839 is committed 00000100:00100000:3.0:1788201232.156780:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201232.163600:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442629248 00000100:00100000:1.0:1788201232.163622:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442629248 00000100:00100000:1.0:1788201232.163720:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5080 00000100:00100000:1.0:1788201232.163734:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c543f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:13717:x1875064442629248:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:1.0:1788201232.163763:0:12968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201232.163791:0:12968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d33d7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4b9a expref: -99 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.163879:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d33de lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.163897:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d33de lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.163911:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d33de lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.163935:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d33e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.163944:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d33e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.163951:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d33e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.164391:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d33ec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.164403:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d33ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.164411:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d33ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201232.164458:0:12968:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f0:0x0]: returning size 0 00000004:00200000:1.0:1788201232.164464:0:12968:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201232.164496:0:12968:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d33ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.164510:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d33ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.164521:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d33de lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.164528:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d33de lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.164541:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d33de lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.164549:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201232.164554:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d33de lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.164562:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d33de lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.164576:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:1.0:1788201232.164579:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201232.164595:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d33de lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.164603:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d33de lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.164619:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d33e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.164626:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d33e5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.164633:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d33e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.164638:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201232.164641:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d33e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.164652:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d33e5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.164660:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x7fbd58ea (ffff9e03c5173100) 00010000:00010000:1.0:1788201232.164663:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201232.164666:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d33e5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.164673:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d33e5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.164715:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d33d7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b9a expref: 30 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.164732:0:12968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d33ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b9a expref: 29 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.164740:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f0:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:1.0:1788201232.164742:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201232.164745:0:12968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2c00, rc 0) 00000100:00100000:1.0:1788201232.164848:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c543f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+29:13717:x1875064442629248:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 1117us (8392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201232.164859:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5080 00000100:00100000:3.0:1788201232.178420:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201232.178554:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442629376 00000100:00100000:0.0:1788201232.178569:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442629376 00000100:00100000:0.0:1788201232.178662:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:0.0:1788201232.178675:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c543c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+29:2360:x1875064442629376:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201232.178697:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201232.178740:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d33ec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b9a expref: 29 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.178766:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f0:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:0.0:1788201232.178773:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201232.178842:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c543c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:2360:x1875064442629376:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 169us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201232.178851:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000001:00080000:0.0:1788201232.181980:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968839 is committed 00000100:00100000:1.0:1788201232.198970:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201232.199147:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442629504 00000100:00100000:2.0:1788201232.199161:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442629504 00000100:00100000:2.0:1788201232.199248:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5081 00000100:00100000:2.0:1788201232.199262:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:13718:x1875064442629504:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1788201232.199332:0:13379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201232.199361:0:13379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d33f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4ba1 expref: -99 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.199449:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d33fa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.199629:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d33fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.199646:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d33fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201232.200936:0:13379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3e9:0x0]: returning size 7680 00000004:00200000:2.0:1788201232.200947:0:13379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 7 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201232.201035:0:13379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d33fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.201076:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d33f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ba1 expref: 30 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.201093:0:13379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d33fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ba1 expref: 29 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.201101:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:2.0:1788201232.201103:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201232.201107:0:13379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0030a00, rc 0) 00000100:00100000:2.0:1788201232.201208:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+29:13718:x1875064442629504:12345-192.168.201.30@tcp:101:rm.0 Request processed in 1949us (2253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201232.201217:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5081 00000100:00100000:3.0:1788201232.207093:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201232.210345:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442629760 00000100:00100000:1.0:1788201232.210368:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442629760 00000100:00100000:2.0:1788201232.211950:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5082 00000100:00100000:2.0:1788201232.211967:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c543e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+29:13718:x1875064442629760:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1788201232.212011:0:12971:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201232.212042:0:12971:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3401 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4ba8 expref: -99 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201232.212438:0:12971:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3e9:0x0]: returning size 7680 00010000:00010000:2.0:1788201232.212670:0:12971:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3401 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ba8 expref: 31 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.212700:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173c00) 00010000:00010000:2.0:1788201232.212704:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788201232.212716:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3401 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ba8 expref: 31 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.212732:0:12971:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031a00, rc 0) 00000100:00100000:2.0:1788201232.212834:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c543e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+30:13718:x1875064442629760:12345-192.168.201.30@tcp:101:rm.0 Request processed in 871us (5757us total) trans 8589938640 rc 301/301 00000100:00100000:2.0:1788201232.212842:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5082 00000100:00100000:1.0:1788201232.227565:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201232.228038:0:12973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442629888 00000100:00100000:0.0:1788201232.228054:0:12973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442629888 00000100:00100000:0.0:1788201232.228177:0:12973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1018 00000100:00100000:0.0:1788201232.228190:0:12973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c67d9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+30:13718:x1875064442629888:12345-192.168.201.30@tcp:37:rm.0 00010000:00010000:2.0:1788201232.233715:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201232.237192:0:12973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c67d9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+30:13718:x1875064442629888:12345-192.168.201.30@tcp:37:rm.0 Request processed in 8985us (9624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201232.237210:0:12973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1018 00000100:00100000:3.0:1788201232.242908:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201232.243095:0:12972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442630144 00000100:00100000:2.0:1788201232.243113:0:12972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442630144 00000100:00100000:2.0:1788201232.243195:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1019 00000100:00100000:2.0:1788201232.243208:0:12972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c543ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+30:13718:x1875064442630144:12345-192.168.201.30@tcp:35:rm.0 00000100:00100000:2.0:1788201232.244022:0:12972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c543ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+31:13718:x1875064442630144:12345-192.168.201.30@tcp:35:rm.0 Request processed in 810us (1124us total) trans 8589938641 rc 0/0 00000100:00100000:2.0:1788201232.244032:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1019 00000100:00100000:3.0:1788201232.247512:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201232.247644:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442630400 00000100:00100000:1.0:1788201232.247662:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442630400 00000100:00100000:1.0:1788201232.247870:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5083 00000100:00100000:1.0:1788201232.247886:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4deb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+31:13718:x1875064442630400:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1788201232.247926:0:13406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201232.247956:0:13406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d340f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4baf expref: -99 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.248392:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d3416 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.248411:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d3416 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.248426:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d3416 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201232.248442:0:13406:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3e9:0x0]: returning size 7680 00010000:00010000:1.0:1788201232.248664:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d340f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4baf expref: 34 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.248685:0:13406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d3416 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4baf expref: 33 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.248696:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:1.0:1788201232.248700:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788201232.248704:0:13406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2a00, rc 0) 00000100:00100000:1.0:1788201232.248873:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4deb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+33:13718:x1875064442630400:12345-192.168.201.30@tcp:101:rm.0 Request processed in 990us (1375us total) trans 8589938642 rc 0/0 00000100:00100000:1.0:1788201232.248883:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5083 00000100:00100000:3.0:1788201232.256393:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201232.256508:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442630528 00000100:00100000:2.0:1788201232.256518:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442630528 00000100:00100000:2.0:1788201232.256599:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5084 00000100:00100000:2.0:1788201232.256611:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+33:13718:x1875064442630528:12345-192.168.201.30@tcp:41:rm.0 00000004:00000024:2.0:1788201232.256690:0:13379:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 7717519360 avail 7689207808 00000100:00100000:2.0:1788201232.256764:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+33:13718:x1875064442630528:12345-192.168.201.30@tcp:41:rm.0 Request processed in 156us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201232.256772:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5084 00000100:00100000:3.0:1788201232.261405:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201232.261784:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442630784 00000100:00100000:2.0:1788201232.261794:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442630784 00000100:00100000:2.0:1788201232.261856:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5085 00000100:00100000:2.0:1788201232.261867:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+33:13718:x1875064442630784:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1788201232.261925:0:12971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788201232.261955:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d32c6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b38 expref: 33 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.261976:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d2f85 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a12 expref: 32 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.261989:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3eb:0x0].0x0 (ffff9e03c33e8900) 00010000:00010000:2.0:1788201232.262004:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d33fa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ba1 expref: 31 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.262015:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:2.0:1788201232.262018:0:12971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201232.262041:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3424 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.262054:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3424 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.262064:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3424 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.262079:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d342b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.262086:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d342b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.262094:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d342b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.267790:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3432 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.267818:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3432 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.267833:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3432 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201232.269803:0:12971:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].503, 64 off40384 00000004:00080000:2.0:1788201232.269818:0:12971:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 507527523478ns, next at 508527520433ns, rc = 0 00010000:00010000:2.0:1788201232.269906:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3439 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.269921:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3439 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.269933:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3439 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.269941:0:12971:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3439 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.269948:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3439 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.269954:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3439 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.269985:0:12971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201232.270008:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3432 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.270014:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3432 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.270020:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3432 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.270027:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201232.270031:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3432 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.270038:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3432 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.270048:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3eb:0x0].0x0 (ffff9e03c33ed600) 00010000:00010000:2.0:1788201232.270052:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201232.270056:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3432 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.270062:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3432 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.270082:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3424 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.270088:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3424 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.270098:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3424 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.270103:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201232.270106:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3424 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.270112:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3424 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.270120:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:2.0:1788201232.270123:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201232.270126:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3424 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.270131:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3424 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201232.270141:0:12971:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f20d0937 reply state 00000000e763d21a transno 8589938643 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d342b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201232.270151:0:12971:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201232.270379:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+32:13718:x1875064442630784:12345-192.168.201.30@tcp:36:rm.0 Request processed in 8509us (8979us total) trans 8589938643 rc 0/0 00000100:00100000:2.0:1788201232.270388:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5085 00010000:00010000:0.0:1788201232.270957:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201232.270967:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3439 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.270977:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201232.270982:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3439 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.270992:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3439 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.271005:0:7645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3eb:0x0].0x0 (ffff9e03c33ed600) 00010000:00010000:0.0:1788201232.271008:0:7645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201232.271011:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3439 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.271017:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3439 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3eb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.271044:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201232.271046:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201232.271049:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201232.275738:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d342b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.275758:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d342b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.275767:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d342b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.275775:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201232.275781:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d342b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.275789:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d342b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.275807:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x15fcbbea (ffff9e03c33ed800) 00010000:00010000:0.0:1788201232.275810:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201232.275815:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d342b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.275821:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d342b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201232.277055:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201232.277239:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442631040 00000100:00100000:1.0:1788201232.277261:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442631040 00000100:00100000:1.0:1788201232.277399:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5086 00000100:00100000:1.0:1788201232.277424:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+31:13718:x1875064442631040:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201232.277520:0:13406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201232.277560:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d331a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b4d expref: 31 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.277599:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016c00/0x9383f985bc4d3018 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a3c expref: 30 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.277611:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ee:0x0].0x0 (ffff9e03c33e8500) 00010000:00010000:1.0:1788201232.277623:0:13406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201232.277650:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d3440 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.278860:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d3440 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.278878:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d3440 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.278908:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d3447 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.278916:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d3447 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.278922:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d3447 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.279088:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d344e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.279097:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d344e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.279104:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d344e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201232.281179:0:13406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].502, 64 off40320 00000004:00080000:1.0:1788201232.281201:0:13406:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 507538905603ns, next at 508538901002ns, rc = 0 00010000:00010000:1.0:1788201232.281323:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d3455 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.281345:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d3455 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.281360:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d3455 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.281371:0:13406:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d3455 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.281380:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d3455 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.281387:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d3455 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.281522:0:13406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201232.281559:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d344e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.281569:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d344e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.281577:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d344e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.281594:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201232.281601:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d344e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.281610:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d344e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.281627:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ee:0x0].0x0 (ffff9e03c5173900) 00010000:00010000:1.0:1788201232.281630:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201232.281636:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d344e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.281644:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d344e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.281680:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d3440 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.281689:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d3440 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.281695:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d3440 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.281702:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201232.281712:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d3440 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.281720:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d3440 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.281729:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:1.0:1788201232.281732:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201232.281735:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d3440 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.281742:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d3440 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201232.281754:0:13406:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb2274ca reply state 000000009f9a5402 transno 8589938644 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d3447 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201232.281766:0:13406:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201232.281903:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+31:13718:x1875064442631040:12345-192.168.201.30@tcp:36:rm.0 Request processed in 4487us (4850us total) trans 8589938644 rc 0/0 00000100:00100000:1.0:1788201232.281914:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5086 00010000:00010000:3.0:1788201232.282512:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201232.282522:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d3455 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.282532:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201232.282537:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d3455 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.282545:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d3455 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.282559:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ee:0x0].0x0 (ffff9e03c5173900) 00010000:00010000:3.0:1788201232.282562:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788201232.282566:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d3455 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.282578:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d3455 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3ee:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.282615:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201232.282619:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201232.282621:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201232.284633:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d3447 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.284663:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d3447 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.284673:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d3447 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.284681:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201232.284687:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d3447 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.284697:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d3447 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.284830:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0xef09e6ea (ffff9e03c5173100) 00010000:00010000:1.0:1788201232.284834:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201232.284840:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d3447 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.284848:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d3447 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201232.288081:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201232.288286:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442631296 00000100:00100000:2.0:1788201232.288344:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442631296 00000100:00100000:2.0:1788201232.288415:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5087 00000100:00100000:2.0:1788201232.288427:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+30:13718:x1875064442631296:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1788201232.288508:0:13379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788201232.288541:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d32aa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b31 expref: 30 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.288679:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1200/0x9383f985bc4d2f54 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a04 expref: 29 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.288701:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ea:0x0].0x0 (ffff9e03c2fc5400) 00010000:00010000:2.0:1788201232.288714:0:13379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201232.288737:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d345c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.288750:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d345c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.288759:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d345c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.288773:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3463 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.288780:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3463 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.288785:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3463 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.288907:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d346a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.288916:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d346a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.288924:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d346a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201232.295599:0:13379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].503, 64 off40384 00010000:00010000:3.0:1788201232.295928:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016400/0x9383f985bc4d3471 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.295952:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016400/0x9383f985bc4d3471 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.295968:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016400/0x9383f985bc4d3471 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.295979:0:13379:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016400/0x9383f985bc4d3471 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.295987:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016400/0x9383f985bc4d3471 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.295995:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016400/0x9383f985bc4d3471 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.296025:0:13379:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201232.296064:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d346a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.296071:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d346a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.296080:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d346a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.296087:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201232.296092:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d346a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.296102:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d346a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.296119:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ea:0x0].0x0 (ffff9e03c33edb00) 00010000:00010000:3.0:1788201232.296124:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201232.296130:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d346a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.296138:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d346a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.296165:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d345c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.296249:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d345c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.296256:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d345c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.296262:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201232.296266:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d345c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.296278:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d345c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.296288:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:3.0:1788201232.296416:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201232.296422:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d345c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.296429:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d345c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201232.296443:0:13379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f9706be2 reply state 00000000348b9e7d transno 8589938645 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3463 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201232.296453:0:13379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201232.296676:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+30:13718:x1875064442631296:12345-192.168.201.30@tcp:36:rm.0 Request processed in 8243us (8613us total) trans 8589938645 rc 0/0 00000100:00100000:3.0:1788201232.296689:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5087 00010000:00010000:2.0:1788201232.296917:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201232.296930:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016400/0x9383f985bc4d3471 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.296940:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3016400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201232.296945:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016400/0x9383f985bc4d3471 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.296956:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016400/0x9383f985bc4d3471 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.296976:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ea:0x0].0x0 (ffff9e03c33edb00) 00010000:00010000:2.0:1788201232.296979:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788201232.296983:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016400/0x9383f985bc4d3471 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.296990:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016400/0x9383f985bc4d3471 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3ea:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.297037:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201232.297039:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201232.297041:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201232.304990:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3463 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.305017:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3463 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.305031:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3463 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.305038:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201232.305043:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3463 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.305053:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3463 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.305076:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0xcda302ea (ffff9e03c33ed200) 00010000:00010000:2.0:1788201232.305079:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201232.305085:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3463 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.305092:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3463 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201232.305698:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201232.305838:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442631552 00000100:00100000:2.0:1788201232.305852:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442631552 00000100:00100000:2.0:1788201232.305928:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5088 00000100:00100000:2.0:1788201232.305940:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+29:13718:x1875064442631552:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1788201232.306023:0:12971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788201232.306051:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d3336 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b54 expref: 29 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.306072:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d3049 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a4a expref: 28 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.306087:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ef:0x0].0x0 (ffff9e03c33ed000) 00010000:00010000:2.0:1788201232.306097:0:12971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201232.306126:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3478 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.306141:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3478 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.306151:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3478 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.306166:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d347f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.306173:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d347f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.306180:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d347f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.306370:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3486 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.306380:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3486 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.306388:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3486 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201232.307094:0:12971:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].504, 64 off40448 00010000:00010000:2.0:1788201232.307174:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d348d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.307186:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d348d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.307195:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d348d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.307203:0:12971:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d348d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.307210:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d348d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.307216:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d348d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.307243:0:12971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201232.307269:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3486 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.307276:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3486 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.307284:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3486 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.307290:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201232.307319:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3486 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.307327:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3486 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.307342:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ef:0x0].0x0 (ffff9e03c33ede00) 00010000:00010000:2.0:1788201232.307346:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201232.307350:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3486 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.307357:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3486 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.307378:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3478 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.307385:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3478 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.307392:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3478 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.307398:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201232.307401:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3478 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.307407:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3478 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.307414:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:2.0:1788201232.307416:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201232.307419:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3478 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.307425:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3478 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201232.307439:0:12971:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000facdaf2b reply state 0000000013a176d3 transno 8589938646 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d347f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201232.307448:0:12971:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201232.307555:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+29:13718:x1875064442631552:12345-192.168.201.30@tcp:36:rm.0 Request processed in 1613us (1860us total) trans 8589938646 rc 0/0 00000100:00100000:2.0:1788201232.307565:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5088 00010000:00010000:3.0:1788201232.308268:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201232.308279:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d348d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.308289:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201232.308315:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d348d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.308325:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d348d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.308344:0:7645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ef:0x0].0x0 (ffff9e03c33ede00) 00010000:00010000:3.0:1788201232.308347:0:7645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788201232.308351:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d348d lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.308358:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d348d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3ef:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.308383:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201232.308385:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201232.308387:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201232.314811:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d347f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.314834:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d347f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.314843:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d347f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.314852:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201232.314859:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d347f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.314869:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d347f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.314891:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x37639fea (ffff9e03c33ed700) 00010000:00010000:0.0:1788201232.314894:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201232.314899:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d347f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.314907:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d347f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201232.325001:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201232.325924:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442631808 00000100:00100000:1.0:1788201232.325939:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442631808 00000100:00100000:1.0:1788201232.326073:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5089 00000100:00100000:1.0:1788201232.326087:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:13718:x1875064442631808:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201232.326187:0:13406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201232.326465:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0e00/0x9383f985bc4d32fe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b46 expref: 28 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.326497:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d2fe7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a2e expref: 27 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.326521:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ed:0x0].0x0 (ffff9e03c5173e00) 00010000:00010000:1.0:1788201232.326536:0:13406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201232.326566:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3494 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.326593:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3494 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.326607:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3494 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.326625:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d349b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.326633:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d349b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.326641:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d349b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.326809:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d34a2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.326818:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d34a2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.326826:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d34a2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201232.328436:0:13406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].505, 64 off40512 00010000:00010000:1.0:1788201232.328552:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d34a9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.328571:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d34a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.328594:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d34a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.328606:0:13406:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d34a9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.328614:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d34a9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.328622:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d34a9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.328644:0:13406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201232.328682:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d34a2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.328690:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d34a2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.328697:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d34a2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.329231:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201232.329241:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d34a2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.329252:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d34a2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.329272:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ed:0x0].0x0 (ffff9e03c5173200) 00010000:00010000:1.0:1788201232.329275:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201232.329281:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d34a2 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.329288:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d34a2 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.329365:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3494 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.329372:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3494 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.329380:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3494 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.329385:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201232.329388:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3494 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.329395:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3494 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.329403:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:1.0:1788201232.329405:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201232.329409:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3494 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.329414:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3494 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201232.329425:0:13406:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ed8fe1d reply state 00000000c24f937b transno 8589938647 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d349b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201232.329435:0:13406:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788201232.329636:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201232.329645:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d34a9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.329652:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201232.329666:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d34a9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.329674:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d34a9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.329685:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ed:0x0].0x0 (ffff9e03c5173200) 00010000:00010000:3.0:1788201232.329688:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788201232.329691:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d34a9 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.329698:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d34a9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3ed:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.329732:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201232.329734:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201232.329736:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201232.330241:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:13718:x1875064442631808:12345-192.168.201.30@tcp:36:rm.0 Request processed in 4148us (5248us total) trans 8589938647 rc 0/0 00000100:00100000:1.0:1788201232.330253:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5089 00000100:00100000:3.0:1788201232.337251:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:2.0:1788201232.337377:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d349b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.337392:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d349b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.337402:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d349b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.337410:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201232.337417:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d349b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.337425:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d349b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.337447:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0xa6b02dea (ffff9e03c5173100) 00010000:00010000:2.0:1788201232.337451:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201232.337472:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d349b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.337480:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d349b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201232.337827:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442632064 00000100:00100000:1.0:1788201232.337842:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442632064 00000100:00100000:1.0:1788201232.337923:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5090 00000100:00100000:1.0:1788201232.337935:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:13718:x1875064442632064:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201232.338024:0:13379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201232.338049:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d32e2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b3f expref: 28 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.338075:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d2fb6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a20 expref: 27 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.338087:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ec:0x0].0x0 (ffff9e03c5173d00) 00010000:00010000:1.0:1788201232.338096:0:13379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201232.338126:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d34b0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.338142:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d34b0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.338154:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d34b0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.338170:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d34b7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.338178:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d34b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.338185:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d34b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.338369:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d34be lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.338378:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d34be lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.338386:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d34be lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201232.341917:0:13379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].504, 64 off40448 00010000:00010000:1.0:1788201232.342032:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d34c5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.342057:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d34c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.342072:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d34c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.342082:0:13379:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d34c5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.342089:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d34c5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.342096:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d34c5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.342133:0:13379:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201232.342165:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d34be lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.342602:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201232.342611:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d34c5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.342675:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d34be lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.342682:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d34be lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.343145:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201232.343153:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d34c5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.343166:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d34c5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.343195:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ec:0x0].0x0 (ffff9e03c5173300) 00010000:00010000:2.0:1788201232.343199:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788201232.343205:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d34c5 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.343211:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d34c5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.343227:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201232.343229:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201232.343231:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201232.343667:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201232.343674:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d34be lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.343684:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d34be lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.343695:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ec:0x0].0x0 (ffff9e03c5173300) 00010000:00010000:1.0:1788201232.343697:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201232.343701:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d34be lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.343779:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d34be lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.343815:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d34b0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.343823:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d34b0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.343828:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d34b0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.343833:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201232.343837:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d34b0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.343844:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d34b0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.343853:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:1.0:1788201232.343856:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201232.343859:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d34b0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.343866:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d34b0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201232.343877:0:13379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c46421a9 reply state 00000000442511d1 transno 8589938648 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d34b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201232.343889:0:13379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201232.344088:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:13718:x1875064442632064:12345-192.168.201.30@tcp:36:rm.0 Request processed in 6147us (6847us total) trans 8589938648 rc 0/0 00000100:00100000:1.0:1788201232.344100:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5090 00000100:00100000:0.0:1788201232.348389:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:2.0:1788201232.348521:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d34b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.348538:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d34b7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.348549:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d34b7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.348563:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201232.348569:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d34b7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.348579:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d34b7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.348616:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x5e5674ea (ffff9e03c5173400) 00010000:00010000:2.0:1788201232.348620:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201232.348627:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d34b7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.348633:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d34b7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201232.350073:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442632320 00000100:00100000:3.0:1788201232.350091:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442632320 00000100:00100000:3.0:1788201232.350340:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5091 00000100:00100000:3.0:1788201232.350354:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:13718:x1875064442632320:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:3.0:1788201232.350855:0:12968:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788201232.350893:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d3352 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b5b expref: 26 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.350918:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0000/0x9383f985bc4d307a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a58 expref: 25 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.350930:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f0:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:3.0:1788201232.350943:0:12968:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201232.350972:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017000/0x9383f985bc4d34cc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.350988:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017000/0x9383f985bc4d34cc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.350999:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017000/0x9383f985bc4d34cc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.351016:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d34d3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.351028:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d34d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.351035:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d34d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.351859:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017200/0x9383f985bc4d34da lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.351876:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017200/0x9383f985bc4d34da lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.351887:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017200/0x9383f985bc4d34da lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201232.353926:0:12968:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].505, 64 off40512 00010000:00010000:3.0:1788201232.354036:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017c00/0x9383f985bc4d34e1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.354057:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017c00/0x9383f985bc4d34e1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.354070:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017c00/0x9383f985bc4d34e1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.354078:0:12968:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017c00/0x9383f985bc4d34e1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.354084:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017c00/0x9383f985bc4d34e1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.354091:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017c00/0x9383f985bc4d34e1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.354264:0:12968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201232.354330:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017200/0x9383f985bc4d34da lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.354339:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017200/0x9383f985bc4d34da lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.354345:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017200/0x9383f985bc4d34da lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.354353:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201232.354358:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017200/0x9383f985bc4d34da lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.354366:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017200/0x9383f985bc4d34da lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.354382:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f0:0x0].0x0 (ffff9e03c33e8c00) 00010000:00010000:3.0:1788201232.354385:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201232.354391:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017200/0x9383f985bc4d34da lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.354397:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017200/0x9383f985bc4d34da lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.354422:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017000/0x9383f985bc4d34cc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.354429:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017000/0x9383f985bc4d34cc lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.354440:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017000/0x9383f985bc4d34cc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.354444:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201232.354447:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017000/0x9383f985bc4d34cc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.354454:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017000/0x9383f985bc4d34cc lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.354479:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:3.0:1788201232.354482:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201232.354486:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017000/0x9383f985bc4d34cc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.354491:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017000/0x9383f985bc4d34cc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201232.354510:0:12968:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044b45dd9 reply state 00000000c5bc973a transno 8589938649 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d34d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201232.354522:0:12968:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201232.354675:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:13718:x1875064442632320:12345-192.168.201.30@tcp:36:rm.0 Request processed in 4319us (6296us total) trans 8589938649 rc 0/0 00000100:00100000:3.0:1788201232.354695:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5091 00010000:00010000:0.0:1788201232.357731:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201232.357750:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017c00/0x9383f985bc4d34e1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.357764:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201232.357770:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017c00/0x9383f985bc4d34e1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.357782:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017c00/0x9383f985bc4d34e1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.357806:0:7645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f0:0x0].0x0 (ffff9e03c33e8c00) 00010000:00010000:0.0:1788201232.357810:0:7645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201232.357817:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017c00/0x9383f985bc4d34e1 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.357825:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017c00/0x9383f985bc4d34e1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.357853:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201232.357855:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201232.357857:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201232.360078:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d34d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.360103:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d34d3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.360113:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d34d3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.360120:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201232.360126:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d34d3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.360137:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d34d3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.360165:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x7fbd58ea (ffff9e03c33e8b00) 00010000:00010000:2.0:1788201232.360246:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201232.360254:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d34d3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.360261:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d34d3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3e9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201232.363401:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201232.363530:0:12973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442632576 00000100:00100000:2.0:1788201232.363544:0:12973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442632576 00000100:00100000:2.0:1788201232.363648:0:12973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1020 00000100:00100000:2.0:1788201232.363660:0:12973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+25:13718:x1875064442632576:12345-192.168.201.30@tcp:35:rm.0 00000100:00100000:2.0:1788201232.364044:0:12973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:13718:x1875064442632576:12345-192.168.201.30@tcp:35:rm.0 Request processed in 385us (659us total) trans 8589938650 rc 0/0 00000100:00100000:2.0:1788201232.364053:0:12973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1020 00000100:00100000:1.0:1788201232.371475:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201232.373208:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442632832 00000100:00100000:2.0:1788201232.373231:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442632832 00000100:00100000:2.0:1788201232.373347:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5092 00000100:00100000:2.0:1788201232.373362:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:13718:x1875064442632832:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1788201232.373457:0:13406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788201232.373499:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d3416 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4baf expref: 26 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.373526:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0a00/0x9383f985bc4d2f23 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c49f6 expref: 25 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.373547:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:2.0:1788201232.373567:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d2ec8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c49e1 expref: 24 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.373607:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173c00) 00010000:00010000:2.0:1788201232.373617:0:13406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201232.373650:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d34e8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.373665:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d34e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.373679:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d34e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.373691:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d34ef lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.373698:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d34ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.373705:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d34ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.374060:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d34f6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.374067:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d34f6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.374075:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d34f6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201232.374861:0:13406:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3e9:0x0]: returning size 7680 00010000:00010000:2.0:1788201232.374881:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d34f6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.374888:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d34f6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.374892:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d34f6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.374897:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201232.374900:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d34f6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.374905:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d34f6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.374915:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3e9:0x0].0x0 (ffff9e03c33edb00) 00010000:00010000:2.0:1788201232.374917:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201232.374920:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d34f6 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.374925:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d34f6 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.374943:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d34e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.374949:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d34e8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.374953:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d34e8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.374955:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201232.374957:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d34e8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.374960:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d34e8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.374964:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33ed000) 00010000:00010000:2.0:1788201232.374965:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201232.374966:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d34e8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.374969:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d34e8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201232.374976:0:13406:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000360926ec reply state 00000000a06c4483 transno 8589938651 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d34ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201232.374982:0:13406:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201232.375085:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+25:13718:x1875064442632832:12345-192.168.201.30@tcp:36:rm.0 Request processed in 1725us (3635us total) trans 8589938651 rc 0/0 00000100:00100000:2.0:1788201232.375094:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5092 00010000:00010000:2.0:1788201232.380392:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d34ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.380422:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d34ef lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.380430:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d34ef lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.380437:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201232.380443:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d34ef lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.380452:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d34ef lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.380474:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc2d93176 (ffff9e03c33ed200) 00010000:00010000:2.0:1788201232.380478:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201232.380484:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d34ef lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.380491:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d34ef lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc2d93176 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201232.613822:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201232.613856:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458217216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201232.613985:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201232.614211:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458217216 00000100:00100000:3.0:1788201232.614220:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458217216 00000100:00100000:3.0:1788201232.615209:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788201232.615232:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458217216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201232.615518:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 525008896 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1788201232.615638:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458217216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 414us (1652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201232.615648:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788201232.620238:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458217216:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788201233.253803:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788201234.237150:0:12980:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938633 is committed 00000001:00080000:3.0:1788201234.237170:0:12980:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938648 is committed 00000004:00080000:3.0:1788201234.237181:0:12980:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 15 committed 00000001:00080000:3.0:1788201234.237206:0:12980:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938651 is committed 00000004:00080000:3.0:1788201234.237220:0:12980:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 15 committed 00000100:00100000:1.0:1788201234.237991:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201234.238012:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c20bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458217344:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201234.238255:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201234.238731:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458217344 00000100:00100000:2.0:1788201234.238738:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458217344 00000100:00080000:3.0:1788201234.238852:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201234.238991:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458217472:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201234.239022:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201234.239222:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458217472 00000100:00100000:2.0:1788201234.239227:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458217472 00000100:00100000:2.0:1788201234.239267:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4172 00000100:00100000:2.0:1788201234.239281:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c20bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458217344:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201234.239350:0:13440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1048 count 1 00010000:00010000:2.0:1788201234.239388:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d34fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201234.239411:0:13440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e8637c64/0x9383f985bc4d313e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a9e expref: 508 pid: 13443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201234.239420:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x418:0x0].0x0 since=19s v=(0 0) 00010000:00010000:2.0:1788201234.239425:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x418:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201234.239430:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d34fd lrc: 4/0,1 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201234.239467:0:13440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e8637c64/0x9383f985bc4d313e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a9e expref: 508 pid: 13443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201234.239482:0:13440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e8637c64/0x9383f985bc4d313e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a9e expref: 508 pid: 13443 timeout: 609 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201234.239494:0:13440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c51a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:13440:1875064458217600:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201234.239570:0:13440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f9471240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201234.239662:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4173 00000100:00100000:1.0:1788201234.239671:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c20bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458217472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788201234.239685:0:12363:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1046 count 1 00010000:00010000:1.0:1788201234.239699:0:12363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d3504 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201234.239712:0:12363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4dea086/0x9383f985bc4d309d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a66 expref: 7 pid: 13446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201234.239719:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x416:0x0].0x0 since=19s v=(0 0) 00010000:00010000:1.0:1788201234.239723:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x416:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201234.239726:0:12363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d3504 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201234.239745:0:12363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b4dea086/0x9383f985bc4d309d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a66 expref: 7 pid: 13446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201234.239756:0:12363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b4dea086/0x9383f985bc4d309d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a66 expref: 7 pid: 13446 timeout: 609 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201234.239769:0:12363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c20bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12363:1875064458217728:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201234.239807:0:12363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5900 going to sleep for 11 seconds 00000100:00080000:2.0:1788201234.240608:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201234.242342:0:12363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c20bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12363:1875064458217728:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201234.242372:0:12363:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d3504 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201234.243012:0:13440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c51a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:13440:1875064458217600:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201234.243033:0:13440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d34fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201234.255874:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201234.255942:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201234.256266:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442632960 00000100:00100000:3.0:1788201234.256279:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442632960 00010000:00010000:3.0:1788201234.256411:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e8637c64/0x9383f985bc4d313e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a9e expref: 509 pid: 13443 timeout: 609 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201234.256457:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442633088 00000100:00100000:3.0:1788201234.256461:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442633088 00010000:00010000:3.0:1788201234.256480:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b4dea086/0x9383f985bc4d309d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a66 expref: 8 pid: 13446 timeout: 609 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201234.256505:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1535 00000100:00100000:3.0:1788201234.256515:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c7e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2359:x1875064442632960:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201234.256547:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201234.256562:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e8637c64/0x9383f985bc4d313e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a9e expref: 509 pid: 13443 timeout: 609 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.256582:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e8637c64/0x9383f985bc4d313e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a9e expref: 509 pid: 13443 timeout: 609 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.256605:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8637c64/0x9383f985bc4d313e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a9e expref: 509 pid: 13443 timeout: 609 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.256623:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x418:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201234.256627:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x418:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201234.256633:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d34fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.256643:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d34fd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.256682:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201234.256742:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c7e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2359:x1875064442632960:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 227us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201234.256751:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1535 00000100:00100000:3.0:1788201234.256803:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1536 00000100:00100000:3.0:1788201234.256810:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c20bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2359:x1875064442633088:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201234.256819:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201234.256824:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b4dea086/0x9383f985bc4d309d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a66 expref: 8 pid: 13446 timeout: 609 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.256842:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b4dea086/0x9383f985bc4d309d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a66 expref: 8 pid: 13446 timeout: 609 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.256857:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4dea086/0x9383f985bc4d309d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a66 expref: 8 pid: 13446 timeout: 609 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.256868:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x416:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201234.256872:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x416:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201234.256876:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d3504 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.256884:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d3504 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.256913:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201234.256932:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c20bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2359:x1875064442633088:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 122us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201234.256939:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1536 00000100:00080000:3.0:1788201234.257075:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201234.257079:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788201234.257090:0:12363:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d3504 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.257100:0:12363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d3504 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.257116:0:12363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d3504 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.257124:0:12363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d3504 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.257141:0:12363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201234.257646:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c20bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3311:x1875064458217472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17976us (18622us total) trans 4294968840 rc 0/0 00000100:00100000:3.0:1788201234.257655:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4173 00010000:00010000:3.0:1788201234.257680:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201234.257686:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d3504 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.257695:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201234.257700:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d3504 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.257710:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d3504 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.257723:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d3504 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.257730:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a490acb/0x9383f985bc4d3504 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.257749:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201234.257751:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201234.257754:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788201234.257799:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00c3b80/2, rc 0, transno 4294968840 00000100:00100000:3.0:1788201234.257812:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458217472:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788201234.257837:0:13440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d34fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.257845:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d34fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.257853:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d34fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.257861:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d34fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.257884:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201234.258189:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c20bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3311:x1875064458217344:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18913us (19935us total) trans 4294968840 rc 0/0 00000100:00100000:3.0:1788201234.258196:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4172 00000004:00080000:3.0:1788201234.258225:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c20bd500/2, rc 0, transno 4294968840 00000100:00100000:3.0:1788201234.258233:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c20bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458217344:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788201234.260387:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201234.260405:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d34fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201234.260420:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201234.260426:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d34fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201234.260445:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d34fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201234.260468:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d34fd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201234.260476:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d34fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201234.260503:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201234.260505:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201234.260507:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201234.277581:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788201235.173645:0:12996:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 510431346955ns, next at 511431343125ns, rc = 0 00000100:00100000:3.0:1788201235.173665:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201235.173699:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458217856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201235.173782:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201235.173845:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458217856 00000100:00100000:2.0:1788201235.173858:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458217856 00000100:00100000:2.0:1788201235.173927:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788201235.173940:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875064458217856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201235.173985:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 13631488 granted 525008896 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201235.174070:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875064458217856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201235.174080:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788201235.174134:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458217856:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788201235.301812:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201236.326191:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201236.709664:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c20bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875064458218112:0@lo:400:kworker.0 00000100:00100000:1.0:1788201236.709737:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201236.709788:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875064458218624:0@lo:400:kworker.0 00000100:00100000:1.0:1788201236.709813:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201236.709839:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201236.709845:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c20bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875064458218240:0@lo:400:kworker.0 00000100:00100000:1.0:1788201236.709868:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201236.709898:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458218112 00000100:00100000:1.0:1788201236.709907:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458218112 00000100:00100000:1.0:1788201236.709966:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458218624 00000100:00100000:1.0:1788201236.709970:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458218624 00000100:00100000:1.0:1788201236.709991:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458218240 00000100:00100000:1.0:1788201236.709994:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458218240 00000100:00100000:1.0:1788201236.710015:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788201236.710023:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875064458218112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201236.710084:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875064458218112:12345-0@lo:400:kworker.0 Request processed in 60us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201236.710091:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788201236.710111:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788201236.710116:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875064458218624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201236.710142:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875064458218624:12345-0@lo:400:kworker.0 Request processed in 26us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201236.710148:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788201236.710161:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788201236.710167:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875064458218240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201236.710191:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875064458218240:12345-0@lo:400:kworker.0 Request processed in 26us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201236.710197:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788201236.710239:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c20bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875064458218240:0@lo:400:kworker.0 00000100:00100000:1.0:1788201236.710253:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c20bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875064458218112:0@lo:400:kworker.0 00000100:00100000:1.0:1788201236.710261:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875064458218624:0@lo:400:kworker.0 00000100:00100000:0.0:1788201236.710379:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458218368:0@lo:400:kworker.0 00000100:00100000:0.0:1788201236.710414:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201236.710453:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788201236.710459:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c20bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458217984:0@lo:400:kworker.0 00000100:00100000:0.0:1788201236.710492:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201236.710525:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff057480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458218496:0@lo:400:kworker.0 00000100:00100000:0.0:1788201236.710549:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201236.710584:0:12965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458217984 00000100:00100000:0.0:1788201236.710588:0:12965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458217984 00000100:00100000:0.0:1788201236.710617:0:12965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788201236.710624:0:12965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f950e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3312:x1875064458217984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201236.710660:0:12965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f950e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3312:x1875064458217984:12345-0@lo:400:kworker.0 Request processed in 36us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201236.710666:0:12965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788201236.710702:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c20bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458217984:0@lo:400:kworker.0 00000100:00080000:3.0:1788201236.710784:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201236.710907:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458218368 00000100:00100000:1.0:1788201236.710911:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458218368 00000100:00100000:1.0:1788201236.710985:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458218496 00000100:00100000:1.0:1788201236.710989:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458218496 00000100:00100000:2.0:1788201236.711059:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788201236.711070:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3312:x1875064458218368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201236.711114:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3312:x1875064458218368:12345-0@lo:400:kworker.0 Request processed in 47us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201236.711120:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788201236.711148:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458218368:0@lo:400:kworker.0 00000100:00080000:3.0:1788201236.722562:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201236.722807:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201236.724014:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788201236.724031:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1875064458218496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201236.724134:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1875064458218496:12345-0@lo:400:kworker.0 Request processed in 109us (13583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201236.724141:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788201236.727670:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff057480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458218496:0@lo:400:kworker.0 00000100:00100000:3.0:1788201236.882933:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201236.882986:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201236.883028:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201236.883061:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201236.883090:0:12964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442633216 00000100:00100000:3.0:1788201236.883099:0:12964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442633216 00000100:00100000:3.0:1788201236.883153:0:12964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 105 00000100:00100000:3.0:1788201236.883163:0:12964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f950e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442633216:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201236.883236:0:12964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f950e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442633216:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 74us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201236.883244:0:12964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 105 00000100:00100000:0.0:1788201236.883389:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442633344 00000100:00100000:0.0:1788201236.883394:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442633344 00000100:00100000:0.0:1788201236.883496:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 74 00000100:00100000:0.0:1788201236.883537:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2360:x1875064442633344:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201236.883587:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2360:x1875064442633344:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 84us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201236.883589:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442633600 00000100:00100000:2.0:1788201236.883594:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442633600 00000100:00100000:0.0:1788201236.883595:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 74 00000100:00100000:0.0:1788201236.884971:0:13451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442633472 00000100:00100000:0.0:1788201236.884985:0:13451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442633472 00000100:00080000:3.0:1788201236.887562:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201236.887572:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201236.887574:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201236.892320:0:13451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 139 00000100:00100000:0.0:1788201236.892336:0:13451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2360:x1875064442633472:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201236.892426:0:13451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2360:x1875064442633472:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 93us (9363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201236.892435:0:13451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 139 00000100:00100000:2.0:1788201236.892679:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 140 00000100:00100000:2.0:1788201236.892688:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442633600:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201236.892721:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442633600:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 34us (9735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201236.892727:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 140 00010000:00010000:0.0:1788201237.350356:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788201237.378114:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968840 is committed 00000001:00080000:0.0:1788201237.391938:0:6732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294968840 is committed 00000004:00080000:3.0:1788201237.737938:0:12994:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 512995641640ns, next at 513995638815ns, rc = 0 00000100:00100000:3.0:1788201237.737968:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201237.739103:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c543ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458218752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201237.739185:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201237.749451:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458218752 00000100:00100000:0.0:1788201237.749811:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458218752 00000100:00100000:0.0:1788201237.749884:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788201237.749895:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c543c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458218752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201237.749938:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 525008896 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1788201237.750216:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c543c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458218752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 322us (11029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201237.750224:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788201237.750364:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968840 gen 2 00000004:00080000:2.0:1788201237.750384:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c20bd500, transno 4294968840 00000100:00100000:2.0:1788201237.750412:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c543ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458218752:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788201238.374832:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788201239.372955:0:12980:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 16 committed 00000004:00080000:3.0:1788201239.373053:0:12980:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 16 committed 00000100:00100000:1.0:1788201239.373246:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201239.373273:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff057480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458219136:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201239.373378:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201239.373448:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458219136 00000100:00100000:1.0:1788201239.373455:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458219136 00000100:00100000:1.0:1788201239.373520:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4174 00000100:00100000:1.0:1788201239.373530:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff056d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458219136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201239.373559:0:6705:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1049 count 1 00000100:00100000:3.0:1788201239.373920:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458218880:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201239.373956:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201239.374056:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201239.374063:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1a71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458219008:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201239.374087:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201239.374118:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458218880 00000100:00100000:3.0:1788201239.374122:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458218880 00000100:00100000:3.0:1788201239.374145:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458219008 00000100:00100000:3.0:1788201239.374147:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458219008 00000100:00100000:3.0:1788201239.374162:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4175 00000100:00100000:3.0:1788201239.374168:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c543c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3312:x1875064458218880:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201239.374180:0:13441:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1046 count 1 00010000:00010000:3.0:1788201239.374204:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004933b680/0x9383f985bc4d350b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201239.374224:0:13441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000456a114c/0x9383f985bc4d3137 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a97 expref: 507 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201239.374233:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x416:0x0].0x0 since=24s v=(0 0) 00010000:00010000:3.0:1788201239.374237:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x416:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201239.374241:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004933b680/0x9383f985bc4d350b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201239.374274:0:13441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000456a114c/0x9383f985bc4d3137 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a97 expref: 507 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201239.374289:0:13441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000456a114c/0x9383f985bc4d3137 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a97 expref: 507 pid: 12363 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201239.374326:0:13441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c24a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:13441:1875064458219264:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201239.374399:0:13441:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201239.374418:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4176 00000100:00100000:3.0:1788201239.374426:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c543ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+7:3312:x1875064458219008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201239.374438:0:13446:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1047 count 1 00010000:00010000:3.0:1788201239.374450:0:13446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009362eac0/0x9383f985bc4d3512 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x417:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201239.374472:0:13446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d30f8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x417:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a82 expref: 507 pid: 13442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201239.374479:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x417:0x0].0x0 since=24s v=(0 0) 00010000:00010000:3.0:1788201239.374482:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x417:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201239.374486:0:13446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009362eac0/0x9383f985bc4d3512 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x417:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201239.374506:0:13446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d30f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x417:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a82 expref: 507 pid: 13442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201239.374515:0:13446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d30f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x417:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a82 expref: 507 pid: 13442 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201239.374526:0:13446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c24a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:13446:1875064458219392:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201239.374552:0:13446:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91a80 going to sleep for 11 seconds 00010000:00010000:1.0:1788201239.374912:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8727954/0x9383f985bc4d3519 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201239.374928:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000069265cef/0x9383f985bc4d323a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b1c expref: 507 pid: 13449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201239.374936:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x419:0x0].0x0 since=24s v=(0 0) 00010000:00010000:1.0:1788201239.374941:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x419:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201239.374945:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8727954/0x9383f985bc4d3519 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201239.375031:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458219520:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201239.375067:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201239.375106:0:13442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458219520 00000100:00100000:0.0:1788201239.375111:0:13442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458219520 00000100:00100000:0.0:1788201239.375148:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4177 00000100:00100000:0.0:1788201239.375157:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458219520:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201239.375173:0:13442:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1048 count 1 00010000:00010000:0.0:1788201239.375190:0:13442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d3520 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.375203:0:13442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d3145 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4aa5 expref: 6 pid: 13448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.375212:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x418:0x0].0x0 since=24s v=(0 0) 00010000:00010000:0.0:1788201239.375215:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x418:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201239.375220:0:13442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d3520 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.375242:0:13442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d3145 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4aa5 expref: 6 pid: 13448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.375252:0:13442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d3145 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4aa5 expref: 6 pid: 13448 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201239.375263:0:13442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:13442:1875064458219776:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201239.375415:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000069265cef/0x9383f985bc4d323a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b1c expref: 507 pid: 13449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201239.375425:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000069265cef/0x9383f985bc4d323a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b1c expref: 507 pid: 13449 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201239.375436:0:6705:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04ff055f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6705:1875064458219904:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201239.375528:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458219648:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201239.375561:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201239.380309:0:13442:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2ff0000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201239.380357:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458219648 00000100:00100000:0.0:1788201239.380368:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458219648 00000100:00100000:0.0:1788201239.380449:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4178 00000100:00100000:0.0:1788201239.380468:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3312:x1875064458219648:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201239.380503:0:13448:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1047 count 1 00010000:00010000:0.0:1788201239.380531:0:13448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081e542d9/0x9383f985bc4d3527 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x417:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.380554:0:13448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aaee9d17/0x9383f985bc4d314c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x417:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ad6 expref: 6 pid: 13448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.380572:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x417:0x0].0x0 since=24s v=(0 0) 00010000:00010000:0.0:1788201239.380578:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x417:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201239.380583:0:13448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081e542d9/0x9383f985bc4d3527 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x417:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.380621:0:13448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aaee9d17/0x9383f985bc4d314c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x417:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ad6 expref: 6 pid: 13448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.380636:0:13448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aaee9d17/0x9383f985bc4d314c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x417:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ad6 expref: 6 pid: 13448 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201239.380661:0:13448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:13448:1875064458220032:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201239.380728:0:13448:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2ff0b40 going to sleep for 11 seconds 00000100:00080000:0.0:1788201239.384879:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201239.384890:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201239.385084:0:6705:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f96350c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201239.396482:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201239.396507:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201239.396522:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201239.396542:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201239.396653:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442633728 00000100:00100000:0.0:1788201239.396662:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442633728 00010000:00010000:0.0:1788201239.396723:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000456a114c/0x9383f985bc4d3137 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a97 expref: 508 pid: 12363 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201239.396772:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442633984 00000100:00100000:0.0:1788201239.396775:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442633984 00010000:00010000:0.0:1788201239.396792:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aaee9d17/0x9383f985bc4d314c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x417:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ad6 expref: 7 pid: 13448 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201239.396810:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442633856 00000100:00100000:0.0:1788201239.396813:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442633856 00010000:00010000:0.0:1788201239.396826:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d30f8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x417:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a82 expref: 509 pid: 13442 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201239.396842:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442634112 00000100:00100000:0.0:1788201239.396844:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442634112 00010000:00010000:0.0:1788201239.396857:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000069265cef/0x9383f985bc4d323a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b1c expref: 510 pid: 13449 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201239.396873:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1537 00000100:00100000:0.0:1788201239.396882:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+510:2362:x1875064442633728:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201239.396898:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201239.396903:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000456a114c/0x9383f985bc4d3137 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a97 expref: 510 pid: 12363 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.396917:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000456a114c/0x9383f985bc4d3137 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a97 expref: 510 pid: 12363 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.396943:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x416:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201239.396949:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x416:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201239.396956:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004933b680/0x9383f985bc4d350b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.396977:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004933b680/0x9383f985bc4d350b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.397000:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201239.397050:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+510:2362:x1875064442633728:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 168us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201239.397058:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1537 00000100:00100000:0.0:1788201239.397078:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1538 00000100:00100000:0.0:1788201239.397085:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2362:x1875064442633984:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201239.397093:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201239.397098:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aaee9d17/0x9383f985bc4d314c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x417:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ad6 expref: 7 pid: 13448 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.397107:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aaee9d17/0x9383f985bc4d314c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x417:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ad6 expref: 7 pid: 13448 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.397121:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x417:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201239.397124:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x417:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201239.397129:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000081e542d9/0x9383f985bc4d3527 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x417:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.397136:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081e542d9/0x9383f985bc4d3527 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x417:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.397150:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201239.397168:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2362:x1875064442633984:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 84us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201239.397174:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1538 00000100:00100000:0.0:1788201239.397188:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1539 00000100:00100000:0.0:1788201239.397194:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2362:x1875064442633856:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201239.397201:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201239.397206:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d30f8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x417:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a82 expref: 509 pid: 13442 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.397215:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d30f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x417:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a82 expref: 509 pid: 13442 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.397227:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x417:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201239.397230:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x417:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201239.397234:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009362eac0/0x9383f985bc4d3512 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.397241:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009362eac0/0x9383f985bc4d3512 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.397253:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201239.397273:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2362:x1875064442633856:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 80us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201239.397282:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1539 00000100:00100000:0.0:1788201239.397340:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1540 00000100:00100000:0.0:1788201239.397347:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2362:x1875064442634112:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201239.397354:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201239.397359:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000069265cef/0x9383f985bc4d323a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b1c expref: 508 pid: 13449 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.397369:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000069265cef/0x9383f985bc4d323a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b1c expref: 508 pid: 13449 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.397381:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x419:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201239.397384:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x419:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201239.397388:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c8727954/0x9383f985bc4d3519 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.397396:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8727954/0x9383f985bc4d3519 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.397408:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201239.397424:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2362:x1875064442634112:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 78us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201239.397430:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1540 00010000:00010000:0.0:1788201239.397617:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201239.397652:0:13446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d30f8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x417:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a82 expref: 507 pid: 13442 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201239.397673:0:13446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c24a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:13446:1875064458219392:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201239.397694:0:13446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009362eac0/0x9383f985bc4d3512 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.397705:0:13446:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009362eac0/0x9383f985bc4d3512 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.397712:0:13446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009362eac0/0x9383f985bc4d3512 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.397723:0:13446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009362eac0/0x9383f985bc4d3512 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.397731:0:13446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009362eac0/0x9383f985bc4d3512 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.397746:0:13446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201239.398284:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c543ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+8:3312:x1875064458219008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23857us (24194us total) trans 4294968841 rc 0/0 00000100:00100000:0.0:1788201239.398326:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4176 00010000:00010000:0.0:1788201239.398351:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201239.398357:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009362eac0/0x9383f985bc4d3512 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.398372:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201239.398376:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009362eac0/0x9383f985bc4d3512 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.398384:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009362eac0/0x9383f985bc4d3512 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.398398:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009362eac0/0x9383f985bc4d3512 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.398405:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009362eac0/0x9383f985bc4d3512 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.398422:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201239.398424:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201239.398425:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788201239.398476:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c1a71f80/2, rc 0, transno 4294968841 00000100:00100000:0.0:1788201239.398483:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1a71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458219008:0@lo:6:osp-syn-0-0.0 00000100:00080000:2.0:1788201239.399095:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201239.399101:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788201239.399360:0:13441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000456a114c/0x9383f985bc4d3137 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x416:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4a97 expref: 506 pid: 12363 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201239.399375:0:13441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c24a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:13441:1875064458219264:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201239.399393:0:13441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004933b680/0x9383f985bc4d350b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201239.399403:0:13441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004933b680/0x9383f985bc4d350b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201239.399410:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004933b680/0x9383f985bc4d350b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201239.399419:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004933b680/0x9383f985bc4d350b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201239.399427:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004933b680/0x9383f985bc4d350b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201239.399444:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201239.400114:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c543c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3312:x1875064458218880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 25944us (26155us total) trans 4294968842 rc 0/0 00000100:00100000:3.0:1788201239.400123:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4175 00000100:00100000:2.0:1788201239.400348:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201239.400437:0:13442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:13442:1875064458219776:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201239.400519:0:13442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d3520 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201239.400638:0:13448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aaee9d17/0x9383f985bc4d314c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x417:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ad6 expref: 6 pid: 13448 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201239.400664:0:13448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:13448:1875064458220032:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201239.400676:0:13448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000081e542d9/0x9383f985bc4d3527 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201239.400684:0:13448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000081e542d9/0x9383f985bc4d3527 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201239.400690:0:13448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081e542d9/0x9383f985bc4d3527 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201239.400702:0:13448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081e542d9/0x9383f985bc4d3527 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201239.400709:0:13448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081e542d9/0x9383f985bc4d3527 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201239.400731:0:13448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788201239.401415:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+7:3312:x1875064458219648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20955us (25850us total) trans 4294968841 rc 0/0 00000100:00100000:1.0:1788201239.401425:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4178 00010000:00010000:1.0:1788201239.401480:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069265cef/0x9383f985bc4d323a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4b1c expref: 505 pid: 13449 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201239.401493:0:6705:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff055f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6705:1875064458219904:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201239.401507:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c8727954/0x9383f985bc4d3519 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201239.401515:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c8727954/0x9383f985bc4d3519 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201239.401522:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8727954/0x9383f985bc4d3519 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201239.401531:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8727954/0x9383f985bc4d3519 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201239.401539:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8727954/0x9383f985bc4d3519 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201239.401552:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788201239.402076:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788201239.402084:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004933b680/0x9383f985bc4d350b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201239.402092:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201239.402097:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004933b680/0x9383f985bc4d350b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201239.402105:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004933b680/0x9383f985bc4d350b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201239.402123:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004933b680/0x9383f985bc4d350b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201239.402130:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004933b680/0x9383f985bc4d350b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x416:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201239.402148:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201239.402152:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081e542d9/0x9383f985bc4d3527 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201239.402158:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201239.402161:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081e542d9/0x9383f985bc4d3527 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201239.402169:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081e542d9/0x9383f985bc4d3527 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201239.402180:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081e542d9/0x9383f985bc4d3527 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201239.402187:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081e542d9/0x9383f985bc4d3527 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x417:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201239.402201:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201239.402204:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8727954/0x9383f985bc4d3519 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201239.402209:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201239.402212:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8727954/0x9383f985bc4d3519 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201239.402219:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8727954/0x9383f985bc4d3519 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201239.402227:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8727954/0x9383f985bc4d3519 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201239.402232:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8727954/0x9383f985bc4d3519 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201239.402248:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201239.402249:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201239.402251:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201239.402679:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201239.402685:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201239.402718:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968840 gen 2 00000004:00080000:0.0:1788201239.402724:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00c3b80, transno 4294968840 00000100:00100000:0.0:1788201239.402739:0:3312:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9e04f00a7100 x1875064458219648/t4294968841(4294968841) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201294 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788201239.402760:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00a7100/2, rc 0, transno 4294968841 00000100:00100000:0.0:1788201239.402766:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458219648:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788201239.402781:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c1a73800/2, rc 0, transno 4294968842 00000100:00100000:0.0:1788201239.402784:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458218880:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201239.403322:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442634240 00000100:00100000:0.0:1788201239.403331:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442634240 00010000:00010000:0.0:1788201239.403361:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d3145 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4aa5 expref: 6 pid: 13448 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201239.403397:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1541 00000100:00100000:0.0:1788201239.403407:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2361:x1875064442634240:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201239.403421:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201239.403427:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d3145 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4aa5 expref: 6 pid: 13448 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.403440:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d3145 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4aa5 expref: 6 pid: 13448 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.403469:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4e56fd5/0x9383f985bc4d3145 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x418:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4aa5 expref: 6 pid: 13448 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.403484:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x418:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201239.403488:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x418:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201239.403494:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d3520 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.403509:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d3520 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x418:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.403532:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201239.403583:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2361:x1875064442634240:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 178us (3236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201239.403590:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1541 00010000:00010000:3.0:1788201239.403776:0:13442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d3520 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201239.403786:0:13442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d3520 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201239.403796:0:13442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d3520 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201239.403804:0:13442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d3520 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201239.403824:0:13442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201239.404224:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3311:x1875064458219520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 29068us (29155us total) trans 4294968842 rc 0/0 00000100:00100000:3.0:1788201239.404232:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4177 00000004:00080000:0.0:1788201239.404991:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00a4700/2, rc 0, transno 4294968842 00000100:00100000:0.0:1788201239.405000:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458219520:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788201239.405018:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201239.405023:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d3520 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.405033:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201239.405036:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d3520 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.405044:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d3520 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.405059:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d3520 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.405065:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d3520 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x418:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201239.405089:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201239.405091:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201239.405093:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201239.405496:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff056d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3311:x1875064458219136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 31966us (32115us total) trans 4294968843 rc 0/0 00000100:00100000:2.0:1788201239.405506:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4174 00000004:00080000:0.0:1788201239.406069:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04ff057480/2, rc 0, transno 4294968843 00000100:00100000:0.0:1788201239.406075:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04ff057480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458219136:0@lo:6:osp-syn-0-0.0 00000001:02000400:3.0:1788201240.265140:0:13996:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 102b: check resend (reply lost) with multiple modify RPCs in flight ========================================================== 14:33:58 (1788201238) 00000100:00100000:1.0:1788201240.297243:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201240.297270:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458220160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201240.297721:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201240.297846:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458220160 00000100:00100000:2.0:1788201240.297855:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458220160 00000100:00100000:2.0:1788201240.297907:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788201240.297917:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875064458220160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201240.297956:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 13631488 granted 525008896 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201240.298011:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875064458220160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201240.298017:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788201240.298685:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458220160:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788201240.422686:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201240.435095:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201240.435450:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442634368 00000100:00100000:1.0:1788201240.435470:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442634368 00000100:00100000:1.0:1788201240.435532:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5093 00000100:00100000:1.0:1788201240.435544:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c24a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:14284:x1875064442634368:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1788201240.435574:0:13406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201240.435598:0:13406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d352e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4bb6 expref: -99 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.435665:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d3535 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.435679:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d3535 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.435692:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d3535 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201240.436734:0:13406:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1788201240.436742:0:13406:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201240.436815:0:13406:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d3535 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.436846:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d352e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4bb6 expref: 7 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.436862:0:13406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d3535 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4bb6 expref: 6 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.436871:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173d00) 00010000:00010000:1.0:1788201240.436874:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201240.436877:0:13406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3e00, rc 0) 00000100:00100000:1.0:1788201240.436941:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c24a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:14284:x1875064442634368:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1401us (1859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201240.436949:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5093 00000100:00080000:0.0:1788201240.437036:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201240.447629:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201240.448691:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442634496 00000100:00100000:1.0:1788201240.448704:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442634496 00000100:00100000:1.0:1788201240.448766:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5094 00000100:00100000:1.0:1788201240.448776:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:14284:x1875064442634496:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1788201240.448798:0:12971:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201240.448822:0:12971:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d353c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4bbd expref: -99 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.448888:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3543 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.448901:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3543 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.448918:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3543 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.448933:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d354a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.448940:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d354a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.448947:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d354a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.449238:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3543 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.449245:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3543 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.449251:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3543 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.449257:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201240.449262:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3543 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.449269:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3543 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.449281:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173d00) 00010000:00010000:1.0:1788201240.449284:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201240.449289:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3543 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.449323:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3543 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.449334:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d354a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.449340:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d354a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.449345:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d354a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.449350:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201240.449353:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d354a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.449358:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d354a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.449365:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x58a1b1aa (ffff9e03c5173f00) 00010000:00010000:1.0:1788201240.449368:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201240.449370:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d354a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.449376:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d354a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.449409:0:12971:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d353c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4bbd expref: 7 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.449426:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173d00) 00010000:00010000:1.0:1788201240.449428:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201240.449432:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d353c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4bbd expref: 7 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.449451:0:12971:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2200, rc 0) 00000100:00100000:1.0:1788201240.449529:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:14284:x1875064442634496:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 754us (1912us total) trans 0 rc 301/301 00000100:00100000:1.0:1788201240.449538:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5094 00000100:00100000:3.0:1788201240.454650:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201240.454710:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442634752 00000100:00100000:1.0:1788201240.454721:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442634752 00000100:00100000:1.0:1788201240.454776:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5095 00000100:00100000:1.0:1788201240.454787:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c24a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:14284:x1875064442634752:12345-192.168.201.30@tcp:36:lfs.0 00010000:00010000:1.0:1788201240.454846:0:12969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201240.454873:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d3535 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4bb6 expref: 6 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.454889:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173d00) 00010000:00010000:1.0:1788201240.454899:0:12969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201240.455170:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d3551 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.455185:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d3551 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.455195:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d3551 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.455216:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d3558 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.455224:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d3558 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.455231:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d3558 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201240.458878:0:12969:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f1:0x0]: returning size 512 00010000:00010000:1.0:1788201240.458901:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d3551 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.458912:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d3551 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.458920:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d3551 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.458926:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201240.458931:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d3551 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.458939:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d3551 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.458958:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173700) 00010000:00010000:1.0:1788201240.458961:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201240.458964:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d3551 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.458975:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d3551 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201240.458998:0:12969:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a6acdd7 reply state 0000000013cf30d7 transno 8589938652 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d3558 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201240.459009:0:12969:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201240.459131:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c24a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:14284:x1875064442634752:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 4342us (4487us total) trans 8589938652 rc 0/0 00000100:00100000:1.0:1788201240.459142:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5095 00010000:00010000:0.0:1788201240.464720:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d3558 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.464739:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d3558 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.464747:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d3558 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.464753:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201240.464759:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d3558 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.464767:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d3558 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.464783:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x58a1b1aa (ffff9e03c5173800) 00010000:00010000:0.0:1788201240.464787:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201240.464791:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d3558 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.464798:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d3558 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201240.512256:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201240.515908:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442634880 00000100:00100000:1.0:1788201240.515926:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442634880 00000100:00100000:1.0:1788201240.516044:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5096 00000100:00100000:1.0:1788201240.516055:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c24a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:14290:x1875064442634880:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1788201240.516082:0:12968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201240.516106:0:12968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d355f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4bc4 expref: -99 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.516170:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d3566 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.516184:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d3566 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.516196:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d3566 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201240.516263:0:12968:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1788201240.516267:0:12968:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201240.516310:0:12968:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d3566 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.516470:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d355f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4bc4 expref: 8 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.516488:0:12968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d3566 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4bc4 expref: 7 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.516496:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173700) 00010000:00010000:1.0:1788201240.516498:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201240.516502:0:12968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2200, rc 0) 00000100:00100000:1.0:1788201240.516578:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c24a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:14290:x1875064442634880:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 514us (4320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201240.516585:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5096 00000100:00100000:2.0:1788201240.524817:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201240.524890:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442635136 00000100:00100000:3.0:1788201240.524900:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442635136 00000100:00100000:3.0:1788201240.524959:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5097 00000100:00100000:3.0:1788201240.524970:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:14290:x1875064442635136:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788201240.524991:0:12971:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201240.525012:0:12971:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017000/0x9383f985bc4d356d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4bcb expref: -99 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.525087:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d3574 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.525100:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d3574 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.525111:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d3574 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.525125:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017c00/0x9383f985bc4d357b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.525132:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017c00/0x9383f985bc4d357b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.525137:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017c00/0x9383f985bc4d357b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201240.525263:0:12971:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f1:0x0]: returning size 512 00010000:00010000:3.0:1788201240.525514:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d3574 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.525524:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d3574 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.525530:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d3574 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.525537:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201240.525541:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d3574 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.526453:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d3574 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.526470:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173700) 00010000:00010000:3.0:1788201240.526473:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201240.526478:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d3574 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.526484:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d3574 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.526500:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017c00/0x9383f985bc4d357b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.526506:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017c00/0x9383f985bc4d357b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.526513:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017c00/0x9383f985bc4d357b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.526518:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201240.526520:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017c00/0x9383f985bc4d357b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.526526:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017c00/0x9383f985bc4d357b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.526537:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x58a1b1aa (ffff9e03c33e8200) 00010000:00010000:3.0:1788201240.526539:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201240.526543:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017c00/0x9383f985bc4d357b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.526622:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017c00/0x9383f985bc4d357b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.526673:0:12971:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017000/0x9383f985bc4d356d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4bcb expref: 9 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.526683:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173700) 00010000:00010000:3.0:1788201240.526685:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201240.526689:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017000/0x9383f985bc4d356d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4bcb expref: 9 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.526698:0:12971:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c3017000, rc 0) 00000100:00100000:3.0:1788201240.526773:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:14290:x1875064442635136:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1804us (1966us total) trans 8589938653 rc 301/301 00000100:00100000:3.0:1788201240.526782:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5097 00000100:00100000:3.0:1788201240.537246:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201240.537361:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442635392 00000100:00100000:0.0:1788201240.537372:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442635392 00000100:00100000:0.0:1788201240.537485:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5098 00000100:00100000:0.0:1788201240.537496:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c24a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:14290:x1875064442635392:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1788201240.537522:0:12969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201240.537543:0:12969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d3589 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4bd2 expref: -99 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.537619:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d3590 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.537632:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d3590 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.537642:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d3590 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.537656:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d3597 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.537663:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d3597 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.537669:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d3597 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.537806:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d359e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.537815:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d359e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.537822:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d359e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201240.537831:0:12969:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f1:0x0]: returning size 512 00010000:00010000:0.0:1788201240.537925:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d3590 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.537933:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d3590 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.537939:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d3590 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.537946:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201240.537950:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d3590 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.537956:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d3590 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.537967:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173700) 00010000:00010000:0.0:1788201240.537970:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201240.537975:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d3590 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.537980:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d3590 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.537992:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d3597 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.538002:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d3597 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.538008:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d3597 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.538014:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201240.538016:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d3597 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.538022:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d3597 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.538029:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x58a1b1aa (ffff9e03c2fc5d00) 00010000:00010000:0.0:1788201240.538031:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201240.538034:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d3597 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.538039:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d3597 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.538288:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d3589 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4bd2 expref: 11 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.538327:0:12969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d359e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4bd2 expref: 10 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.538335:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:0.0:1788201240.538338:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201240.538340:0:12969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc7600, rc 0) 00000100:00100000:0.0:1788201240.538402:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c24a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:14290:x1875064442635392:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 908us (1166us total) trans 8589938654 rc 0/0 00000100:00100000:0.0:1788201240.538409:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5098 00000100:00100000:1.0:1788201240.542631:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201240.542668:0:12973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442635648 00000100:00100000:1.0:1788201240.542677:0:12973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442635648 00000100:00100000:1.0:1788201240.542727:0:12973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1021 00000100:00100000:1.0:1788201240.542736:0:12973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c20bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:14290:x1875064442635648:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:1.0:1788201240.543001:0:12973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c20bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:14290:x1875064442635648:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 265us (378us total) trans 8589938655 rc 0/0 00000100:00100000:1.0:1788201240.543010:0:12973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1021 00000100:00100000:1.0:1788201240.551763:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201240.551809:0:13381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442635776 00000100:00100000:2.0:1788201240.551820:0:13381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442635776 00000100:00100000:2.0:1788201240.551877:0:13381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1022 00000100:00100000:2.0:1788201240.551888:0:13381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c20bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:14290:x1875064442635776:12345-192.168.201.30@tcp:33:lfs.0 00000004:00200000:2.0:1788201240.551991:0:13381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f1:0x0]: returning size 512 00000004:00200000:2.0:1788201240.551996:0:13381:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:2.0:1788201240.552078:0:13381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c20bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:14290:x1875064442635776:12345-192.168.201.30@tcp:33:lfs.0 Request processed in 191us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201240.552085:0:13381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1022 00000100:00100000:3.0:1788201240.554647:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201240.554745:0:12972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442636032 00000100:00100000:1.0:1788201240.554756:0:12972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442636032 00000100:00100000:1.0:1788201240.554819:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1023 00000100:00100000:1.0:1788201240.554829:0:12972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c24a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:14290:x1875064442636032:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:1.0:1788201240.555091:0:12972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c24a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:14290:x1875064442636032:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 263us (455us total) trans 8589938656 rc 0/0 00000100:00100000:1.0:1788201240.555100:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1023 00000100:00100000:3.0:1788201240.606754:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201240.606881:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442636160 00000100:00100000:1.0:1788201240.606892:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442636160 00000100:00100000:1.0:1788201240.606958:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5099 00000100:00100000:1.0:1788201240.606968:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c24a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:14295:x1875064442636160:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:1.0:1788201240.606992:0:12968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201240.607008:0:12968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d35ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4bd9 expref: -99 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.607072:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d35b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.607088:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d35b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.607098:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d35b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.607114:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d35ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.607121:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d35ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.607128:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d35ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.607216:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d35c1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.607223:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d35c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.607227:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d35c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201240.607249:0:12968:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f1:0x0]: returning size 512 00000004:00200000:1.0:1788201240.607251:0:12968:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201240.607266:0:12968:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d35c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.607275:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d35b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.607279:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d35b3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.607283:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d35b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.607287:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201240.607450:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d35b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.607460:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d35b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.607477:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173700) 00010000:00010000:1.0:1788201240.607481:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201240.607485:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d35b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.607495:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d35b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.607508:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d35ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.607514:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d35ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.607519:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d35ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.607523:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201240.607526:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d35ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.607532:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d35ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.607539:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x58a1b1aa (ffff9e03c5173d00) 00010000:00010000:1.0:1788201240.607541:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201240.607544:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d35ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.607550:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d35ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.607580:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d35ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4bd9 expref: 14 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.607596:0:12968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d35c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4bd9 expref: 13 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.607603:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:1.0:1788201240.607606:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788201240.607609:0:12968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2a00, rc 0) 00000100:00100000:3.0:1788201240.607984:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c24a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:14295:x1875064442636160:12345-192.168.201.30@tcp:101:touch.0 Request processed in 1014us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201240.607993:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5099 00000100:00100000:3.0:1788201240.610615:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201240.610689:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442636416 00000100:00100000:0.0:1788201240.610700:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442636416 00000100:00100000:0.0:1788201240.610836:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5100 00000100:00100000:0.0:1788201240.610847:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c24a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:14295:x1875064442636416:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:0.0:1788201240.610868:0:12971:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201240.610871:0:12971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788201240.610897:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d359e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4bd2 expref: 13 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.610917:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:0.0:1788201240.610921:0:12971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201240.610935:0:12971:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d35c8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4be0 expref: -99 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.611054:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d35cf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.611191:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d35cf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.611202:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d35cf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.611220:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d35d6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.611233:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d35d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.611240:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d35d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201240.612185:0:12971:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x419:0x0], index 1: 0 00010000:00010000:0.0:1788201240.612388:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d35dd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.612402:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d35dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.612413:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d35dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.612460:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d35cf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.612468:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d35cf lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.612474:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d35cf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.612480:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201240.612484:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d35cf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.612491:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d35cf lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.612506:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:0.0:1788201240.612509:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201240.612514:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d35cf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.612519:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d35cf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201240.612891:0:12971:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a651397 reply state 00000000b696ed5f transno 8589938657 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d35d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201240.612900:0:12971:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201240.612937:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d35c8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4be0 expref: 15 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.612952:0:12971:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d35dd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4be0 expref: 14 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.612961:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f2:0x0].0x0 (ffff9e03c2fc5600) 00010000:00010000:0.0:1788201240.612964:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201240.612967:0:12971:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc7200, rc 0) 00000100:00100000:0.0:1788201240.613054:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c24a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:14295:x1875064442636416:12345-192.168.201.30@tcp:101:touch.0 Request processed in 2208us (2443us total) trans 8589938657 rc 0/0 00000100:00100000:0.0:1788201240.613132:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5100 00010000:00010000:2.0:1788201240.615707:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d35d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.615724:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d35d6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.615732:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d35d6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.615738:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201240.615743:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d35d6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.615750:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d35d6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.615778:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0xcda302ea (ffff9e03c2fc5d00) 00010000:00010000:2.0:1788201240.615781:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201240.615786:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d35d6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.615792:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d35d6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201240.616866:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201240.617806:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442636672 00000100:00100000:0.0:1788201240.617817:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442636672 00000100:00100000:0.0:1788201240.617909:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5101 00000100:00100000:0.0:1788201240.617920:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c24a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:14295:x1875064442636672:12345-192.168.201.30@tcp:36:touch.0 00010000:00010000:0.0:1788201240.617977:0:12969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201240.617997:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d35dd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4be0 expref: 14 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.618013:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f2:0x0].0x0 (ffff9e03c2fc5600) 00010000:00010000:0.0:1788201240.618022:0:12969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201240.618060:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d35eb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.618072:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d35eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.618080:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d35eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201240.618192:0:12969:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000da14506 reply state 000000000db127a0 transno 8589938658 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d35eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201240.618201:0:12969:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201240.618312:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c24a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:14295:x1875064442636672:12345-192.168.201.30@tcp:36:touch.0 Request processed in 375us (1433us total) trans 8589938658 rc 0/0 00000100:00100000:0.0:1788201240.618320:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5101 00000100:00100000:1.0:1788201240.623947:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201240.624209:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442636800 00000100:00100000:3.0:1788201240.624220:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442636800 00000100:00100000:3.0:1788201240.624288:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5102 00000100:00100000:3.0:1788201240.624336:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c20bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:14295:x1875064442636800:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:3.0:1788201240.624366:0:12968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201240.624390:0:12968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017000/0x9383f985bc4d35f2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4be7 expref: -99 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.624465:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017000/0x9383f985bc4d35f2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4be7 expref: 16 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.624479:0:12968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017000/0x9383f985bc4d35f2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4be7 expref: 16 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.624499:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f2:0x0].0x0 (ffff9e03c2fc5700) 00010000:00010000:3.0:1788201240.624502:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201240.624506:0:12968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c3017000, rc 0) 00000100:00100000:3.0:1788201240.624582:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c20bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:14295:x1875064442636800:12345-192.168.201.30@tcp:101:touch.0 Request processed in 250us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201240.624589:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5102 00010000:00010000:0.0:1788201240.625254:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d35eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.625267:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d35eb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.625274:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d35eb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.625286:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201240.625397:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d35eb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.625408:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d35eb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.625421:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f2:0x0].0x0 (ffff9e03c2fc5700) 00010000:00010000:0.0:1788201240.625424:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201240.625428:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d35eb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.625435:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d35eb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201240.627781:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201240.627869:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442636928 00000100:00100000:3.0:1788201240.627879:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442636928 00000100:00100000:3.0:1788201240.627932:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4179 00000100:00100000:3.0:1788201240.627942:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c20bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2361:x1875064442636928:12345-192.168.201.30@tcp:2:touch.0 00000100:00100000:3.0:1788201240.628222:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c20bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2361:x1875064442636928:12345-192.168.201.30@tcp:2:touch.0 Request processed in 281us (449us total) trans 4294968843 rc 0/0 00000100:00100000:3.0:1788201240.628234:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4179 00000100:00100000:2.0:1788201240.633407:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201240.633527:0:12973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442637184 00000100:00100000:1.0:1788201240.633540:0:12973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442637184 00000100:00100000:1.0:1788201240.633608:0:12973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1024 00000100:00100000:1.0:1788201240.633618:0:12973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c67d9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:14295:x1875064442637184:12345-192.168.201.30@tcp:35:touch.0 00000100:00100000:1.0:1788201240.635821:0:12973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c67d9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:14295:x1875064442637184:12345-192.168.201.30@tcp:35:touch.0 Request processed in 2194us (2413us total) trans 8589938659 rc 0/0 00000100:00100000:1.0:1788201240.635836:0:12973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1024 00000100:00100000:1.0:1788201240.667180:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201240.667534:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442637440 00000100:00100000:0.0:1788201240.667546:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442637440 00000100:00100000:0.0:1788201240.667613:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5103 00000100:00100000:0.0:1788201240.667625:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c20bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:14296:x1875064442637440:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:0.0:1788201240.667651:0:12971:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201240.667673:0:12971:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d35f9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4bee expref: -99 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.667800:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d3600 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.667815:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d3600 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.667825:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d3600 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.667841:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d3607 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.667848:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d3607 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.667854:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d3607 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201240.668878:0:12971:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x41a:0x0], index 0: 0 00010000:00010000:0.0:1788201240.669048:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d360e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.669060:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d360e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.669070:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d360e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.669103:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d3600 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.669110:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d3600 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.669117:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d3600 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.669124:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201240.669128:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d3600 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.669140:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d3600 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.669152:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:0.0:1788201240.669155:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201240.669159:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d3600 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.669166:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d3600 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201240.669179:0:12971:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096cec4c0 reply state 0000000081d09823 transno 8589938660 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d3607 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201240.669189:0:12971:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201240.669218:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d35f9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4bee expref: 19 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.669611:0:12971:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d360e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4bee expref: 18 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.669619:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f3:0x0].0x0 (ffff9e03c2fc5000) 00010000:00010000:0.0:1788201240.669621:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201240.669624:0:12971:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc7600, rc 0) 00000100:00100000:0.0:1788201240.669697:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c20bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:14296:x1875064442637440:12345-192.168.201.30@tcp:101:touch.0 Request processed in 2074us (2526us total) trans 8589938660 rc 0/0 00000100:00100000:0.0:1788201240.669706:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5103 00010000:00010000:2.0:1788201240.671837:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d3607 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.671852:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d3607 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.671860:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d3607 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.671865:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201240.671870:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d3607 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.671877:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d3607 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.671891:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x15fcbbea (ffff9e03c2fc5600) 00010000:00010000:2.0:1788201240.671894:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201240.671897:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d3607 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.671903:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d3607 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201240.673339:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201240.673684:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442637696 00000100:00100000:0.0:1788201240.673695:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442637696 00000100:00100000:0.0:1788201240.673751:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5104 00000100:00100000:0.0:1788201240.673762:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c20bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+18:14296:x1875064442637696:12345-192.168.201.30@tcp:36:touch.0 00010000:00010000:0.0:1788201240.673837:0:12969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201240.673864:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d360e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4bee expref: 18 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.673885:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f3:0x0].0x0 (ffff9e03c2fc5000) 00010000:00010000:0.0:1788201240.673895:0:12969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201240.673943:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d361c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.673956:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d361c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.673965:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d361c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201240.674111:0:12969:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b9f253c reply state 00000000a6f0d58b transno 8589938661 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d361c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201240.674121:0:12969:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201240.674212:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c20bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:14296:x1875064442637696:12345-192.168.201.30@tcp:36:touch.0 Request processed in 452us (923us total) trans 8589938661 rc 0/0 00000100:00100000:0.0:1788201240.674233:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5104 00000100:00100000:1.0:1788201240.688612:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201240.688788:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442637824 00000100:00100000:3.0:1788201240.688798:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442637824 00000100:00100000:3.0:1788201240.688872:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5105 00000100:00100000:3.0:1788201240.688883:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c543ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:14296:x1875064442637824:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:3.0:1788201240.688909:0:13379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201240.688930:0:13379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017c00/0x9383f985bc4d3623 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4bf5 expref: -99 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.688992:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017c00/0x9383f985bc4d3623 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4bf5 expref: 20 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.689006:0:13379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017c00/0x9383f985bc4d3623 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4bf5 expref: 20 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.689037:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f3:0x0].0x0 (ffff9e03c2fc5c00) 00010000:00010000:3.0:1788201240.689040:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201240.689043:0:13379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c3017c00, rc 0) 00000100:00100000:3.0:1788201240.689101:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c543ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:14296:x1875064442637824:12345-192.168.201.30@tcp:101:touch.0 Request processed in 219us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201240.689108:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5105 00010000:00010000:2.0:1788201240.690161:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d361c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.690174:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d361c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.690181:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d361c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.690188:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201240.690194:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d361c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.690206:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d361c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.690219:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f3:0x0].0x0 (ffff9e03c2fc5c00) 00010000:00010000:2.0:1788201240.690372:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201240.690378:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d361c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.690385:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d361c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201240.694013:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201240.694251:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442637952 00000100:00100000:0.0:1788201240.694264:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442637952 00000100:00100000:0.0:1788201240.694589:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4180 00000100:00100000:0.0:1788201240.694602:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c24a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2360:x1875064442637952:12345-192.168.201.30@tcp:2:touch.0 00000100:00100000:0.0:1788201240.694969:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c24a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+506:2360:x1875064442637952:12345-192.168.201.30@tcp:2:touch.0 Request processed in 369us (964us total) trans 4294968844 rc 0/0 00000100:00100000:0.0:1788201240.694978:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4180 00000100:00100000:1.0:1788201240.700644:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201240.705791:0:13381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442638208 00000100:00100000:2.0:1788201240.705809:0:13381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442638208 00000100:00100000:2.0:1788201240.705907:0:13381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1025 00000100:00100000:2.0:1788201240.705919:0:13381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:14296:x1875064442638208:12345-192.168.201.30@tcp:35:touch.0 00000100:00100000:2.0:1788201240.706324:0:13381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:14296:x1875064442638208:12345-192.168.201.30@tcp:35:touch.0 Request processed in 378us (5661us total) trans 8589938662 rc 0/0 00000100:00100000:2.0:1788201240.706332:0:13381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1025 00000100:00100000:2.0:1788201240.719701:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201240.720577:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442638464 00000100:00100000:1.0:1788201240.720589:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442638464 00000100:00100000:1.0:1788201240.720715:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5106 00000100:00100000:1.0:1788201240.720727:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:14297:x1875064442638464:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:1.0:1788201240.720756:0:13406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201240.720791:0:13406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d362a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4bfc expref: -99 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.720945:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3631 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.720960:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3631 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.720971:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3631 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.720988:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3638 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.720995:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3638 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.721002:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3638 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201240.724064:0:13406:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x41a:0x0], index 1: 0 00010000:00010000:1.0:1788201240.724485:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d363f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.724504:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d363f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.724515:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d363f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.724554:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3631 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.724565:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3631 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.724572:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3631 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.724578:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201240.724582:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3631 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.724589:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3631 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.724601:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:1.0:1788201240.724604:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201240.724608:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3631 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.724614:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3631 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201240.724628:0:13406:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c036ccd1 reply state 00000000f3963213 transno 8589938663 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3638 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201240.724637:0:13406:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201240.724674:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d362a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4bfc expref: 23 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.724690:0:13406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d363f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4bfc expref: 22 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.724702:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f4:0x0].0x0 (ffff9e03c5173f00) 00010000:00010000:1.0:1788201240.724704:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201240.724706:0:13406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3000, rc 0) 00000100:00100000:1.0:1788201240.724784:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:14297:x1875064442638464:12345-192.168.201.30@tcp:101:touch.0 Request processed in 4059us (5093us total) trans 8589938663 rc 0/0 00000100:00100000:1.0:1788201240.724793:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5106 00010000:00010000:2.0:1788201240.726655:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3638 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.726671:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3638 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.726678:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3638 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.726684:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201240.726690:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3638 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.726697:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3638 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.726711:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x5e5674ea (ffff9e03c5173d00) 00010000:00010000:2.0:1788201240.726713:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201240.726718:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3638 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.726723:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3638 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201240.733845:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201240.734282:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442638720 00000100:00100000:3.0:1788201240.734316:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442638720 00000100:00100000:3.0:1788201240.734459:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5107 00000100:00100000:3.0:1788201240.734470:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:14297:x1875064442638720:12345-192.168.201.30@tcp:36:touch.0 00010000:00010000:3.0:1788201240.734534:0:12968:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201240.734808:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d363f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4bfc expref: 22 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.734829:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f4:0x0].0x0 (ffff9e03c5173f00) 00010000:00010000:3.0:1788201240.734840:0:12968:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201240.734890:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d364d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.734906:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d364d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.734916:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d364d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201240.735062:0:12968:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058272d27 reply state 00000000e497b411 transno 8589938664 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d364d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201240.735072:0:12968:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201240.735167:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:14297:x1875064442638720:12345-192.168.201.30@tcp:36:touch.0 Request processed in 698us (1332us total) trans 8589938664 rc 0/0 00000100:00100000:3.0:1788201240.735173:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5107 00010000:00010000:2.0:1788201240.742835:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d364d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.742865:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d364d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.742872:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d364d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.742879:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201240.742884:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d364d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.742892:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d364d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.742909:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f4:0x0].0x0 (ffff9e03c33e8200) 00010000:00010000:2.0:1788201240.742914:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201240.742919:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d364d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.742924:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d364d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201240.743772:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201240.743901:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442638848 00000100:00100000:0.0:1788201240.743912:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442638848 00000100:00100000:0.0:1788201240.743978:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5108 00000100:00100000:0.0:1788201240.743989:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c502aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:14297:x1875064442638848:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:0.0:1788201240.744015:0:12971:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201240.744048:0:12971:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d3654 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4c03 expref: -99 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.744107:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d3654 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c03 expref: 23 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.744122:0:12971:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d3654 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c03 expref: 23 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.744139:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f4:0x0].0x0 (ffff9e03c2fc5000) 00010000:00010000:0.0:1788201240.744141:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788201240.744144:0:12971:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc7a00, rc 0) 00000100:00100000:0.0:1788201240.744208:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c502aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:14297:x1875064442638848:12345-192.168.201.30@tcp:101:touch.0 Request processed in 221us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201240.744215:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5108 00000100:00100000:0.0:1788201240.762030:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201240.762115:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442638976 00000100:00100000:1.0:1788201240.762126:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442638976 00000100:00100000:1.0:1788201240.762187:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4181 00000100:00100000:1.0:1788201240.762198:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2360:x1875064442638976:12345-192.168.201.30@tcp:2:touch.0 00000100:00100000:1.0:1788201240.763154:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442638976:12345-192.168.201.30@tcp:2:touch.0 Request processed in 953us (1129us total) trans 4294968844 rc 0/0 00000100:00100000:1.0:1788201240.763165:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4181 00000100:00100000:2.0:1788201240.768416:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201240.768534:0:12973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442639232 00000100:00100000:1.0:1788201240.768544:0:12973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442639232 00000100:00100000:1.0:1788201240.768605:0:12973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1026 00000100:00100000:1.0:1788201240.768616:0:12973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:14297:x1875064442639232:12345-192.168.201.30@tcp:35:touch.0 00000100:00100000:1.0:1788201240.769358:0:12973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:14297:x1875064442639232:12345-192.168.201.30@tcp:35:touch.0 Request processed in 741us (948us total) trans 8589938665 rc 0/0 00000100:00100000:1.0:1788201240.769368:0:12973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1026 00000100:00100000:3.0:1788201240.809728:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201240.810196:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442639488 00000100:00100000:1.0:1788201240.810216:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442639488 00000100:00100000:1.0:1788201240.810279:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5109 00000100:00100000:1.0:1788201240.810455:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c24a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:14298:x1875064442639488:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:1.0:1788201240.810484:0:13406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201240.810516:0:13406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d365b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4c0a expref: -99 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.811278:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3662 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.811317:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3662 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.812462:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3662 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.812500:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d3669 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.812511:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d3669 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.812519:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d3669 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201240.816182:0:13406:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x41b:0x0], index 0: 0 00010000:00010000:1.0:1788201240.819050:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d3670 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.819076:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d3670 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.819089:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d3670 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.819130:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3662 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.819138:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3662 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.819145:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3662 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.819152:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201240.819157:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3662 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.819165:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3662 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.819177:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:1.0:1788201240.819180:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201240.819184:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3662 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.819191:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3662 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201240.819221:0:13406:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000602cf8b2 reply state 0000000072784c9c transno 8589938666 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d3669 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201240.819232:0:13406:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201240.819271:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d365b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c0a expref: 27 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.822043:0:13406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d3670 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c0a expref: 26 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.822068:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f5:0x0].0x0 (ffff9e03c5173f00) 00010000:00010000:1.0:1788201240.822072:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201240.822076:0:13406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2000, rc 0) 00000100:00100000:1.0:1788201240.822163:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c24a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:14298:x1875064442639488:12345-192.168.201.30@tcp:101:touch.0 Request processed in 11870us (12442us total) trans 8589938666 rc 0/0 00000100:00100000:1.0:1788201240.822173:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5109 00010000:00010000:2.0:1788201240.831524:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d3669 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.831543:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d3669 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.831552:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d3669 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.831558:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201240.831562:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d3669 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.831569:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d3669 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.831586:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0xa6b02dea (ffff9e03c5173500) 00010000:00010000:2.0:1788201240.831589:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201240.831594:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d3669 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.831600:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d3669 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201240.832060:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201240.832132:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442639744 00000100:00100000:1.0:1788201240.832143:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442639744 00000100:00100000:1.0:1788201240.832207:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5110 00000100:00100000:1.0:1788201240.832218:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c24a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:14298:x1875064442639744:12345-192.168.201.30@tcp:36:touch.0 00010000:00010000:1.0:1788201240.832273:0:13379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201240.832325:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d3670 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c0a expref: 26 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.832340:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f5:0x0].0x0 (ffff9e03c5173f00) 00010000:00010000:1.0:1788201240.832349:0:13379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201240.832502:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d367e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.832517:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d367e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.832526:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d367e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201240.832671:0:13379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7d06dfc reply state 00000000fe2b6b83 transno 8589938667 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d367e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201240.832680:0:13379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201240.832782:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c24a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:14298:x1875064442639744:12345-192.168.201.30@tcp:36:touch.0 Request processed in 564us (726us total) trans 8589938667 rc 0/0 00000100:00100000:2.0:1788201240.832789:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5110 00010000:00010000:2.0:1788201240.834570:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d367e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.834587:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d367e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.834594:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d367e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.834601:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201240.834607:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d367e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.834615:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d367e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.834631:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f5:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:2.0:1788201240.834634:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201240.834638:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d367e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.834644:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d367e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201240.835753:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201240.836408:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442639872 00000100:00100000:1.0:1788201240.836420:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442639872 00000100:00100000:1.0:1788201240.836491:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5111 00000100:00100000:1.0:1788201240.836502:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c24a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:14298:x1875064442639872:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:1.0:1788201240.836530:0:12969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201240.836556:0:12969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d3685 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4c11 expref: -99 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.836618:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d3685 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c11 expref: 27 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.836632:0:12969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d3685 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c11 expref: 27 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.836650:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f5:0x0].0x0 (ffff9e03c5173d00) 00010000:00010000:1.0:1788201240.836653:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201240.836657:0:12969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2600, rc 0) 00000100:00100000:1.0:1788201240.836716:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c24a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:14298:x1875064442639872:12345-192.168.201.30@tcp:101:touch.0 Request processed in 216us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201240.836723:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5111 00000100:00100000:3.0:1788201240.841830:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201240.841919:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442640000 00000100:00100000:2.0:1788201240.841928:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442640000 00000100:00100000:2.0:1788201240.841991:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4182 00000100:00100000:2.0:1788201240.842001:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c24a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+506:2360:x1875064442640000:12345-192.168.201.30@tcp:2:touch.0 00000100:00100000:2.0:1788201240.842349:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c24a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+507:2360:x1875064442640000:12345-192.168.201.30@tcp:2:touch.0 Request processed in 348us (529us total) trans 4294968845 rc 0/0 00000100:00100000:2.0:1788201240.842358:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4182 00000100:00100000:2.0:1788201240.849735:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201240.850511:0:13381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442640256 00000100:00100000:1.0:1788201240.850523:0:13381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442640256 00000100:00100000:1.0:1788201240.850589:0:13381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1027 00000100:00100000:1.0:1788201240.850600:0:13381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:14298:x1875064442640256:12345-192.168.201.30@tcp:35:touch.0 00000100:00100000:1.0:1788201240.850956:0:13381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:14298:x1875064442640256:12345-192.168.201.30@tcp:35:touch.0 Request processed in 357us (1229us total) trans 8589938668 rc 0/0 00000100:00100000:1.0:1788201240.850965:0:13381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1027 00000100:00100000:3.0:1788201240.867240:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201240.867508:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442640512 00000100:00100000:1.0:1788201240.867520:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442640512 00000100:00100000:1.0:1788201240.867593:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5112 00000100:00100000:1.0:1788201240.867604:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c24a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:14299:x1875064442640512:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:1.0:1788201240.867630:0:13406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201240.867653:0:13406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d368c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4c18 expref: -99 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.867805:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d3693 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.867819:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d3693 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.867829:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d3693 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.867844:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d369a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.867851:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d369a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.867857:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d369a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201240.868379:0:13406:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x41b:0x0], index 1: 0 00010000:00010000:1.0:1788201240.868553:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d36a1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.868564:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d36a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.868572:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d36a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.868609:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d3693 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.868620:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d3693 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.868627:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d3693 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.868633:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201240.868638:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d3693 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.868645:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d3693 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.868657:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:1.0:1788201240.868660:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201240.868664:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d3693 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.868670:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d3693 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201240.868682:0:13406:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003378cd90 reply state 00000000bb59db30 transno 8589938669 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d369a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201240.868692:0:13406:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201240.868723:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d368c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c18 expref: 31 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.868737:0:13406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d36a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c18 expref: 30 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.868749:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f6:0x0].0x0 (ffff9e03c5173e00) 00010000:00010000:1.0:1788201240.868751:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201240.868753:0:13406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2e00, rc 0) 00000100:00100000:1.0:1788201240.868840:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c24a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+31:14299:x1875064442640512:12345-192.168.201.30@tcp:101:touch.0 Request processed in 1237us (1611us total) trans 8589938669 rc 0/0 00000100:00100000:1.0:1788201240.868849:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5112 00010000:00010000:2.0:1788201240.875450:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d369a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.875469:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d369a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.875477:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d369a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.875483:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201240.875498:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d369a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.875510:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d369a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.875528:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0xef09e6ea (ffff9e03c5173f00) 00010000:00010000:2.0:1788201240.875531:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201240.875535:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d369a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.875541:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d369a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201240.880075:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201240.880510:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442640768 00000100:00100000:0.0:1788201240.880528:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442640768 00000100:00100000:0.0:1788201240.880610:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5113 00000100:00100000:0.0:1788201240.880623:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c24a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+30:14299:x1875064442640768:12345-192.168.201.30@tcp:36:touch.0 00010000:00010000:0.0:1788201240.880693:0:12971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201240.880724:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d36a1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c18 expref: 30 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.880745:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f6:0x0].0x0 (ffff9e03c5173e00) 00010000:00010000:0.0:1788201240.880757:0:12971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201240.880804:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d36af lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.880818:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d36af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.880828:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d36af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201240.880970:0:12971:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e5c47d5 reply state 00000000d8344bbb transno 8589938670 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d36af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201240.880979:0:12971:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201240.881083:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c24a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+31:14299:x1875064442640768:12345-192.168.201.30@tcp:36:touch.0 Request processed in 463us (1023us total) trans 8589938670 rc 0/0 00000100:00100000:0.0:1788201240.881091:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5113 00010000:00010000:2.0:1788201240.885007:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d36af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.885027:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d36af lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.885035:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d36af lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.885041:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201240.885046:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d36af lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.885054:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d36af lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.885070:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f6:0x0].0x0 (ffff9e03c2fc5200) 00010000:00010000:2.0:1788201240.885072:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201240.885077:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d36af lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.885083:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d36af lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201240.885979:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201240.886071:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442640896 00000100:00100000:1.0:1788201240.886083:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442640896 00000100:00100000:1.0:1788201240.886158:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5114 00000100:00100000:1.0:1788201240.886168:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c24a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+30:14299:x1875064442640896:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:1.0:1788201240.886193:0:12969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201240.886216:0:12969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d36b6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4c1f expref: -99 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.886273:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d36b6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c1f expref: 31 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.886285:0:12969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d36b6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c1f expref: 31 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.886626:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f6:0x0].0x0 (ffff9e03c5173800) 00010000:00010000:1.0:1788201240.886629:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201240.886632:0:12969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2000, rc 0) 00000100:00100000:1.0:1788201240.886741:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c24a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+31:14299:x1875064442640896:12345-192.168.201.30@tcp:101:touch.0 Request processed in 573us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201240.886752:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5114 00000100:00100000:3.0:1788201240.892717:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201240.894806:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442641024 00000100:00100000:0.0:1788201240.894822:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442641024 00000100:00100000:2.0:1788201240.896662:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4183 00000100:00100000:2.0:1788201240.896677:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d80f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2359:x1875064442641024:12345-192.168.201.30@tcp:2:touch.0 00000100:00100000:2.0:1788201240.897044:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d80f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2359:x1875064442641024:12345-192.168.201.30@tcp:2:touch.0 Request processed in 368us (4340us total) trans 4294968845 rc 0/0 00000100:00100000:2.0:1788201240.897053:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4183 00000100:00100000:3.0:1788201240.902012:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201240.902132:0:12973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442641280 00000100:00100000:1.0:1788201240.902144:0:12973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442641280 00000100:00100000:1.0:1788201240.902208:0:12973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1028 00000100:00100000:1.0:1788201240.902220:0:12973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d80f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+31:14299:x1875064442641280:12345-192.168.201.30@tcp:35:touch.0 00000100:00100000:1.0:1788201240.902743:0:12973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d80f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+32:14299:x1875064442641280:12345-192.168.201.30@tcp:35:touch.0 Request processed in 524us (740us total) trans 8589938671 rc 0/0 00000100:00100000:1.0:1788201240.902751:0:12973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1028 00000100:00100000:3.0:1788201240.919180:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201240.919326:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442641536 00000100:00100000:2.0:1788201240.919341:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442641536 00000100:00100000:2.0:1788201240.919478:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5115 00000100:00100000:2.0:1788201240.919497:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d80f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+32:14300:x1875064442641536:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:2.0:1788201240.919523:0:13379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201240.919546:0:13379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d36bd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4c26 expref: -99 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.919668:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d36c4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.919682:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d36c4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.919693:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d36c4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.919707:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d36cb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.919719:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d36cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.919725:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d36cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201240.920181:0:13379:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x41c:0x0], index 0: 0 00010000:00010000:2.0:1788201240.920352:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d36d2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.920361:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d36d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.920370:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d36d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.920398:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d36c4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.920405:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d36c4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.920412:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d36c4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.920418:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201240.920422:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d36c4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.920429:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d36c4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.920459:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:2.0:1788201240.920462:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201240.920466:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d36c4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.920472:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d36c4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201240.920487:0:13379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d831ee79 reply state 00000000f62a4690 transno 8589938672 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d36cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201240.920496:0:13379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201240.920523:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d36bd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c26 expref: 35 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.920535:0:13379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d36d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c26 expref: 34 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.920542:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f7:0x0].0x0 (ffff9e03c33ed500) 00010000:00010000:2.0:1788201240.920544:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201240.920547:0:13379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031400, rc 0) 00000100:00100000:2.0:1788201240.920617:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d80f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+35:14300:x1875064442641536:12345-192.168.201.30@tcp:101:touch.0 Request processed in 1130us (1451us total) trans 8589938672 rc 0/0 00000100:00100000:2.0:1788201240.920624:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5115 00000100:00100000:3.0:1788201240.926556:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201240.926694:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442641792 00000100:00100000:1.0:1788201240.926705:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442641792 00000100:00100000:1.0:1788201240.926763:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5116 00000100:00100000:1.0:1788201240.926772:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d80f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+35:14300:x1875064442641792:12345-192.168.201.30@tcp:36:touch.0 00010000:00010000:1.0:1788201240.926826:0:12971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201240.926851:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d36d2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c26 expref: 35 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.926872:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f7:0x0].0x0 (ffff9e03c33ed500) 00010000:00010000:1.0:1788201240.926881:0:12971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201240.926930:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d36e0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.926947:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d36e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.926956:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d36e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.926986:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d36cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.926994:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d36cb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.927000:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d36cb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.927006:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201240.927009:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d36cb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.927016:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d36cb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.927025:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x37639fea (ffff9e03c33edd00) 00010000:00010000:0.0:1788201240.927029:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201240.927032:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d36cb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.927037:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d36cb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201240.927106:0:12971:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031eb5c73 reply state 00000000ff778924 transno 8589938673 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d36e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201240.927116:0:12971:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201240.927228:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d80f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+35:14300:x1875064442641792:12345-192.168.201.30@tcp:36:touch.0 Request processed in 456us (682us total) trans 8589938673 rc 0/0 00000100:00100000:1.0:1788201240.927235:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5116 00010000:00010000:2.0:1788201240.931796:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d36e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.931812:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d36e0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.931820:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d36e0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.931826:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201240.931831:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d36e0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.931837:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d36e0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.931854:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f7:0x0].0x0 (ffff9e03c5173600) 00010000:00010000:2.0:1788201240.931857:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201240.931862:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d36e0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.931868:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d36e0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201240.935114:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201240.936208:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442641920 00000100:00100000:1.0:1788201240.936224:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442641920 00000100:00100000:1.0:1788201240.936340:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5117 00000100:00100000:1.0:1788201240.936353:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+34:14300:x1875064442641920:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:1.0:1788201240.936391:0:12969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201240.936422:0:12969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d36e7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4c2d expref: -99 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.936510:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d36e7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c2d expref: 35 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.936527:0:12969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d36e7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c2d expref: 35 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201240.936548:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f7:0x0].0x0 (ffff9e03c5173b00) 00010000:00010000:1.0:1788201240.936552:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201240.936556:0:12969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3800, rc 0) 00000100:00100000:1.0:1788201240.936640:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+35:14300:x1875064442641920:12345-192.168.201.30@tcp:101:touch.0 Request processed in 290us (1541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201240.936653:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5117 00000100:00100000:3.0:1788201240.944837:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201240.945125:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442642048 00000100:00100000:0.0:1788201240.945141:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442642048 00000100:00100000:0.0:1788201240.945226:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4184 00000100:00100000:0.0:1788201240.945237:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35604eb4-baf9-45be-a20a-4883a2cd8cf9+507:2359:x1875064442642048:12345-192.168.201.30@tcp:2:touch.0 00000100:00100000:0.0:1788201240.945817:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2359:x1875064442642048:12345-192.168.201.30@tcp:2:touch.0 Request processed in 580us (994us total) trans 4294968846 rc 0/0 00000100:00100000:0.0:1788201240.945825:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4184 00000100:00100000:0.0:1788201240.948624:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201240.950598:0:13381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442642304 00000100:00100000:1.0:1788201240.950622:0:13381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442642304 00000100:00100000:1.0:1788201240.950741:0:13381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1029 00000100:00100000:1.0:1788201240.950754:0:13381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+35:14300:x1875064442642304:12345-192.168.201.30@tcp:35:touch.0 00000100:00100000:1.0:1788201240.951252:0:13381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+36:14300:x1875064442642304:12345-192.168.201.30@tcp:35:touch.0 Request processed in 498us (2637us total) trans 8589938674 rc 0/0 00000100:00100000:1.0:1788201240.951261:0:13381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1029 00000100:00100000:3.0:1788201240.969272:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201240.969802:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442642560 00000100:00100000:2.0:1788201240.969813:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442642560 00000100:00100000:2.0:1788201240.969876:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5118 00000100:00100000:2.0:1788201240.969887:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+36:14301:x1875064442642560:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:2.0:1788201240.969911:0:13379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201240.969932:0:13379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d36ee lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4c34 expref: -99 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.970062:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d36f5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.970081:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d36f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.970092:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d36f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.970107:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d36fc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.970114:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d36fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.970121:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d36fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201240.970840:0:13379:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x41c:0x0], index 1: 0 00010000:00010000:2.0:1788201240.971005:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3703 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.971018:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3703 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.971027:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3703 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.971061:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d36f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.971069:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d36f5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.971077:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d36f5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.971085:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201240.971089:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d36f5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.971097:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d36f5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.971110:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:2.0:1788201240.971113:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201240.971117:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d36f5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.971124:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d36f5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201240.971140:0:13379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cbdd279f reply state 000000005c2d4e55 transno 8589938675 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d36fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201240.971149:0:13379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201240.971179:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d36ee lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c34 expref: 39 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.971193:0:13379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3703 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c34 expref: 38 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.971200:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f8:0x0].0x0 (ffff9e03c33ed300) 00010000:00010000:2.0:1788201240.971203:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201240.971206:0:13379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031c00, rc 0) 00000100:00100000:2.0:1788201240.971284:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+39:14301:x1875064442642560:12345-192.168.201.30@tcp:101:touch.0 Request processed in 1394us (2020us total) trans 8589938675 rc 0/0 00010000:00010000:0.0:1788201240.972872:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d36fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.972892:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d36fc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.972901:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d36fc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.972908:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201240.972913:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d36fc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.972921:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d36fc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.972936:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x7fbd58ea (ffff9e03c33edc00) 00010000:00010000:0.0:1788201240.972939:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201240.972944:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d36fc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.972950:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d36fc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201240.973251:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5118 00000100:00100000:3.0:1788201240.979378:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201240.979428:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442642816 00000100:00100000:0.0:1788201240.979446:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442642816 00000100:00100000:0.0:1788201240.979537:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5119 00000100:00100000:0.0:1788201240.979545:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+38:14301:x1875064442642816:12345-192.168.201.30@tcp:36:touch.0 00010000:00010000:0.0:1788201240.979596:0:12971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201240.979618:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3703 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c34 expref: 38 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.979636:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f8:0x0].0x0 (ffff9e03c33ed300) 00010000:00010000:0.0:1788201240.979644:0:12971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201240.979682:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d3711 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.979693:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d3711 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201240.979699:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d3711 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201240.979816:0:12971:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4e72679 reply state 00000000c33df06c transno 8589938676 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d3711 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201240.979823:0:12971:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201240.979911:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+39:14301:x1875064442642816:12345-192.168.201.30@tcp:36:touch.0 Request processed in 366us (543us total) trans 8589938676 rc 0/0 00000100:00100000:0.0:1788201240.979917:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5119 00010000:00010000:2.0:1788201240.983227:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d3711 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.983240:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d3711 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.983245:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d3711 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.983249:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201240.983252:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d3711 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.983256:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d3711 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.983268:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f8:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:2.0:1788201240.983270:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201240.983273:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d3711 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201240.983276:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d3711 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201240.985822:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201240.985988:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442642944 00000100:00100000:3.0:1788201240.985997:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442642944 00000100:00100000:3.0:1788201240.986741:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5120 00000100:00100000:3.0:1788201240.986756:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+38:14301:x1875064442642944:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:3.0:1788201240.986782:0:12968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201240.986801:0:12968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016400/0x9383f985bc4d3718 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4c3b expref: -99 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.986860:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016400/0x9383f985bc4d3718 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c3b expref: 39 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.986871:0:12968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016400/0x9383f985bc4d3718 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c3b expref: 39 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201240.986883:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f8:0x0].0x0 (ffff9e03c33e8400) 00010000:00010000:3.0:1788201240.986885:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201240.986888:0:12968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c3016400, rc 0) 00000100:00100000:3.0:1788201240.986939:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+39:14301:x1875064442642944:12345-192.168.201.30@tcp:101:touch.0 Request processed in 189us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201240.986946:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5120 00000100:00100000:0.0:1788201240.997140:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201240.999758:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442643072 00000100:00100000:1.0:1788201240.999774:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442643072 00000100:00100000:0.0:1788201240.999922:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4185 00000100:00100000:0.0:1788201240.999933:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2361:x1875064442643072:12345-192.168.201.30@tcp:2:touch.0 00000100:00100000:0.0:1788201241.000626:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:2361:x1875064442643072:12345-192.168.201.30@tcp:2:touch.0 Request processed in 690us (3492us total) trans 4294968846 rc 0/0 00000100:00100000:0.0:1788201241.000636:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4185 00000100:00100000:0.0:1788201241.009403:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201241.012417:0:12972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442643328 00000100:00100000:3.0:1788201241.012445:0:12972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442643328 00000100:00100000:3.0:1788201241.012665:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1030 00000100:00100000:3.0:1788201241.012676:0:12972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c67da050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+39:14301:x1875064442643328:12345-192.168.201.30@tcp:35:touch.0 00000100:00100000:3.0:1788201241.013032:0:12972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c67da050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+40:14301:x1875064442643328:12345-192.168.201.30@tcp:35:touch.0 Request processed in 357us (3744us total) trans 8589938677 rc 0/0 00000100:00100000:3.0:1788201241.013041:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1030 00010000:00010000:0.0:1788201241.446147:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201241.832762:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5028700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458220416:0@lo:400:kworker.0 00000100:00100000:1.0:1788201241.832836:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201241.832882:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c502a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875064458220928:0@lo:400:kworker.0 00000100:00100000:1.0:1788201241.832901:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201241.832919:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788201241.832924:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c502b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458220288:0@lo:400:kworker.0 00000100:00100000:1.0:1788201241.832946:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201241.832965:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5029f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458220800:0@lo:400:kworker.0 00000100:00100000:1.0:1788201241.832984:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201241.833006:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c502b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458220544:0@lo:400:kworker.0 00000100:00100000:1.0:1788201241.833024:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201241.833047:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201241.833051:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5029880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458220672:0@lo:400:kworker.0 00000100:00100000:1.0:1788201241.833071:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201241.833099:0:12965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458220288 00000100:00100000:1.0:1788201241.833106:0:12965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458220288 00000100:00100000:1.0:1788201241.833152:0:12965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788201241.833160:0:12965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f950cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458220288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201241.833204:0:12965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f950cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458220288:12345-0@lo:400:kworker.0 Request processed in 44us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201241.833211:0:12965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788201241.833244:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458220800 00000100:00100000:1.0:1788201241.833247:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458220800 00000100:00100000:1.0:1788201241.833276:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458220672 00000100:00100000:1.0:1788201241.833278:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458220672 00000100:00100000:1.0:1788201241.833322:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788201241.833329:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5029180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+7:3311:x1875064458220800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201241.833357:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5029180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+7:3311:x1875064458220800:12345-0@lo:400:kworker.0 Request processed in 30us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201241.833363:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788201241.833372:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788201241.833377:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f965c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+8:3312:x1875064458220672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201241.833426:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f965c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+8:3312:x1875064458220672:12345-0@lo:400:kworker.0 Request processed in 40us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201241.833433:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:1.0:1788201241.833568:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201241.833572:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201241.833605:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5029880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458220672:0@lo:400:kworker.0 00000100:00100000:1.0:1788201241.833625:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c502b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458220288:0@lo:400:kworker.0 00000100:00100000:1.0:1788201241.833633:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5029f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458220800:0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.833944:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458220416 00000100:00100000:2.0:1788201241.833949:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458220416 00000100:00100000:2.0:1788201241.833982:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458220928 00000100:00100000:2.0:1788201241.833984:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458220928 00000100:00100000:2.0:1788201241.833999:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458220544 00000100:00100000:2.0:1788201241.834001:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458220544 00000100:00100000:2.0:1788201241.834016:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788201241.834022:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875064458220416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.834063:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875064458220416:12345-0@lo:400:kworker.0 Request processed in 42us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201241.834069:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788201241.834081:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788201241.834086:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c502b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875064458220928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.834109:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c502b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875064458220928:12345-0@lo:400:kworker.0 Request processed in 23us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201241.834114:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788201241.834123:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788201241.834128:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c502bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458220544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.834152:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c502bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458220544:12345-0@lo:400:kworker.0 Request processed in 24us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201241.834158:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1788201241.834176:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201241.834192:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c502b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458220544:0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.834210:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5028700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458220416:0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.834218:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c502a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875064458220928:0@lo:400:kworker.0 00000100:00100000:2.0:1788201242.012127:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201242.012170:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201242.012205:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201242.012341:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442643584 00000100:00100000:0.0:1788201242.012353:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442643584 00000100:00100000:0.0:1788201242.012441:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 78 00000100:00100000:0.0:1788201242.012453:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+40:2362:x1875064442643584:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201242.012455:0:12964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442643456 00000100:00100000:3.0:1788201242.012459:0:12964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442643456 00000100:00100000:3.0:1788201242.012504:0:12964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 107 00000100:00100000:3.0:1788201242.012511:0:12964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f950c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2361:x1875064442643456:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201242.012543:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+40:2362:x1875064442643584:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 88us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201242.012552:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 78 00000100:00080000:0.0:1788201242.012577:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201242.012623:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442643840 00000100:00100000:2.0:1788201242.012627:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442643840 00000100:00100000:2.0:1788201242.012664:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 143 00000100:00100000:2.0:1788201242.012672:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:2362:x1875064442643840:12345-192.168.201.30@tcp:400:kworker.0 00000100:00080000:1.0:1788201242.025563:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201242.028039:0:12964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f950c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2361:x1875064442643456:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 15515us (15908us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201242.028057:0:12964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 107 00000100:00100000:0.0:1788201242.031373:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201242.031538:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:2362:x1875064442643840:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 18863us (19328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201242.031553:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 143 00000100:00100000:2.0:1788201242.031615:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442643712 00000100:00100000:2.0:1788201242.031624:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442643712 00000100:00080000:2.0:1788201242.031652:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201242.031691:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 144 00000100:00100000:2.0:1788201242.031701:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2361:x1875064442643712:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201242.031760:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2361:x1875064442643712:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 61us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201242.031767:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 144 00000100:00100000:0.0:1788201242.123965:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201242.124085:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442643968 00000100:00100000:2.0:1788201242.124096:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442643968 00000100:00100000:2.0:1788201242.124155:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5121 00000100:00100000:2.0:1788201242.124165:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+40:14312:x1875064442643968:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1788201242.124186:0:13406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201242.124208:0:13406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d371f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4c42 expref: -99 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.124272:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d3726 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.124286:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d3726 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.124337:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d3726 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.124357:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d372d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.124365:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d372d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.124371:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d372d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.124479:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3734 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.124488:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3734 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.124495:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3734 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201242.124530:0:13406:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f2:0x0]: returning size 0 00000004:00200000:2.0:1788201242.124534:0:13406:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201242.124557:0:13406:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3734 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.124567:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3734 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.124576:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d3726 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.124582:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d3726 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.124593:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d3726 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.124599:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201242.124603:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d3726 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.124610:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d3726 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.124621:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:2.0:1788201242.124624:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201242.124628:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d3726 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.124633:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d3726 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.124644:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d372d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.124650:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d372d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.124656:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d372d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.124661:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201242.124663:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d372d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.124673:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d372d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.124680:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0xcda302ea (ffff9e03c33edc00) 00010000:00010000:2.0:1788201242.124682:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201242.124685:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d372d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.124691:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d372d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.124994:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d371f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c42 expref: 42 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.125011:0:13406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3734 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c42 expref: 41 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.125017:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f2:0x0].0x0 (ffff9e03c2fc5700) 00010000:00010000:2.0:1788201242.125020:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201242.125022:0:13406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031c00, rc 0) 00000100:00100000:2.0:1788201242.125178:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+41:14312:x1875064442643968:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 1013us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201242.125185:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5121 00000100:00100000:2.0:1788201242.131603:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201242.135642:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442644096 00000100:00100000:1.0:1788201242.135658:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442644096 00000100:00100000:1.0:1788201242.135722:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5122 00000100:00100000:1.0:1788201242.135733:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+41:14313:x1875064442644096:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1788201242.135754:0:12971:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201242.135779:0:12971:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d373b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4c49 expref: -99 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.135848:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d3742 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.135863:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d3742 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.135874:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d3742 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.135888:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d3749 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.135894:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d3749 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.135900:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d3749 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.135997:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3750 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.136005:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3750 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.136012:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3750 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201242.136043:0:12971:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f3:0x0]: returning size 0 00000004:00200000:1.0:1788201242.136047:0:12971:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201242.136065:0:12971:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3750 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.136076:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3750 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.136084:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d3742 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.136090:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d3742 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.136097:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d3742 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.136103:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201242.136107:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d3742 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.136113:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d3742 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.136124:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:1.0:1788201242.136127:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201242.136132:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d3742 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.136142:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d3742 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.136154:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d3749 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.136160:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d3749 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.136165:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d3749 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.136171:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201242.136173:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d3749 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.136179:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d3749 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.136185:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x15fcbbea (ffff9e03c5173000) 00010000:00010000:1.0:1788201242.136188:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201242.136191:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d3749 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.136196:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d3749 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.136228:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d373b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c49 expref: 43 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.136244:0:12971:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3750 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c49 expref: 42 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.136250:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f3:0x0].0x0 (ffff9e03c2fc5c00) 00010000:00010000:1.0:1788201242.136252:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201242.136254:0:12971:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2800, rc 0) 00000100:00100000:1.0:1788201242.136358:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+42:14313:x1875064442644096:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 626us (4762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201242.136367:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5122 00000100:00100000:3.0:1788201242.159613:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201242.159648:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201242.159676:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442644224 00000100:00100000:3.0:1788201242.159685:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442644224 00000100:00100000:3.0:1788201242.159741:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4186 00000100:00100000:3.0:1788201242.159752:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:2360:x1875064442644224:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1788201242.159773:0:13438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201242.159795:0:13438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1124bc0/0x9383f985bc4d3757 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4c50 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201242.159822:0:13438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x419:0x0] initial LVB size: 0, mtime: 0x6a95c918, atime: 0x6a95c918, ctime: 0x6a95c918, blocks: 0x1 00010000:00010000:3.0:1788201242.159840:0:13438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x419:0x0].0x0 since=517s v=(0 0) 00010000:00010000:3.0:1788201242.159845:0:13438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x419:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201242.159854:0:13438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1124bc0/0x9383f985bc4d3757 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c50 expref: 10 pid: 13438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.159874:0:13438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e1124bc0/0x9383f985bc4d3757 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c50 expref: 10 pid: 13438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.159887:0:13438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c3016c00, rc 0) 00000100:00100000:3.0:1788201242.159936:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2360:x1875064442644224:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 185us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201242.159943:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4186 00000100:00100000:3.0:1788201242.159967:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442644352 00000100:00100000:3.0:1788201242.159970:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442644352 00000100:00100000:3.0:1788201242.159994:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5123 00000100:00100000:3.0:1788201242.160000:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+42:14314:x1875064442644352:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1788201242.160009:0:12969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201242.160021:0:12969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017400/0x9383f985bc4d375e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4c57 expref: -99 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.160072:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d3765 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.160083:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d3765 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.160092:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d3765 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.160106:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d376c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.160112:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d376c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.160118:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d376c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.160199:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016000/0x9383f985bc4d3773 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.160207:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016000/0x9383f985bc4d3773 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.160213:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016000/0x9383f985bc4d3773 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201242.160243:0:12969:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f4:0x0]: returning size 0 00000004:00200000:3.0:1788201242.160246:0:12969:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201242.160261:0:12969:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016000/0x9383f985bc4d3773 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.160270:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016000/0x9383f985bc4d3773 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.160277:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d3765 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.160284:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d3765 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.160330:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d3765 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.160337:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201242.160340:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d3765 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.160348:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d3765 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.160358:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:3.0:1788201242.160361:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201242.160364:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d3765 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.160370:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017800/0x9383f985bc4d3765 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.160380:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d376c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.160385:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d376c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.160390:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d376c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.160395:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201242.160398:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d376c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.160407:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d376c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.160427:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x5e5674ea (ffff9e03c33e8100) 00010000:00010000:3.0:1788201242.160430:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201242.160433:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d376c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.160438:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017e00/0x9383f985bc4d376c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.160470:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017400/0x9383f985bc4d375e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c57 expref: 44 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.160480:0:12969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016000/0x9383f985bc4d3773 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c57 expref: 43 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.160487:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f4:0x0].0x0 (ffff9e03c2fc5000) 00010000:00010000:3.0:1788201242.160489:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201242.160491:0:12969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c3016000, rc 0) 00000100:00100000:3.0:1788201242.160517:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+43:14314:x1875064442644352:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 516us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201242.160524:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5123 00000100:00100000:3.0:1788201242.161181:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201242.162211:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442644480 00000100:00100000:1.0:1788201242.162221:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442644480 00000100:00100000:1.0:1788201242.162273:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4187 00000100:00100000:1.0:1788201242.162283:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2361:x1875064442644480:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1788201242.162731:0:13439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201242.162754:0:13439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d377a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4c5e expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201242.162782:0:13439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x41a:0x0] initial LVB size: 0, mtime: 0x6a95c918, atime: 0x6a95c918, ctime: 0x6a95c918, blocks: 0x1 00010000:00010000:1.0:1788201242.162799:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41a:0x0].0x0 since=517s v=(0 0) 00010000:00010000:1.0:1788201242.162803:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201242.162813:0:13439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d377a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c5e expref: 509 pid: 13439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.162831:0:13439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d377a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c5e expref: 509 pid: 13439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.162848:0:13439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3e00, rc 0) 00000100:00100000:1.0:1788201242.162908:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2361:x1875064442644480:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 627us (1728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201242.162915:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4187 00000100:00100000:3.0:1788201242.166671:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201242.166714:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442644608 00000100:00100000:3.0:1788201242.166723:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442644608 00000100:00100000:3.0:1788201242.166774:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5124 00000100:00100000:3.0:1788201242.166784:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+43:14315:x1875064442644608:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1788201242.166806:0:13406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201242.166827:0:13406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d3781 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4c65 expref: -99 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.166894:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d3788 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.166907:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d3788 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.166918:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d3788 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.166932:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017200/0x9383f985bc4d378f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.166938:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017200/0x9383f985bc4d378f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.166944:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017200/0x9383f985bc4d378f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.167036:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017a00/0x9383f985bc4d3796 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.167044:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017a00/0x9383f985bc4d3796 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.167051:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017a00/0x9383f985bc4d3796 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201242.167084:0:13406:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f5:0x0]: returning size 0 00000004:00200000:3.0:1788201242.167088:0:13406:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201242.167106:0:13406:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017a00/0x9383f985bc4d3796 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.167116:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017a00/0x9383f985bc4d3796 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.167124:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d3788 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.167129:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d3788 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.167135:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d3788 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.167142:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3016600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201242.167145:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d3788 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.167152:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d3788 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.167162:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:3.0:1788201242.167165:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201242.167169:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d3788 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.167175:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016600/0x9383f985bc4d3788 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.167193:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017200/0x9383f985bc4d378f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.167199:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017200/0x9383f985bc4d378f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.167205:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017200/0x9383f985bc4d378f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.167211:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c3017200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201242.167213:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017200/0x9383f985bc4d378f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.167218:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017200/0x9383f985bc4d378f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.167225:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0xa6b02dea (ffff9e03c33e8000) 00010000:00010000:3.0:1788201242.167227:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201242.167230:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017200/0x9383f985bc4d378f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.167235:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017200/0x9383f985bc4d378f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.167266:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017600/0x9383f985bc4d3781 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c65 expref: 45 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.167280:0:13406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017a00/0x9383f985bc4d3796 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c65 expref: 44 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.168399:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f5:0x0].0x0 (ffff9e03c5173d00) 00010000:00010000:3.0:1788201242.168407:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201242.168420:0:13406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c3017a00, rc 0) 00000100:00100000:3.0:1788201242.168489:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+44:14315:x1875064442644608:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 1703us (1825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201242.168497:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5124 00000100:00100000:3.0:1788201242.175820:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201242.175861:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442644864 00000100:00100000:3.0:1788201242.175871:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442644864 00000100:00100000:3.0:1788201242.175923:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5125 00000100:00100000:3.0:1788201242.175932:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+44:14313:x1875064442644864:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:3.0:1788201242.175987:0:13379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201242.176013:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3750 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c49 expref: 44 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.176029:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f3:0x0].0x0 (ffff9e03c2fc5c00) 00010000:00010000:3.0:1788201242.176033:0:13379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201242.176064:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d379d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.176077:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d379d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.176087:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d379d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201242.178724:0:13379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac57def6 reply state 0000000098c78b3d transno 8589938678 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d379d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201242.178744:0:13379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:02000000:3.0:1788201242.178798:0:13379:0:(ldlm_lib.c:3355:target_send_reply_msg()) *** cfs_fail_loc=15a, val=0*** 00000100:00100000:0.0:1788201242.180722:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201242.180765:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201242.180797:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442645248 00000100:00100000:0.0:1788201242.180806:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442645248 00000100:00100000:0.0:1788201242.180861:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4188 00000100:00100000:0.0:1788201242.180871:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2362:x1875064442645248:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1788201242.180890:0:13449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201242.180912:0:13449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d37a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4c6c expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201242.180938:0:13449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x41a:0x0] initial LVB size: 0, mtime: 0x6a95c918, atime: 0x6a95c918, ctime: 0x6a95c918, blocks: 0x1 00010000:00010000:0.0:1788201242.180957:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41a:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1788201242.180963:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201242.180972:0:13449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d37a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c6c expref: 11 pid: 13449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.180989:0:13449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d37a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c6c expref: 11 pid: 13449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.181004:0:13449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc7600, rc 0) 00000100:00100000:0.0:1788201242.181057:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:2362:x1875064442645248:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 188us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201242.181064:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4188 00000100:00100000:0.0:1788201242.181092:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442645120 00000100:00100000:0.0:1788201242.181096:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442645120 00000100:00100000:0.0:1788201242.181122:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5126 00000100:00100000:0.0:1788201242.181129:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+46:14312:x1875064442645120:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:0.0:1788201242.181168:0:12968:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201242.181190:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3734 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c42 expref: 46 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.181206:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f2:0x0].0x0 (ffff9e03c2fc5700) 00010000:00010000:0.0:1788201242.181210:0:12968:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201242.181236:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d37ab lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.181247:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d37ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.181256:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d37ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201242.184476:0:12968:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000089c1ace4 reply state 0000000049bb067f transno 8589938679 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d37ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201242.184493:0:12968:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:02000000:0.0:1788201242.184556:0:12968:0:(ldlm_lib.c:3355:target_send_reply_msg()) *** cfs_fail_loc=15a, val=0*** 00010000:00080000:0.0:1788201242.184560:0:12968:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788201242.184591:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+47:14312:x1875064442645120:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 3458us (3821us total) trans 8589938679 rc 0/0 00000100:00100000:0.0:1788201242.184601:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5126 00010000:00080000:3.0:1788201242.188318:0:13379:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788201242.188351:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+46:14313:x1875064442644864:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 12411us (12530us total) trans 8589938678 rc 0/0 00000100:00100000:3.0:1788201242.188363:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5125 00010000:00010000:2.0:1788201242.188822:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d37ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.188834:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d37ab lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.188843:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d37ab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.188851:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201242.188856:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d37ab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.188863:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d37ab lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.188881:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f2:0x0].0x0 (ffff9e03c2fc5700) 00010000:00010000:2.0:1788201242.188885:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788201242.188889:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d37ab lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.188894:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d37ab lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.189454:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d379d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.189462:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d379d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.189468:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d379d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.189473:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201242.189477:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d379d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.189483:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d379d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.189493:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f3:0x0].0x0 (ffff9e03c2fc5c00) 00010000:00010000:0.0:1788201242.189496:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788201242.189499:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d379d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.189505:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d379d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201242.193210:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201242.193595:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442645376 00000100:00100000:3.0:1788201242.193606:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442645376 00000100:00100000:3.0:1788201242.193700:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5127 00000100:00100000:3.0:1788201242.193712:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+44:14316:x1875064442645376:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1788201242.193736:0:13406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201242.193758:0:13406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d37b2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4c73 expref: -99 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.193848:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d37b9 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.193862:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d37b9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.193874:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d37b9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.193890:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d37c0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.193897:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d37c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.193907:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d37c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.194009:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d37c7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.194017:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d37c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.194024:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d37c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201242.194056:0:13406:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f6:0x0]: returning size 0 00000004:00200000:3.0:1788201242.194060:0:13406:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201242.194076:0:13406:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d37c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.194087:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d37c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.194094:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d37b9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.194101:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d37b9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.194108:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d37b9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.194114:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bca00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201242.194118:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d37b9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.194125:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d37b9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.194136:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:3.0:1788201242.194139:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201242.194143:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d37b9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.194149:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d37b9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.194161:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d37c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.194167:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d37c0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.194173:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d37c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.194178:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bce00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201242.194180:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d37c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.194185:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d37c0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.194191:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0xef09e6ea (ffff9e03c33e8000) 00010000:00010000:3.0:1788201242.194193:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201242.194196:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d37c0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.194202:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d37c0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.194229:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d37b2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c73 expref: 46 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.194242:0:13406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d37c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c73 expref: 45 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.194249:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f6:0x0].0x0 (ffff9e03c5173800) 00010000:00010000:3.0:1788201242.194251:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201242.194254:0:13406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bc600, rc 0) 00000100:00100000:3.0:1788201242.194504:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+45:14316:x1875064442645376:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 792us (1304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201242.194512:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5127 00000100:00100000:0.0:1788201242.195812:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201242.196093:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442645504 00000100:00100000:1.0:1788201242.196101:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442645504 00000100:00100000:1.0:1788201242.196176:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5128 00000100:00100000:1.0:1788201242.196186:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+45:14318:x1875064442645504:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1788201242.196204:0:12971:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201242.196222:0:12971:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d37ce lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4c7a expref: -99 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.196283:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d37d5 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.196324:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d37d5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.196336:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d37d5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.196351:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d37dc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.196357:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d37dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.196363:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d37dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.196458:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d37e3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.196467:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d37e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.196474:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d37e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201242.196508:0:12971:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f8:0x0]: returning size 0 00000004:00200000:1.0:1788201242.196512:0:12971:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201242.196683:0:12971:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d37e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.196695:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d37e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.196703:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d37d5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.196708:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d37d5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.196715:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d37d5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.196721:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201242.196725:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d37d5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.196733:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d37d5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.196744:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:1.0:1788201242.196747:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201242.196751:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d37d5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.196757:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d37d5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.196767:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d37dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.196774:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d37dc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.196779:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d37dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.196784:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201242.196787:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d37dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.196792:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d37dc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.196798:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x7fbd58ea (ffff9e03c5173300) 00010000:00010000:1.0:1788201242.196800:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201242.196803:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d37dc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.196808:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d37dc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.196836:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d37ce lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c7a expref: 47 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.196849:0:12971:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d37e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c7a expref: 46 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.196857:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f8:0x0].0x0 (ffff9e03c33e8400) 00010000:00010000:1.0:1788201242.196859:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201242.196861:0:12971:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3200, rc 0) 00000100:00100000:1.0:1788201242.196917:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+46:14318:x1875064442645504:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 733us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201242.196924:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5128 00000100:00100000:2.0:1788201242.199595:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201242.199668:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442645632 00000100:00100000:3.0:1788201242.199678:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442645632 00000100:00100000:3.0:1788201242.199740:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4189 00000100:00100000:3.0:1788201242.199751:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2359:x1875064442645632:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1788201242.199771:0:6703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201242.199792:0:6703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de2b048b/0x9383f985bc4d37ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4c81 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201242.199821:0:6703:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x41b:0x0] initial LVB size: 0, mtime: 0x6a95c918, atime: 0x6a95c918, ctime: 0x6a95c918, blocks: 0x1 00010000:00010000:3.0:1788201242.199839:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41b:0x0].0x0 since=517s v=(0 0) 00010000:00010000:3.0:1788201242.199844:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201242.199853:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de2b048b/0x9383f985bc4d37ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c81 expref: 510 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.199869:0:6703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000de2b048b/0x9383f985bc4d37ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c81 expref: 510 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.199881:0:6703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bd600, rc 0) 00000100:00100000:3.0:1788201242.199944:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+510:2359:x1875064442645632:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 194us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201242.199951:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4189 00000100:00100000:0.0:1788201242.209097:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201242.209156:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201242.209201:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201242.209216:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442645888 00000100:00100000:3.0:1788201242.209227:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442645888 00000100:00100000:0.0:1788201242.209232:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201242.209261:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201242.209289:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5129 00000100:00100000:3.0:1788201242.209339:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+46:14314:x1875064442645888:12345-192.168.201.30@tcp:36:chmod.0 00000100:00100000:0.0:1788201242.209341:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201242.209367:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442646144 00000100:00100000:0.0:1788201242.209372:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442646144 00010000:00010000:3.0:1788201242.209399:0:12969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788201242.209404:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442646528 00000100:00100000:0.0:1788201242.209409:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442646528 00010000:00010000:3.0:1788201242.209439:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016000/0x9383f985bc4d3773 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c57 expref: 46 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201242.209448:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4190 00010000:00010000:3.0:1788201242.209464:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f4:0x0].0x0 (ffff9e03c2fc5000) 00010000:00010000:3.0:1788201242.209470:0:12969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201242.209471:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:2360:x1875064442646144:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1788201242.209484:0:12363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201242.209504:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d37f1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.209505:0:12363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f0ecd86/0x9383f985bc4d37f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4ce3 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.209534:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d37f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201242.209538:0:12363:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x41c:0x0] initial LVB size: 0, mtime: 0x6a95c918, atime: 0x6a95c918, ctime: 0x6a95c918, blocks: 0x1 00010000:00010000:3.0:1788201242.209553:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d37f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.209561:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41c:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1788201242.209568:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201242.209577:0:12363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f0ecd86/0x9383f985bc4d37f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ce3 expref: 13 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.209594:0:12363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009f0ecd86/0x9383f985bc4d37f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ce3 expref: 13 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.209606:0:12363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc7c00, rc 0) 00000100:00100000:0.0:1788201242.209665:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:2360:x1875064442646144:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 207us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201242.209676:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4190 00000100:00100000:0.0:1788201242.209699:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4191 00000100:00100000:0.0:1788201242.209706:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:2362:x1875064442646528:12345-192.168.201.30@tcp:101:ll_sa.0 00010000:00010000:0.0:1788201242.209714:0:12363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201242.209724:0:12363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000558b5a3d/0x9383f985bc4d37ff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4d1b expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201242.209739:0:12363:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x41b:0x0] initial LVB size: 0, mtime: 0x6a95c918, atime: 0x6a95c918, ctime: 0x6a95c918, blocks: 0x1 00010000:00010000:0.0:1788201242.209751:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41b:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1788201242.209754:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201242.209760:0:12363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000558b5a3d/0x9383f985bc4d37ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d1b expref: 13 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201242.209762:0:12969:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000592792f3 reply state 00000000567bc03f transno 8589938680 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d37f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201242.209778:0:12969:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201242.209781:0:12363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000558b5a3d/0x9383f985bc4d37ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d1b expref: 13 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.209791:0:12363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc7400, rc 0) 00010000:02000000:3.0:1788201242.209811:0:12969:0:(ldlm_lib.c:3355:target_send_reply_msg()) *** cfs_fail_loc=15a, val=0*** 00000100:00100000:0.0:1788201242.209817:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:2362:x1875064442646528:12345-192.168.201.30@tcp:101:ll_sa.0 Request processed in 109us (553us total) trans 0 rc 0/0 00010000:00080000:3.0:1788201242.209817:0:12969:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788201242.209825:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4191 00000100:00100000:3.0:1788201242.209836:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+47:14314:x1875064442645888:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 501us (747us total) trans 8589938680 rc 0/0 00000100:00100000:3.0:1788201242.209843:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5129 00000100:00100000:0.0:1788201242.209850:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442646016 00000100:00100000:0.0:1788201242.209855:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442646016 00000100:00100000:0.0:1788201242.209874:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442646272 00000100:00100000:0.0:1788201242.209878:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442646272 00000100:00100000:0.0:1788201242.209887:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442646400 00000100:00100000:0.0:1788201242.209890:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442646400 00000100:00100000:0.0:1788201242.209902:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 865 00000100:00100000:0.0:1788201242.209909:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+49:2362:x1875064442646016:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:0.0:1788201242.209929:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201242.209939:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d3806 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4cb2 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.209976:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d380d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.209985:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d380d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.209993:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d380d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210005:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d3814 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210013:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d3814 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210019:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d3814 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210109:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d381b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210118:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d381b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210124:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d381b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201242.210140:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f7:0x0]: returning size 0 00000004:00200000:0.0:1788201242.210144:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201242.210158:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d381b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210167:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d381b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210175:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d380d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210181:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d380d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210188:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d380d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210194:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201242.210197:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d380d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210205:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d380d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210213:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:0.0:1788201242.210216:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201242.210220:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d380d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210225:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d380d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210239:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d3814 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210245:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d3814 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210251:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d3814 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210257:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201242.210260:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d3814 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210266:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d3814 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210273:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x37639fea (ffff9e03c2fc5a00) 00010000:00010000:0.0:1788201242.210275:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201242.210277:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d3814 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210283:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d3814 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210347:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d3806 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4cb2 expref: 51 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210360:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d381b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4cb2 expref: 50 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210372:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f7:0x0].0x0 (ffff9e03c5173b00) 00010000:00010000:0.0:1788201242.210374:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201242.210378:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc7000, rc 0) 00010000:00010000:0.0:1788201242.210383:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201242.210391:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d3822 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4cb9 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210431:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d3829 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210439:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d3829 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210447:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d3829 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210458:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d3830 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210465:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d3830 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210471:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d3830 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210523:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d3837 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210531:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d3837 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210542:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d3837 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201242.210555:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f8:0x0]: returning size 0 00000004:00200000:0.0:1788201242.210558:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201242.210567:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d3837 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210575:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d3837 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210581:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d3829 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210587:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d3829 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210593:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d3829 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210598:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201242.210601:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d3829 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210607:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d3829 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210615:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:0.0:1788201242.210617:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201242.210620:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d3829 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210630:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d3829 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210639:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d3830 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210645:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d3830 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210651:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d3830 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210656:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201242.210658:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d3830 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210663:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d3830 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210670:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x7fbd58ea (ffff9e03c2fc5100) 00010000:00010000:0.0:1788201242.210673:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201242.210676:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d3830 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210681:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d3830 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210703:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d3822 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4cb9 expref: 52 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210718:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d3837 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4cb9 expref: 51 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210724:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f8:0x0].0x0 (ffff9e03c33e8400) 00010000:00010000:0.0:1788201242.210727:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201242.210729:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c37d0c00, rc 0) 00010000:00010000:0.0:1788201242.210734:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201242.210741:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1800/0x9383f985bc4d383e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4cc0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210764:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0a00/0x9383f985bc4d3845 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210772:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0a00/0x9383f985bc4d3845 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210779:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0a00/0x9383f985bc4d3845 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210790:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0000/0x9383f985bc4d384c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210796:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0000/0x9383f985bc4d384c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210802:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0000/0x9383f985bc4d384c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210825:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0a00/0x9383f985bc4d3845 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210832:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0a00/0x9383f985bc4d3845 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210838:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0a00/0x9383f985bc4d3845 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210843:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201242.210846:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0a00/0x9383f985bc4d3845 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210852:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0a00/0x9383f985bc4d3845 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210859:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:0.0:1788201242.210861:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201242.210863:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0a00/0x9383f985bc4d3845 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210868:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0a00/0x9383f985bc4d3845 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210876:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0000/0x9383f985bc4d384c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210882:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0000/0x9383f985bc4d384c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210887:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0000/0x9383f985bc4d384c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210891:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201242.210894:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0000/0x9383f985bc4d384c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210900:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0000/0x9383f985bc4d384c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210905:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0xc81711ea (ffff9e03c2fc5b00) 00010000:00010000:0.0:1788201242.210907:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201242.210909:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0000/0x9383f985bc4d384c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210915:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0000/0x9383f985bc4d384c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210933:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1800/0x9383f985bc4d383e lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4cc0 expref: 52 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210941:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:0.0:1788201242.210943:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201242.210946:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1800/0x9383f985bc4d383e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4cc0 expref: 52 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.210954:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c37d1800, rc -2) 00000100:00100000:0.0:1788201242.210998:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+51:2362:x1875064442646016:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 1089us (1842us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201242.211005:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 865 00000100:00100000:0.0:1788201242.211028:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 866 00000100:00100000:0.0:1788201242.211036:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+50:2360:x1875064442646272:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:0.0:1788201242.211072:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201242.211081:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0e00/0x9383f985bc4d3853 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4c88 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211103:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1200/0x9383f985bc4d385a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211111:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1200/0x9383f985bc4d385a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211118:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1200/0x9383f985bc4d385a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211126:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d3861 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211132:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d3861 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211138:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d3861 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211159:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1200/0x9383f985bc4d385a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211164:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1200/0x9383f985bc4d385a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211170:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1200/0x9383f985bc4d385a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211174:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201242.211177:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1200/0x9383f985bc4d385a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211186:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1200/0x9383f985bc4d385a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211193:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:0.0:1788201242.211195:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201242.211197:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1200/0x9383f985bc4d385a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211203:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1200/0x9383f985bc4d385a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211212:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d3861 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211217:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d3861 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211222:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d3861 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211227:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201242.211229:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d3861 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211234:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d3861 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211240:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0xc81711ea (ffff9e03c2fc5400) 00010000:00010000:0.0:1788201242.211242:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201242.211244:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d3861 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211250:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1000/0x9383f985bc4d3861 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211266:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0e00/0x9383f985bc4d3853 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c88 expref: 51 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211273:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:0.0:1788201242.211274:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201242.211278:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0e00/0x9383f985bc4d3853 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c88 expref: 51 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211285:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c37d0e00, rc -2) 00000100:00100000:0.0:1788201242.211339:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+50:2360:x1875064442646272:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 304us (2108us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201242.211345:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 866 00000100:00100000:0.0:1788201242.211357:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 867 00000100:00100000:0.0:1788201242.211364:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+49:2359:x1875064442646400:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:0.0:1788201242.211378:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201242.211384:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d3868 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4cf8 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211406:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d386f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211428:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d386f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211438:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d386f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211450:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d3876 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211457:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d3876 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211463:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d3876 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211521:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d387d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211530:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d387d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211536:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d387d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201242.211553:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f7:0x0]: returning size 0 00000004:00200000:0.0:1788201242.211556:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201242.211568:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d387d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211576:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d387d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211582:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d386f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211591:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d386f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211596:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d386f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211600:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201242.211603:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d386f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211609:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d386f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211616:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:0.0:1788201242.211618:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201242.211621:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d386f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211626:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1a00/0x9383f985bc4d386f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211635:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d3876 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211640:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d3876 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211646:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d3876 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211651:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d0600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201242.211655:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d3876 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211660:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d3876 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211666:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x37639fea (ffff9e03c2fc5e00) 00010000:00010000:0.0:1788201242.211667:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201242.211669:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d3876 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211675:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0600/0x9383f985bc4d3876 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211696:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1c00/0x9383f985bc4d3868 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4cf8 expref: 51 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211707:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d387d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4cf8 expref: 50 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211713:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f7:0x0].0x0 (ffff9e03c5173b00) 00010000:00010000:0.0:1788201242.211714:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201242.211717:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c37d0400, rc 0) 00010000:00010000:0.0:1788201242.211721:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201242.211728:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d3884 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4cff expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211749:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1400/0x9383f985bc4d388b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211756:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1400/0x9383f985bc4d388b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211763:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1400/0x9383f985bc4d388b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211773:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d3892 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211780:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d3892 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211786:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d3892 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211810:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1400/0x9383f985bc4d388b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211817:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1400/0x9383f985bc4d388b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211823:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1400/0x9383f985bc4d388b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211828:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201242.211831:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1400/0x9383f985bc4d388b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211837:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1400/0x9383f985bc4d388b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211845:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:0.0:1788201242.211848:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201242.211851:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1400/0x9383f985bc4d388b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211857:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1400/0x9383f985bc4d388b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211867:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d3892 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.211867:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d37f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211888:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d3892 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.211888:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d37f1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211906:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d3892 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211911:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c37d1e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201242.211914:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d3892 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.211921:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d37f1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211923:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d3892 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.211939:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bcc00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201242.211941:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0xc81711ea (ffff9e03c2fc5300) 00010000:00010000:0.0:1788201242.211944:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201242.211945:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d37f1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211948:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d3892 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.211963:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d37f1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211964:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d1e00/0x9383f985bc4d3892 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.211989:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f4:0x0].0x0 (ffff9e03c2fc5000) 00010000:00010000:3.0:1788201242.211994:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788201242.211998:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d37f1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.211999:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d3884 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4cff expref: 51 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.212028:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d37f1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.212033:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:0.0:1788201242.212037:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201242.212042:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0200/0x9383f985bc4d3884 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4cff expref: 51 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.212054:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c37d0200, rc -2) 00000100:00100000:0.0:1788201242.212083:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+49:2359:x1875064442646400:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 720us (2746us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201242.212090:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 867 00000100:00100000:3.0:1788201242.220192:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201242.220245:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201242.220990:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442646656 00000100:00100000:1.0:1788201242.221000:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442646656 00000100:00100000:1.0:1788201242.221054:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4192 00000100:00100000:1.0:1788201242.221064:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:2362:x1875064442646656:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1788201242.221081:0:13441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201242.221096:0:13441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d3899 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4d22 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.221120:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201242.221124:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201242.221131:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d3899 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d22 expref: 14 pid: 13441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.221143:0:13441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d3899 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d22 expref: 14 pid: 13441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.221153:0:13441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3000, rc 0) 00000100:00100000:1.0:1788201242.221211:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:2362:x1875064442646656:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 148us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201242.221218:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4192 00000100:00100000:2.0:1788201242.221369:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442647168 00000100:00100000:2.0:1788201242.221374:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442647168 00000100:00100000:2.0:1788201242.221401:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 868 00000100:00100000:2.0:1788201242.221408:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+49:2361:x1875064442647168:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:2.0:1788201242.221443:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201242.221462:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d38a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4d30 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.221511:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d38a7 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.221527:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d38a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.221537:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d38a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.221553:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d38ae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.221561:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d38ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.221568:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d38ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.221630:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d38a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.221639:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d38a7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.221645:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d38a7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.221652:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201242.221655:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d38a7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.221660:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d38a7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.221668:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:2.0:1788201242.221670:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201242.221674:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d38a7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.221679:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d38a7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.221701:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d38ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.221707:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d38ae lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.221713:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d38ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.221718:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201242.221721:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d38ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.221727:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d38ae lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.221735:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0xc81711ea (ffff9e03c33edc00) 00010000:00010000:2.0:1788201242.221736:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201242.221738:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d38ae lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.221742:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d38ae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.221762:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d38a0 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d30 expref: 50 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.221771:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:2.0:1788201242.221773:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201242.221777:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d38a0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d30 expref: 50 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.221786:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031800, rc -2) 00000100:00100000:2.0:1788201242.221821:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+49:2361:x1875064442647168:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 414us (1576us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201242.221828:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 868 00000100:00100000:3.0:1788201242.225113:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201242.225155:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201242.225195:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201242.225197:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442647040 00000100:00100000:2.0:1788201242.225210:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442647040 00000100:00100000:2.0:1788201242.225277:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442646912 00000100:00100000:2.0:1788201242.225281:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442646912 00000100:00100000:2.0:1788201242.225319:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5130 00000100:00100000:2.0:1788201242.225327:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+50:14317:x1875064442647040:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1788201242.225347:0:13406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201242.225364:0:13406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d38b5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4d29 expref: -99 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.225438:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d38bc lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.225453:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d38bc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.225464:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d38bc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.225479:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d38c3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.225483:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d38c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.225488:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d38c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.225573:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d38ca lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.225580:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d38ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.225585:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d38ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201242.225617:0:13406:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f7:0x0]: returning size 0 00000004:00200000:2.0:1788201242.225622:0:13406:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201242.225641:0:13406:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d38ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.225653:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d38ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.225660:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d38bc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201242.225661:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5131 00010000:00010000:2.0:1788201242.225669:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d38bc lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201242.225679:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+51:14315:x1875064442646912:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:2.0:1788201242.225684:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d38bc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.225691:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201242.225696:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d38bc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.225704:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d38bc lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.225717:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:2.0:1788201242.225721:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201242.225725:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d38bc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.225730:0:12971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201242.225732:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d38bc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.225749:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d38c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.225751:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017a00/0x9383f985bc4d3796 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c65 expref: 51 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.225764:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d38c3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.225771:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d38c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.225775:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f5:0x0].0x0 (ffff9e03c5173d00) 00010000:00010000:2.0:1788201242.225777:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201242.225780:0:12971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201242.225782:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d38c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.225793:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d38c3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.225802:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x37639fea (ffff9e03c33ed500) 00010000:00010000:3.0:1788201242.225804:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d38d1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.225805:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201242.225810:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d38c3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.225818:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d38d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.225819:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d38c3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.225837:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d38d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.225863:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d38b5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d29 expref: 51 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.225875:0:13406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d38ca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d29 expref: 50 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.225882:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f7:0x0].0x0 (ffff9e03c5173b00) 00010000:00010000:2.0:1788201242.225885:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201242.225887:0:13406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0030000, rc 0) 00000100:00100000:2.0:1788201242.225940:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+50:14317:x1875064442647040:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 613us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201242.225946:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5130 00000004:00010000:3.0:1788201242.226052:0:12971:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b739f406 reply state 0000000009f2f22e transno 8589938681 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d38d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201242.226067:0:12971:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:02000000:3.0:1788201242.226089:0:12971:0:(ldlm_lib.c:3355:target_send_reply_msg()) *** cfs_fail_loc=15a, val=0*** 00010000:00080000:3.0:1788201242.226093:0:12971:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788201242.226116:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+51:14315:x1875064442646912:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 443us (960us total) trans 8589938681 rc 0/0 00000100:00100000:3.0:1788201242.226123:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5131 00010000:00010000:1.0:1788201242.226146:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d38d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.226152:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d38d1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.226156:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d38d1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.226158:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bce00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201242.226160:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d38d1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.226164:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d38d1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.226170:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f5:0x0].0x0 (ffff9e03c5173d00) 00010000:00010000:1.0:1788201242.226171:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788201242.226173:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d38d1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.226177:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d38d1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201242.226352:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442647296 00000100:00100000:0.0:1788201242.226357:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442647296 00000100:00100000:0.0:1788201242.226386:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 869 00000100:00100000:0.0:1788201242.226394:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+50:2359:x1875064442647296:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:0.0:1788201242.226427:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201242.226437:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d38d8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4d61 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.226468:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d38df lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.226475:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d38df lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.226480:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d38df lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.226489:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d38e6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x53c502ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.226497:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d38e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.226503:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d38e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.226539:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d38df lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.226547:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d38df lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.226552:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d38df lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.226555:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201242.226557:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d38df lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.226560:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d38df lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.226566:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:0.0:1788201242.226567:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201242.226569:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d38df lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.226573:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d38df lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.226579:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d38e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.226583:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d38e6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.226587:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d38e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.226590:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201242.226593:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d38e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.226598:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d38e6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.226604:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x53c502ea (ffff9e04ff181d00) 00010000:00010000:0.0:1788201242.226606:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201242.226608:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d38e6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.226613:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d38e6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.226633:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d38d8 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d61 expref: 51 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.226641:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:0.0:1788201242.226643:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201242.226646:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d38d8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d61 expref: 51 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.226660:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c19a9a00, rc -2) 00000100:00100000:0.0:1788201242.226702:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+50:2359:x1875064442647296:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 309us (1507us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201242.226709:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 869 00000100:00100000:3.0:1788201242.232818:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201242.233073:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442647552 00000100:00100000:0.0:1788201242.233084:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442647552 00000100:00100000:0.0:1788201242.233147:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5132 00000100:00100000:0.0:1788201242.233158:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+50:14318:x1875064442647552:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:0.0:1788201242.233219:0:12968:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201242.233248:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d37e3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c7a expref: 50 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.233268:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f8:0x0].0x0 (ffff9e03c33e8400) 00010000:00010000:0.0:1788201242.233273:0:12968:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201242.233340:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d38ed lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.233355:0:12968:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d3837 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4cb9 expref: 49 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.233367:0:12968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d38ed lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.233453:0:12968:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d3837 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4cb9 expref: 49 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.233481:0:12968:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d3837 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4cb9 expref: 49 pid: 6714 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201242.233508:0:12968:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5029f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:12968:1875064458221056:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201242.233589:0:12968:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d89e16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201242.234740:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201242.234788:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201242.234809:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442647680 00000100:00100000:0.0:1788201242.234821:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442647680 00000100:00100000:0.0:1788201242.234889:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 870 00000100:00100000:0.0:1788201242.234900:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+50:2361:x1875064442647680:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:0.0:1788201242.235066:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201242.235084:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d38f4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4d68 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.235137:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d38fb lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201242.235147:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:0.0:1788201242.235163:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d38fb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.235177:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d38fb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201242.235199:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442647936 00000100:00100000:0.0:1788201242.235204:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442647936 00000100:00100000:0.0:1788201242.235254:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:0.0:1788201242.235263:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c7e15850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+52:2362:x1875064442647936:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201242.235276:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788201242.235280:0:13442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442647808 00010000:00010000:0.0:1788201242.235330:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d38ca lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d29 expref: 52 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201242.235335:0:13442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442647808 00010000:00010000:0.0:1788201242.235353:0:13458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f7:0x0].0x0 (ffff9e03c5173b00) 00010000:00010000:0.0:1788201242.235358:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201242.235401:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4193 00000100:00100000:1.0:1788201242.235427:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35604eb4-baf9-45be-a20a-4883a2cd8cf9+510:2362:x1875064442647808:12345-192.168.201.30@tcp:101:chmod.0 00000100:00100000:0.0:1788201242.235435:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c7e15850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+51:2362:x1875064442647936:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 166us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201242.235448:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00010000:00010000:1.0:1788201242.235451:0:13442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201242.235474:0:13442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9237659/0x9383f985bc4d3902 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4d6f expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201242.235508:0:13442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x41c:0x0] initial LVB size: 0, mtime: 0x6a95c918, atime: 0x6a95c918, ctime: 0x6a95c918, blocks: 0x1 00010000:00010000:1.0:1788201242.235610:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41c:0x0].0x0 since=517s v=(0 0) 00010000:00010000:1.0:1788201242.235616:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201242.235627:0:13442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9237659/0x9383f985bc4d3902 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d6f expref: 511 pid: 13442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.235647:0:13442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9237659/0x9383f985bc4d3902 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d6f expref: 511 pid: 13442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.235661:0:13442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2e00, rc 0) 00000100:00100000:1.0:1788201242.235709:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2362:x1875064442647808:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 297us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201242.235717:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4193 00010000:00010000:0.0:1788201242.236195:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3909 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xad7e02ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.236213:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3909 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.236222:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3909 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.236288:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d38fb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.236329:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d38fb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.236335:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d38fb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.236342:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201242.236346:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d38fb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.236353:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d38fb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.236362:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:0.0:1788201242.236365:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201242.236370:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d38fb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.236376:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d38fb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.236389:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3909 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.236396:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3909 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.236402:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3909 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.236407:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201242.236421:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3909 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.236431:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3909 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.236438:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0xad7e02ea (ffff9e04ff181d00) 00010000:00010000:0.0:1788201242.236441:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201242.236444:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3909 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.236451:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3909 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.236489:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d38f4 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d68 expref: 50 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.237036:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:0.0:1788201242.237041:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201242.237047:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d38f4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d68 expref: 50 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.237064:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c19a9a00, rc -2) 00000100:00100000:1.0:1788201242.244714:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+49:2361:x1875064442647680:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 9794us (9964us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201242.244736:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 870 00000100:00100000:0.0:1788201242.244992:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201242.245028:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201242.245095:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442648320 00000100:00100000:3.0:1788201242.245105:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442648320 00010000:00010000:3.0:1788201242.245145:0:7646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d3837 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4cb9 expref: 49 pid: 6714 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201242.245160:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442648192 00000100:00100000:2.0:1788201242.245171:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442648192 00000100:00100000:3.0:1788201242.245197:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1542 00000100:00100000:3.0:1788201242.245211:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+50:2360:x1875064442648320:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201242.245228:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788201242.245233:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5133 00010000:00010000:3.0:1788201242.245243:0:7646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d3837 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4cb9 expref: 50 pid: 6714 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201242.245251:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+50:14316:x1875064442648192:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:3.0:1788201242.245274:0:7646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d3837 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4cb9 expref: 50 pid: 6714 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.245345:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f8:0x0].0x0 (ffff9e03c33e8400) 00010000:00010000:3.0:1788201242.245351:0:7646:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d38ed lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.245361:0:7646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d38ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.245364:0:12969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201242.245376:0:7646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d38ed lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.245396:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d37c7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c73 expref: 50 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.245397:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201242.245433:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f6:0x0].0x0 (ffff9e03c5173800) 00010000:00010000:2.0:1788201242.245440:0:12969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201242.245464:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+49:2360:x1875064442648320:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 255us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201242.245474:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1542 00010000:00010000:2.0:1788201242.245495:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3910 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.245513:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3910 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201242.245528:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3910 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201242.246204:0:12969:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef929a76 reply state 0000000071b8bb1d transno 8589938682 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3910 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201242.246217:0:12969:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:02000000:2.0:1788201242.246283:0:12969:0:(ldlm_lib.c:3355:target_send_reply_msg()) *** cfs_fail_loc=15a, val=0*** 00010000:00080000:2.0:1788201242.246288:0:12969:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788201242.246342:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+50:14316:x1875064442648192:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 1096us (1357us total) trans 8589938682 rc 0/0 00000100:00100000:2.0:1788201242.246353:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5133 00010000:00010000:1.0:1788201242.246577:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0c00/0x9383f985bc4d3837 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4cb9 expref: 49 pid: 6714 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201242.246595:0:12968:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5029f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:12968:1875064458221056:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201242.246635:0:12968:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d38ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.246645:0:12968:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d38ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.246651:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d38ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201242.246795:0:12968:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044394d06 reply state 00000000b10c0c2d transno 8589938683 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d38ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201242.246803:0:12968:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:02000000:1.0:1788201242.246828:0:12968:0:(ldlm_lib.c:3355:target_send_reply_msg()) *** cfs_fail_loc=15a, val=0*** 00010000:00080000:1.0:1788201242.246831:0:12968:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788201242.246850:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+50:14318:x1875064442647552:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 13695us (14043us total) trans 8589938683 rc 0/0 00000100:00100000:1.0:1788201242.246858:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5132 00010000:00010000:0.0:1788201242.247022:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d38ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.247040:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d38ed lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.247048:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d38ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.247055:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201242.247059:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d38ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.247067:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d38ed lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.247082:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f8:0x0].0x0 (ffff9e03c33e8400) 00010000:00010000:0.0:1788201242.247085:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788201242.247090:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d38ed lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201242.247096:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d38ed lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.248341:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3910 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.248361:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3910 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.248368:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3910 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.248376:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201242.248381:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3910 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.248390:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3910 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.248408:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f6:0x0].0x0 (ffff9e03c5173800) 00010000:00010000:3.0:1788201242.248420:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788201242.248426:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3910 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.248437:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3910 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201242.250256:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201242.250479:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442648576 00000100:00100000:1.0:1788201242.250493:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442648576 00000100:00100000:1.0:1788201242.250567:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5134 00000100:00100000:1.0:1788201242.250581:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+48:14317:x1875064442648576:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:1.0:1788201242.250678:0:12971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201242.250714:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d381b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4cb2 expref: 48 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.250740:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c37d0400/0x9383f985bc4d387d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4cf8 expref: 47 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.250751:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f7:0x0].0x0 (ffff9e03c5173b00) 00010000:00010000:1.0:1788201242.250757:0:12971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201242.250800:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3917 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.250816:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3917 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201242.250827:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3917 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201242.251122:0:12971:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005152051e reply state 000000001b66b7ef transno 8589938684 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3917 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201242.251134:0:12971:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:02000000:1.0:1788201242.251179:0:12971:0:(ldlm_lib.c:3355:target_send_reply_msg()) *** cfs_fail_loc=15a, val=0*** 00010000:00080000:1.0:1788201242.251183:0:12971:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788201242.251209:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+48:14317:x1875064442648576:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 630us (964us total) trans 8589938684 rc 0/0 00000100:00100000:1.0:1788201242.251216:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5134 00010000:00010000:3.0:1788201242.251442:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3917 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.251450:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3917 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.251456:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3917 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.251463:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201242.251468:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3917 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.251475:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3917 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.251486:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f7:0x0].0x0 (ffff9e03c5173b00) 00010000:00010000:3.0:1788201242.251489:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788201242.251493:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3917 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201242.251500:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3917 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788201242.451255:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968846 is committed 00000001:00080000:0.0:1788201242.451283:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968841 is committed 00000001:00080000:0.0:1788201242.451541:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968842 is committed 00000001:00080000:0.0:1788201242.453908:0:6732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294968846 is committed 00000001:00080000:0.0:1788201242.453928:0:6732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294968841 is committed 00000001:00080000:0.0:1788201242.453935:0:6732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294968843 is committed 00010000:00010000:0.0:1788201242.472021:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201242.853783:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201242.853817:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458221184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201242.853931:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201242.854122:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458221184 00000100:00100000:3.0:1788201242.854134:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458221184 00000100:00100000:3.0:1788201242.854211:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788201242.854224:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5029f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458221184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201242.854274:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 525008896 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1788201242.854379:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5029f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458221184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201242.854388:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788201242.854672:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968843 gen 2 00000004:00080000:1.0:1788201242.854679:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c1a71f80, transno 4294968841 00000004:00080000:1.0:1788201242.854697:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c1a73800, transno 4294968842 00000004:00080000:1.0:1788201242.854701:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04ff057480, transno 4294968843 00000100:00100000:1.0:1788201242.854715:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458221184:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1788201242.855224:0:12993:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00010000:00010000:0.0:1788201243.493841:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201244.521441:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788201244.525558:0:12980:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938679 is committed 00000001:00080000:2.0:1788201244.525596:0:12980:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938684 is committed 00000100:00100000:1.0:1788201245.413640:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458221312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201245.413755:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201245.413946:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458221312 00000100:00100000:3.0:1788201245.413957:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458221312 00000100:00100000:3.0:1788201245.414040:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788201245.414056:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c502b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458221312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201245.414103:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 13631488 granted 525008896 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201245.414170:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c502b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458221312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201245.414178:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1788201245.414401:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201245.414757:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968842 gen 2 00000004:00080000:1.0:1788201245.414765:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00a7100, transno 4294968841 00000004:00080000:1.0:1788201245.414788:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00a4700, transno 4294968842 00000100:00100000:1.0:1788201245.414805:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458221312:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788201245.542788:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201246.566310:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201246.950796:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201246.950828:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2e01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458221440:0@lo:400:kworker.0 00000100:00100000:1.0:1788201246.950926:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201246.951006:0:12965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458221440 00000100:00100000:1.0:1788201246.951014:0:12965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458221440 00000100:00100000:1.0:1788201246.951068:0:12965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788201246.951077:0:12965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f950d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458221440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201246.951134:0:12965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f950d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458221440:12345-0@lo:400:kworker.0 Request processed in 57us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201246.951142:0:12965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788201246.951200:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2e01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458221440:0@lo:400:kworker.0 00000100:00100000:3.0:1788201246.951550:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d80f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458221696:0@lo:400:kworker.0 00000100:00100000:3.0:1788201246.952155:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201246.952195:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201246.952202:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d80f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458221824:0@lo:400:kworker.0 00000100:00100000:1.0:1788201246.952543:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458221568:0@lo:400:kworker.0 00000100:00100000:1.0:1788201246.952589:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201246.952609:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875064458222080:0@lo:400:kworker.0 00000100:00100000:1.0:1788201246.952643:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201246.952673:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201246.952679:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458221952:0@lo:400:kworker.0 00000100:00100000:1.0:1788201246.952704:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201246.952746:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458221696 00000100:00100000:1.0:1788201246.952755:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458221696 00000100:00100000:1.0:1788201246.952831:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458221568 00000100:00100000:1.0:1788201246.952834:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458221568 00000100:00100000:1.0:1788201246.952857:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458222080 00000100:00100000:1.0:1788201246.952860:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458222080 00000100:00100000:1.0:1788201246.952878:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788201246.952887:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d1f0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458221696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201246.952943:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d1f0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458221696:12345-0@lo:400:kworker.0 Request processed in 57us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201246.952950:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788201246.952968:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788201246.952974:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875064458221568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201246.953006:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875064458221568:12345-0@lo:400:kworker.0 Request processed in 33us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201246.953012:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788201246.953022:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788201246.953028:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875064458222080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201246.953049:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875064458222080:12345-0@lo:400:kworker.0 Request processed in 21us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201246.953054:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788201246.953074:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458221952 00000100:00100000:1.0:1788201246.953078:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458221952 00000100:00100000:1.0:1788201246.953102:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788201246.953108:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c502ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458221952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201246.953135:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c502ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458221952:12345-0@lo:400:kworker.0 Request processed in 28us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201246.953141:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:1.0:1788201246.953167:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201246.953202:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d1f0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458221952:0@lo:400:kworker.0 00000100:00100000:1.0:1788201246.953224:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458221568:0@lo:400:kworker.0 00000100:00100000:1.0:1788201246.953234:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d1f0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875064458222080:0@lo:400:kworker.0 00000100:00100000:3.0:1788201246.953511:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201246.953554:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d80f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458221696:0@lo:400:kworker.0 00000100:00100000:1.0:1788201246.953755:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458221824 00000100:00100000:1.0:1788201246.954163:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458221824 00000100:00100000:1.0:1788201246.954278:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788201246.954290:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d1f0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458221824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201246.954389:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d1f0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458221824:12345-0@lo:400:kworker.0 Request processed in 104us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201246.954396:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788201246.954594:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d80f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458221824:0@lo:400:kworker.0 00000100:00080000:0.0:1788201246.955302:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201247.121408:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201247.121459:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201247.121507:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201247.121580:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201247.121631:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442649088 00000100:00100000:0.0:1788201247.121644:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442649088 00000100:00100000:0.0:1788201247.121714:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442648960 00000100:00100000:0.0:1788201247.121717:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442648960 00000100:00100000:0.0:1788201247.121746:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 147 00000100:00100000:0.0:1788201247.121756:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2360:x1875064442649088:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201247.121850:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2360:x1875064442649088:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 95us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201247.121859:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 147 00000100:00100000:0.0:1788201247.121881:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 148 00000100:00100000:0.0:1788201247.121887:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2360:x1875064442648960:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201247.121911:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2360:x1875064442648960:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201247.121917:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 148 00000100:00080000:0.0:1788201247.121945:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201247.121950:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201247.122680:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442648832 00000100:00100000:1.0:1788201247.122691:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442648832 00000100:00080000:0.0:1788201247.122807:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201247.122860:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 82 00000100:00100000:1.0:1788201247.122871:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:2360:x1875064442648832:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201247.122943:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:2360:x1875064442648832:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 74us (1550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201247.122950:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 82 00000100:00100000:2.0:1788201247.123587:0:12964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442648704 00000100:00100000:2.0:1788201247.123595:0:12964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442648704 00000100:00100000:2.0:1788201247.123656:0:12964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 109 00000100:00100000:2.0:1788201247.123666:0:12964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f950d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442648704:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201247.123716:0:12964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f950d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442648704:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 52us (2207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201247.123723:0:12964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 109 00010000:00010000:0.0:1788201247.589797:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201247.973674:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201247.973697:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458222208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201247.973770:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201247.973862:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458222208 00000100:00100000:3.0:1788201247.973870:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458222208 00000100:00100000:3.0:1788201247.973938:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788201247.973949:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c502a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458222208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201247.973991:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 525008896 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1788201247.974048:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c502a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458222208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201247.974056:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788201247.974427:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d1f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458222208:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788201248.613486:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201249.637767:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201250.533619:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201250.533645:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458222336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201250.533721:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201250.533793:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458222336 00000100:00100000:3.0:1788201250.533802:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458222336 00000100:00100000:3.0:1788201250.533878:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788201250.533889:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458222336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201250.533930:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 13631488 granted 525008896 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201250.533988:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458222336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201250.533996:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:0.0:1788201250.534061:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201250.534135:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458222336:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788201250.661541:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201251.686072:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201252.069672:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458222720:0@lo:400:kworker.0 00000100:00100000:3.0:1788201252.069756:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201252.069826:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201252.069842:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458222848:0@lo:400:kworker.0 00000100:00100000:3.0:1788201252.069870:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201252.069921:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458222848 00000100:00100000:3.0:1788201252.069930:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458222848 00000100:00100000:3.0:1788201252.069988:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788201252.069999:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d1f0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458222848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201252.070053:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d1f0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458222848:12345-0@lo:400:kworker.0 Request processed in 55us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201252.070061:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:3.0:1788201252.070081:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201252.070113:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458222848:0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.070487:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458222464:0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.070533:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201252.070574:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458222976:0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.070598:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201252.070619:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788201252.070626:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875064458222592:0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.070650:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201252.070665:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875064458223104:0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.070683:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201252.070710:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458222720 00000100:00100000:0.0:1788201252.070715:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458222720 00000100:00100000:0.0:1788201252.070755:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458222592 00000100:00100000:0.0:1788201252.070758:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458222592 00000100:00100000:0.0:1788201252.070773:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458223104 00000100:00100000:0.0:1788201252.070776:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458223104 00000100:00100000:0.0:1788201252.070791:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788201252.070797:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d1f0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458222720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.070847:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d1f0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458222720:12345-0@lo:400:kworker.0 Request processed in 50us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201252.070854:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788201252.070868:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788201252.070874:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875064458222592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.071009:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875064458222592:12345-0@lo:400:kworker.0 Request processed in 134us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201252.071017:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788201252.071029:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788201252.071036:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875064458223104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.071063:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875064458223104:12345-0@lo:400:kworker.0 Request processed in 28us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201252.071069:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788201252.071098:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875064458222592:0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.071106:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875064458223104:0@lo:400:kworker.0 00000100:00100000:1.0:1788201252.071257:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458222976 00000100:00100000:1.0:1788201252.071263:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458222976 00000100:00100000:1.0:1788201252.071328:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788201252.071337:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458222976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201252.071378:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458222976:12345-0@lo:400:kworker.0 Request processed in 44us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201252.071385:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788201252.071485:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458222976:0@lo:400:kworker.0 00000100:00100000:3.0:1788201252.072005:0:12965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458222464 00000100:00100000:3.0:1788201252.072011:0:12965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458222464 00000100:00100000:3.0:1788201252.072052:0:12965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788201252.072060:0:12965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f950e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458222464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201252.072110:0:12965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f950e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458222464:12345-0@lo:400:kworker.0 Request processed in 51us (1577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201252.072118:0:12965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1788201252.072160:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201252.072166:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201252.072190:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458222720:0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.077033:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458222464:0@lo:400:kworker.0 00000100:00100000:1.0:1788201252.240863:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201252.240912:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201252.240958:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201252.240994:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201252.241093:0:12964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442649216 00000100:00100000:3.0:1788201252.241103:0:12964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442649216 00000100:00100000:3.0:1788201252.241174:0:12964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 111 00000100:00100000:3.0:1788201252.241186:0:12964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f950c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442649216:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201252.241264:0:12964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f950c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442649216:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 81us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201252.241272:0:12964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 111 00000100:00100000:2.0:1788201252.241526:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442649600 00000100:00100000:2.0:1788201252.241531:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442649600 00000100:00100000:2.0:1788201252.241577:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442649472 00000100:00100000:2.0:1788201252.241580:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442649472 00000100:00100000:2.0:1788201252.241606:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 151 00000100:00100000:2.0:1788201252.241614:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c502b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2360:x1875064442649600:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201252.241644:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c502b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2360:x1875064442649600:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 31us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201252.241650:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 151 00000100:00100000:2.0:1788201252.241663:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 152 00000100:00100000:2.0:1788201252.241669:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5028380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2360:x1875064442649472:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201252.241692:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5028380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2360:x1875064442649472:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201252.241698:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 152 00000100:00080000:3.0:1788201252.241941:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201252.241946:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201252.242008:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442649344 00000100:00100000:0.0:1788201252.242025:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442649344 00000100:00100000:0.0:1788201252.242076:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 86 00000100:00100000:0.0:1788201252.242084:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:2360:x1875064442649344:12345-192.168.201.30@tcp:400:kworker.0 00000100:00080000:3.0:1788201252.242676:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201252.242809:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:2360:x1875064442649344:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 35us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201252.242821:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 86 00010000:00010000:3.0:1788201252.711290:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201253.102372:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201253.102399:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458223232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201253.102474:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201253.102690:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458223232 00000100:00100000:2.0:1788201253.102699:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458223232 00000100:00100000:2.0:1788201253.102757:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788201253.102767:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458223232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201253.102800:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 525008896 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1788201253.102855:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458223232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201253.102862:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788201253.102952:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d1f0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458223232:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788201253.733497:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201254.758457:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201255.653909:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201255.653933:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458223360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201255.654007:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201255.654337:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458223360 00000100:00100000:0.0:1788201255.654345:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458223360 00000100:00100000:0.0:1788201255.654421:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788201255.654432:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d1f0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458223360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201255.654467:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 13631488 granted 525008896 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201255.654520:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d1f0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458223360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201255.654527:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788201255.654576:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458223360:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788201255.654648:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788201255.781723:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201256.805542:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201257.191577:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458223872:0@lo:400:kworker.0 00000100:00100000:3.0:1788201257.191651:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201257.191717:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201257.191724:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458223744:0@lo:400:kworker.0 00000100:00100000:3.0:1788201257.191753:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201257.191798:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458223872 00000100:00100000:3.0:1788201257.191799:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458223744 00000100:00100000:2.0:1788201257.191810:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458223872 00000100:00100000:3.0:1788201257.191810:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458223744 00000100:00100000:3.0:1788201257.191868:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788201257.191880:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458223744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201257.191888:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d80f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458223488:0@lo:400:kworker.0 00000100:00100000:0.0:1788201257.191939:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201257.191988:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d80f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458223616:0@lo:400:kworker.0 00000100:00100000:2.0:1788201257.192372:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788201257.192382:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458223872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201257.195551:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458223744:12345-0@lo:400:kworker.0 Request processed in 3665us (3789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201257.195568:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1788201257.195614:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201257.195620:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201257.195637:0:12965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458223488 00000100:00100000:3.0:1788201257.195646:0:12965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458223488 00000100:00100000:3.0:1788201257.195694:0:12965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788201257.195701:0:12965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f950c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458223488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201257.195782:0:12965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f950c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458223488:12345-0@lo:400:kworker.0 Request processed in 81us (3842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201257.195789:0:12965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788201257.195844:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458223744:0@lo:400:kworker.0 00000100:00100000:0.0:1788201257.199255:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d80f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458223488:0@lo:400:kworker.0 00000100:00100000:0.0:1788201257.199274:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458224000:0@lo:400:kworker.0 00000100:00100000:0.0:1788201257.199350:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201257.201019:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458224000 00000100:00100000:3.0:1788201257.201032:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458224000 00000100:00100000:3.0:1788201257.201122:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788201257.201134:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458224000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201257.201224:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458224000:12345-0@lo:400:kworker.0 Request processed in 92us (1873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201257.201231:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:0.0:1788201257.201370:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201257.201408:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458224000:0@lo:400:kworker.0 00000100:00100000:1.0:1788201257.204947:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201257.205008:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875064458224128:0@lo:400:kworker.0 00000100:00100000:1.0:1788201257.205044:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201257.205212:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458223616 00000100:00100000:3.0:1788201257.205220:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458223616 00000100:00100000:3.0:1788201257.205274:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458224128 00000100:00100000:3.0:1788201257.205278:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458224128 00000100:00100000:3.0:1788201257.205324:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788201257.205334:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875064458223616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201257.205399:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875064458223616:12345-0@lo:400:kworker.0 Request processed in 67us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201257.205407:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788201257.205423:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788201257.205429:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875064458224128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201257.205458:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875064458224128:12345-0@lo:400:kworker.0 Request processed in 30us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201257.205464:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788201257.205702:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d80f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458223616:0@lo:400:kworker.0 00000100:00100000:1.0:1788201257.205713:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875064458224128:0@lo:400:kworker.0 00000100:00080000:0.0:1788201257.206194:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201257.206820:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458223872:12345-0@lo:400:kworker.0 Request processed in 14436us (15164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201257.206832:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788201257.207451:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458223872:0@lo:400:kworker.0 00000100:00100000:0.0:1788201257.364121:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201257.364174:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201257.364220:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201257.364262:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201257.364327:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442650112 00000100:00100000:2.0:1788201257.364336:0:12964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442649728 00000100:00100000:0.0:1788201257.364337:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442650112 00000100:00100000:2.0:1788201257.364344:0:12964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442649728 00000100:00100000:0.0:1788201257.364395:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442649984 00000100:00100000:0.0:1788201257.364399:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442649984 00000100:00100000:2.0:1788201257.364404:0:12964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 113 00000100:00100000:2.0:1788201257.364416:0:12964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f950ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2361:x1875064442649728:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201257.364431:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 155 00000100:00100000:0.0:1788201257.364442:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d80f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2361:x1875064442650112:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201257.364488:0:12964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f950ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2361:x1875064442649728:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 75us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201257.364499:0:12964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 113 00000100:00100000:0.0:1788201257.364500:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d80f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2361:x1875064442650112:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 57us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201257.364510:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 155 00000100:00100000:0.0:1788201257.364532:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 156 00000100:00100000:0.0:1788201257.364540:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1a71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2361:x1875064442649984:12345-192.168.201.30@tcp:400:kworker.0 00000100:00080000:2.0:1788201257.364551:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201257.364556:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201257.364572:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1a71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2361:x1875064442649984:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 33us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201257.364580:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 156 00000100:00100000:3.0:1788201257.365070:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442649856 00000100:00100000:3.0:1788201257.365075:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442649856 00000100:00100000:3.0:1788201257.365140:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 90 00000100:00100000:3.0:1788201257.365158:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d80f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:2361:x1875064442649856:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201257.365205:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d80f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:2361:x1875064442649856:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 58us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201257.365212:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 90 00000100:00080000:2.0:1788201257.366187:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788201257.829569:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201258.220905:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201258.220947:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458224256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201258.221070:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201258.221351:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458224256 00000100:00100000:1.0:1788201258.221362:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458224256 00000100:00100000:1.0:1788201258.221446:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788201258.221458:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458224256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201258.221509:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 525008896 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1788201258.221737:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458224256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 281us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201258.221745:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788201258.223230:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458224256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201258.459477:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201258.459543:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201258.459581:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201258.459630:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201258.459847:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442650624 00000100:00100000:3.0:1788201258.459860:0:12965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442650240 00000100:00100000:3.0:1788201258.459872:0:12965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442650240 00000100:00100000:2.0:1788201258.459875:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442650624 00000100:00100000:2.0:1788201258.459964:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442650496 00000100:00100000:2.0:1788201258.459969:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442650496 00000100:00100000:3.0:1788201258.459975:0:12965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 114 00000100:00100000:3.0:1788201258.459995:0:12965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c648d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442650240:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201258.460018:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 157 00000100:00100000:2.0:1788201258.460033:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c26e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2362:x1875064442650624:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201258.460139:0:12965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c648d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442650240:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 137us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201258.460152:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c26e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2362:x1875064442650624:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 117us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201258.460164:0:12965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 114 00000100:00100000:2.0:1788201258.460171:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 157 00000100:00100000:2.0:1788201258.460200:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 158 00000100:00100000:2.0:1788201258.460208:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c26e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2362:x1875064442650496:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201258.460374:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442650368 00000100:00100000:1.0:1788201258.460382:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442650368 00000100:00100000:1.0:1788201258.460423:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 91 00000100:00100000:1.0:1788201258.460431:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c26e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:2358:x1875064442650368:12345-192.168.201.30@tcp:38:kworker.0 00010000:02000400:1.0:1788201258.460463:0:12968:0:(ldlm_lib.c:964:target_handle_reconnect()) lustre-MDT0000: Client 35604eb4-baf9-45be-a20a-4883a2cd8cf9 (at 192.168.201.30@tcp) reconnecting 00000100:00100000:2.0:1788201258.465211:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c26e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2362:x1875064442650496:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 4989us (5614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201258.465227:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 158 00010000:00080000:1.0:1788201258.478012:0:12968:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp t4294967305 exp ffff9e04fae42000 cur 533 last 1788201258 00000004:00100000:1.0:1788201258.478075:0:12968:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli 192.168.201.30@tcp supports cksum type 77, return 77 00000100:00080000:1.0:1788201258.478111:0:12968:0:(import.c:65:import_set_state_nolock()) ffff9e04fae46000 : changing import state from FULL to RECOVER 00000100:00080000:1.0:1788201258.478125:0:12968:0:(import.c:65:import_set_state_nolock()) ffff9e04fae46000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201258.478254:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c26e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:2358:x1875064442650368:12345-192.168.201.30@tcp:38:kworker.0 Request processed in 17822us (18621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201258.478267:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 91 00000100:00100000:0.0:1788201258.521542:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201258.521593:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201258.521614:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201258.522868:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442644864 00000100:00100000:2.0:1788201258.522881:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442644864 00000100:00100000:2.0:1788201258.522948:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442645888 00000100:00100000:2.0:1788201258.522952:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442645888 00000100:00100000:2.0:1788201258.522970:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442647552 00000100:00100000:2.0:1788201258.522973:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442647552 00000100:00100000:2.0:1788201258.522990:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5135 00000100:00100000:2.0:1788201258.522999:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c26e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:14313:x1875064442644864:12345-192.168.201.30@tcp:36:chmod.0 00000004:00080000:2.0:1788201258.523073:0:13379:0:(mdt_recovery.c:90:mdt_req_from_lrd()) @@@ restoring transno req@ffff9e03c26e0e00 x1875064442644864/t0(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:379/0 lens 488/3152 e 0 to 0 dl 1788201269 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00000004:00000400:2.0:1788201258.523085:0:13379:0:(mdt_recovery.c:102:mdt_req_from_lrd()) @@@ restoring transno req@ffff9e03c26e0e00 x1875064442644864/t8589938678(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:379/0 lens 488/3152 e 0 to 0 dl 1788201269 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201258.523655:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5136 00000100:00100000:1.0:1788201258.523671:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:14314:x1875064442645888:12345-192.168.201.30@tcp:36:chmod.0 00000004:00080000:1.0:1788201258.523714:0:13406:0:(mdt_recovery.c:90:mdt_req_from_lrd()) @@@ restoring transno req@ffff9e03c12d1500 x1875064442645888/t0(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:379/0 lens 488/3152 e 0 to 0 dl 1788201269 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00000004:00000400:1.0:1788201258.523730:0:13406:0:(mdt_recovery.c:102:mdt_req_from_lrd()) @@@ restoring transno req@ffff9e03c12d1500 x1875064442645888/t8589938680(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:379/0 lens 488/3152 e 0 to 0 dl 1788201269 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201258.523838:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:14314:x1875064442645888:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 173us (2244us total) trans 8589938680 rc 0/0 00000100:00100000:1.0:1788201258.523845:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5136 00000100:00100000:1.0:1788201258.523867:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5137 00000100:00100000:1.0:1788201258.523875:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:14318:x1875064442647552:12345-192.168.201.30@tcp:36:chmod.0 00000004:00080000:1.0:1788201258.523895:0:13406:0:(mdt_recovery.c:90:mdt_req_from_lrd()) @@@ restoring transno req@ffff9e03c12d3b80 x1875064442647552/t0(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:379/0 lens 488/3152 e 0 to 0 dl 1788201269 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00000004:00000400:1.0:1788201258.523903:0:13406:0:(mdt_recovery.c:102:mdt_req_from_lrd()) @@@ restoring transno req@ffff9e03c12d3b80 x1875064442647552/t8589938683(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:379/0 lens 488/3152 e 0 to 0 dl 1788201269 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201258.523941:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:14318:x1875064442647552:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 67us (2325us total) trans 8589938683 rc 0/0 00000100:00100000:1.0:1788201258.523948:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5137 00000100:00100000:0.0:1788201258.529935:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201258.530884:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442648192 00000100:00100000:1.0:1788201258.530897:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442648192 00000100:00100000:1.0:1788201258.530956:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5138 00000100:00100000:1.0:1788201258.530966:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:14316:x1875064442648192:12345-192.168.201.30@tcp:36:chmod.0 00000004:00080000:1.0:1788201258.531202:0:13406:0:(mdt_recovery.c:90:mdt_req_from_lrd()) @@@ restoring transno req@ffff9e03c12d1180 x1875064442648192/t0(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:379/0 lens 488/3152 e 0 to 0 dl 1788201269 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00000004:00000400:1.0:1788201258.531214:0:13406:0:(mdt_recovery.c:102:mdt_req_from_lrd()) @@@ restoring transno req@ffff9e03c12d1180 x1875064442648192/t8589938682(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:379/0 lens 488/3152 e 0 to 0 dl 1788201269 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201258.531781:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:14316:x1875064442648192:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 814us (1854us total) trans 8589938682 rc 0/0 00000100:00100000:1.0:1788201258.531792:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5138 00000100:00100000:0.0:1788201258.533382:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201258.538526:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442651264 00000100:00100000:3.0:1788201258.538541:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442651264 00000100:00100000:3.0:1788201258.538610:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4194 00000100:00100000:3.0:1788201258.538620:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2362:x1875064442651264:12345-192.168.201.30@tcp:2:chmod.0 00002000:00010000:3.0:1788201258.538886:0:6703:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x41a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788201258.538890:0:6703:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x41a:0x0] updating lvb mtime from disk: 1788201240 -> 1788201240 00002000:00010000:3.0:1788201258.538893:0:6703:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x41a:0x0] updating lvb atime from disk: 1788201240 -> 1788201240 00002000:00010000:3.0:1788201258.538895:0:6703:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x41a:0x0] updating lvb ctime from disk: 1788201240 -> 1788201242 00002000:00010000:3.0:1788201258.538898:0:6703:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x41a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788201258.546632:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:2362:x1875064442651264:12345-192.168.201.30@tcp:2:chmod.0 Request processed in 8001us (13246us total) trans 4294968847 rc 0/0 00000100:00100000:3.0:1788201258.546649:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4194 00000100:00100000:2.0:1788201258.548175:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c26e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:14313:x1875064442644864:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 25167us (26636us total) trans 8589938678 rc 0/0 00000100:00100000:2.0:1788201258.548187:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5135 00000100:00100000:0.0:1788201258.550149:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201258.550244:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201258.550332:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201258.550357:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201258.550396:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201258.550424:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442645120 00000100:00100000:0.0:1788201258.550434:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442645120 00000100:00100000:3.0:1788201258.550790:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442651392 00000100:00100000:3.0:1788201258.550795:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442651392 00000100:00100000:3.0:1788201258.550837:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442651520 00000100:00100000:3.0:1788201258.550840:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442651520 00000100:00100000:3.0:1788201258.550878:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4195 00000100:00100000:3.0:1788201258.550889:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:2362:x1875064442651392:12345-192.168.201.30@tcp:2:chmod.0 00002000:00010000:3.0:1788201258.551100:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788201258.551104:0:13445:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb mtime from disk: 1788201240 -> 1788201240 00002000:00010000:3.0:1788201258.551107:0:13445:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb atime from disk: 1788201240 -> 1788201240 00002000:00010000:3.0:1788201258.551109:0:13445:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb ctime from disk: 1788201240 -> 1788201242 00002000:00010000:3.0:1788201258.551111:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x41b:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788201258.551178:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:2362:x1875064442651392:12345-192.168.201.30@tcp:2:chmod.0 Request processed in 290us (1047us total) trans 4294968848 rc 0/0 00000100:00100000:3.0:1788201258.551187:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4195 00000100:00100000:3.0:1788201258.551203:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4196 00000100:00100000:3.0:1788201258.551210:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:2362:x1875064442651520:12345-192.168.201.30@tcp:2:chmod.0 00002000:00010000:3.0:1788201258.551282:0:13445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788201258.551285:0:13445:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb mtime from disk: 1788201240 -> 1788201240 00002000:00010000:3.0:1788201258.551287:0:13445:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb atime from disk: 1788201240 -> 1788201240 00002000:00010000:3.0:1788201258.551290:0:13445:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb ctime from disk: 1788201240 -> 1788201242 00002000:00010000:3.0:1788201258.551310:0:13445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x41c:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788201258.551334:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:2362:x1875064442651520:12345-192.168.201.30@tcp:2:chmod.0 Request processed in 124us (1090us total) trans 4294968849 rc 0/0 00000100:00100000:3.0:1788201258.551340:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4196 00000100:00100000:3.0:1788201258.551368:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442646912 00000100:00100000:3.0:1788201258.551371:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442646912 00000100:00100000:3.0:1788201258.551393:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442648576 00000100:00100000:3.0:1788201258.551396:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442648576 00000100:00100000:3.0:1788201258.551413:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5139 00000100:00100000:3.0:1788201258.551419:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:14315:x1875064442646912:12345-192.168.201.30@tcp:36:chmod.0 00000004:00080000:3.0:1788201258.551462:0:12971:0:(mdt_recovery.c:90:mdt_req_from_lrd()) @@@ restoring transno req@ffff9e03c12d3800 x1875064442646912/t0(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:379/0 lens 488/3152 e 0 to 0 dl 1788201269 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00000004:00000400:3.0:1788201258.551486:0:12971:0:(mdt_recovery.c:102:mdt_req_from_lrd()) @@@ restoring transno req@ffff9e03c12d3800 x1875064442646912/t8589938681(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:379/0 lens 488/3152 e 0 to 0 dl 1788201269 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201258.551543:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:14315:x1875064442646912:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 124us (1185us total) trans 8589938681 rc 0/0 00000100:00100000:3.0:1788201258.551550:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5139 00000100:00100000:3.0:1788201258.551563:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5140 00000100:00100000:3.0:1788201258.551569:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:14317:x1875064442648576:12345-192.168.201.30@tcp:36:chmod.0 00000004:00080000:3.0:1788201258.551590:0:12971:0:(mdt_recovery.c:90:mdt_req_from_lrd()) @@@ restoring transno req@ffff9e03c12d1c00 x1875064442648576/t0(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:379/0 lens 488/3152 e 0 to 0 dl 1788201269 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00000004:00000400:3.0:1788201258.551599:0:12971:0:(mdt_recovery.c:102:mdt_req_from_lrd()) @@@ restoring transno req@ffff9e03c12d1c00 x1875064442648576/t8589938684(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:379/0 lens 488/3152 e 0 to 0 dl 1788201269 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201258.551636:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:14317:x1875064442648576:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 67us (1240us total) trans 8589938684 rc 0/0 00000100:00100000:3.0:1788201258.551641:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5140 00000100:00100000:0.0:1788201258.557757:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5141 00000100:00100000:0.0:1788201258.557777:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:14312:x1875064442645120:12345-192.168.201.30@tcp:36:chmod.0 00000004:00080000:0.0:1788201258.557845:0:12969:0:(mdt_recovery.c:90:mdt_req_from_lrd()) @@@ restoring transno req@ffff9e03c12d2680 x1875064442645120/t0(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:379/0 lens 488/3152 e 0 to 0 dl 1788201269 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00000004:00000400:0.0:1788201258.557857:0:12969:0:(mdt_recovery.c:102:mdt_req_from_lrd()) @@@ restoring transno req@ffff9e03c12d2680 x1875064442645120/t8589938679(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:379/0 lens 488/3152 e 0 to 0 dl 1788201269 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201258.558201:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:14312:x1875064442645120:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 430us (7866us total) trans 8589938679 rc 0/0 00000100:00100000:0.0:1788201258.558210:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5141 00000100:00100000:1.0:1788201258.558844:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201258.558939:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201258.558972:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201258.559002:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442652032 00000100:00100000:1.0:1788201258.559017:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442652032 00000100:00100000:1.0:1788201258.559055:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442652160 00000100:00100000:1.0:1788201258.559059:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442652160 00000100:00100000:1.0:1788201258.559077:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442652288 00000100:00100000:1.0:1788201258.559080:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442652288 00000100:00100000:1.0:1788201258.559118:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4197 00000100:00100000:1.0:1788201258.559140:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35604eb4-baf9-45be-a20a-4883a2cd8cf9+510:2359:x1875064442652032:12345-192.168.201.30@tcp:2:chmod.0 00002000:00010000:1.0:1788201258.559413:0:13440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788201258.559417:0:13440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb mtime from disk: 1788201240 -> 1788201240 00002000:00010000:1.0:1788201258.559420:0:13440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb atime from disk: 1788201240 -> 1788201240 00002000:00010000:1.0:1788201258.559422:0:13440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb ctime from disk: 1788201240 -> 1788201242 00002000:00010000:1.0:1788201258.559424:0:13440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x41a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788201258.559806:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4198 00000100:00100000:3.0:1788201258.559818:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2360:x1875064442652160:12345-192.168.201.30@tcp:2:chmod.0 00002000:00010000:3.0:1788201258.559919:0:13442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788201258.559923:0:13442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb mtime from disk: 1788201240 -> 1788201240 00002000:00010000:3.0:1788201258.559925:0:13442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb atime from disk: 1788201240 -> 1788201240 00002000:00010000:3.0:1788201258.559926:0:13442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb ctime from disk: 1788201240 -> 1788201242 00002000:00010000:3.0:1788201258.559928:0:13442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x41c:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788201258.560150:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4199 00000100:00100000:0.0:1788201258.560160:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35604eb4-baf9-45be-a20a-4883a2cd8cf9+512:2360:x1875064442652288:12345-192.168.201.30@tcp:2:chmod.0 00002000:00010000:0.0:1788201258.560256:0:13446:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788201258.560259:0:13446:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb mtime from disk: 1788201240 -> 1788201240 00002000:00010000:0.0:1788201258.560262:0:13446:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb atime from disk: 1788201240 -> 1788201240 00002000:00010000:0.0:1788201258.560263:0:13446:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb ctime from disk: 1788201240 -> 1788201242 00002000:00010000:0.0:1788201258.560265:0:13446:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x41b:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788201258.571072:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35604eb4-baf9-45be-a20a-4883a2cd8cf9+513:2359:x1875064442652032:12345-192.168.201.30@tcp:2:chmod.0 Request processed in 11933us (12219us total) trans 4294968847 rc 0/0 00000100:00100000:1.0:1788201258.571101:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4197 00000100:00100000:3.0:1788201258.579166:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35604eb4-baf9-45be-a20a-4883a2cd8cf9+512:2360:x1875064442652160:12345-192.168.201.30@tcp:2:chmod.0 Request processed in 19339us (20215us total) trans 4294968848 rc 0/0 00000100:00100000:3.0:1788201258.579183:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4198 00000100:00100000:0.0:1788201258.579282:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2360:x1875064442652288:12345-192.168.201.30@tcp:2:chmod.0 Request processed in 18932us (20117us total) trans 4294968849 rc 0/0 00000100:00100000:0.0:1788201258.579323:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4199 00000100:00100000:0.0:1788201258.579406:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201258.581239:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442652416 00000100:00100000:3.0:1788201258.581253:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442652416 00000100:00100000:3.0:1788201258.581364:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4200 00000100:00100000:3.0:1788201258.581377:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:2359:x1875064442652416:12345-192.168.201.30@tcp:2:chmod.0 00002000:00010000:3.0:1788201258.581604:0:13444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x419:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788201258.581609:0:13444:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x419:0x0] updating lvb mtime from disk: 1788201240 -> 1788201240 00002000:00010000:3.0:1788201258.581611:0:13444:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x419:0x0] updating lvb atime from disk: 1788201240 -> 1788201240 00002000:00010000:3.0:1788201258.581613:0:13444:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x419:0x0] updating lvb ctime from disk: 1788201240 -> 1788201242 00002000:00010000:3.0:1788201258.581616:0:13444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x419:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788201258.581693:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:2359:x1875064442652416:12345-192.168.201.30@tcp:2:chmod.0 Request processed in 318us (2287us total) trans 4294968850 rc 0/0 00000100:00100000:3.0:1788201258.581700:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4200 00000100:00100000:1.0:1788201258.649636:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201258.649734:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442652544 00000100:00100000:3.0:1788201258.649744:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442652544 00000100:00100000:3.0:1788201258.649814:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5142 00000100:00100000:3.0:1788201258.649825:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:14342:x1875064442652544:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:3.0:1788201258.649858:0:13406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201258.649882:0:13406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d391e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4d76 expref: -99 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.649951:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3925 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.649966:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3925 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.649978:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3925 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.649993:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d392c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.650000:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d392c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.650026:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d392c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.650463:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3933 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.650473:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3933 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.650481:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3933 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201258.650514:0:13406:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f2:0x0]: returning size 0 00000004:00200000:3.0:1788201258.650519:0:13406:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201258.650540:0:13406:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3933 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.650552:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3933 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.650560:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3925 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.650566:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3925 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.650572:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3925 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.650579:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bda00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201258.650582:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3925 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.650589:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3925 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.650600:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:3.0:1788201258.650603:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201258.650607:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3925 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.650614:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3925 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.650626:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d392c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.650632:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d392c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.650638:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d392c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.650644:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201258.650646:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d392c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.650652:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d392c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.650659:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0xcda302ea (ffff9e03c33e8f00) 00010000:00010000:3.0:1788201258.650661:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201258.650664:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d392c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.650670:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d392c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.650701:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d391e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d76 expref: 16 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.650714:0:13406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3933 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d76 expref: 15 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.650722:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f2:0x0].0x0 (ffff9e03c2fc5700) 00010000:00010000:3.0:1788201258.650724:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201258.650726:0:13406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bdc00, rc 0) 00000100:00100000:3.0:1788201258.650786:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:14342:x1875064442652544:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 963us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201258.650794:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5142 00000100:00100000:2.0:1788201258.659351:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201258.659549:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442652672 00000100:00100000:1.0:1788201258.659560:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442652672 00000100:00100000:1.0:1788201258.659624:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 871 00000100:00100000:1.0:1788201258.659634:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:2359:x1875064442652672:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:1.0:1788201258.659692:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201258.659717:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d393a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4d7d expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.659778:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3941 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.659792:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3941 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.659803:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3941 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.659817:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d3948 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.659824:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d3948 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.659830:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d3948 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660230:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d394f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660240:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d394f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660247:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d394f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201258.660268:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f3:0x0]: returning size 0 00000004:00200000:1.0:1788201258.660272:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201258.660367:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d394f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660381:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d394f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660390:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3941 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660396:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3941 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660403:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3941 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660409:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201258.660413:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3941 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660419:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3941 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660431:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:1.0:1788201258.660434:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201258.660438:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3941 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660444:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3941 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660455:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d3948 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660462:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d3948 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660468:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d3948 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660474:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201258.660476:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d3948 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660482:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d3948 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660488:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x15fcbbea (ffff9e03c5173100) 00010000:00010000:1.0:1788201258.660490:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201258.660493:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d3948 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660498:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d3948 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660528:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d393a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d7d expref: 17 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660548:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d394f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d7d expref: 16 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660555:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f3:0x0].0x0 (ffff9e03c2fc5c00) 00010000:00010000:1.0:1788201258.660557:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201258.660560:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3a00, rc 0) 00010000:00010000:1.0:1788201258.660566:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201258.660574:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3956 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4d84 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660600:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d395d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660608:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d395d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660613:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d395d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660623:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3964 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660629:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3964 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660636:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3964 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660867:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d200/0x9383f985bc4d396b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660876:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d200/0x9383f985bc4d396b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660883:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d200/0x9383f985bc4d396b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201258.660898:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f4:0x0]: returning size 0 00000004:00200000:1.0:1788201258.660901:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201258.660910:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d200/0x9383f985bc4d396b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660923:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d200/0x9383f985bc4d396b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660929:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d395d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660935:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d395d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660941:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d395d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660946:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201258.660949:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d395d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660955:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d395d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660963:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:1.0:1788201258.660965:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201258.660968:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d395d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660973:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d395d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660982:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3964 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660988:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3964 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.660995:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3964 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.661001:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201258.661004:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3964 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.661010:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3964 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.661017:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x5e5674ea (ffff9e03c5173900) 00010000:00010000:1.0:1788201258.661019:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201258.661021:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3964 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.661027:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3964 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.661048:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3956 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d84 expref: 18 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.661059:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d200/0x9383f985bc4d396b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d84 expref: 17 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.661065:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f4:0x0].0x0 (ffff9e03c2fc5000) 00010000:00010000:1.0:1788201258.661067:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201258.661069:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c507d200, rc 0) 00010000:00010000:1.0:1788201258.661074:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201258.661081:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507de00/0x9383f985bc4d3972 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4d8b expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.661103:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507da00/0x9383f985bc4d3979 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.661111:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507da00/0x9383f985bc4d3979 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.661118:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507da00/0x9383f985bc4d3979 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.661142:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c400/0x9383f985bc4d3980 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.661150:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c400/0x9383f985bc4d3980 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.661156:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c400/0x9383f985bc4d3980 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.663607:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d800/0x9383f985bc4d3987 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.663627:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d800/0x9383f985bc4d3987 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.663639:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d800/0x9383f985bc4d3987 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201258.663664:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f5:0x0]: returning size 0 00000004:00200000:1.0:1788201258.663668:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201258.663688:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d800/0x9383f985bc4d3987 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.663702:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d800/0x9383f985bc4d3987 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.663709:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507da00/0x9383f985bc4d3979 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.663715:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507da00/0x9383f985bc4d3979 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.663722:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507da00/0x9383f985bc4d3979 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.663728:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507da00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201258.663732:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507da00/0x9383f985bc4d3979 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.663739:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507da00/0x9383f985bc4d3979 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.663751:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:1.0:1788201258.663754:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201258.663758:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507da00/0x9383f985bc4d3979 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.663764:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507da00/0x9383f985bc4d3979 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.663777:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c400/0x9383f985bc4d3980 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.663782:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c400/0x9383f985bc4d3980 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.663788:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c400/0x9383f985bc4d3980 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.663794:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507c400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201258.663796:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c400/0x9383f985bc4d3980 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.663803:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c400/0x9383f985bc4d3980 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.663809:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0xa6b02dea (ffff9e03c5173400) 00010000:00010000:1.0:1788201258.663812:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201258.663814:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c400/0x9383f985bc4d3980 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.663820:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c400/0x9383f985bc4d3980 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.663856:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507de00/0x9383f985bc4d3972 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d8b expref: 19 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.663869:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d800/0x9383f985bc4d3987 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d8b expref: 18 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.663876:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f5:0x0].0x0 (ffff9e03c5173d00) 00010000:00010000:1.0:1788201258.663878:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201258.663881:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c507d800, rc 0) 00010000:00010000:1.0:1788201258.663890:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201258.663900:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c200/0x9383f985bc4d398e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4d92 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.663936:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d600/0x9383f985bc4d3995 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.663945:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d600/0x9383f985bc4d3995 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.663952:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d600/0x9383f985bc4d3995 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.663965:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ca00/0x9383f985bc4d399c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.663972:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ca00/0x9383f985bc4d399c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.663979:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ca00/0x9383f985bc4d399c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.664255:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ce00/0x9383f985bc4d39a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.664264:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ce00/0x9383f985bc4d39a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.664271:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ce00/0x9383f985bc4d39a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201258.664284:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f6:0x0]: returning size 0 00000004:00200000:1.0:1788201258.664287:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201258.664463:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ce00/0x9383f985bc4d39a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.664478:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ce00/0x9383f985bc4d39a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.664485:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d600/0x9383f985bc4d3995 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.664490:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d600/0x9383f985bc4d3995 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.664496:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d600/0x9383f985bc4d3995 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.664501:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201258.664504:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d600/0x9383f985bc4d3995 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.664509:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d600/0x9383f985bc4d3995 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.664517:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:1.0:1788201258.664520:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201258.664523:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d600/0x9383f985bc4d3995 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.664529:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d600/0x9383f985bc4d3995 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.664539:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ca00/0x9383f985bc4d399c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.664544:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ca00/0x9383f985bc4d399c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.664550:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ca00/0x9383f985bc4d399c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.664556:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507ca00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201258.664559:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ca00/0x9383f985bc4d399c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.664565:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ca00/0x9383f985bc4d399c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.664572:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0xef09e6ea (ffff9e03c5173200) 00010000:00010000:1.0:1788201258.664574:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201258.664577:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ca00/0x9383f985bc4d399c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.664583:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ca00/0x9383f985bc4d399c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.664606:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c200/0x9383f985bc4d398e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d92 expref: 20 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.664617:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ce00/0x9383f985bc4d39a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d92 expref: 19 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.664623:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f6:0x0].0x0 (ffff9e03c5173800) 00010000:00010000:1.0:1788201258.664625:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201258.664627:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c507ce00, rc 0) 00010000:00010000:1.0:1788201258.664633:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201258.664640:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c000/0x9383f985bc4d39aa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4d99 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.664663:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d39b1 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.664671:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d39b1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.664677:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d39b1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.664688:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507dc00/0x9383f985bc4d39b8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.664694:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507dc00/0x9383f985bc4d39b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.664701:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507dc00/0x9383f985bc4d39b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.664939:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c600/0x9383f985bc4d39bf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.664949:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c600/0x9383f985bc4d39bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.664958:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c600/0x9383f985bc4d39bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201258.664973:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f7:0x0]: returning size 0 00000004:00200000:1.0:1788201258.664977:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201258.664988:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c600/0x9383f985bc4d39bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665002:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c600/0x9383f985bc4d39bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665025:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d39b1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665032:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d39b1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665039:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d39b1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665044:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507c800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201258.665048:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d39b1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665054:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d39b1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665062:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:1.0:1788201258.665064:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201258.665067:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d39b1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665072:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d39b1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665081:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507dc00/0x9383f985bc4d39b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665087:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507dc00/0x9383f985bc4d39b8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665094:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507dc00/0x9383f985bc4d39b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665099:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507dc00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201258.665102:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507dc00/0x9383f985bc4d39b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665108:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507dc00/0x9383f985bc4d39b8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665115:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x37639fea (ffff9e03c5173600) 00010000:00010000:1.0:1788201258.665117:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201258.665120:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507dc00/0x9383f985bc4d39b8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665138:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507dc00/0x9383f985bc4d39b8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665159:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c000/0x9383f985bc4d39aa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d99 expref: 21 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665170:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c600/0x9383f985bc4d39bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d99 expref: 20 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665176:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f7:0x0].0x0 (ffff9e03c5173b00) 00010000:00010000:1.0:1788201258.665179:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201258.665181:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c507c600, rc 0) 00010000:00010000:1.0:1788201258.665185:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201258.665192:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507cc00/0x9383f985bc4d39c6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4da0 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665216:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d400/0x9383f985bc4d39cd lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665224:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d400/0x9383f985bc4d39cd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665231:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d400/0x9383f985bc4d39cd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665243:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d39d4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665250:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d39d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665255:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d39d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665489:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d39db lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665499:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d39db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665505:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d39db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201258.665520:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f8:0x0]: returning size 0 00000004:00200000:1.0:1788201258.665523:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201258.665533:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d39db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665545:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d39db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665552:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d400/0x9383f985bc4d39cd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665558:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d400/0x9383f985bc4d39cd lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665564:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d400/0x9383f985bc4d39cd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665569:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201258.665572:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d400/0x9383f985bc4d39cd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665578:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d400/0x9383f985bc4d39cd lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665585:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:1.0:1788201258.665587:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201258.665590:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d400/0x9383f985bc4d39cd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665595:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d400/0x9383f985bc4d39cd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665604:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d39d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665610:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d39d4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665617:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d39d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665622:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201258.665624:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d39d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665630:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d39d4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665635:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x7fbd58ea (ffff9e03c5173e00) 00010000:00010000:1.0:1788201258.665637:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201258.665640:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d39d4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665645:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d39d4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665662:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507cc00/0x9383f985bc4d39c6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4da0 expref: 22 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665671:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d39db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4da0 expref: 21 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665677:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f8:0x0].0x0 (ffff9e03c33e8400) 00010000:00010000:1.0:1788201258.665679:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201258.665681:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9c0be00, rc 0) 00010000:00010000:1.0:1788201258.665685:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201258.665691:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ba00/0x9383f985bc4d39e2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4da7 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665711:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a400/0x9383f985bc4d39e9 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665719:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a400/0x9383f985bc4d39e9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665726:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a400/0x9383f985bc4d39e9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665735:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d39f0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665742:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d39f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665748:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d39f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665855:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a400/0x9383f985bc4d39e9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665862:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a400/0x9383f985bc4d39e9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665868:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a400/0x9383f985bc4d39e9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665873:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0a400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201258.665876:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a400/0x9383f985bc4d39e9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665886:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a400/0x9383f985bc4d39e9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665894:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:1.0:1788201258.665896:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201258.665898:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a400/0x9383f985bc4d39e9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665904:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a400/0x9383f985bc4d39e9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665912:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d39f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665918:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d39f0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665925:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d39f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665929:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0b600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201258.665932:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d39f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665938:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d39f0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665943:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0xc81711ea (ffff9e03c5173f00) 00010000:00010000:1.0:1788201258.665945:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201258.665948:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d39f0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665954:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d39f0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665971:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ba00/0x9383f985bc4d39e2 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4da7 expref: 22 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665980:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:1.0:1788201258.665982:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201258.665985:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ba00/0x9383f985bc4d39e2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4da7 expref: 22 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.665993:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9c0ba00, rc -2) 00000100:00100000:1.0:1788201258.666217:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:2359:x1875064442652672:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 6583us (6875us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201258.666226:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 871 00000100:00100000:1.0:1788201258.668028:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201258.668148:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201258.668664:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442652800 00000100:00100000:2.0:1788201258.668676:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442652800 00000100:00100000:2.0:1788201258.668747:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5143 00000100:00100000:2.0:1788201258.668759:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5392a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:14345:x1875064442652800:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:2.0:1788201258.668783:0:13379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201258.668805:0:13379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d39f7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4db5 expref: -99 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.668875:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d39fe lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.668889:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d39fe lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.668900:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d39fe lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.668917:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3a05 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.668925:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3a05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.668933:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3a05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201258.669432:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442652928 00000100:00100000:3.0:1788201258.669438:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442652928 00000100:00100000:3.0:1788201258.669514:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 872 00000100:00100000:3.0:1788201258.669523:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5392300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:2360:x1875064442652928:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:3.0:1788201258.669550:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201258.669563:0:6715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3a0c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4dbc expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.669596:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3a13 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.669605:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3a13 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.669614:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3a13 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.669626:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3a1a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xa05302ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.669633:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3a1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.669640:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3a1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.669695:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3a13 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.669703:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3a13 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.669710:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3a13 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.669716:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bda00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201258.669720:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3a13 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.669727:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3a13 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.669738:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:3.0:1788201258.669741:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201258.669746:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3a13 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.669753:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3a13 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.669765:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3a1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.669771:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3a1a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.669778:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3a1a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.669784:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bd800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201258.669787:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3a1a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.669794:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3a1a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.669802:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0xa05302ea (ffff9e03c33e8f00) 00010000:00010000:3.0:1788201258.669804:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201258.669808:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3a1a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.669814:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3a1a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.669844:0:6715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3a0c lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4dbc expref: 24 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.669861:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:3.0:1788201258.669863:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201258.669867:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3a0c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4dbc expref: 24 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.669876:0:6715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bc000, rc -2) 00000100:00100000:3.0:1788201258.669982:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5392300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:2360:x1875064442652928:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 460us (1833us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201258.669992:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 872 00010000:00010000:2.0:1788201258.670453:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3a21 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.670465:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3a21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.670474:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3a21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201258.670508:0:13379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f3:0x0]: returning size 0 00000004:00200000:2.0:1788201258.670512:0:13379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201258.670528:0:13379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3a21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.670539:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3a21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.670546:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d39fe lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.670552:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d39fe lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.670558:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d39fe lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.670563:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201258.670566:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d39fe lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.670572:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d39fe lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.670580:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:2.0:1788201258.670582:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201258.670585:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d39fe lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.670595:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d39fe lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.670606:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3a05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.670610:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3a05 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.670616:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3a05 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.670621:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201258.670623:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3a05 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.670629:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3a05 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.670636:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x15fcbbea (ffff9e03c33ed500) 00010000:00010000:2.0:1788201258.670638:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201258.670641:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3a05 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.670647:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3a05 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.670672:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d39f7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4db5 expref: 23 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.670691:0:13379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3a21 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4db5 expref: 22 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.670698:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f3:0x0].0x0 (ffff9e03c2fc5c00) 00010000:00010000:2.0:1788201258.670701:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201258.670703:0:13379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031c00, rc 0) 00000100:00100000:2.0:1788201258.670747:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5392a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:14345:x1875064442652800:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 1991us (2726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201258.670754:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5143 00000100:00100000:1.0:1788201258.674798:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201258.675098:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442653056 00000100:00100000:0.0:1788201258.675109:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442653056 00000100:00100000:0.0:1788201258.675349:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:0.0:1788201258.675362:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3448e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:2360:x1875064442653056:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201258.675381:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201258.675409:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3a21 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4db5 expref: 22 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.675427:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f3:0x0].0x0 (ffff9e03c2fc5c00) 00010000:00010000:0.0:1788201258.675433:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201258.675504:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3448e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:2360:x1875064442653056:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 145us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201258.675512:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:3.0:1788201258.683551:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201258.685727:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442653184 00000100:00100000:0.0:1788201258.685743:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442653184 00000100:00100000:0.0:1788201258.685855:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5144 00000100:00100000:0.0:1788201258.685866:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:14346:x1875064442653184:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:0.0:1788201258.685889:0:12969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201258.685912:0:12969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3a28 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4dc3 expref: -99 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.685979:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d3a2f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.685994:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d3a2f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.686006:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d3a2f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.686037:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3a36 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.686046:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3a36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.686052:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3a36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.686786:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3a3d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.686799:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3a3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.686806:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3a3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201258.686840:0:12969:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f4:0x0]: returning size 0 00000004:00200000:0.0:1788201258.686846:0:12969:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201258.686868:0:12969:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3a3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.686879:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3a3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.686887:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d3a2f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.686892:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d3a2f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.686903:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d3a2f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.686909:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201258.686912:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d3a2f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.686919:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d3a2f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.686931:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:0.0:1788201258.686933:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201258.686937:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d3a2f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.686943:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d3a2f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.686957:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3a36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.686963:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3a36 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.686969:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3a36 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.686974:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201258.686976:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3a36 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.686986:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3a36 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.686991:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x5e5674ea (ffff9e04ff181f00) 00010000:00010000:0.0:1788201258.686994:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201258.686996:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3a36 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.687001:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3a36 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.687046:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3a28 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4dc3 expref: 23 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.687060:0:12969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3a3d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4dc3 expref: 22 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.687067:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f4:0x0].0x0 (ffff9e03c2fc5000) 00010000:00010000:0.0:1788201258.687069:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201258.687072:0:12969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c19a8000, rc 0) 00000100:00100000:0.0:1788201258.687437:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:14346:x1875064442653184:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 1572us (3895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201258.687446:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5144 00000100:00100000:2.0:1788201258.690337:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201258.690430:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442653312 00000100:00100000:0.0:1788201258.690441:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442653312 00000100:00100000:0.0:1788201258.690519:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:0.0:1788201258.690531:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:2362:x1875064442653312:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201258.690551:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201258.690578:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3a3d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4dc3 expref: 22 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.690595:0:13458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f4:0x0].0x0 (ffff9e03c2fc5000) 00010000:00010000:0.0:1788201258.690600:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201258.690653:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:2362:x1875064442653312:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 125us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201258.690661:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:1.0:1788201258.718399:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201258.718524:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442653440 00000100:00100000:0.0:1788201258.718539:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442653440 00000100:00100000:0.0:1788201258.718624:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5145 00000100:00100000:0.0:1788201258.718639:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:14347:x1875064442653440:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:0.0:1788201258.718676:0:12968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201258.718708:0:12968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3a44 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4dca expref: -99 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.718801:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3a4b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.718820:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3a4b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.718834:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3a4b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.718852:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3a52 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.718865:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3a52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.718872:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3a52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.719394:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d3a59 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.719407:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d3a59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.719415:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d3a59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201258.719459:0:12968:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f5:0x0]: returning size 0 00000004:00200000:0.0:1788201258.719465:0:12968:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201258.719489:0:12968:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d3a59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.719503:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d3a59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.719513:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3a4b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.719520:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3a4b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.719529:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3a4b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.719541:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201258.719547:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3a4b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.719556:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3a4b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.719571:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:0.0:1788201258.719574:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201258.719580:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3a4b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.719587:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3a4b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.719602:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3a52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.719609:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3a52 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.719616:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3a52 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.719622:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201258.719626:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3a52 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.719632:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3a52 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.719645:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0xa6b02dea (ffff9e04ff181f00) 00010000:00010000:0.0:1788201258.719648:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201258.719651:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3a52 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.719659:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3a52 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.719697:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3a44 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4dca expref: 23 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.719711:0:12968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d3a59 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4dca expref: 22 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.719720:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f5:0x0].0x0 (ffff9e03c5173d00) 00010000:00010000:0.0:1788201258.719722:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201258.719725:0:12968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c19a9a00, rc 0) 00000100:00100000:0.0:1788201258.720155:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:14347:x1875064442653440:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 1516us (1769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201258.720166:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5145 00000100:00100000:1.0:1788201258.737053:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201258.737166:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442653568 00000100:00100000:3.0:1788201258.737179:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442653568 00000100:00100000:3.0:1788201258.737424:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:3.0:1788201258.737438:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:2361:x1875064442653568:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201258.737525:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201258.737561:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d3a59 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4dca expref: 22 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.737588:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f5:0x0].0x0 (ffff9e03c5173d00) 00010000:00010000:3.0:1788201258.737594:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201258.737714:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:2361:x1875064442653568:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 278us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201258.737723:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:1.0:1788201258.754408:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201258.754948:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442653696 00000100:00100000:3.0:1788201258.754972:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442653696 00000100:00100000:2.0:1788201258.755147:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5146 00000100:00100000:2.0:1788201258.755162:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:14348:x1875064442653696:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:2.0:1788201258.755198:0:13379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201258.755229:0:13379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3a60 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4dd1 expref: -99 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.755405:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3a67 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.755422:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3a67 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.755437:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3a67 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.755531:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3a6e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.755540:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3a6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.755547:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3a6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.761067:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3a75 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.761096:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3a75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.761111:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3a75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201258.761178:0:13379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f6:0x0]: returning size 0 00000004:00200000:2.0:1788201258.761184:0:13379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201258.761211:0:13379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3a75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.761225:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3a75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.761235:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3a67 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.761241:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3a67 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.761248:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3a67 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.762584:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201258.762592:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3a67 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.762603:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3a67 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.762625:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:2.0:1788201258.762629:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201258.762635:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3a67 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.762642:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3a67 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.762666:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3a6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.762673:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3a6e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.762680:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3a6e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.762686:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201258.762689:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3a6e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.762695:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3a6e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.762706:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0xef09e6ea (ffff9e03c33ed500) 00010000:00010000:2.0:1788201258.762708:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201258.762711:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3a6e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.762718:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3a6e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.762781:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3a60 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4dd1 expref: 23 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.762798:0:13379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3a75 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4dd1 expref: 22 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.762805:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f6:0x0].0x0 (ffff9e03c5173800) 00010000:00010000:2.0:1788201258.762808:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201258.762811:0:13379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031a00, rc 0) 00000100:00100000:2.0:1788201258.762931:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:14348:x1875064442653696:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 7769us (8538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201258.762942:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5146 00000100:00100000:2.0:1788201258.770093:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201258.770183:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442653824 00000100:00100000:3.0:1788201258.770198:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442653824 00000100:00100000:3.0:1788201258.770407:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:3.0:1788201258.770420:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:2361:x1875064442653824:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201258.770439:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201258.770469:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3a75 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4dd1 expref: 22 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.770494:0:8524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f6:0x0].0x0 (ffff9e03c5173800) 00010000:00010000:3.0:1788201258.770500:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201258.770566:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:2361:x1875064442653824:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 149us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201258.770574:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:1.0:1788201258.782093:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201258.782559:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442653952 00000100:00100000:0.0:1788201258.782572:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442653952 00000100:00100000:0.0:1788201258.782697:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5147 00000100:00100000:0.0:1788201258.782709:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c543c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:14349:x1875064442653952:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:0.0:1788201258.782730:0:12969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201258.782750:0:12969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3a7c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4dd8 expref: -99 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.782819:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3a83 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.782845:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3a83 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.782856:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3a83 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.782871:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3a8a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.782878:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3a8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.782885:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3a8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.783258:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d3a91 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.783268:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d3a91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.783276:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d3a91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201258.783361:0:12969:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f7:0x0]: returning size 0 00000004:00200000:0.0:1788201258.783366:0:12969:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201258.783386:0:12969:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d3a91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.783401:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d3a91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.783408:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3a83 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.783414:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3a83 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.783420:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3a83 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.783425:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201258.783428:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3a83 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.783435:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3a83 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.783445:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:0.0:1788201258.783448:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201258.783452:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3a83 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.783457:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3a83 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.783468:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3a8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.783473:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3a8a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.783478:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3a8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.783483:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a8e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201258.783485:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3a8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.783491:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3a8a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.783497:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x37639fea (ffff9e04ff181f00) 00010000:00010000:0.0:1788201258.783499:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201258.783502:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3a8a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.783507:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3a8a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.783537:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3a7c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4dd8 expref: 23 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.783549:0:12969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d3a91 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4dd8 expref: 22 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.783555:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f7:0x0].0x0 (ffff9e03c5173b00) 00010000:00010000:0.0:1788201258.783557:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201258.783559:0:12969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c19a9800, rc 0) 00000100:00100000:0.0:1788201258.783630:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c543c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:14349:x1875064442653952:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 924us (1547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201258.783640:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5147 00000100:00100000:0.0:1788201258.795948:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201258.797021:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442654080 00000100:00100000:2.0:1788201258.797072:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442654080 00000100:00100000:2.0:1788201258.797193:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:2.0:1788201258.797205:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:2360:x1875064442654080:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201258.797230:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201258.797274:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d3a91 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4dd8 expref: 22 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.797342:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f7:0x0].0x0 (ffff9e03c5173b00) 00010000:00010000:2.0:1788201258.797350:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201258.797592:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:2360:x1875064442654080:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 239us (1505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201258.797603:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:2.0:1788201258.817751:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201258.817810:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201258.817999:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442654336 00000100:00100000:1.0:1788201258.818012:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442654336 00000100:00100000:1.0:1788201258.818097:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 873 00000100:00100000:1.0:1788201258.818110:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:2361:x1875064442654336:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:1.0:1788201258.818179:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201258.818208:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b000/0x9383f985bc4d3a98 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4de6 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.818289:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b200/0x9383f985bc4d3a9f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.818344:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b200/0x9383f985bc4d3a9f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.818360:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b200/0x9383f985bc4d3a9f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.818381:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3aa6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x60f002ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201258.818382:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442654208 00010000:00010000:1.0:1788201258.818391:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x60f002ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201258.818400:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442654208 00010000:00010000:1.0:1788201258.818413:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x60f002ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201258.818487:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5148 00000100:00100000:3.0:1788201258.818501:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:14350:x1875064442654208:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:3.0:1788201258.818524:0:12968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201258.818550:0:12968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3aad lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4ddf expref: -99 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.818617:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3ab4 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.818633:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3ab4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.818646:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3ab4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.818663:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3abb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.818671:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3abb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.818678:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3abb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.824086:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b200/0x9383f985bc4d3a9f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.824105:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b200/0x9383f985bc4d3a9f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.824114:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b200/0x9383f985bc4d3a9f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.824120:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0b200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201258.824138:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b200/0x9383f985bc4d3a9f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.824147:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b200/0x9383f985bc4d3a9f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.824170:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:1.0:1788201258.824174:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201258.824180:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b200/0x9383f985bc4d3a9f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.824187:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b200/0x9383f985bc4d3a9f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.824205:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x60f002ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.824211:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3aa6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x60f002ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.824217:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x60f002ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.824223:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0ac00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201258.824226:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x60f002ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.824231:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3aa6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x60f002ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.824238:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x60f002ea (ffff9e03c5173f00) 00010000:00010000:1.0:1788201258.824241:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201258.824245:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3aa6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x60f002ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.824251:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3aa6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x60f002ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.824740:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3ac2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.824758:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.824770:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201258.824822:0:12968:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f8:0x0]: returning size 0 00000004:00200000:2.0:1788201258.824827:0:12968:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201258.824853:0:12968:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.824866:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.824914:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b000/0x9383f985bc4d3a98 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4de6 expref: 24 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.828701:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3ab4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.829040:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3ab4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.829054:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3ab4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.829061:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bd800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201258.829068:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3ab4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.829081:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3ab4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.829104:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:2.0:1788201258.829107:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201258.829112:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3ab4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.829119:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3ab4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.829157:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3abb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.829164:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3abb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.829170:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3abb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.829176:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bda00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201258.829179:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3abb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.829189:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3abb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.829197:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x7fbd58ea (ffff9e03c33e8f00) 00010000:00010000:2.0:1788201258.829200:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201258.829203:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3abb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.829208:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3abb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.829275:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3aad lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ddf expref: 25 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.829319:0:12968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ddf expref: 24 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.829327:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f8:0x0].0x0 (ffff9e03c33e8400) 00010000:00010000:2.0:1788201258.829330:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201258.829333:0:12968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031400, rc 0) 00010000:00010000:1.0:1788201258.829876:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:1.0:1788201258.829881:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201258.829887:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b000/0x9383f985bc4d3a98 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4de6 expref: 24 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.829902:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9c0b000, rc -2) 00000100:00100000:2.0:1788201258.831659:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:14350:x1875064442654208:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 13144us (13906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201258.831678:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5148 00000100:00100000:1.0:1788201258.839893:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:2361:x1875064442654336:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 21764us (22061us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201258.839914:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 873 00000100:00100000:2.0:1788201258.847619:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201258.847710:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442654464 00000100:00100000:3.0:1788201258.847726:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442654464 00000100:00100000:3.0:1788201258.847884:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:3.0:1788201258.847898:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c7e17050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:2362:x1875064442654464:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201258.847916:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201258.847943:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3ac2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ddf expref: 22 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.847965:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f8:0x0].0x0 (ffff9e03c33e8400) 00010000:00010000:3.0:1788201258.847970:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201258.848038:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c7e17050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:2362:x1875064442654464:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 145us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201258.848047:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 17 00010000:00010000:1.0:1788201258.854871:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201258.854976:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201258.855184:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442654592 00000100:00100000:2.0:1788201258.855199:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442654592 00000100:00100000:2.0:1788201258.855286:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5149 00000100:00100000:2.0:1788201258.855339:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:14351:x1875064442654592:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1788201258.855372:0:13379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201258.855413:0:13379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3ac9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4ded expref: -99 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.855523:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3ad0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.855540:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.855555:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201258.856014:0:13379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f1:0x0]: returning size 7680 00000004:00200000:2.0:1788201258.856020:0:13379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 7 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201258.856109:0:13379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.856158:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3ac9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ded expref: 23 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.856182:0:13379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3ad0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ded expref: 22 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.856193:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:2.0:1788201258.856196:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201258.856201:0:13379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031c00, rc 0) 00000100:00100000:2.0:1788201258.856806:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:14351:x1875064442654592:12345-192.168.201.30@tcp:101:rm.0 Request processed in 1505us (1838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201258.856816:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5149 00000100:00100000:1.0:1788201258.863641:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201258.864049:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442654848 00000100:00100000:0.0:1788201258.864068:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442654848 00000100:00100000:0.0:1788201258.864179:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5150 00000100:00100000:0.0:1788201258.864193:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c543ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:14351:x1875064442654848:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1788201258.864225:0:12969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201258.864257:0:12969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3ad7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4df4 expref: -99 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201258.864878:0:12969:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f1:0x0]: returning size 7680 00010000:00010000:0.0:1788201258.865167:0:12969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3ad7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4df4 expref: 24 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.865187:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173700) 00010000:00010000:0.0:1788201258.865191:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201258.865197:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3ad7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4df4 expref: 24 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.865214:0:12969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c19a8200, rc 0) 00000100:00100000:0.0:1788201258.865327:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c543ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:14351:x1875064442654848:12345-192.168.201.30@tcp:101:rm.0 Request processed in 1137us (1696us total) trans 8589938685 rc 301/301 00000100:00100000:0.0:1788201258.865336:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5150 00000100:00100000:0.0:1788201258.872075:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201258.875675:0:13381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442654976 00000100:00100000:2.0:1788201258.875698:0:13381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442654976 00000100:00100000:2.0:1788201258.875967:0:13381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1031 00000100:00100000:2.0:1788201258.875981:0:13381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:14351:x1875064442654976:12345-192.168.201.30@tcp:37:rm.0 00000100:00100000:2.0:1788201258.883978:0:13381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:14351:x1875064442654976:12345-192.168.201.30@tcp:37:rm.0 Request processed in 7982us (11901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201258.883996:0:13381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1031 00000100:00100000:1.0:1788201258.892037:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201258.892154:0:12973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442655232 00000100:00100000:3.0:1788201258.892168:0:12973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442655232 00000100:00100000:3.0:1788201258.892257:0:12973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1032 00000100:00100000:3.0:1788201258.892270:0:12973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c543ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:14351:x1875064442655232:12345-192.168.201.30@tcp:35:rm.0 00000100:00100000:3.0:1788201258.893050:0:12973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c543ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:14351:x1875064442655232:12345-192.168.201.30@tcp:35:rm.0 Request processed in 778us (1024us total) trans 8589938686 rc 0/0 00000100:00100000:3.0:1788201258.893060:0:12973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1032 00000100:00100000:0.0:1788201258.899207:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201258.899384:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442655488 00000100:00100000:2.0:1788201258.899407:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442655488 00000100:00100000:2.0:1788201258.899622:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5151 00000100:00100000:2.0:1788201258.899636:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:14351:x1875064442655488:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1788201258.899690:0:12968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201258.899731:0:12968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3ae5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4dfb expref: -99 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.900105:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3aec lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.900132:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3aec lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.900147:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3aec lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201258.900161:0:12968:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f1:0x0]: returning size 7680 00010000:00010000:3.0:1788201258.901428:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3ae5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4dfb expref: 27 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.901634:0:12968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3aec lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4dfb expref: 26 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.901645:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:3.0:1788201258.901648:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788201258.901652:0:12968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031000, rc 0) 00000100:00100000:3.0:1788201258.901816:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:14351:x1875064442655488:12345-192.168.201.30@tcp:101:rm.0 Request processed in 2182us (2622us total) trans 8589938687 rc 0/0 00000100:00100000:3.0:1788201258.901826:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5151 00000100:00100000:0.0:1788201258.911654:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201258.911753:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442655616 00000100:00100000:3.0:1788201258.911778:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442655616 00000100:00100000:3.0:1788201258.911864:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5152 00000100:00100000:3.0:1788201258.911877:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:14351:x1875064442655616:12345-192.168.201.30@tcp:41:rm.0 00000004:00000024:3.0:1788201258.911962:0:12971:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 7717519360 avail 7689207808 00000100:00100000:3.0:1788201258.912061:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:14351:x1875064442655616:12345-192.168.201.30@tcp:41:rm.0 Request processed in 185us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201258.912070:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5152 00000100:00100000:1.0:1788201258.933450:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201258.933673:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442655872 00000100:00100000:0.0:1788201258.933687:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442655872 00000100:00100000:0.0:1788201258.933781:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5153 00000100:00100000:0.0:1788201258.933794:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c543c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:14351:x1875064442655872:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:0.0:1788201258.933878:0:12969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788201258.933914:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c600/0x9383f985bc4d39bf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d99 expref: 26 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.933944:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d36e7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c2d expref: 25 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.933969:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f7:0x0].0x0 (ffff9e03c5173b00) 00010000:00010000:0.0:1788201258.933991:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3ad0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ded expref: 24 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.934000:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:0.0:1788201258.934004:0:12969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201258.934034:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d3afa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.934050:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d3afa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.934063:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d3afa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.934082:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3b01 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.934090:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3b01 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.934097:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3b01 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.935283:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3b08 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.935332:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3b08 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.935342:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3b08 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201258.936557:0:12969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].506, 64 off40576 00000004:00080000:1.0:1788201258.936572:0:12969:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 534194277464ns, next at 535194274109ns, rc = 0 00010000:00010000:1.0:1788201258.936663:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3b0f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.936677:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3b0f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.936688:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3b0f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.936696:0:12969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3b0f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.936702:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3b0f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.936710:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3b0f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.936738:0:12969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201258.936767:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3b08 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.936774:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3b08 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.936781:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3b08 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.936788:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0b400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201258.936794:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3b08 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.936803:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3b08 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.936815:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f7:0x0].0x0 (ffff9e03c5173f00) 00010000:00010000:1.0:1788201258.936818:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201258.936823:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3b08 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.936831:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3b08 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.936854:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d3afa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.936862:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d3afa lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.936868:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d3afa lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.936873:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a8800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201258.936876:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d3afa lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.936881:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d3afa lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.936889:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:1.0:1788201258.936891:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201258.936895:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d3afa lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.936900:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d3afa lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201258.936912:0:12969:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002d799a48 reply state 00000000ccf9861f transno 8589938688 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3b01 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201258.936923:0:12969:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201258.937049:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c543c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+25:14351:x1875064442655872:12345-192.168.201.30@tcp:36:rm.0 Request processed in 3252us (3610us total) trans 8589938688 rc 0/0 00000100:00100000:1.0:1788201258.937060:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5153 00010000:00010000:0.0:1788201258.937704:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201258.937774:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3b0f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.937787:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0b800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201258.937792:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3b0f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.937800:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3b0f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.937815:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f7:0x0].0x0 (ffff9e03c5173f00) 00010000:00010000:0.0:1788201258.937819:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201258.937822:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3b0f lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.937828:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3b0f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.937848:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201258.937852:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201258.937854:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201258.939692:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3b01 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.939821:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3b01 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.939836:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3b01 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.939843:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a8200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201258.939849:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3b01 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.939857:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3b01 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.939876:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x37639fea (ffff9e04ff181f00) 00010000:00010000:0.0:1788201258.939878:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201258.939884:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3b01 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.939890:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3b01 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201258.945633:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201258.946021:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442656128 00000100:00100000:3.0:1788201258.946036:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442656128 00000100:00100000:3.0:1788201258.946507:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5154 00000100:00100000:3.0:1788201258.946521:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:14351:x1875064442656128:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:3.0:1788201258.946587:0:12968:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788201258.946615:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3933 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d76 expref: 24 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.946645:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017000/0x9383f985bc4d35f2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4be7 expref: 23 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.946656:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f2:0x0].0x0 (ffff9e03c2fc5700) 00010000:00010000:3.0:1788201258.946667:0:12968:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201258.946688:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d3b16 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.946700:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d3b16 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.946709:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d3b16 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.946722:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3b1d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.946728:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3b1d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.946733:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3b1d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.946842:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3b24 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.946855:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3b24 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.946862:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3b24 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201258.947566:0:12968:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].506, 64 off40576 00000004:00080000:3.0:1788201258.947577:0:12968:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 534205282663ns, next at 535205279971ns, rc = 0 00010000:00010000:3.0:1788201258.947638:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3b2b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.947649:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3b2b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.947657:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3b2b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.947664:0:12968:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3b2b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.947670:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3b2b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.947676:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3b2b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.947709:0:12968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201258.947731:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3b24 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.947738:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3b24 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.947745:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3b24 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.947752:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201258.947756:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3b24 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.947763:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3b24 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.947772:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f2:0x0].0x0 (ffff9e03c33e8c00) 00010000:00010000:3.0:1788201258.947775:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201258.947780:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3b24 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.947786:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3b24 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.947803:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d3b16 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.947809:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d3b16 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.947811:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201258.947818:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d3b16 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.947826:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bcc00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201258.947827:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3b2b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.947830:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d3b16 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.947862:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d3b16 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.947869:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:3.0:1788201258.947871:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201258.947874:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d3b16 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.947880:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d3b16 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201258.947888:0:12968:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce6dfb04 reply state 00000000dd8e5f44 transno 8589938689 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3b1d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201258.947897:0:12968:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201258.947924:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bda00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201258.947934:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3b2b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.947946:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3b2b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201258.947985:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:14351:x1875064442656128:12345-192.168.201.30@tcp:36:rm.0 Request processed in 1465us (2366us total) trans 8589938689 rc 0/0 00000100:00100000:3.0:1788201258.947995:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5154 00010000:00010000:1.0:1788201258.948484:0:7645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f2:0x0].0x0 (ffff9e03c33e8c00) 00010000:00010000:1.0:1788201258.948487:0:7645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201258.948493:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3b2b lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.948500:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3b2b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.948597:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201258.948600:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201258.948602:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201258.950771:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3b1d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.950788:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3b1d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.950795:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3b1d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.950801:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201258.950805:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3b1d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.950816:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3b1d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.950832:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0xcda302ea (ffff9e03c33e8b00) 00010000:00010000:3.0:1788201258.950835:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201258.950840:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3b1d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.950845:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3b1d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201258.954074:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201258.954214:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442656384 00000100:00100000:0.0:1788201258.954229:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442656384 00000100:00100000:0.0:1788201258.954417:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5155 00000100:00100000:0.0:1788201258.954429:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:14351:x1875064442656384:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:0.0:1788201258.954632:0:13406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788201258.954660:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507ce00/0x9383f985bc4d39a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d92 expref: 23 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.954683:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d36b6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c1f expref: 22 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.954699:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f6:0x0].0x0 (ffff9e03c5173800) 00010000:00010000:0.0:1788201258.954710:0:13406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201258.954732:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3b32 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.954745:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3b32 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.954755:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3b32 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.954770:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3b39 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.954776:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3b39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.954782:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3b39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.954896:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3b40 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.954905:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3b40 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.954912:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3b40 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201258.965385:0:13406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].507, 64 off40640 00010000:00010000:1.0:1788201258.965511:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3b47 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.965535:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3b47 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.965550:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3b47 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.965561:0:13406:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3b47 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.965568:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3b47 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.965575:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3b47 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.965602:0:13406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201258.965632:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3b40 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.965639:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3b40 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.965645:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3b40 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.965651:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a8e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201258.965657:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3b40 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.965665:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3b40 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.965680:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f6:0x0].0x0 (ffff9e04ff181500) 00010000:00010000:1.0:1788201258.965683:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201258.965688:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3b40 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.965695:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3b40 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.965717:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3b32 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.965723:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3b32 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.965729:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3b32 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.965734:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a8200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201258.965737:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3b32 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.965743:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3b32 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.965755:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:1.0:1788201258.965757:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201258.965760:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3b32 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.965766:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3b32 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201258.965775:0:13406:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d34fa0ff reply state 000000004feb03d0 transno 8589938690 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3b39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201258.965786:0:13406:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201258.965922:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:14351:x1875064442656384:12345-192.168.201.30@tcp:36:rm.0 Request processed in 11489us (11856us total) trans 8589938690 rc 0/0 00000100:00100000:1.0:1788201258.965933:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5155 00010000:00010000:3.0:1788201258.966407:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201258.966422:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3b47 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.966434:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0b400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201258.966439:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3b47 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.966449:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3b47 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.966470:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f6:0x0].0x0 (ffff9e04ff181500) 00010000:00010000:3.0:1788201258.966473:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788201258.966479:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3b47 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.966484:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3b47 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.966511:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201258.966514:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201258.966517:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201258.972048:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3b39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.972073:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3b39 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.972082:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3b39 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.972089:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201258.972097:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3b39 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.972106:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3b39 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.972136:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0xef09e6ea (ffff9e04ff181f00) 00010000:00010000:0.0:1788201258.972139:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201258.972145:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3b39 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.972152:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3b39 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201258.974113:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201258.974257:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442656640 00000100:00100000:0.0:1788201258.974271:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442656640 00000100:00100000:0.0:1788201258.974412:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5156 00000100:00100000:0.0:1788201258.974425:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:14351:x1875064442656640:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:0.0:1788201258.974511:0:12969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788201258.975037:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d394f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d7d expref: 22 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.975083:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3017c00/0x9383f985bc4d3623 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4bf5 expref: 21 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.975096:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f3:0x0].0x0 (ffff9e03c2fc5c00) 00010000:00010000:0.0:1788201258.975111:0:12969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201258.975153:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d3b4e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.975171:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d3b4e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.975181:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d3b4e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.975198:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3b55 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.975232:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3b55 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.975240:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3b55 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.975620:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d3b5c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.975629:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d3b5c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.975637:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d3b5c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201258.978034:0:12969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].507, 64 off40640 00010000:00010000:0.0:1788201258.978149:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d3b63 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.978170:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d3b63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.978182:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d3b63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.978191:0:12969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d3b63 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.978197:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d3b63 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.978204:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d3b63 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.978454:0:12969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201258.978485:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d3b5c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.978491:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d3b5c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.978498:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d3b5c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.978505:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201258.978510:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d3b5c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.978519:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d3b5c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.978544:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f3:0x0].0x0 (ffff9e04ff181d00) 00010000:00010000:0.0:1788201258.978547:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201258.978552:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d3b5c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.978558:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d3b5c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.978579:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d3b4e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.978585:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d3b4e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.978591:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d3b4e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.978596:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201258.978598:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d3b4e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.978604:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d3b4e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.978612:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:0.0:1788201258.978614:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201258.978617:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d3b4e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.978627:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d3b4e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201258.978636:0:12969:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ede906ae reply state 00000000cae347c3 transno 8589938691 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3b55 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201258.978645:0:12969:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201258.978777:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:14351:x1875064442656640:12345-192.168.201.30@tcp:36:rm.0 Request processed in 4348us (4671us total) trans 8589938691 rc 0/0 00000100:00100000:0.0:1788201258.978788:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5156 00010000:00010000:2.0:1788201258.983964:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201258.983988:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d3b63 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.984010:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201258.984015:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d3b63 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.984027:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d3b63 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.984051:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f3:0x0].0x0 (ffff9e04ff181d00) 00010000:00010000:2.0:1788201258.984055:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788201258.984061:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d3b63 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.984067:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d3b63 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201258.984098:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201258.984100:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201258.984102:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201258.985572:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3b55 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.985591:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3b55 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.985599:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3b55 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.985606:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a8000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201258.985611:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3b55 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.985620:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3b55 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.985635:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x15fcbbea (ffff9e04ff181900) 00010000:00010000:3.0:1788201258.985639:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201258.985644:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3b55 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.985651:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3b55 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201258.989613:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201258.990151:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442656896 00000100:00100000:3.0:1788201258.990163:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442656896 00000100:00100000:3.0:1788201258.990241:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5157 00000100:00100000:3.0:1788201258.990254:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:14351:x1875064442656896:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:3.0:1788201258.990460:0:12968:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788201258.990497:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d39db lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4da0 expref: 21 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.990534:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c3016400/0x9383f985bc4d3718 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c3b expref: 20 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.990547:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f8:0x0].0x0 (ffff9e03c33e8400) 00010000:00010000:3.0:1788201258.990559:0:12968:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201258.990590:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3b6a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.990608:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3b6a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.990618:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3b6a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.990639:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d3b71 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.990646:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d3b71 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.990652:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d3b71 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.991210:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3b78 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.991221:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3b78 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.991233:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3b78 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201258.993248:0:12968:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].508, 64 off40704 00010000:00010000:3.0:1788201258.993465:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3b7f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.993486:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3b7f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.993500:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3b7f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.993510:0:12968:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3b7f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.993518:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3b7f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.993539:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3b7f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.993568:0:12968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201258.993600:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3b78 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.993606:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3b78 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.993613:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3b78 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.993624:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201258.993629:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3b78 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.993637:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3b78 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.993651:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f8:0x0].0x0 (ffff9e03c33e8500) 00010000:00010000:3.0:1788201258.993654:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201258.993659:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3b78 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.993676:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3b78 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.993698:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3b6a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.993704:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3b6a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.993719:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3b6a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.993725:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201258.993728:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3b6a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.993734:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3b6a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.993746:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:3.0:1788201258.993748:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201258.993751:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3b6a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201258.993758:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3b6a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201258.993768:0:12968:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be1299ef reply state 00000000d4533c77 transno 8589938692 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d3b71 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201258.993778:0:12968:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201258.993905:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:14351:x1875064442656896:12345-192.168.201.30@tcp:36:rm.0 Request processed in 3647us (4300us total) trans 8589938692 rc 0/0 00000100:00100000:3.0:1788201258.993917:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5157 00010000:00010000:1.0:1788201258.994585:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201258.994596:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3b7f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.994605:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bdc00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201258.994610:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3b7f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.994618:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3b7f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.994631:0:7645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f8:0x0].0x0 (ffff9e03c33e8500) 00010000:00010000:1.0:1788201258.994634:0:7645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201258.994638:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3b7f lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.994644:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3b7f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201258.994667:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201258.994670:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201258.994671:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201258.997503:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d3b71 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.997534:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d3b71 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.997543:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d3b71 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.997550:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bcc00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201258.997556:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d3b71 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.997564:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d3b71 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.997585:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x7fbd58ea (ffff9e03c33e8b00) 00010000:00010000:0.0:1788201258.997589:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201258.997594:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d3b71 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201258.997604:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d3b71 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201259.011696:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201259.012117:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442657152 00000100:00100000:3.0:1788201259.012141:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442657152 00000100:00100000:3.0:1788201259.012369:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5158 00000100:00100000:3.0:1788201259.012383:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:14351:x1875064442657152:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:3.0:1788201259.012596:0:13406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788201259.012631:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d200/0x9383f985bc4d396b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d84 expref: 20 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.012659:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d3654 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c03 expref: 19 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.012855:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f4:0x0].0x0 (ffff9e03c2fc5000) 00010000:00010000:3.0:1788201259.012872:0:13406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201259.012903:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3b86 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.012921:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3b86 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.012934:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3b86 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.012952:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3b8d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.012959:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3b8d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.012966:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3b8d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.013573:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3b94 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.013586:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3b94 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.013594:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3b94 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788201259.014456:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788201259.016469:0:13406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].509, 64 off40768 00010000:00010000:3.0:1788201259.016603:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3b9b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.016625:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3b9b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.016641:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3b9b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.016651:0:13406:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3b9b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.016658:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3b9b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.016665:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3b9b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.016695:0:13406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201259.016916:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3b94 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.016924:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3b94 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.016931:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3b94 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.016939:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bd800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201259.016944:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3b94 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.016953:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3b94 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.016971:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f4:0x0].0x0 (ffff9e03c33e8900) 00010000:00010000:3.0:1788201259.016974:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201259.016980:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3b94 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.016986:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3b94 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.017022:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3b86 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.017029:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3b86 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.017034:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3b86 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.017040:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201259.017043:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3b86 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.017049:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3b86 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.017056:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:3.0:1788201259.017059:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201259.017062:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3b86 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.017068:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3b86 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201259.017079:0:13406:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081abab01 reply state 00000000496862fc transno 8589938693 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3b8d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201259.017094:0:13406:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201259.017694:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:14351:x1875064442657152:12345-192.168.201.30@tcp:36:rm.0 Request processed in 5308us (6010us total) trans 8589938693 rc 0/0 00000100:00100000:3.0:1788201259.017705:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5158 00010000:00010000:1.0:1788201259.017816:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201259.017826:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3b9b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.017834:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bca00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201259.017838:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3b9b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.017845:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3b9b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.017857:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f4:0x0].0x0 (ffff9e03c33e8900) 00010000:00010000:1.0:1788201259.017860:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201259.017864:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3b9b lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.017870:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3b9b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.017890:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201259.017892:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201259.017895:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201259.020731:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3b8d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.020756:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3b8d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.020764:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3b8d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.020771:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201259.020778:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3b8d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.020796:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3b8d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.020817:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x5e5674ea (ffff9e03c33e8400) 00010000:00010000:3.0:1788201259.020820:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201259.020825:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3b8d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.020832:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3b8d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201259.041092:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201259.041237:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442657408 00000100:00100000:1.0:1788201259.041252:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442657408 00000100:00100000:1.0:1788201259.041401:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5159 00000100:00100000:1.0:1788201259.041414:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:14351:x1875064442657408:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201259.041501:0:12969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201259.041539:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d800/0x9383f985bc4d3987 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d8b expref: 19 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.041568:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d3685 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c11 expref: 18 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.041581:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f5:0x0].0x0 (ffff9e03c5173d00) 00010000:00010000:1.0:1788201259.041595:0:12969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201259.041625:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3ba2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.041644:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3ba2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.041654:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3ba2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.041671:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3ba9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.041678:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3ba9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.041684:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3ba9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.041835:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3bb0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.041845:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3bb0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.041853:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3bb0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201259.042646:0:12969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].508, 64 off40704 00010000:00010000:1.0:1788201259.042725:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3bb7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.042736:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3bb7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.042745:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3bb7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.042754:0:12969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3bb7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.042760:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3bb7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.042768:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3bb7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.042801:0:12969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201259.042831:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3bb0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.042841:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3bb0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.042847:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3bb0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.042853:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0b400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201259.042857:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3bb0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.042865:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3bb0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.042875:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f5:0x0].0x0 (ffff9e03c5173600) 00010000:00010000:1.0:1788201259.042878:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201259.042882:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3bb0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.042887:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3bb0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.042906:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3ba2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.042912:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3ba2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.042917:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3ba2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.042923:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0be00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201259.042926:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3ba2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.042933:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3ba2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.042940:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:1.0:1788201259.042943:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201259.042946:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3ba2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201259.042952:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3ba2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201259.042962:0:12969:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e7e223f0 reply state 000000004352d2b0 transno 8589938694 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3ba9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201259.042972:0:12969:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201259.043080:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:14351:x1875064442657408:12345-192.168.201.30@tcp:36:rm.0 Request processed in 1666us (1999us total) trans 8589938694 rc 0/0 00000100:00100000:1.0:1788201259.043090:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5159 00010000:00010000:3.0:1788201259.043631:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201259.043641:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3bb7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.043649:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0b800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201259.043654:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3bb7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.043661:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3bb7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.043673:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f5:0x0].0x0 (ffff9e03c5173600) 00010000:00010000:3.0:1788201259.043676:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788201259.043679:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3bb7 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.043685:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3bb7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.043702:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201259.043705:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201259.043707:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201259.046775:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3ba9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.046802:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3ba9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.046811:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3ba9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.046818:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0a600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201259.046824:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3ba9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.046833:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3ba9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.046853:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0xa6b02dea (ffff9e03c5173e00) 00010000:00010000:0.0:1788201259.046856:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201259.046861:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3ba9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.046868:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3ba9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f1:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201259.050694:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201259.051927:0:13381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442657664 00000100:00100000:2.0:1788201259.051945:0:13381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442657664 00000100:00100000:2.0:1788201259.052062:0:13381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1033 00000100:00100000:2.0:1788201259.052075:0:13381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+18:14351:x1875064442657664:12345-192.168.201.30@tcp:35:rm.0 00000100:00100000:2.0:1788201259.052515:0:13381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:14351:x1875064442657664:12345-192.168.201.30@tcp:35:rm.0 Request processed in 441us (1835us total) trans 8589938695 rc 0/0 00000100:00100000:2.0:1788201259.052525:0:13381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1033 00000100:00100000:1.0:1788201259.058945:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201259.059087:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442657920 00000100:00100000:3.0:1788201259.059101:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442657920 00000100:00100000:3.0:1788201259.059201:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5160 00000100:00100000:3.0:1788201259.059213:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:14351:x1875064442657920:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:3.0:1788201259.059634:0:12968:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788201259.059672:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3aec lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4dfb expref: 19 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.059700:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d35c1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4bd9 expref: 18 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.059787:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:3.0:1788201259.059812:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d3566 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4bc4 expref: 17 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.059822:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173700) 00010000:00010000:3.0:1788201259.059829:0:12968:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201259.059865:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3bbe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.059880:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3bbe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.059891:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3bbe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.059906:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3bc5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.059914:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3bc5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.059920:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3bc5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.060386:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3bcc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.060674:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3bcc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.060688:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3bcc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201259.063943:0:12968:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f1:0x0]: returning size 7680 00010000:00010000:2.0:1788201259.064110:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3bcc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.064136:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3bcc lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.064146:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3bcc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.064152:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bd800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201259.064158:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3bcc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.064167:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3bcc lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.064190:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c33e8e00) 00010000:00010000:2.0:1788201259.064193:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201259.064199:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3bcc lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.065074:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3bcc lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.065136:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3bbe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.065142:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3bbe lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.065148:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3bbe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.065153:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201259.065158:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3bbe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.065164:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3bbe lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.065175:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33e8400) 00010000:00010000:2.0:1788201259.065178:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201259.065181:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3bbe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.065187:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3bbe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201259.065201:0:12968:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000951b524d reply state 00000000d0a306ff transno 8589938696 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3bc5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201259.065212:0:12968:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201259.070269:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+18:14351:x1875064442657920:12345-192.168.201.30@tcp:36:rm.0 Request processed in 11033us (11315us total) trans 8589938696 rc 0/0 00000100:00100000:2.0:1788201259.070286:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5160 00010000:00010000:3.0:1788201259.076730:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3bc5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.076753:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3bc5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.076763:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3bc5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.076770:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201259.076776:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3bc5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.076786:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3bc5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.076810:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x58a1b1aa (ffff9e03c33e8700) 00010000:00010000:3.0:1788201259.076814:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201259.076820:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3bc5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201259.076827:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3bc5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x58a1b1aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788201259.852137:0:12980:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938691 is committed 00000001:00080000:2.0:1788201259.852162:0:12980:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938694 is committed 00000004:00080000:2.0:1788201259.852172:0:12980:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 17 committed 00000001:00080000:2.0:1788201259.852185:0:12980:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938695 is committed 00000001:00080000:2.0:1788201259.852191:0:12980:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938696 is committed 00000004:00080000:2.0:1788201259.852200:0:12980:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 17 committed 00000100:00100000:2.0:1788201259.852400:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201259.852427:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458224384:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201259.852523:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201259.852604:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458224384 00000100:00100000:2.0:1788201259.852616:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458224384 00000100:00100000:2.0:1788201259.852686:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4201 00000100:00100000:2.0:1788201259.852696:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458224384:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201259.852732:0:13438:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1049 count 1 00010000:00010000:2.0:1788201259.852766:0:13438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d3bd3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.852794:0:13438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1124bc0/0x9383f985bc4d3757 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c50 expref: 13 pid: 13438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.852805:0:13438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x419:0x0].0x0 since=18s v=(0 0) 00010000:00010000:2.0:1788201259.852811:0:13438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x419:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201259.852816:0:13438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d3bd3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.852851:0:13438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e1124bc0/0x9383f985bc4d3757 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c50 expref: 13 pid: 13438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201259.852866:0:13438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e1124bc0/0x9383f985bc4d3757 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c50 expref: 13 pid: 13438 timeout: 635 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201259.852881:0:13438:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13438:1875064458224512:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201259.852949:0:13438:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2fd9cc0 going to sleep for 11 seconds 00000100:00080000:2.0:1788201259.852963:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201259.853652:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458224640:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201259.853692:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201259.853786:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458224640 00000100:00100000:0.0:1788201259.853794:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458224640 00000100:00100000:0.0:1788201259.853846:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4202 00000100:00100000:0.0:1788201259.853855:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458224640:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201259.853877:0:13447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1052 count 1 00010000:00010000:0.0:1788201259.853900:0:13447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000071acddb/0x9383f985bc4d3bda lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.853918:0:13447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9237659/0x9383f985bc4d3902 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d6f expref: 510 pid: 13442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.853925:0:13447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41c:0x0].0x0 since=18s v=(0 0) 00010000:00010000:0.0:1788201259.853929:0:13447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201259.853932:0:13447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000071acddb/0x9383f985bc4d3bda lrc: 4/0,1 mode: --/PW res: [0x240000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.853959:0:13447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d9237659/0x9383f985bc4d3902 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d6f expref: 510 pid: 13442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.853970:0:13447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d9237659/0x9383f985bc4d3902 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d6f expref: 510 pid: 13442 timeout: 635 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201259.853983:0:13447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:13447:1875064458224768:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201259.854044:0:13447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f9471300 going to sleep for 11 seconds 00000100:00080000:2.0:1788201259.854609:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201259.858045:0:13447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:13447:1875064458224768:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201259.858091:0:13447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000071acddb/0x9383f985bc4d3bda lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201259.858332:0:13438:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13438:1875064458224512:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201259.858351:0:13438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d3bd3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201259.865250:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201259.865350:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201259.865396:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442658048 00000100:00100000:0.0:1788201259.865409:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442658048 00010000:00010000:0.0:1788201259.865485:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e1124bc0/0x9383f985bc4d3757 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c50 expref: 14 pid: 13438 timeout: 635 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201259.865528:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442658176 00000100:00100000:0.0:1788201259.865532:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442658176 00010000:00010000:0.0:1788201259.865552:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d9237659/0x9383f985bc4d3902 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d6f expref: 511 pid: 13442 timeout: 635 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201259.865578:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1543 00000100:00100000:0.0:1788201259.865590:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:2360:x1875064442658048:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201259.865611:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201259.865618:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e1124bc0/0x9383f985bc4d3757 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c50 expref: 14 pid: 13438 timeout: 635 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.865633:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e1124bc0/0x9383f985bc4d3757 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c50 expref: 14 pid: 13438 timeout: 635 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.865665:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1124bc0/0x9383f985bc4d3757 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x419:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c50 expref: 14 pid: 13438 timeout: 635 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.865693:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x419:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201259.865698:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x419:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201259.865706:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d3bd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.865717:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d3bd3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x419:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.865752:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201259.865820:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:2360:x1875064442658048:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 232us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201259.865830:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1543 00000100:00100000:0.0:1788201259.865851:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1544 00000100:00100000:0.0:1788201259.865857:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2361:x1875064442658176:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201259.865866:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201259.865870:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d9237659/0x9383f985bc4d3902 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d6f expref: 511 pid: 13442 timeout: 635 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.865880:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d9237659/0x9383f985bc4d3902 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d6f expref: 511 pid: 13442 timeout: 635 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.865897:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9237659/0x9383f985bc4d3902 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d6f expref: 511 pid: 13442 timeout: 635 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.865913:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201259.865916:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201259.865920:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000071acddb/0x9383f985bc4d3bda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.865928:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000071acddb/0x9383f985bc4d3bda lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.865946:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201259.865965:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+510:2361:x1875064442658176:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 108us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201259.865971:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1544 00000100:00080000:0.0:1788201259.867887:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201259.867899:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788201259.867919:0:13438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d3bd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.867938:0:13438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d3bd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.867951:0:13438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d3bd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.867959:0:13438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d3bd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.868002:0:13438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201259.873349:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3312:x1875064458224384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20498us (20670us total) trans 4294968851 rc 0/0 00000100:00100000:0.0:1788201259.873368:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4201 00010000:00010000:0.0:1788201259.873436:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201259.873447:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d3bd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.873464:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201259.873470:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d3bd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.873482:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d3bd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.873510:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d3bd3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.873518:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d3bd3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x419:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.873552:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201259.873554:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201259.873556:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201259.873573:0:13447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000071acddb/0x9383f985bc4d3bda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.873583:0:13447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000071acddb/0x9383f985bc4d3bda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.873594:0:13447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000071acddb/0x9383f985bc4d3bda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.873602:0:13447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000071acddb/0x9383f985bc4d3bda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.873636:0:13447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1788201259.875377:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c2b7c000/2, rc 0, transno 4294968851 00000100:00100000:1.0:1788201259.875411:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458224384:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201259.876893:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3310:x1875064458224640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23034us (23193us total) trans 4294968850 rc 0/0 00000100:00100000:0.0:1788201259.876909:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4202 00010000:00010000:0.0:1788201259.876955:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201259.876965:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000071acddb/0x9383f985bc4d3bda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.876980:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a8a00 already unused, calling callback (ffffffffc13fbfe0) 00000004:00080000:1.0:1788201259.878290:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c12d2a00/2, rc 0, transno 4294968850 00000100:00100000:1.0:1788201259.878332:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458224640:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788201259.878764:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000071acddb/0x9383f985bc4d3bda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.878794:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000071acddb/0x9383f985bc4d3bda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.878825:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000071acddb/0x9383f985bc4d3bda lrc: 1/0,0 mode: --/PW res: [0x240000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.878835:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000071acddb/0x9383f985bc4d3bda lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201259.878868:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201259.878871:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201259.878873:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201259.892369:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788201260.774454:0:12996:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 536032156729ns, next at 537032154344ns, rc = 0 00000100:00100000:1.0:1788201260.774714:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458224896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201260.774790:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201260.774849:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458224896 00000100:00100000:1.0:1788201260.774857:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458224896 00000100:00100000:1.0:1788201260.774905:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788201260.774914:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d094c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875064458224896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201260.774953:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 13631488 granted 525008896 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201260.774998:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d094c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875064458224896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201260.775005:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788201260.775356:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458224896:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788201260.902249:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201261.925494:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201262.309685:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458225152:0@lo:400:kworker.0 00000100:00100000:0.0:1788201262.309788:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201262.309831:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458225024:0@lo:400:kworker.0 00000100:00100000:0.0:1788201262.309866:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875064458225664:0@lo:400:kworker.0 00000100:00100000:1.0:1788201262.309878:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201262.309888:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201262.309910:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458225536:0@lo:400:kworker.0 00000100:00100000:1.0:1788201262.309937:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201262.309968:0:12964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458225024 00000100:00100000:1.0:1788201262.309968:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458225152 00000100:00100000:0.0:1788201262.309977:0:12964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458225024 00000100:00100000:1.0:1788201262.309977:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458225152 00000100:00100000:1.0:1788201262.310030:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458225664 00000100:00100000:1.0:1788201262.310034:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458225664 00000100:00100000:0.0:1788201262.310035:0:12964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788201262.310045:0:12964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c648e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3312:x1875064458225024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201262.310053:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788201262.310058:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cfface00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875064458225152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201262.310112:0:12964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c648e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3312:x1875064458225024:12345-0@lo:400:kworker.0 Request processed in 69us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201262.310112:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cfface00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875064458225152:12345-0@lo:400:kworker.0 Request processed in 53us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201262.310121:0:12964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788201262.310121:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788201262.310140:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788201262.310146:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875064458225664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201262.310157:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458225408:0@lo:400:kworker.0 00000100:00100000:2.0:1788201262.310223:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875064458225280:0@lo:400:kworker.0 00000100:00080000:3.0:1788201262.310230:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201262.310264:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458225536 00000100:00100000:3.0:1788201262.310268:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458225536 00000100:00100000:3.0:1788201262.310330:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788201262.310338:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3312:x1875064458225536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201262.314009:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875064458225664:12345-0@lo:400:kworker.0 Request processed in 3847us (4102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201262.314034:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788201262.314154:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458225024:0@lo:400:kworker.0 00000100:00100000:1.0:1788201262.314241:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458225152:0@lo:400:kworker.0 00000100:00100000:1.0:1788201262.314255:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875064458225664:0@lo:400:kworker.0 00000100:00080000:1.0:1788201262.314313:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201262.322596:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201262.322714:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458225408 00000100:00100000:0.0:1788201262.322726:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458225408 00000100:00100000:0.0:1788201262.322808:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788201262.322823:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875064458225408:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788201262.322823:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201262.322936:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875064458225408:12345-0@lo:400:kworker.0 Request processed in 117us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201262.322944:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788201262.323044:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458225408:0@lo:400:kworker.0 00000100:00100000:2.0:1788201262.324576:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201262.324664:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458225280 00000100:00100000:2.0:1788201262.324673:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458225280 00000100:00100000:2.0:1788201262.324749:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788201262.324760:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875064458225280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201262.324821:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875064458225280:12345-0@lo:400:kworker.0 Request processed in 64us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201262.324828:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:2.0:1788201262.324854:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201262.324883:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875064458225280:0@lo:400:kworker.0 00000100:00100000:3.0:1788201262.337158:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3312:x1875064458225536:12345-0@lo:400:kworker.0 Request processed in 26806us (27205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201262.337179:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788201262.339959:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458225536:0@lo:400:kworker.0 00000001:00080000:2.0:1788201262.958095:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968851 is committed 00000001:00080000:2.0:1788201262.958114:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968850 is committed 00010000:00010000:3.0:1788201262.959741:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788201262.966894:0:6732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294968850 is committed 00000001:00080000:1.0:1788201262.966921:0:6732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294968849 is committed 00000004:00080000:3.0:1788201263.346239:0:12994:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 538603941026ns, next at 539603938780ns, rc = 0 00000100:00100000:2.0:1788201263.346635:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201263.347759:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458225792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201263.348796:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201263.349253:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458225792 00000100:00100000:2.0:1788201263.349263:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458225792 00000100:00100000:2.0:1788201263.349343:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788201263.349355:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458225792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201263.349405:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 525008896 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1788201263.350646:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458225792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1284us (1842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201263.351639:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788201263.352417:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968850 gen 2 00000004:00080000:2.0:1788201263.352884:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c12d2a00, transno 4294968850 00000100:00100000:2.0:1788201263.352940:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458225792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201263.511154:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201263.511206:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201263.511257:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201263.511286:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201263.511395:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442658688 00000100:00100000:1.0:1788201263.511408:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442658688 00000100:00100000:1.0:1788201263.511506:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442658560 00000100:00080000:0.0:1788201263.511507:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201263.511510:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442658560 00000100:00080000:0.0:1788201263.511532:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201263.511543:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 161 00000100:00100000:1.0:1788201263.511556:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:2361:x1875064442658688:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201263.511686:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:2361:x1875064442658688:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 132us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201263.511694:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 161 00000100:00100000:1.0:1788201263.511714:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 162 00000100:00100000:1.0:1788201263.511721:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+507:2361:x1875064442658560:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201263.511751:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+507:2361:x1875064442658560:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 31us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201263.511758:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 162 00000100:00100000:3.0:1788201263.512162:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442658432 00000100:00100000:3.0:1788201263.512168:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442658432 00000100:00100000:3.0:1788201263.512227:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 95 00000100:00100000:3.0:1788201263.512235:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2361:x1875064442658432:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201263.512290:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2361:x1875064442658432:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 57us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201263.512313:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 95 00000100:00100000:3.0:1788201263.512337:0:12965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442658304 00000100:00100000:3.0:1788201263.512342:0:12965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442658304 00000100:00100000:3.0:1788201263.512383:0:12965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 116 00000100:00100000:3.0:1788201263.512390:0:12965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c648d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2361:x1875064442658304:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201263.512419:0:12965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c648d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2361:x1875064442658304:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 29us (1161us total) trans 0 rc 0/0 00000100:00080000:0.0:1788201263.512585:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201263.516587:0:12965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 116 00010000:00010000:1.0:1788201263.976584:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788201264.918864:0:12980:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 18 committed 00000100:00100000:3.0:1788201264.919458:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458225920:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201264.919539:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201264.919901:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458225920 00000100:00100000:0.0:1788201264.919909:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458225920 00000100:00100000:0.0:1788201264.919975:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4203 00000100:00100000:0.0:1788201264.919985:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458225920:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201264.920009:0:13441:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1051 count 1 00010000:00010000:0.0:1788201264.920046:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb9d03e5/0x9383f985bc4d3be1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201264.920067:0:13441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000558b5a3d/0x9383f985bc4d37ff lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d1b expref: 8 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201264.920076:0:13441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d3899 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d22 expref: 8 pid: 13441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201264.920083:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41b:0x0].0x0 since=23s v=(0 0) 00010000:00010000:0.0:1788201264.920088:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201264.920092:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb9d03e5/0x9383f985bc4d3be1 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201264.920124:0:13441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d3899 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d22 expref: 8 pid: 13441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201264.920138:0:13441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d3899 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d22 expref: 8 pid: 13441 timeout: 640 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201264.920150:0:13441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:13441:1875064458226304:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201264.920222:0:13441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000558b5a3d/0x9383f985bc4d37ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d1b expref: 8 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201264.920231:0:13441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000558b5a3d/0x9383f985bc4d37ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d1b expref: 8 pid: 12363 timeout: 640 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201264.920241:0:13441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:13441:1875064458226432:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201264.920262:0:13441:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c29a5b40 going to sleep for 11 seconds 00000004:00080000:3.0:1788201264.925391:0:14259:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 18 committed 00000100:00100000:3.0:1788201264.925539:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458226560:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201264.925688:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201264.925732:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201264.925738:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458226688:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201264.925759:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201264.925789:0:13442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458226560 00000100:00100000:3.0:1788201264.925796:0:13442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458226560 00000100:00100000:3.0:1788201264.925844:0:13442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458226688 00000100:00100000:3.0:1788201264.925847:0:13442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458226688 00000100:00100000:3.0:1788201264.925869:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4204 00000100:00100000:3.0:1788201264.925877:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3310:x1875064458226560:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201264.925904:0:13442:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1050 count 1 00010000:00010000:3.0:1788201264.925932:0:13442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d3be8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201264.925955:0:13442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d377a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c5e expref: 506 pid: 13439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201264.925964:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41a:0x0].0x0 since=23s v=(0 0) 00010000:00010000:3.0:1788201264.925969:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201264.925973:0:13442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d3be8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201264.926007:0:13442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d377a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c5e expref: 506 pid: 13439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201264.926032:0:13442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d377a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c5e expref: 506 pid: 13439 timeout: 640 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201264.926044:0:13442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5287b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:13442:1875064458226816:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201264.926102:0:13442:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c3362b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201264.926121:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4205 00000100:00100000:3.0:1788201264.926128:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1875064458226688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201264.926141:0:6706:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1051 count 1 00010000:00010000:3.0:1788201264.926155:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d3bef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201264.926166:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000de2b048b/0x9383f985bc4d37ea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x41b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c81 expref: 506 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201264.926173:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41b:0x0].0x0 since=23s v=(0 0) 00010000:00010000:3.0:1788201264.926176:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201264.926179:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d3bef lrc: 4/0,1 mode: --/PW res: [0x240000400:0x41b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201264.926197:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000de2b048b/0x9383f985bc4d37ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x41b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c81 expref: 506 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201264.926212:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000de2b048b/0x9383f985bc4d37ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x41b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c81 expref: 506 pid: 6703 timeout: 640 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201264.926221:0:6706:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1875064458226944:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201264.926244:0:6706:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c33620c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201264.926458:0:13441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:13441:1875064458226304:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201264.926557:0:13441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:13441:1875064458226432:192.168.201.30@tcp:104: 00000100:00080000:2.0:1788201264.926974:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201264.926980:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201264.930521:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458226176:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201264.930618:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201264.930678:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201264.930685:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458226048:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201264.930705:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201264.930748:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458226176 00000100:00100000:2.0:1788201264.930755:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458226176 00000100:00100000:2.0:1788201264.930797:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458226048 00000100:00100000:2.0:1788201264.930799:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458226048 00000100:00100000:2.0:1788201264.930817:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4206 00000100:00100000:2.0:1788201264.930824:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3313:x1875064458226176:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201264.930855:0:10484:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1050 count 1 00010000:00010000:2.0:1788201264.930887:0:10484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d3bf6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.930910:0:10484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d37a4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c6c expref: 8 pid: 13449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.930920:0:10484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41a:0x0].0x0 since=23s v=(0 0) 00010000:00010000:2.0:1788201264.930924:0:10484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201264.930928:0:10484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d3bf6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.930963:0:10484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d37a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c6c expref: 8 pid: 13449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.930977:0:10484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d37a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c6c expref: 8 pid: 13449 timeout: 640 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201264.930988:0:10484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10484:1875064458227072:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201264.931065:0:10484:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d09c0240 going to sleep for 11 seconds 00000100:00100000:2.0:1788201264.931084:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4207 00000100:00100000:2.0:1788201264.931091:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3313:x1875064458226048:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201264.931104:0:13438:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1052 count 1 00010000:00010000:2.0:1788201264.931116:0:13438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d3bfd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.931127:0:13438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009f0ecd86/0x9383f985bc4d37f8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ce3 expref: 8 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.931133:0:13438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41c:0x0].0x0 since=23s v=(0 0) 00010000:00010000:2.0:1788201264.931136:0:13438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201264.931140:0:13438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d3bfd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.931158:0:13438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009f0ecd86/0x9383f985bc4d37f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ce3 expref: 8 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.931174:0:13438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009f0ecd86/0x9383f985bc4d37f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ce3 expref: 8 pid: 12363 timeout: 640 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201264.931189:0:13438:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13438:1875064458227200:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201264.931212:0:13438:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d09c0780 going to sleep for 11 seconds 00010000:00010000:3.0:1788201264.931839:0:13441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fb9d03e5/0x9383f985bc4d3be1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201264.931992:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201264.932037:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201264.932061:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442658944 00000100:00100000:2.0:1788201264.932066:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442658944 00010000:00010000:2.0:1788201264.932091:0:7646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000558b5a3d/0x9383f985bc4d37ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d1b expref: 9 pid: 12363 timeout: 640 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201264.932114:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442658816 00000100:00100000:2.0:1788201264.932116:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442658816 00010000:00010000:2.0:1788201264.932126:0:7646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d3899 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d22 expref: 10 pid: 13441 timeout: 640 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201264.932142:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1545 00000100:00100000:2.0:1788201264.932149:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2360:x1875064442658944:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201264.932158:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201264.932163:0:7646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000558b5a3d/0x9383f985bc4d37ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d1b expref: 10 pid: 12363 timeout: 640 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.932175:0:7646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000558b5a3d/0x9383f985bc4d37ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d1b expref: 10 pid: 12363 timeout: 640 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.932196:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000558b5a3d/0x9383f985bc4d37ff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d1b expref: 10 pid: 12363 timeout: 640 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.932212:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201264.932239:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:2360:x1875064442658944:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 91us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201264.932246:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1545 00000100:00100000:2.0:1788201264.932261:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1546 00000100:00100000:2.0:1788201264.932267:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2362:x1875064442658816:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201264.932274:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201264.932278:0:7646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d3899 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d22 expref: 8 pid: 13441 timeout: 640 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.932288:0:7646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d3899 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d22 expref: 8 pid: 13441 timeout: 640 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.932327:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d3899 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4d22 expref: 8 pid: 13441 timeout: 640 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.932336:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201264.932340:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201264.932345:0:7646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb9d03e5/0x9383f985bc4d3be1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.932353:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb9d03e5/0x9383f985bc4d3be1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.932378:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201264.932392:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2362:x1875064442658816:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 125us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201264.932398:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1546 00010000:00010000:2.0:1788201264.932446:0:13441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fb9d03e5/0x9383f985bc4d3be1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.932454:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb9d03e5/0x9383f985bc4d3be1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.932463:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb9d03e5/0x9383f985bc4d3be1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.932471:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb9d03e5/0x9383f985bc4d3be1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.932487:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201264.933029:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3311:x1875064458225920:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13033us (13478us total) trans 4294968852 rc 0/0 00000100:00100000:2.0:1788201264.933037:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4203 00010000:00010000:2.0:1788201264.933062:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201264.933067:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb9d03e5/0x9383f985bc4d3be1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.933076:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a8e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201264.933080:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb9d03e5/0x9383f985bc4d3be1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.933089:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb9d03e5/0x9383f985bc4d3be1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.933100:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb9d03e5/0x9383f985bc4d3be1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.933108:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb9d03e5/0x9383f985bc4d3be1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.933126:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201264.933127:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201264.933129:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201264.933159:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968851 gen 2 00000004:00080000:2.0:1788201264.933165:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c2b7c000, transno 4294968851 00000100:00100000:2.0:1788201264.935058:0:3311:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9e04cffae300 x1875064458225920/t4294968852(4294968852) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201319 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788201264.935075:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04cffae300/2, rc 0, transno 4294968852 00000100:00100000:2.0:1788201264.935080:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458225920:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201264.937093:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201264.937128:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201264.937169:0:13526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442659072 00000100:00100000:2.0:1788201264.937177:0:13526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442659072 00000100:00100000:3.0:1788201264.937212:0:13442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5287b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:13442:1875064458226816:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201264.937221:0:13526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d377a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c5e expref: 507 pid: 13439 timeout: 640 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201264.937250:0:13442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d3be8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201264.938133:0:13526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442659200 00000100:00100000:2.0:1788201264.938141:0:13526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442659200 00010000:00010000:2.0:1788201264.938168:0:13526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000de2b048b/0x9383f985bc4d37ea lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x41b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c81 expref: 508 pid: 6703 timeout: 640 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201264.938200:0:13526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1547 00000100:00100000:2.0:1788201264.938212:0:13526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2361:x1875064442659072:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201264.938229:0:13526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201264.938236:0:13526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d377a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x41a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c5e expref: 508 pid: 13439 timeout: 640 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.938251:0:13526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d377a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x41a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c5e expref: 508 pid: 13439 timeout: 640 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.938277:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d377a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x41a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c5e expref: 508 pid: 13439 timeout: 640 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.938339:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201264.938345:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201264.938351:0:13526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d3be8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.938361:0:13526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d3be8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.938405:0:13526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201264.938487:0:13526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+507:2361:x1875064442659072:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 278us (1403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201264.938494:0:13526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1547 00000100:00100000:2.0:1788201264.938514:0:13526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1548 00000100:00100000:2.0:1788201264.938521:0:13526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+506:2361:x1875064442659200:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201264.938529:0:13526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201264.938533:0:13526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000de2b048b/0x9383f985bc4d37ea lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x41b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c81 expref: 506 pid: 6703 timeout: 640 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.938543:0:13526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000de2b048b/0x9383f985bc4d37ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x41b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c81 expref: 506 pid: 6703 timeout: 640 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.938554:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201264.938557:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201264.938561:0:13526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d3bef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.938568:0:13526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d3bef lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x41b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.938579:0:13526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201264.938596:0:13526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+506:2361:x1875064442659200:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 76us (1468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201264.938606:0:13526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1548 00010000:00010000:2.0:1788201264.938641:0:13442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d3be8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.938650:0:13442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d3be8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.938660:0:13442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d3be8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.938667:0:13442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d3be8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.938685:0:13442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201264.939282:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3310:x1875064458226560:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13404us (13594us total) trans 4294968851 rc 0/0 00000100:00100000:2.0:1788201264.939292:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4204 00010000:00010000:2.0:1788201264.939363:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201264.939370:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d3be8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.939380:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201264.939385:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d3be8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.939395:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d3be8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.939408:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d3be8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.939416:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d3be8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.939434:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201264.939436:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201264.939438:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201264.939642:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de2b048b/0x9383f985bc4d37ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x41b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c81 expref: 505 pid: 6703 timeout: 640 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201264.939657:0:6706:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1875064458226944:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201264.939687:0:6706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d3bef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201264.939697:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d3bef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201264.939706:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d3bef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201264.939714:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d3bef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201264.939721:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d3bef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201264.939727:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c5284a80/2, rc 0, transno 4294968851 00000100:00100000:3.0:1788201264.939740:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458226560:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788201264.939749:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201264.940172:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3310:x1875064458226688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14043us (14410us total) trans 4294968852 rc 0/0 00000100:00100000:0.0:1788201264.940179:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4205 00000004:00080000:3.0:1788201264.940422:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c5286300/2, rc 0, transno 4294968852 00000100:00100000:3.0:1788201264.940430:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458226688:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201264.940845:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201264.940882:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201264.942639:0:10484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10484:1875064458227072:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201264.942675:0:10484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d3bf6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.942969:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201264.942977:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d3bef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.942986:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201264.942991:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d3bef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.943001:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d3bef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.943031:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d3bef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.943040:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d3bef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.943065:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201264.943067:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201264.943069:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201264.943087:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442659328 00000100:00100000:2.0:1788201264.943093:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442659328 00010000:00010000:2.0:1788201264.943126:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d37a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c6c expref: 7 pid: 13449 timeout: 640 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201264.943163:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442659456 00000100:00100000:2.0:1788201264.943167:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442659456 00010000:00010000:2.0:1788201264.943180:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009f0ecd86/0x9383f985bc4d37f8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ce3 expref: 8 pid: 12363 timeout: 640 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201264.943202:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1549 00000100:00100000:2.0:1788201264.943211:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c7e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2361:x1875064442659328:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201264.943229:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201264.943234:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d37a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c6c expref: 8 pid: 13449 timeout: 640 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.943247:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d37a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c6c expref: 8 pid: 13449 timeout: 640 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.943265:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d37a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4c6c expref: 8 pid: 13449 timeout: 640 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.943282:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201264.943286:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201264.943319:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d3bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.943330:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d3bf6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.943355:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201264.943412:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c7e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2361:x1875064442659328:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 201us (2569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201264.943420:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1549 00000100:00100000:0.0:1788201264.943910:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1550 00000100:00100000:0.0:1788201264.943922:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2362:x1875064442659456:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201264.943932:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201264.943938:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009f0ecd86/0x9383f985bc4d37f8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ce3 expref: 6 pid: 12363 timeout: 640 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201264.943956:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009f0ecd86/0x9383f985bc4d37f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ce3 expref: 6 pid: 12363 timeout: 640 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201264.943970:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201264.943973:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201264.943977:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d3bfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201264.943985:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d3bfd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201264.943998:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201264.944031:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2362:x1875064442659456:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 112us (3148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201264.944038:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1550 00010000:00010000:2.0:1788201264.944135:0:13438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f0ecd86/0x9383f985bc4d37f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ce3 expref: 5 pid: 12363 timeout: 640 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201264.944148:0:13438:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13438:1875064458227200:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201264.944165:0:13438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d3bfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.944176:0:13438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d3bfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.944183:0:13438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d3bfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.944198:0:13438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d3bfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.944206:0:13438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d3bfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201264.944231:0:13438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201264.945240:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201264.945248:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d3bfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201264.945258:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201264.945262:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d3bfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201264.945270:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d3bfd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201264.945290:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d3bfd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201264.945310:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d3bfd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201264.945333:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201264.945335:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201264.945336:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201264.945732:0:10484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d3bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201264.945759:0:10484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d3bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201264.945773:0:10484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d3bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201264.945781:0:10484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d3bf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201264.945825:0:10484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201264.946009:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201264.946025:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d3bf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201264.946035:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201264.946047:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d3bf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201264.946058:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d3bf6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201264.946079:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d3bf6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201264.946087:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d3bf6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201264.946129:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201264.946131:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201264.946134:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201264.947154:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3313:x1875064458226048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16056us (16441us total) trans 4294968853 rc 0/0 00000100:00100000:2.0:1788201264.947165:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4207 00000004:00080000:0.0:1788201264.947265:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04cffac000/2, rc 0, transno 4294968853 00000100:00100000:0.0:1788201264.947278:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458226048:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201264.949439:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3313:x1875064458226176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18603us (18808us total) trans 4294968854 rc 0/0 00000100:00100000:3.0:1788201264.949456:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4206 00000004:00080000:0.0:1788201264.949864:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04cffaf800/2, rc 0, transno 4294968854 00000100:00100000:0.0:1788201264.949875:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458226176:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788201264.998151:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201265.894389:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458227328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201265.894463:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201265.894586:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458227328 00000100:00100000:3.0:1788201265.894595:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458227328 00000100:00100000:3.0:1788201265.894651:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788201265.894661:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3312:x1875064458227328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201265.894696:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 13631488 granted 525008896 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201265.894754:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3312:x1875064458227328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201265.894762:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788201265.894852:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458227328:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788201266.024215:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201266.957779:0:14326:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 102c: check replay w/o reconstruction with multiple mod RPCs in flight ========================================================== 14:34:25 (1788201265) 00010000:00010000:0.0:1788201267.046267:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201267.196495:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201267.196616:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442659584 00000100:00100000:1.0:1788201267.196631:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442659584 00000100:00100000:1.0:1788201267.196726:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5161 00000100:00100000:1.0:1788201267.196741:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:14915:x1875064442659584:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1788201267.196772:0:12969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201267.196807:0:12969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3c04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4e02 expref: -99 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.196910:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3c0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.196928:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3c0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.196945:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3c0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201267.197381:0:12969:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1788201267.197388:0:12969:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201267.197486:0:12969:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3c0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.197523:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3c04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e02 expref: 7 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.197550:0:12969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3c0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e02 expref: 6 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.197561:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173d00) 00010000:00010000:1.0:1788201267.197565:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201267.197569:0:12969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9c0b800, rc 0) 00000100:00100000:1.0:1788201267.197660:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:14915:x1875064442659584:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 922us (1178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201267.197669:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5161 00000100:00080000:0.0:1788201267.197955:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201267.213343:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201267.213518:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442659712 00000100:00100000:3.0:1788201267.213532:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442659712 00000100:00100000:3.0:1788201267.213611:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5162 00000100:00100000:3.0:1788201267.213625:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:14915:x1875064442659712:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788201267.213659:0:13406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201267.213689:0:13406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d3c12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4e09 expref: -99 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.213781:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d3c19 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.213799:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d3c19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.213812:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d3c19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.213831:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d3c20 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.213837:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d3c20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.213843:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d3c20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.214414:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d3c19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.214426:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d3c19 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.214433:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d3c19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.214445:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bce00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201267.214450:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d3c19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.214458:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d3c19 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.214472:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173d00) 00010000:00010000:3.0:1788201267.214475:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201267.214481:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d3c19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.214487:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d3c19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.214499:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d3c20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.214505:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d3c20 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.214511:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d3c20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.214517:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201267.214519:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d3c20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.214526:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d3c20 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.214538:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1317f023 (ffff9e03c33e8b00) 00010000:00010000:3.0:1788201267.214540:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201267.214543:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d3c20 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.214548:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d3c20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.214591:0:13406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d3c12 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e09 expref: 7 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.214603:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173d00) 00010000:00010000:3.0:1788201267.214606:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201267.214610:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d3c12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e09 expref: 7 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.214620:0:13406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bc200, rc 0) 00000100:00100000:3.0:1788201267.214710:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:14915:x1875064442659712:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1087us (1385us total) trans 0 rc 301/301 00000100:00100000:3.0:1788201267.214719:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5162 00000100:00100000:0.0:1788201267.230441:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201267.231013:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442659968 00000100:00100000:1.0:1788201267.231028:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442659968 00000100:00100000:1.0:1788201267.231168:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5163 00000100:00100000:1.0:1788201267.231181:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:14915:x1875064442659968:12345-192.168.201.30@tcp:36:lfs.0 00010000:00010000:1.0:1788201267.231261:0:13379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201267.231387:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3c0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e02 expref: 6 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.231411:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173d00) 00010000:00010000:1.0:1788201267.231425:0:13379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201267.231801:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3c27 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.231819:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3c27 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.231831:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3c27 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.231848:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3c2e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1317f023 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.231856:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3c2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.232998:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3c2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201267.240537:0:13379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f9:0x0]: returning size 512 00010000:00010000:1.0:1788201267.240566:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3c27 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.240578:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3c27 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.240586:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3c27 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.240593:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0a600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201267.240599:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3c27 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.240607:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3c27 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.240628:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173900) 00010000:00010000:1.0:1788201267.240632:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201267.240638:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3c27 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.240650:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3c27 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201267.240676:0:13379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e31d7871 reply state 000000000ca22f98 transno 8589938697 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3c2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201267.240688:0:13379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201267.240838:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:14915:x1875064442659968:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 9654us (10408us total) trans 8589938697 rc 0/0 00000100:00100000:1.0:1788201267.240848:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5163 00010000:00010000:1.0:1788201267.245134:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3c2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.245161:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3c2e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.245170:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3c2e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.245178:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0be00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201267.245185:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3c2e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.245195:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3c2e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.245217:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1317f023 (ffff9e03c5173200) 00010000:00010000:1.0:1788201267.245221:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201267.245226:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3c2e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.245239:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3c2e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201267.308396:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201267.308563:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442660096 00000100:00100000:3.0:1788201267.308574:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442660096 00000100:00100000:3.0:1788201267.308647:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5164 00000100:00100000:3.0:1788201267.308660:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:14923:x1875064442660096:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788201267.308694:0:12968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201267.308720:0:12968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d3c35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4e10 expref: -99 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.308795:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d3c3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.308809:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d3c3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.308819:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d3c3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201267.308898:0:12968:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788201267.308902:0:12968:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201267.308923:0:12968:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d3c3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.308951:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d3c35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e10 expref: 8 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.308972:0:12968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d3c3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e10 expref: 7 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.308989:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33e8b00) 00010000:00010000:3.0:1788201267.308992:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201267.308996:0:12968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bc600, rc 0) 00000100:00100000:3.0:1788201267.309072:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:14923:x1875064442660096:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 415us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201267.309729:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5164 00000100:00100000:0.0:1788201267.312489:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201267.312565:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442660352 00000100:00100000:3.0:1788201267.312577:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442660352 00000100:00100000:3.0:1788201267.312646:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5165 00000100:00100000:3.0:1788201267.312658:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:14923:x1875064442660352:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788201267.312688:0:12971:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201267.312711:0:12971:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d3c43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4e17 expref: -99 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.312801:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3c4a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.312815:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3c4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.312825:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3c4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.312836:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3c51 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.312841:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3c51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.312845:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3c51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201267.313013:0:12971:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f9:0x0]: returning size 512 00010000:00010000:3.0:1788201267.313133:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3c4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.313139:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3c4a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.313143:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3c4a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.313148:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201267.313151:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3c4a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.313157:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3c4a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.313167:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33e8b00) 00010000:00010000:3.0:1788201267.313169:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201267.313172:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3c4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.313176:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3c4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.313186:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3c51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.313189:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3c51 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.313193:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3c51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.313197:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bd600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201267.313199:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3c51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.313202:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3c51 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.313208:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1317f023 (ffff9e03c33e8500) 00010000:00010000:3.0:1788201267.313210:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201267.313211:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3c51 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.313215:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3c51 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.313248:0:12971:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d3c43 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e17 expref: 9 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.313258:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33e8b00) 00010000:00010000:3.0:1788201267.313260:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201267.313262:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d3c43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e17 expref: 9 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.313270:0:12971:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bce00, rc 0) 00000100:00100000:3.0:1788201267.313373:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:14923:x1875064442660352:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 717us (893us total) trans 8589938698 rc 301/301 00000100:00100000:3.0:1788201267.313379:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5165 00000100:00100000:1.0:1788201267.325199:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201267.325338:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442660608 00000100:00100000:2.0:1788201267.325353:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442660608 00000100:00100000:2.0:1788201267.325435:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5166 00000100:00100000:2.0:1788201267.325447:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:14923:x1875064442660608:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1788201267.325481:0:13379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201267.325510:0:13379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3c5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4e1e expref: -99 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.325605:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3c66 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.325626:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3c66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.325639:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3c66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.325656:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3c6d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.325664:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3c6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.325672:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3c6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.326124:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3c74 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.326135:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3c74 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.326142:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3c74 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201267.326154:0:13379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f9:0x0]: returning size 512 00010000:00010000:2.0:1788201267.326343:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3c66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.326352:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3c66 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.326361:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3c66 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.326368:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201267.326373:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3c66 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.326382:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3c66 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.326398:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33e8b00) 00010000:00010000:2.0:1788201267.326401:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201267.326407:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3c66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.326413:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3c66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.326430:0:13379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3c6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.326435:0:13379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3c6d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.326440:0:13379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3c6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.326445:0:13379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201267.326447:0:13379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3c6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.326453:0:13379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3c6d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.326463:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1317f023 (ffff9e03c33edc00) 00010000:00010000:2.0:1788201267.326466:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201267.326468:0:13379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3c6d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.326474:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3c6d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.327258:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3c5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e1e expref: 11 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.327387:0:13379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3c74 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e1e expref: 10 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.327398:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:2.0:1788201267.327401:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201267.327403:0:13379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031000, rc 0) 00000100:00100000:2.0:1788201267.327564:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:14923:x1875064442660608:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 2117us (2378us total) trans 8589938699 rc 0/0 00000100:00100000:2.0:1788201267.327574:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5166 00000100:00100000:0.0:1788201267.356031:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201267.356932:0:12973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442660864 00000100:00100000:3.0:1788201267.356948:0:12973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442660864 00000100:00100000:3.0:1788201267.357040:0:12973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1034 00000100:00100000:3.0:1788201267.357053:0:12973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:14923:x1875064442660864:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1788201267.357465:0:12973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:14923:x1875064442660864:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 413us (1449us total) trans 8589938700 rc 0/0 00000100:00100000:3.0:1788201267.357475:0:12973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1034 00000100:00100000:2.0:1788201267.368811:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201267.368990:0:12972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442660992 00000100:00100000:1.0:1788201267.369004:0:12972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442660992 00000100:00100000:1.0:1788201267.369079:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1035 00000100:00100000:1.0:1788201267.369091:0:12972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c67d8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:14923:x1875064442660992:12345-192.168.201.30@tcp:33:lfs.0 00000004:00200000:1.0:1788201267.369235:0:12972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f9:0x0]: returning size 512 00000004:00200000:1.0:1788201267.369240:0:12972:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:1.0:1788201267.369398:0:12972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c67d8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:14923:x1875064442660992:12345-192.168.201.30@tcp:33:lfs.0 Request processed in 308us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201267.369407:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1035 00000100:00100000:1.0:1788201267.376806:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201267.376962:0:13381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442661248 00000100:00100000:2.0:1788201267.376983:0:13381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442661248 00000100:00100000:2.0:1788201267.377060:0:13381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1036 00000100:00100000:2.0:1788201267.377072:0:13381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:14923:x1875064442661248:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:2.0:1788201267.377484:0:13381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:14923:x1875064442661248:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 413us (692us total) trans 8589938701 rc 0/0 00000100:00100000:2.0:1788201267.377497:0:13381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1036 00000100:00100000:0.0:1788201267.422384:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201267.422642:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442661376 00000100:00100000:3.0:1788201267.422655:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442661376 00000100:00100000:3.0:1788201267.422782:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5167 00000100:00100000:3.0:1788201267.422795:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:14929:x1875064442661376:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:3.0:1788201267.422839:0:12968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201267.422868:0:12968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d3c82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4e25 expref: -99 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.422968:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3c89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.422995:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3c89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.423010:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3c89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.423029:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3c90 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.423036:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3c90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.423043:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3c90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.423193:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d3c97 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.423202:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d3c97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.423213:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d3c97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201267.423251:0:12968:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f9:0x0]: returning size 512 00000004:00200000:3.0:1788201267.423256:0:12968:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201267.423326:0:12968:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d3c97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.423341:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3c89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.423348:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3c89 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.423355:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3c89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.423361:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bd600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201267.423365:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3c89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.423373:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3c89 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.423387:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33e8b00) 00010000:00010000:3.0:1788201267.423390:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201267.423396:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3c89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.423402:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3c89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.423620:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3c90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.423629:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3c90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.423634:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3c90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.423640:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201267.423643:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3c90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.423649:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3c90 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.423658:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1317f023 (ffff9e03c33e8500) 00010000:00010000:3.0:1788201267.423661:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201267.423665:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3c90 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.423671:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3c90 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.423711:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d3c82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e25 expref: 14 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.423726:0:12968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d3c97 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e25 expref: 13 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.423805:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:3.0:1788201267.423807:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788201267.423810:0:12968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bc200, rc 0) 00000100:00100000:3.0:1788201267.424041:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:14929:x1875064442661376:12345-192.168.201.30@tcp:101:touch.0 Request processed in 1247us (1670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201267.424050:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5167 00000100:00100000:0.0:1788201267.428592:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201267.428706:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442661632 00000100:00100000:1.0:1788201267.428720:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442661632 00000100:00100000:1.0:1788201267.428902:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5168 00000100:00100000:1.0:1788201267.428917:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:14929:x1875064442661632:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:1.0:1788201267.428948:0:12969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201267.428953:0:12969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788201267.429000:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3c74 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e1e expref: 13 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.429025:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:1.0:1788201267.429032:0:12969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201267.429050:0:12969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b200/0x9383f985bc4d3c9e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4e2c expref: -99 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.429234:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b000/0x9383f985bc4d3ca5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.429252:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b000/0x9383f985bc4d3ca5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.429263:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b000/0x9383f985bc4d3ca5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.429290:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3cac lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.429629:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3cac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.429637:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3cac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201267.430755:0:12969:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x41d:0x0], index 0: 0 00010000:00010000:1.0:1788201267.431243:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a800/0x9383f985bc4d3cb3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.431260:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a800/0x9383f985bc4d3cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.431271:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a800/0x9383f985bc4d3cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.431458:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b000/0x9383f985bc4d3ca5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.431471:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b000/0x9383f985bc4d3ca5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.431479:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b000/0x9383f985bc4d3ca5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.431485:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0b000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201267.431491:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b000/0x9383f985bc4d3ca5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.431499:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b000/0x9383f985bc4d3ca5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.431514:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:1.0:1788201267.431517:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201267.431523:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b000/0x9383f985bc4d3ca5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.431531:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b000/0x9383f985bc4d3ca5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201267.431548:0:12969:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e1700ec4 reply state 000000007c1f63db transno 8589938702 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3cac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201267.431560:0:12969:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201267.431609:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b200/0x9383f985bc4d3c9e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e2c expref: 15 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.431626:0:12969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a800/0x9383f985bc4d3cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e2c expref: 14 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.431638:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fa:0x0].0x0 (ffff9e03c5173900) 00010000:00010000:1.0:1788201267.431641:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201267.431643:0:12969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9c0a800, rc 0) 00000100:00100000:1.0:1788201267.432110:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:14929:x1875064442661632:12345-192.168.201.30@tcp:101:touch.0 Request processed in 3194us (3531us total) trans 8589938702 rc 0/0 00000100:00100000:1.0:1788201267.432122:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5168 00010000:00010000:3.0:1788201267.433579:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3cac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.433600:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3cac lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.433609:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3cac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.433616:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0ac00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201267.433621:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3cac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.433630:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3cac lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.433649:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0xcda302ea (ffff9e03c5173200) 00010000:00010000:3.0:1788201267.433652:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201267.433657:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3cac lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.433664:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3cac lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201267.434607:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201267.435050:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442661888 00000100:00100000:3.0:1788201267.435062:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442661888 00000100:00100000:3.0:1788201267.435141:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5169 00000100:00100000:3.0:1788201267.435155:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:14929:x1875064442661888:12345-192.168.201.30@tcp:36:touch.0 00010000:00010000:3.0:1788201267.435243:0:13379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201267.435287:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a800/0x9383f985bc4d3cb3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e2c expref: 14 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.435339:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fa:0x0].0x0 (ffff9e03c5173900) 00010000:00010000:3.0:1788201267.435351:0:13379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201267.435418:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3cc1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.435433:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3cc1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.435444:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3cc1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201267.435631:0:13379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000596d6280 reply state 000000002866fdf8 transno 8589938703 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3cc1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201267.435642:0:13379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201267.435782:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:14929:x1875064442661888:12345-192.168.201.30@tcp:36:touch.0 Request processed in 629us (1181us total) trans 8589938703 rc 0/0 00000100:00100000:3.0:1788201267.435791:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5169 00000100:00100000:1.0:1788201267.436391:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458227456:0@lo:400:kworker.0 00000100:00100000:1.0:1788201267.436466:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201267.436797:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0501b36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458227840:0@lo:400:kworker.0 00000100:00100000:3.0:1788201267.436840:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201267.436920:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875064458227584:0@lo:400:kworker.0 00000100:00100000:3.0:1788201267.436950:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201267.436983:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201267.436990:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875064458227712:0@lo:400:kworker.0 00000100:00100000:3.0:1788201267.437014:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201267.437044:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458227584 00000100:00100000:3.0:1788201267.437052:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458227584 00000100:00100000:3.0:1788201267.437121:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458227712 00000100:00100000:3.0:1788201267.437125:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458227712 00000100:00100000:3.0:1788201267.437151:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788201267.437162:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875064458227584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201267.437219:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875064458227584:12345-0@lo:400:kworker.0 Request processed in 59us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201267.437227:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788201267.437244:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788201267.437250:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875064458227712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201267.437327:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875064458227712:12345-0@lo:400:kworker.0 Request processed in 31us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201267.437335:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788201267.437377:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875064458227712:0@lo:400:kworker.0 00000100:00100000:3.0:1788201267.437386:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875064458227584:0@lo:400:kworker.0 00000100:00100000:3.0:1788201267.437442:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458227840 00000100:00100000:3.0:1788201267.437446:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458227840 00000100:00100000:3.0:1788201267.437477:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788201267.437484:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+7:3312:x1875064458227840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201267.437524:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+7:3312:x1875064458227840:12345-0@lo:400:kworker.0 Request processed in 40us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201267.437531:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:3.0:1788201267.437549:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201267.437554:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201267.437574:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0501b36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458227840:0@lo:400:kworker.0 00000100:00100000:0.0:1788201267.438065:0:12964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458227456 00000100:00100000:0.0:1788201267.438080:0:12964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458227456 00000100:00100000:0.0:1788201267.438126:0:12964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788201267.438135:0:12964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c648cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3313:x1875064458227456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201267.439185:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c56f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875064458228096:0@lo:400:kworker.0 00000100:00100000:2.0:1788201267.439190:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201267.439199:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0501b36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458227968:0@lo:400:kworker.0 00000100:00100000:2.0:1788201267.439259:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201267.439348:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458227968 00000100:00100000:2.0:1788201267.439355:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458227968 00000100:00100000:2.0:1788201267.439414:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788201267.439424:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+8:3312:x1875064458227968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201267.439476:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+8:3312:x1875064458227968:12345-0@lo:400:kworker.0 Request processed in 54us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201267.439484:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:2.0:1788201267.439513:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201267.439544:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0501b36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458227968:0@lo:400:kworker.0 00000100:00100000:2.0:1788201267.439726:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:2.0:1788201267.439768:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3cc1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.439782:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3cc1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.439790:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3cc1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.439798:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201267.439803:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3cc1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.439812:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3cc1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.439834:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fa:0x0].0x0 (ffff9e03c33e8c00) 00010000:00010000:2.0:1788201267.439837:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201267.439842:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3cc1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.439848:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d3cc1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201267.439882:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442662016 00000100:00100000:2.0:1788201267.439886:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442662016 00000100:00100000:2.0:1788201267.439917:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5170 00000100:00100000:2.0:1788201267.439926:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:14929:x1875064442662016:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:2.0:1788201267.439950:0:12971:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201267.440137:0:12971:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3cc8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4e33 expref: -99 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.440220:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3cc8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e33 expref: 15 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.440238:0:12971:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3cc8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e33 expref: 15 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.440262:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fa:0x0].0x0 (ffff9e03c33edc00) 00010000:00010000:2.0:1788201267.440265:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201267.440268:0:12971:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031400, rc 0) 00000100:00100000:2.0:1788201267.440355:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:14929:x1875064442662016:12345-192.168.201.30@tcp:101:touch.0 Request processed in 429us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201267.440365:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5170 00000100:00100000:0.0:1788201267.440637:0:12964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c648cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3313:x1875064458227456:12345-0@lo:400:kworker.0 Request processed in 2500us (4167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201267.440648:0:12964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788201267.441176:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458227456:0@lo:400:kworker.0 00000100:00100000:3.0:1788201267.443454:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201267.443498:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458228096 00000100:00100000:1.0:1788201267.443510:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458228096 00000100:00100000:1.0:1788201267.443580:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788201267.443593:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875064458228096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201267.443689:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875064458228096:12345-0@lo:400:kworker.0 Request processed in 98us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201267.443696:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788201267.443785:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c56f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875064458228096:0@lo:400:kworker.0 00000100:00100000:0.0:1788201267.444488:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201267.444563:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442662144 00000100:00100000:3.0:1788201267.444570:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442662144 00000100:00080000:2.0:1788201267.444616:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201267.444641:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4208 00000100:00100000:3.0:1788201267.444651:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2359:x1875064442662144:12345-192.168.201.30@tcp:2:touch.0 00000100:00100000:3.0:1788201267.445174:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+506:2359:x1875064442662144:12345-192.168.201.30@tcp:2:touch.0 Request processed in 522us (689us total) trans 4294968853 rc 0/0 00000100:00100000:3.0:1788201267.445183:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4208 00000100:00100000:2.0:1788201267.448155:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201267.448376:0:12973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442662400 00000100:00100000:3.0:1788201267.448390:0:12973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442662400 00000100:00100000:3.0:1788201267.448466:0:12973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1037 00000100:00100000:3.0:1788201267.448479:0:12973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:14929:x1875064442662400:12345-192.168.201.30@tcp:35:touch.0 00000100:00100000:3.0:1788201267.449699:0:12973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:14929:x1875064442662400:12345-192.168.201.30@tcp:35:touch.0 Request processed in 1217us (1553us total) trans 8589938704 rc 0/0 00000100:00100000:3.0:1788201267.449709:0:12973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1037 00000100:00100000:2.0:1788201267.460067:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201267.460166:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442662656 00000100:00100000:3.0:1788201267.460179:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442662656 00000100:00100000:3.0:1788201267.460253:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5171 00000100:00100000:3.0:1788201267.460266:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0501b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:14930:x1875064442662656:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:3.0:1788201267.460345:0:12969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201267.460371:0:12969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d3ccf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4e3a expref: -99 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.460535:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3cd6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.460555:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3cd6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.460570:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3cd6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.460585:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3cdd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.460590:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3cdd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.460594:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3cdd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201267.461806:0:12969:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x41d:0x0], index 1: 0 00010000:00010000:2.0:1788201267.462070:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3ce4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.462087:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3ce4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.462099:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3ce4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.462147:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3cd6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.462155:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3cd6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.462163:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3cd6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.462169:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201267.462174:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3cd6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.462181:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3cd6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.462201:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:2.0:1788201267.462205:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201267.462210:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3cd6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.462217:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3cd6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201267.462234:0:12969:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5aaf963 reply state 000000008a7c702f transno 8589938705 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3cdd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201267.462245:0:12969:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201267.462370:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d3ccf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e3a expref: 19 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.462388:0:12969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3ce4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e3a expref: 18 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.462396:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fb:0x0].0x0 (ffff9e03c33ed500) 00010000:00010000:2.0:1788201267.462398:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201267.462401:0:12969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031a00, rc 0) 00000100:00100000:2.0:1788201267.462876:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0501b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:14930:x1875064442662656:12345-192.168.201.30@tcp:101:touch.0 Request processed in 2610us (2822us total) trans 8589938705 rc 0/0 00000100:00100000:2.0:1788201267.462886:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5171 00010000:00010000:3.0:1788201267.465221:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3cdd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.465341:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3cdd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.465351:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3cdd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.465362:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bd600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201267.465369:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3cdd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.465378:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3cdd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.465399:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x15fcbbea (ffff9e03c33e8500) 00010000:00010000:3.0:1788201267.465402:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201267.465407:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3cdd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.465413:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3cdd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201267.467672:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201267.468130:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442662912 00000100:00100000:3.0:1788201267.468142:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442662912 00000100:00100000:3.0:1788201267.468210:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5172 00000100:00100000:3.0:1788201267.468220:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2202300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+18:14930:x1875064442662912:12345-192.168.201.30@tcp:36:touch.0 00010000:00010000:3.0:1788201267.468333:0:13406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201267.468361:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3ce4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e3a expref: 18 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.468379:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fb:0x0].0x0 (ffff9e03c33ed500) 00010000:00010000:3.0:1788201267.468388:0:13406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201267.468440:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3cf2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.468452:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3cf2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.469561:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3cf2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201267.469745:0:13406:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7e7b933 reply state 0000000004f8450a transno 8589938706 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3cf2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201267.469754:0:13406:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201267.469886:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2202300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:14930:x1875064442662912:12345-192.168.201.30@tcp:36:touch.0 Request processed in 1665us (2227us total) trans 8589938706 rc 0/0 00000100:00100000:3.0:1788201267.469895:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5172 00010000:00010000:2.0:1788201267.473439:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3cf2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.473465:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3cf2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.473474:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3cf2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.473481:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bd800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201267.473487:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3cf2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.473496:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3cf2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.473520:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fb:0x0].0x0 (ffff9e03c33e8f00) 00010000:00010000:2.0:1788201267.473524:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201267.473529:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3cf2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.473536:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3cf2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201267.479947:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201267.480849:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442663040 00000100:00100000:3.0:1788201267.480873:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442663040 00000100:00100000:2.0:1788201267.481059:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5173 00000100:00100000:2.0:1788201267.481361:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+18:14930:x1875064442663040:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:2.0:1788201267.481395:0:12971:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201267.481420:0:12971:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3cf9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4e41 expref: -99 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.481496:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3cf9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e41 expref: 19 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.481513:0:12971:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3cf9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e41 expref: 19 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.481532:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fb:0x0].0x0 (ffff9e03c33ed900) 00010000:00010000:2.0:1788201267.481535:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201267.481538:0:12971:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0030a00, rc 0) 00000100:00100000:2.0:1788201267.482750:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:14930:x1875064442663040:12345-192.168.201.30@tcp:101:touch.0 Request processed in 541us (1680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201267.482764:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5173 00000100:00100000:0.0:1788201267.484409:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201267.484485:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442663168 00000100:00100000:1.0:1788201267.484500:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442663168 00000100:00100000:1.0:1788201267.484594:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4209 00000100:00100000:1.0:1788201267.484608:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2359:x1875064442663168:12345-192.168.201.30@tcp:2:touch.0 00000100:00080000:2.0:1788201267.484707:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201267.485037:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2359:x1875064442663168:12345-192.168.201.30@tcp:2:touch.0 Request processed in 431us (633us total) trans 4294968855 rc 0/0 00000100:00100000:1.0:1788201267.485046:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4209 00000100:00100000:0.0:1788201267.489591:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201267.489929:0:12972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442663424 00000100:00100000:3.0:1788201267.489953:0:12972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442663424 00000100:00100000:3.0:1788201267.490037:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1038 00000100:00100000:3.0:1788201267.490050:0:12972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:14930:x1875064442663424:12345-192.168.201.30@tcp:35:touch.0 00000100:00100000:3.0:1788201267.490561:0:12972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:14930:x1875064442663424:12345-192.168.201.30@tcp:35:touch.0 Request processed in 512us (979us total) trans 8589938707 rc 0/0 00000100:00100000:3.0:1788201267.490570:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1038 00000100:00100000:2.0:1788201267.502151:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201267.502229:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442663680 00000100:00100000:1.0:1788201267.502244:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442663680 00000100:00100000:1.0:1788201267.502835:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5174 00000100:00100000:1.0:1788201267.502851:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2200700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:14931:x1875064442663680:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:1.0:1788201267.502889:0:12969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201267.502918:0:12969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b200/0x9383f985bc4d3d00 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4e48 expref: -99 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.503121:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b000/0x9383f985bc4d3d07 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.503140:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b000/0x9383f985bc4d3d07 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.503154:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b000/0x9383f985bc4d3d07 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.503171:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a400/0x9383f985bc4d3d0e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.503178:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a400/0x9383f985bc4d3d0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.503184:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a400/0x9383f985bc4d3d0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201267.504191:0:12969:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x41e:0x0], index 0: 0 00010000:00010000:1.0:1788201267.504429:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d3d15 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.504442:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d3d15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.504452:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d3d15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.504799:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b000/0x9383f985bc4d3d07 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.504805:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b000/0x9383f985bc4d3d07 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.504810:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b000/0x9383f985bc4d3d07 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.504815:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0b000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201267.504818:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b000/0x9383f985bc4d3d07 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.504824:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b000/0x9383f985bc4d3d07 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.504836:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:1.0:1788201267.504838:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201267.504842:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b000/0x9383f985bc4d3d07 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.504846:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b000/0x9383f985bc4d3d07 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201267.504859:0:12969:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000038d7d840 reply state 0000000012b0665f transno 8589938708 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a400/0x9383f985bc4d3d0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201267.504870:0:12969:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201267.504915:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b200/0x9383f985bc4d3d00 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e48 expref: 23 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.504930:0:12969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d3d15 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e48 expref: 22 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.504935:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fc:0x0].0x0 (ffff9e03c5173100) 00010000:00010000:1.0:1788201267.504937:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201267.504939:0:12969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9c0b600, rc 0) 00000100:00100000:1.0:1788201267.505181:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2200700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:14931:x1875064442663680:12345-192.168.201.30@tcp:101:touch.0 Request processed in 2333us (3042us total) trans 8589938708 rc 0/0 00000100:00100000:1.0:1788201267.505191:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5174 00000100:00100000:1.0:1788201267.513049:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1788201267.513368:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a400/0x9383f985bc4d3d0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.513386:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a400/0x9383f985bc4d3d0e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.513395:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a400/0x9383f985bc4d3d0e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.513408:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0a400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201267.513414:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a400/0x9383f985bc4d3d0e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.513423:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a400/0x9383f985bc4d3d0e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.513446:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x5e5674ea (ffff9e03c5173d00) 00010000:00010000:3.0:1788201267.513449:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201267.513464:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a400/0x9383f985bc4d3d0e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.513472:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a400/0x9383f985bc4d3d0e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201267.513706:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442663936 00000100:00100000:2.0:1788201267.513720:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442663936 00000100:00100000:2.0:1788201267.513796:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5175 00000100:00100000:2.0:1788201267.513810:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:14931:x1875064442663936:12345-192.168.201.30@tcp:36:touch.0 00010000:00010000:2.0:1788201267.513886:0:12968:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201267.513908:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d3d15 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e48 expref: 22 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.513922:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fc:0x0].0x0 (ffff9e03c5173100) 00010000:00010000:2.0:1788201267.513929:0:12968:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201267.515875:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3d23 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.515905:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3d23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.515919:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3d23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201267.516681:0:12968:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ba06b9b reply state 00000000cb3dcbc9 transno 8589938709 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3d23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201267.516695:0:12968:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201267.516860:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:14931:x1875064442663936:12345-192.168.201.30@tcp:36:touch.0 Request processed in 3048us (3822us total) trans 8589938709 rc 0/0 00000100:00100000:2.0:1788201267.516871:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5175 00010000:00010000:2.0:1788201267.519192:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3d23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.519216:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3d23 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.519225:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3d23 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.519233:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201267.519239:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3d23 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.519248:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3d23 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.519271:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fc:0x0].0x0 (ffff9e03c33edb00) 00010000:00010000:2.0:1788201267.519275:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201267.519281:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3d23 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.519288:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3d23 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201267.520744:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201267.520794:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442664064 00000100:00100000:2.0:1788201267.520808:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442664064 00000100:00100000:2.0:1788201267.520885:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5176 00000100:00100000:2.0:1788201267.520903:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c6bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:14931:x1875064442664064:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:2.0:1788201267.520938:0:12971:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201267.520988:0:12971:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3d2a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4e4f expref: -99 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.521074:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3d2a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e4f expref: 23 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.521096:0:12971:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3d2a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e4f expref: 23 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.521119:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fc:0x0].0x0 (ffff9e03c33ed100) 00010000:00010000:2.0:1788201267.521122:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201267.521126:0:12971:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031c00, rc 0) 00000100:00100000:2.0:1788201267.521210:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c6bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:14931:x1875064442664064:12345-192.168.201.30@tcp:101:touch.0 Request processed in 315us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201267.521218:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5176 00000100:00100000:0.0:1788201267.529521:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201267.529681:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442664192 00000100:00100000:3.0:1788201267.529696:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442664192 00000100:00100000:3.0:1788201267.529779:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4210 00000100:00100000:3.0:1788201267.529791:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f965b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+506:2359:x1875064442664192:12345-192.168.201.30@tcp:2:touch.0 00000100:00100000:3.0:1788201267.530504:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f965b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+507:2359:x1875064442664192:12345-192.168.201.30@tcp:2:touch.0 Request processed in 710us (996us total) trans 4294968854 rc 0/0 00000100:00100000:3.0:1788201267.530515:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4210 00000100:00100000:1.0:1788201267.537273:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201267.539219:0:12973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442664448 00000100:00100000:3.0:1788201267.539238:0:12973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442664448 00000100:00100000:3.0:1788201267.539378:0:12973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1039 00000100:00100000:3.0:1788201267.539392:0:12973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:14931:x1875064442664448:12345-192.168.201.30@tcp:35:touch.0 00000100:00100000:3.0:1788201267.540848:0:12973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:14931:x1875064442664448:12345-192.168.201.30@tcp:35:touch.0 Request processed in 1445us (3576us total) trans 8589938710 rc 0/0 00000100:00100000:3.0:1788201267.540863:0:12973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1039 00000100:00100000:1.0:1788201267.555707:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201267.555835:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442664704 00000100:00100000:2.0:1788201267.555850:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442664704 00000100:00100000:2.0:1788201267.555940:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5177 00000100:00100000:2.0:1788201267.556260:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:14932:x1875064442664704:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:2.0:1788201267.557589:0:12969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201267.557683:0:12969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3d31 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4e56 expref: -99 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.557930:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3d38 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.557948:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3d38 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.558154:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3d38 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.558175:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d3d3f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.558183:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d3d3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.558189:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d3d3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201267.559526:0:12969:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x41e:0x0], index 1: 0 00010000:00010000:2.0:1788201267.559799:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3d46 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.559817:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3d46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.559831:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3d46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.559887:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3d38 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.559901:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3d38 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.559908:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3d38 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.559916:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201267.559920:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3d38 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.559928:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3d38 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.559943:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:2.0:1788201267.559946:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201267.559962:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3d38 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.559978:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d3d38 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201267.559998:0:12969:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d6cfcd0 reply state 00000000df817eb4 transno 8589938711 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d3d3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201267.560008:0:12969:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201267.560054:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d3d31 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e56 expref: 27 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.560068:0:12969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3d46 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e56 expref: 26 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.560092:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fd:0x0].0x0 (ffff9e03c33ed400) 00010000:00010000:2.0:1788201267.560095:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201267.560097:0:12969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031a00, rc 0) 00000100:00100000:2.0:1788201267.560205:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:14932:x1875064442664704:12345-192.168.201.30@tcp:101:touch.0 Request processed in 4254us (4509us total) trans 8589938711 rc 0/0 00000100:00100000:2.0:1788201267.560215:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5177 00010000:00010000:3.0:1788201267.566802:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d3d3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.566825:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d3d3f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.566835:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d3d3f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.566842:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201267.566848:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d3d3f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.566861:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d3d3f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.566883:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0xa6b02dea (ffff9e03c33edb00) 00010000:00010000:3.0:1788201267.566886:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201267.566891:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d3d3f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.566898:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d3d3f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201267.567812:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201267.568550:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442664960 00000100:00100000:2.0:1788201267.568564:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442664960 00000100:00100000:2.0:1788201267.568655:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5178 00000100:00100000:2.0:1788201267.568667:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:14932:x1875064442664960:12345-192.168.201.30@tcp:36:touch.0 00010000:00010000:2.0:1788201267.568751:0:12968:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201267.568779:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d3d46 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e56 expref: 26 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.568799:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fd:0x0].0x0 (ffff9e03c33ed400) 00010000:00010000:2.0:1788201267.568809:0:12968:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201267.568874:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d3d54 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.568889:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d3d54 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.568899:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d3d54 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201267.569108:0:12968:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af069efb reply state 000000001fdd1b04 transno 8589938712 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d3d54 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201267.569123:0:12968:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201267.569241:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:14932:x1875064442664960:12345-192.168.201.30@tcp:36:touch.0 Request processed in 576us (1436us total) trans 8589938712 rc 0/0 00000100:00100000:2.0:1788201267.569249:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5178 00000100:00100000:0.0:1788201267.574640:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201267.574732:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442665088 00000100:00100000:3.0:1788201267.574745:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442665088 00000100:00100000:3.0:1788201267.574826:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5179 00000100:00100000:3.0:1788201267.574837:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:14932:x1875064442665088:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:3.0:1788201267.574873:0:13406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201267.574899:0:13406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3d5b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4e5d expref: -99 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.574993:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3d5b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e5d expref: 28 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.575011:0:13406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3d5b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e5d expref: 28 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.575035:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fd:0x0].0x0 (ffff9e03c33ed000) 00010000:00010000:3.0:1788201267.575039:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201267.575044:0:13406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bd600, rc 0) 00000100:00100000:3.0:1788201267.575123:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:14932:x1875064442665088:12345-192.168.201.30@tcp:101:touch.0 Request processed in 287us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201267.575130:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5179 00010000:00010000:2.0:1788201267.579779:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d3d54 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.579805:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d3d54 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.579814:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d3d54 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.579822:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201267.579829:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d3d54 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.579838:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d3d54 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.579872:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fd:0x0].0x0 (ffff9e03c33ed000) 00010000:00010000:2.0:1788201267.579875:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201267.579881:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d3d54 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.579887:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d3d54 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201267.580277:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201267.580468:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442665216 00000100:00100000:3.0:1788201267.580481:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442665216 00000100:00100000:3.0:1788201267.580592:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4211 00000100:00100000:3.0:1788201267.580604:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2360:x1875064442665216:12345-192.168.201.30@tcp:2:touch.0 00000100:00100000:3.0:1788201267.581071:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442665216:12345-192.168.201.30@tcp:2:touch.0 Request processed in 467us (798us total) trans 4294968856 rc 0/0 00000100:00100000:3.0:1788201267.581089:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4211 00000100:00100000:1.0:1788201267.587517:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201267.587749:0:13381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442665472 00000100:00100000:2.0:1788201267.587762:0:13381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442665472 00000100:00100000:2.0:1788201267.587875:0:13381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1040 00000100:00100000:2.0:1788201267.587888:0:13381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:14932:x1875064442665472:12345-192.168.201.30@tcp:35:touch.0 00000100:00100000:2.0:1788201267.588449:0:13381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:14932:x1875064442665472:12345-192.168.201.30@tcp:35:touch.0 Request processed in 561us (946us total) trans 8589938713 rc 0/0 00000100:00100000:2.0:1788201267.588459:0:13381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1040 00000100:00100000:2.0:1788201267.601206:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201267.601382:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442665728 00000100:00100000:1.0:1788201267.601395:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442665728 00000100:00100000:1.0:1788201267.602071:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5180 00000100:00100000:1.0:1788201267.602159:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:14933:x1875064442665728:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:1.0:1788201267.602197:0:12969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201267.602228:0:12969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ba00/0x9383f985bc4d3d62 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4e64 expref: -99 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.603161:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a800/0x9383f985bc4d3d69 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.603187:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a800/0x9383f985bc4d3d69 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.603203:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a800/0x9383f985bc4d3d69 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.603223:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3d70 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.603231:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3d70 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.603237:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3d70 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201267.605029:0:12969:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x41f:0x0], index 0: 0 00010000:00010000:1.0:1788201267.605390:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3d77 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.605409:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3d77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.605421:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3d77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.606235:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a800/0x9383f985bc4d3d69 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.606249:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a800/0x9383f985bc4d3d69 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.606257:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a800/0x9383f985bc4d3d69 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.606264:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0a800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201267.606270:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a800/0x9383f985bc4d3d69 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.606276:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a800/0x9383f985bc4d3d69 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.606395:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:1.0:1788201267.606399:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201267.606406:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a800/0x9383f985bc4d3d69 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.606413:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a800/0x9383f985bc4d3d69 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201267.606434:0:12969:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000fbc8fe3 reply state 00000000a2a3f4e7 transno 8589938714 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3d70 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201267.606445:0:12969:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201267.606501:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ba00/0x9383f985bc4d3d62 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e64 expref: 31 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.606517:0:12969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3d77 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e64 expref: 30 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.606525:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fe:0x0].0x0 (ffff9e03c5173d00) 00010000:00010000:1.0:1788201267.606527:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201267.606529:0:12969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9c0b800, rc 0) 00000100:00100000:1.0:1788201267.606756:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+31:14933:x1875064442665728:12345-192.168.201.30@tcp:101:touch.0 Request processed in 4606us (5565us total) trans 8589938714 rc 0/0 00000100:00100000:1.0:1788201267.606767:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5180 00000100:00100000:1.0:1788201267.615405:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201267.616361:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442665984 00000100:00100000:0.0:1788201267.616377:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442665984 00000100:00100000:0.0:1788201267.616481:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5181 00000100:00100000:0.0:1788201267.616495:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+31:14933:x1875064442665984:12345-192.168.201.30@tcp:36:touch.0 00010000:00010000:0.0:1788201267.616584:0:12971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201267.616631:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3d77 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e64 expref: 31 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201267.616658:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fe:0x0].0x0 (ffff9e03c5173d00) 00010000:00010000:0.0:1788201267.616671:0:12971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201267.616736:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3d85 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201267.616753:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3d85 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201267.616764:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3d85 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201267.616977:0:12971:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004db1077f reply state 00000000132171c5 transno 8589938715 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3d85 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201267.616990:0:12971:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201267.617389:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+32:14933:x1875064442665984:12345-192.168.201.30@tcp:36:touch.0 Request processed in 894us (1999us total) trans 8589938715 rc 0/0 00000100:00100000:0.0:1788201267.617403:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5181 00010000:00010000:3.0:1788201267.620493:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3d70 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.620515:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3d70 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.620528:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3d70 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.620535:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0ac00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201267.620541:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3d70 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.620549:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3d70 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.620571:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0xef09e6ea (ffff9e03c5173500) 00010000:00010000:3.0:1788201267.620574:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201267.620579:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3d70 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.620586:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3d70 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201267.621152:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201267.621287:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442666112 00000100:00100000:3.0:1788201267.621352:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442666112 00000100:00100000:3.0:1788201267.621423:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5182 00000100:00100000:3.0:1788201267.621435:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+31:14933:x1875064442666112:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:3.0:1788201267.621469:0:13379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201267.621493:0:13379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3d8c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4e6b expref: -99 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.621571:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3d8c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e6b expref: 32 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.621591:0:13379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3d8c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e6b expref: 32 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.621629:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fe:0x0].0x0 (ffff9e04ff181900) 00010000:00010000:3.0:1788201267.621633:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201267.621637:0:13379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bca00, rc 0) 00000100:00100000:3.0:1788201267.621713:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+32:14933:x1875064442666112:12345-192.168.201.30@tcp:101:touch.0 Request processed in 280us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201267.621721:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5182 00010000:00010000:1.0:1788201267.622681:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3d85 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.622698:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3d85 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.622706:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3d85 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.622714:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a8000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201267.622720:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3d85 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.622728:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3d85 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.622745:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fe:0x0].0x0 (ffff9e04ff181900) 00010000:00010000:1.0:1788201267.622748:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201267.622753:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3d85 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.622759:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3d85 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201267.625579:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201267.626593:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442666240 00000100:00100000:0.0:1788201267.626674:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442666240 00000100:00100000:0.0:1788201267.626761:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4212 00000100:00100000:0.0:1788201267.626773:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+507:2359:x1875064442666240:12345-192.168.201.30@tcp:2:touch.0 00000100:00100000:0.0:1788201267.627791:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2359:x1875064442666240:12345-192.168.201.30@tcp:2:touch.0 Request processed in 1012us (2219us total) trans 4294968855 rc 0/0 00000100:00100000:0.0:1788201267.627805:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4212 00000100:00100000:3.0:1788201267.631511:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201267.631604:0:12972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442666496 00000100:00100000:1.0:1788201267.631627:0:12972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442666496 00000100:00100000:1.0:1788201267.631702:0:12972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1041 00000100:00100000:1.0:1788201267.631714:0:12972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c67d8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+31:14933:x1875064442666496:12345-192.168.201.30@tcp:35:touch.0 00000100:00100000:1.0:1788201267.632414:0:12972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c67d8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+32:14933:x1875064442666496:12345-192.168.201.30@tcp:35:touch.0 Request processed in 698us (914us total) trans 8589938716 rc 0/0 00000100:00100000:1.0:1788201267.632424:0:12972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1041 00000100:00100000:1.0:1788201267.643850:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201267.644008:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442666752 00000100:00100000:2.0:1788201267.644022:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442666752 00000100:00100000:2.0:1788201267.644109:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5183 00000100:00100000:2.0:1788201267.644121:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+32:14934:x1875064442666752:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:2.0:1788201267.644155:0:12969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201267.644183:0:12969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d3d93 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4e72 expref: -99 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.644401:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d3d9a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.644419:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d3d9a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.644433:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d3d9a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.644449:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d3da1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.644457:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d3da1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.644469:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d3da1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201267.645066:0:12969:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x41f:0x0], index 1: 0 00010000:00010000:2.0:1788201267.645271:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064a00/0x9383f985bc4d3da8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.645283:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064a00/0x9383f985bc4d3da8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.645335:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064a00/0x9383f985bc4d3da8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.645382:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d3d9a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.645390:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d3d9a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.645396:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d3d9a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.645403:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201267.645408:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d3d9a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.645417:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d3d9a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.645432:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:2.0:1788201267.645435:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201267.645441:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d3d9a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.645447:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d3d9a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201267.645463:0:12969:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c75e5a2 reply state 000000009f88979d transno 8589938717 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d3da1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201267.645473:0:12969:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201267.645512:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d3d93 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e72 expref: 35 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.645527:0:12969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064a00/0x9383f985bc4d3da8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e72 expref: 34 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.645535:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ff:0x0].0x0 (ffff9e03c33ed200) 00010000:00010000:2.0:1788201267.645537:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201267.645540:0:12969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5064a00, rc 0) 00000100:00100000:2.0:1788201267.645648:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+35:14934:x1875064442666752:12345-192.168.201.30@tcp:101:touch.0 Request processed in 1529us (1814us total) trans 8589938717 rc 0/0 00000100:00100000:2.0:1788201267.645657:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5183 00010000:00010000:3.0:1788201267.649289:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d3da1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.649337:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d3da1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.649345:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d3da1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.649353:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201267.649359:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d3da1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.649367:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d3da1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.649388:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x37639fea (ffff9e03c33ed400) 00010000:00010000:3.0:1788201267.649392:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201267.649399:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d3da1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.649407:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d3da1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201267.650597:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201267.651562:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442667008 00000100:00100000:2.0:1788201267.651578:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442667008 00000100:00100000:2.0:1788201267.651678:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5184 00000100:00100000:2.0:1788201267.651692:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+34:14934:x1875064442667008:12345-192.168.201.30@tcp:36:touch.0 00010000:00010000:2.0:1788201267.651778:0:13406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201267.651814:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064a00/0x9383f985bc4d3da8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e72 expref: 34 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.651847:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ff:0x0].0x0 (ffff9e03c33ed200) 00010000:00010000:2.0:1788201267.651874:0:13406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201267.651943:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d3db6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.652200:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d3db6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.652214:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d3db6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201267.652443:0:13406:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031a6fe57 reply state 00000000869aa7f2 transno 8589938718 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d3db6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201267.652456:0:13406:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201267.652596:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+35:14934:x1875064442667008:12345-192.168.201.30@tcp:36:touch.0 Request processed in 906us (2011us total) trans 8589938718 rc 0/0 00000100:00100000:2.0:1788201267.652617:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5184 00010000:00010000:1.0:1788201267.654962:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d3db6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.654993:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d3db6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.655002:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d3db6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.655010:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201267.655015:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d3db6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.655024:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d3db6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.655043:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ff:0x0].0x0 (ffff9e03c33ed700) 00010000:00010000:1.0:1788201267.655046:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201267.655052:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d3db6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.655057:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d3db6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201267.657829:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201267.658004:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442667136 00000100:00100000:3.0:1788201267.658018:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442667136 00000100:00100000:3.0:1788201267.658104:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5185 00000100:00100000:3.0:1788201267.658118:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+34:14934:x1875064442667136:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:3.0:1788201267.658155:0:12968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201267.658187:0:12968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d3dbd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4e79 expref: -99 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.658270:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d3dbd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e79 expref: 35 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.658289:0:12968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d3dbd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e79 expref: 35 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201267.658341:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ff:0x0].0x0 (ffff9e03c33e8500) 00010000:00010000:3.0:1788201267.658344:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201267.658349:0:12968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bcc00, rc 0) 00000100:00100000:3.0:1788201267.658426:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+35:14934:x1875064442667136:12345-192.168.201.30@tcp:101:touch.0 Request processed in 310us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201267.658435:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5185 00000100:00100000:2.0:1788201267.670579:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201267.670810:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442667264 00000100:00100000:3.0:1788201267.670825:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442667264 00000100:00100000:3.0:1788201267.670898:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4213 00000100:00100000:3.0:1788201267.670912:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442667264:12345-192.168.201.30@tcp:2:touch.0 00000100:00100000:3.0:1788201267.671411:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2360:x1875064442667264:12345-192.168.201.30@tcp:2:touch.0 Request processed in 499us (848us total) trans 4294968857 rc 0/0 00000100:00100000:3.0:1788201267.671420:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4213 00000100:00100000:1.0:1788201267.675334:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201267.675441:0:13381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442667520 00000100:00100000:2.0:1788201267.675456:0:13381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442667520 00000100:00100000:2.0:1788201267.675527:0:13381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1042 00000100:00100000:2.0:1788201267.675540:0:13381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+35:14934:x1875064442667520:12345-192.168.201.30@tcp:35:touch.0 00000100:00100000:2.0:1788201267.676044:0:13381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+36:14934:x1875064442667520:12345-192.168.201.30@tcp:35:touch.0 Request processed in 505us (767us total) trans 8589938719 rc 0/0 00000100:00100000:2.0:1788201267.676052:0:13381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1042 00000100:00100000:1.0:1788201267.687574:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201267.687783:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442667776 00000100:00100000:0.0:1788201267.687798:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442667776 00000100:00100000:0.0:1788201267.687884:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5186 00000100:00100000:0.0:1788201267.687896:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c52edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+36:14935:x1875064442667776:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:0.0:1788201267.687932:0:12971:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201267.687977:0:12971:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d3dc4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4e80 expref: -99 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201267.688153:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3dcb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201267.688172:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3dcb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201267.688186:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3dcb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201267.688204:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3dd2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201267.688213:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3dd2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201267.688220:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3dd2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201267.689210:0:12971:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x420:0x0], index 0: 0 00010000:00010000:0.0:1788201267.690270:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3dd9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201267.690326:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201267.690341:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201267.690392:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3dcb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201267.690399:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3dcb lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201267.690407:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3dcb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201267.690414:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a8200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201267.690419:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3dcb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201267.690427:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3dcb lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201267.690446:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:0.0:1788201267.690450:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201267.691042:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3dcb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201267.691052:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3dcb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201267.693656:0:12971:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de65c099 reply state 0000000088b39c07 transno 8589938720 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3dd2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201267.693682:0:12971:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201267.693808:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d3dc4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e80 expref: 39 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201267.693837:0:12971:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e80 expref: 38 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201267.693848:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x400:0x0].0x0 (ffff9e04ff181d00) 00010000:00010000:0.0:1788201267.693865:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201267.693869:0:12971:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c19a8e00, rc 0) 00000100:00100000:0.0:1788201267.693998:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c52edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+39:14935:x1875064442667776:12345-192.168.201.30@tcp:101:touch.0 Request processed in 6102us (6438us total) trans 8589938720 rc 0/0 00000100:00100000:0.0:1788201267.694008:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5186 00000100:00100000:3.0:1788201267.699770:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201267.700200:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442668032 00000100:00100000:1.0:1788201267.700215:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442668032 00000100:00100000:1.0:1788201267.700327:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5187 00000100:00100000:1.0:1788201267.700340:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+39:14935:x1875064442668032:12345-192.168.201.30@tcp:36:touch.0 00010000:00010000:1.0:1788201267.700417:0:13379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201267.700451:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3dd9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e80 expref: 39 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.700472:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x400:0x0].0x0 (ffff9e04ff181d00) 00010000:00010000:1.0:1788201267.700484:0:13379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201267.700540:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3de7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.700555:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3de7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201267.700567:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3de7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201267.700737:0:13379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005db01aad reply state 000000006b5a1b63 transno 8589938721 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3de7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201267.700747:0:13379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201267.700868:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+40:14935:x1875064442668032:12345-192.168.201.30@tcp:36:touch.0 Request processed in 529us (1110us total) trans 8589938721 rc 0/0 00000100:00100000:1.0:1788201267.700875:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5187 00010000:00010000:0.0:1788201267.702141:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3dd2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201267.702158:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3dd2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201267.702165:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3dd2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201267.702172:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201267.702177:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3dd2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201267.702186:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3dd2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201267.702202:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x7fbd58ea (ffff9e04ff181400) 00010000:00010000:0.0:1788201267.702205:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201267.702210:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3dd2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201267.702216:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3dd2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.704578:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3de7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.704598:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3de7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.704603:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3de7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.704614:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0be00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201267.704618:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3de7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.704624:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3de7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.704642:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x400:0x0].0x0 (ffff9e03c5173100) 00010000:00010000:2.0:1788201267.704646:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201267.704652:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3de7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.704658:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3de7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201267.706339:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201267.706639:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442668160 00000100:00100000:2.0:1788201267.706654:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442668160 00000100:00100000:2.0:1788201267.706717:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5188 00000100:00100000:2.0:1788201267.706725:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+38:14935:x1875064442668160:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:2.0:1788201267.706754:0:12969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201267.706775:0:12969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064a00/0x9383f985bc4d3dee lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x400:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4e87 expref: -99 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.706863:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064a00/0x9383f985bc4d3dee lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x400:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e87 expref: 39 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.706881:0:12969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064a00/0x9383f985bc4d3dee lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x400:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e87 expref: 39 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201267.706899:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x400:0x0].0x0 (ffff9e03c33ed200) 00010000:00010000:2.0:1788201267.706901:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201267.706905:0:12969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5064a00, rc 0) 00000100:00100000:2.0:1788201267.706991:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+39:14935:x1875064442668160:12345-192.168.201.30@tcp:101:touch.0 Request processed in 265us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201267.706999:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5188 00000100:00100000:1.0:1788201267.709992:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201267.710181:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442668288 00000100:00100000:0.0:1788201267.710195:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442668288 00000100:00100000:0.0:1788201267.710268:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4214 00000100:00100000:0.0:1788201267.710280:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2359:x1875064442668288:12345-192.168.201.30@tcp:2:touch.0 00000100:00100000:0.0:1788201267.710870:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2359:x1875064442668288:12345-192.168.201.30@tcp:2:touch.0 Request processed in 590us (898us total) trans 4294968856 rc 0/0 00000100:00100000:0.0:1788201267.710877:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4214 00000100:00100000:1.0:1788201267.716417:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201267.716631:0:12973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442668544 00000100:00100000:3.0:1788201267.716643:0:12973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442668544 00000100:00100000:3.0:1788201267.716701:0:12973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1043 00000100:00100000:3.0:1788201267.716711:0:12973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+39:14935:x1875064442668544:12345-192.168.201.30@tcp:35:touch.0 00000100:00100000:3.0:1788201267.717147:0:12973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+40:14935:x1875064442668544:12345-192.168.201.30@tcp:35:touch.0 Request processed in 436us (741us total) trans 8589938722 rc 0/0 00000100:00100000:3.0:1788201267.717153:0:12973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1043 00000001:00080000:1.0:1788201268.009672:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968855 is committed 00000001:00080000:1.0:1788201268.009700:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968853 is committed 00000001:00080000:1.0:1788201268.009710:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968857 is committed 00000001:00080000:1.0:1788201268.009722:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968854 is committed 00000001:00080000:1.0:1788201268.038526:0:6732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294968856 is committed 00000001:00080000:1.0:1788201268.038552:0:6732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294968852 is committed 00010000:00010000:1.0:1788201268.070137:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201268.453750:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458228224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201268.453853:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201268.453990:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458228224 00000100:00100000:0.0:1788201268.454001:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458228224 00000100:00100000:0.0:1788201268.454069:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788201268.454082:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458228224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201268.454132:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 525008896 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1788201268.454285:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458228224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 205us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201268.454322:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788201268.454352:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968852 gen 2 00000004:00080000:2.0:1788201268.454359:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5284a80, transno 4294968851 00000004:00080000:2.0:1788201268.454376:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5286300, transno 4294968852 00000100:00100000:2.0:1788201268.454390:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458228224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201268.635769:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201268.635851:0:12965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442668672 00000100:00100000:1.0:1788201268.635865:0:12965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442668672 00000100:00100000:1.0:1788201268.635959:0:12965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 118 00000100:00100000:1.0:1788201268.635972:0:12965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c648c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442668672:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201268.636074:0:12965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c648c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442668672:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 104us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201268.636083:0:12965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 118 00000100:00100000:1.0:1788201268.645221:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201268.645279:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201268.645327:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201268.645366:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442669056 00000100:00100000:1.0:1788201268.645380:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442669056 00000100:00100000:1.0:1788201268.645441:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442668928 00000100:00100000:1.0:1788201268.645444:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442668928 00000100:00100000:1.0:1788201268.645469:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 165 00000100:00100000:1.0:1788201268.645481:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2359:x1875064442669056:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201268.645581:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2359:x1875064442669056:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 103us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201268.645590:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 165 00000100:00100000:1.0:1788201268.645609:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 166 00000100:00100000:1.0:1788201268.645618:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2359:x1875064442668928:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201268.645643:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2359:x1875064442668928:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 27us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201268.645650:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 166 00000100:00100000:3.0:1788201268.645870:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442668800 00000100:00100000:3.0:1788201268.645875:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442668800 00000100:00100000:3.0:1788201268.645918:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 99 00000100:00100000:3.0:1788201268.645927:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+40:2360:x1875064442668800:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201268.645996:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+40:2360:x1875064442668800:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 70us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201268.646004:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 99 00000100:00100000:3.0:1788201268.678437:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201268.680278:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442669184 00000100:00100000:2.0:1788201268.680313:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442669184 00000100:00100000:2.0:1788201268.680390:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5189 00000100:00100000:2.0:1788201268.680402:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+40:14944:x1875064442669184:12345-192.168.201.30@tcp:41:lfs.0 00000004:00000024:2.0:1788201268.680463:0:12968:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788201268.680556:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+40:14944:x1875064442669184:12345-192.168.201.30@tcp:41:lfs.0 Request processed in 156us (2132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201268.680565:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5189 00000100:00100000:1.0:1788201268.685573:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201268.688807:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442669312 00000100:00100000:3.0:1788201268.688828:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442669312 00000100:00100000:3.0:1788201268.688913:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 141 00000100:00100000:3.0:1788201268.688926:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:14944:x1875064442669312:12345-192.168.201.30@tcp:13:lfs.0 00002000:00000024:3.0:1788201268.689079:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 525008896 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1788201268.689193:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:14944:x1875064442669312:12345-192.168.201.30@tcp:13:lfs.0 Request processed in 269us (3635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201268.689202:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 141 00000100:00100000:0.0:1788201268.706374:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201268.707130:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442669440 00000100:00100000:1.0:1788201268.707146:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442669440 00000100:00100000:1.0:1788201268.707214:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 142 00000100:00100000:1.0:1788201268.707227:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:14944:x1875064442669440:12345-192.168.201.30@tcp:13:lfs.0 00002000:00000024:1.0:1788201268.707279:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 13631488 granted 525008896 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201268.707395:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:14944:x1875064442669440:12345-192.168.201.30@tcp:13:lfs.0 Request processed in 170us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201268.707403:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 142 00000100:00100000:3.0:1788201268.756801:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201268.756851:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442669696 00000100:00100000:3.0:1788201268.756864:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442669696 00000100:00100000:3.0:1788201268.756945:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5190 00000100:00100000:3.0:1788201268.756966:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+40:14951:x1875064442669696:12345-192.168.201.30@tcp:36:mcreate.0 00010000:00010000:3.0:1788201268.757042:0:13406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201268.757081:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d3c3c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e10 expref: 40 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.757105:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33e8b00) 00010000:00010000:3.0:1788201268.757118:0:13406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201268.757234:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3df5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.757250:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3df5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.757261:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3df5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.757275:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3dfc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.757283:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3dfc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.757324:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3dfc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.758009:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3df5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.758019:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3df5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.758026:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3df5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.758032:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bda00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201268.758037:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3df5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.758045:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3df5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.758055:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33e8000) 00010000:00010000:3.0:1788201268.758058:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201268.758062:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3df5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.758068:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3df5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201268.758084:0:13406:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de65551e reply state 0000000017fe0d88 transno 8589938723 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3dfc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201268.758094:0:13406:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201268.758227:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+41:14951:x1875064442669696:12345-192.168.201.30@tcp:36:mcreate.0 Request processed in 1261us (1436us total) trans 8589938723 rc 0/0 00000100:00100000:3.0:1788201268.758237:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5190 00010000:00010000:3.0:1788201268.764990:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3dfc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.765011:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3dfc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.765020:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3dfc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.765026:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bdc00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201268.765032:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3dfc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.765040:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3dfc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.765061:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf2391a86 (ffff9e03c33e8a00) 00010000:00010000:3.0:1788201268.765065:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201268.765070:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3dfc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.765077:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3dfc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201268.795003:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201268.795245:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442669824 00000100:00100000:1.0:1788201268.795260:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442669824 00000100:00100000:1.0:1788201268.795621:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5191 00000100:00100000:1.0:1788201268.795634:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+40:14954:x1875064442669824:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1788201268.795667:0:13379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201268.795696:0:13379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b000/0x9383f985bc4d3e03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4e8e expref: -99 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.795783:0:13379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b200/0x9383f985bc4d3e0a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.795800:0:13379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b200/0x9383f985bc4d3e0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.795818:0:13379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b200/0x9383f985bc4d3e0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201268.796214:0:13379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1788201268.796221:0:13379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201268.796255:0:13379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b200/0x9383f985bc4d3e0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.796288:0:13379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b000/0x9383f985bc4d3e03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e8e expref: 42 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.796464:0:13379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b200/0x9383f985bc4d3e0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e8e expref: 41 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.796473:0:13379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173300) 00010000:00010000:1.0:1788201268.796477:0:13379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201268.796481:0:13379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9c0b200, rc 0) 00000100:00100000:1.0:1788201268.796611:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+41:14954:x1875064442669824:12345-192.168.201.30@tcp:101:rm.0 Request processed in 980us (1620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201268.796619:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5191 00000100:00100000:2.0:1788201268.802832:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201268.803769:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442669952 00000100:00100000:1.0:1788201268.803787:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442669952 00000100:00100000:1.0:1788201268.804257:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5192 00000100:00100000:1.0:1788201268.804274:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+41:14954:x1875064442669952:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1788201268.804336:0:12969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201268.804368:0:12969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a400/0x9383f985bc4d3e11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4e95 expref: -99 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.804481:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d3e18 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.804499:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d3e18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.804513:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d3e18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.804531:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3e1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.804537:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3e1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.804544:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3e1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.804685:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3e26 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x401:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.804694:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3e26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x401:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.804702:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3e26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x401:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201268.804745:0:12969:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x401:0x0]: returning size 0 00000004:00200000:1.0:1788201268.804749:0:12969:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201268.804772:0:12969:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3e26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x401:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.804790:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3e26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x401:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.804800:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d3e18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.804809:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d3e18 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.804816:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d3e18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.804824:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0b600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201268.804829:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d3e18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.804852:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d3e18 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.804867:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173300) 00010000:00010000:1.0:1788201268.804872:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201268.804877:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d3e18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.804885:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d3e18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.804901:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3e1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.804907:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3e1f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.804915:0:12969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3e1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.804931:0:12969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0a600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201268.804935:0:12969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3e1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.804942:0:12969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3e1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.804960:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf2391a86 (ffff9e03c5173400) 00010000:00010000:1.0:1788201268.804963:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201268.804966:0:12969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3e1f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.804973:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3e1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.805009:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a400/0x9383f985bc4d3e11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e95 expref: 43 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.805024:0:12969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3e26 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x401:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e95 expref: 42 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.805032:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x401:0x0].0x0 (ffff9e03c5173900) 00010000:00010000:1.0:1788201268.805035:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201268.805037:0:12969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9c0ac00, rc 0) 00000100:00100000:1.0:1788201268.805559:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+42:14954:x1875064442669952:12345-192.168.201.30@tcp:101:rm.0 Request processed in 1287us (2739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201268.805572:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5192 00000100:00100000:2.0:1788201268.812772:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201268.813232:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442670208 00000100:00100000:3.0:1788201268.813246:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442670208 00000100:00100000:3.0:1788201268.813488:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5193 00000100:00100000:3.0:1788201268.813500:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+42:14954:x1875064442670208:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:3.0:1788201268.813576:0:12971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788201268.813612:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ac00/0x9383f985bc4d3e26 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x401:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e95 expref: 42 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.813637:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x401:0x0].0x0 (ffff9e03c5173900) 00010000:00010000:3.0:1788201268.813655:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b200/0x9383f985bc4d3e0a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e8e expref: 41 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.813664:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173300) 00010000:00010000:3.0:1788201268.813670:0:12971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201268.813702:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3e2d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.813717:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3e2d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.813728:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3e2d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.813741:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3e34 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.813749:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3e34 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.813755:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3e34 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.813909:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d3e3b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x401:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.813997:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d3e3b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x401:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.814005:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d3e3b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x401:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.818526:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3e42 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x401:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.818554:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3e42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x401:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.818566:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3e42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x401:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.818574:0:12971:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3e42 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x401:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.818579:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3e42 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x401:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.818582:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3e42 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x401:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.818650:0:12971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201268.818678:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d3e3b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x401:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.818682:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d3e3b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x401:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.818686:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d3e3b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x401:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.818691:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201268.818695:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d3e3b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x401:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.818701:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d3e3b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x401:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.818710:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x401:0x0].0x0 (ffff9e03c33e8b00) 00010000:00010000:3.0:1788201268.818713:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201268.818716:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d3e3b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x401:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.818720:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d3e3b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x401:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.818741:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3e2d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.818745:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3e2d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.818749:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3e2d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.818751:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bdc00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201268.818753:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3e2d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.818756:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3e2d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.818763:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33e8a00) 00010000:00010000:3.0:1788201268.818765:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201268.818767:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3e2d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.818770:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3e2d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201268.818781:0:12971:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7d22f67 reply state 00000000c9e07069 transno 8589938724 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3e34 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201268.818788:0:12971:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201268.818893:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+42:14954:x1875064442670208:12345-192.168.201.30@tcp:36:rm.0 Request processed in 5391us (6132us total) trans 8589938724 rc 0/0 00000100:00100000:3.0:1788201268.818901:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5193 00010000:00010000:3.0:1788201268.825470:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3e34 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.825491:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3e34 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.825497:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3e34 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.825502:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bda00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201268.825506:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3e34 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.825512:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3e34 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.825534:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf2391a86 (ffff9e03c33e8000) 00010000:00010000:3.0:1788201268.825537:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201268.825540:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3e34 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201268.825545:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3e34 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.826966:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201268.826978:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3e42 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x401:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.826988:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bd800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201268.826993:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3e42 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x401:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.827000:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3e42 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x401:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.827015:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x401:0x0].0x0 (ffff9e03c33e8b00) 00010000:00010000:1.0:1788201268.827019:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201268.827023:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3e42 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x401:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.827030:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d3e42 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x401:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201268.827370:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201268.827374:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201268.827377:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201269.093471:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788201270.062498:0:14259:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938720 is committed 00000001:00080000:1.0:1788201270.062649:0:12980:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938721 is committed 00000001:00080000:1.0:1788201270.062779:0:12980:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938724 is committed 00010000:00010000:0.0:1788201270.120179:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788201270.578230:0:14477:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=4008668d len=0 uarg=00007ffe56787780 00000004:00000080:1.0:1788201270.578256:0:14477:0:(mdt_handler.c:8183:mdt_iocontrol()) lustre-MDT0000: cmd=4008668d len=576 karg=ffff9e03c279c400 uarg=0000000000000000 00080000:00020000:2.0:1788201270.589683:0:14477:0:(osd_handler.c:720:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only *** 00000100:00100000:1.0:1788201271.013768:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201271.013813:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458228352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201271.013925:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201271.014101:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458228352 00000100:00100000:0.0:1788201271.014112:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458228352 00000100:00100000:0.0:1788201271.014197:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788201271.014209:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458228352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201271.014255:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 13631488 granted 525008896 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201271.014342:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458228352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201271.014351:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788201271.014399:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968854 gen 2 00000004:00080000:0.0:1788201271.014406:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cffae300, transno 4294968852 00000004:00080000:0.0:1788201271.014417:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cffac000, transno 4294968853 00000004:00080000:0.0:1788201271.014420:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cffaf800, transno 4294968854 00000100:00100000:0.0:1788201271.014434:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458228352:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1788201271.014865:0:12995:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00000100:00080000:2.0:1788201271.014950:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788201271.151143:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201271.409496:0:14525:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00010000:00010000:0.0:1788201272.165532:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201272.220250:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201272.223507:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442670336 00000100:00100000:1.0:1788201272.223528:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442670336 00000100:00100000:1.0:1788201272.224004:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 874 00000100:00100000:1.0:1788201272.224019:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:2360:x1875064442670336:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:1.0:1788201272.224080:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201272.224111:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3e49 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4e9c expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.224987:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-116, rc=-116) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3e49 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e9c expref: 14 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.225260:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f1:0x0].0x0 (ffff9e03c5173400) 00010000:00010000:1.0:1788201272.225263:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201272.225271:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3e49 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e9c expref: 14 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.225365:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9c0be00, rc -116) 00010000:00000080:1.0:1788201272.225390:0:6714:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e03c53e9180 x1875064442670336/t0(0) o63->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:393/0 lens 664/4320 e 0 to 0 dl 1788201283 ref 1 fl Interpret:/200/0 rc -116/0 job:'ll_sa.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201272.226705:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:2360:x1875064442670336:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 2678us (6461us total) trans 0 rc -116/-116 00000100:00100000:1.0:1788201272.227586:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 874 00000100:00080000:0.0:1788201272.230563:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201272.549577:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458228480:0@lo:400:kworker.0 00000100:00100000:0.0:1788201272.549696:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201272.549962:0:12987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458228480 00000100:00100000:3.0:1788201272.549973:0:12987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458228480 00000100:00100000:3.0:1788201272.550052:0:12987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788201272.550064:0:12987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c648c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3313:x1875064458228480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201272.554700:0:12987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c648c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3313:x1875064458228480:12345-0@lo:400:kworker.0 Request processed in 4626us (4993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201272.554722:0:12987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788201272.555603:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458228864:0@lo:400:kworker.0 00000100:00100000:2.0:1788201272.555715:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201272.555908:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201272.555923:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458228992:0@lo:400:kworker.0 00000100:00100000:2.0:1788201272.555953:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201272.556076:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875064458228608:0@lo:400:kworker.0 00000100:00100000:2.0:1788201272.556113:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201272.556204:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875064458229120:0@lo:400:kworker.0 00000100:00100000:2.0:1788201272.556229:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201272.556253:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201272.556260:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875064458228736:0@lo:400:kworker.0 00000100:00100000:2.0:1788201272.556283:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201272.556355:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458228864 00000100:00100000:2.0:1788201272.556365:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458228864 00000100:00100000:2.0:1788201272.556439:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458228992 00000100:00100000:2.0:1788201272.556443:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458228992 00000100:00100000:2.0:1788201272.556940:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788201272.556955:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c6632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458228864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201272.557190:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788201272.557202:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c6630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458228992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201272.557269:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c6630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458228992:12345-0@lo:400:kworker.0 Request processed in 70us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201272.557277:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788201272.558180:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c6632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458228864:12345-0@lo:400:kworker.0 Request processed in 1225us (2462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201272.558193:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788201272.558232:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458228608 00000100:00100000:2.0:1788201272.558241:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458228608 00000100:00100000:2.0:1788201272.558311:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458229120 00000100:00100000:2.0:1788201272.558315:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458229120 00000100:00100000:2.0:1788201272.558336:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458228736 00000100:00100000:2.0:1788201272.558339:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458228736 00000100:00100000:2.0:1788201272.558357:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788201272.558364:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c6630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875064458228608:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788201272.558388:0:13379:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e04c6630e00 x1875064458228608/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:393/0 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201272.558432:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c6630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875064458228608:12345-0@lo:400:kworker.0 Request processed in 68us (2317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201272.558438:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788201272.558450:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788201272.559033:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788201272.559565:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875064458229120:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788201272.559590:0:13379:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e03c5421880 x1875064458229120/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:393/0 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201272.559651:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875064458229120:12345-0@lo:400:kworker.0 Request processed in 1195us (3420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201272.559659:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788201272.559745:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875064458228608:0@lo:400:kworker.0 00000100:00100000:2.0:1788201272.559755:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875064458229120:0@lo:400:kworker.0 00000100:00100000:2.0:1788201272.560089:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458228992:0@lo:400:kworker.0 00000100:00100000:2.0:1788201272.560102:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458228864:0@lo:400:kworker.0 00000100:00100000:0.0:1788201272.560979:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458228480:0@lo:400:kworker.0 00000100:00100000:3.0:1788201272.561003:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875064458228736:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788201272.561035:0:12968:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e03c5420380 x1875064458228736/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:393/0 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201272.561081:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201272.561090:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201272.561324:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875064458228736:12345-0@lo:400:kworker.0 Request processed in 2281us (5038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201272.561336:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788201272.570379:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875064458228736:0@lo:400:kworker.0 00000100:00100000:2.0:1788201272.584982:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201272.585027:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201272.585056:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201272.585094:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442670464 00000100:00100000:2.0:1788201272.585106:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442670464 00000100:00100000:2.0:1788201272.585226:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442670592 00000100:00100000:2.0:1788201272.585230:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442670592 00000100:00100000:2.0:1788201272.585247:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442670720 00000100:00100000:2.0:1788201272.585250:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442670720 00000100:00100000:2.0:1788201272.585264:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5194 00000100:00100000:2.0:1788201272.585275:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:14996:x1875064442670464:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1788201272.585325:0:12969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201272.585359:0:12969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d3e50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4ea3 expref: -99 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.585452:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d3e57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.585469:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d3e57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.585482:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d3e57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201272.585745:0:12969:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788201272.585751:0:12969:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201272.585842:0:12969:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d3e57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.585880:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d3e50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ea3 expref: 17 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.585912:0:12969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d3e57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ea3 expref: 16 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.585923:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33edf00) 00010000:00010000:2.0:1788201272.585927:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201272.585931:0:12969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5065000, rc 0) 00010000:00000080:2.0:1788201272.585941:0:12969:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e03c5422300 x1875064442670464/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:393/0 lens 576/688 e 0 to 0 dl 1788201283 ref 1 fl Interpret:/600/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201272.586023:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:14996:x1875064442670464:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 749us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201272.586032:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5194 00000100:00100000:2.0:1788201272.586062:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5195 00000100:00100000:2.0:1788201272.586072:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:14997:x1875064442670592:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1788201272.586082:0:12969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201272.586092:0:12969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d3e5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4eaa expref: -99 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.586126:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d3e65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.586135:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d3e65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.586142:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d3e65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201272.586224:0:12969:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788201272.586228:0:12969:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201272.586325:0:12969:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d3e65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.586345:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d3e5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4eaa expref: 17 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.586357:0:12969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d3e65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4eaa expref: 16 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.586363:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33edf00) 00010000:00010000:2.0:1788201272.586366:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201272.586368:0:12969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5065800, rc 0) 00010000:00000080:2.0:1788201272.586373:0:12969:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e03c5423800 x1875064442670592/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:393/0 lens 576/688 e 0 to 0 dl 1788201283 ref 1 fl Interpret:/600/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201272.586403:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:14997:x1875064442670592:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 334us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201272.586410:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5195 00000100:00100000:2.0:1788201272.586426:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5196 00000100:00100000:2.0:1788201272.586434:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:15000:x1875064442670720:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1788201272.586442:0:12969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201272.586451:0:12969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d3e6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4eb1 expref: -99 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.586478:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d3e73 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.586487:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d3e73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.586494:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d3e73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201272.586574:0:12969:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788201272.586578:0:12969:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201272.586647:0:12969:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d3e73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.586666:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d3e6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4eb1 expref: 17 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.586678:0:12969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d3e73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4eb1 expref: 16 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.586684:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33edf00) 00010000:00010000:2.0:1788201272.586687:0:12969:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201272.586689:0:12969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5065200, rc 0) 00010000:00000080:2.0:1788201272.586693:0:12969:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e03c5421c00 x1875064442670720/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:393/0 lens 576/688 e 0 to 0 dl 1788201283 ref 1 fl Interpret:/600/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201272.586721:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:15000:x1875064442670720:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 289us (1665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201272.586728:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5196 00000100:00100000:2.0:1788201272.596892:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201272.596951:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201272.596990:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442670848 00000100:00100000:2.0:1788201272.597004:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442670848 00000100:00100000:2.0:1788201272.597068:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442670976 00000100:00100000:2.0:1788201272.597071:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442670976 00000100:00100000:2.0:1788201272.597098:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5197 00000100:00100000:2.0:1788201272.597122:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+17:15001:x1875064442670848:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1788201272.597153:0:12971:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201272.597182:0:12971:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d3e7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4eb8 expref: -99 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.597272:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d3e81 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.597288:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d3e81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.597327:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d3e81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201272.597601:0:12971:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788201272.597607:0:12971:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201272.597999:0:12971:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d3e81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.598041:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d3e7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4eb8 expref: 19 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.598064:0:12971:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d3e81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4eb8 expref: 18 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.598074:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33edf00) 00010000:00010000:2.0:1788201272.598078:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201272.598083:0:12971:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5064600, rc 0) 00010000:00000080:2.0:1788201272.598094:0:12971:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e03c5422d80 x1875064442670848/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:393/0 lens 576/688 e 0 to 0 dl 1788201283 ref 1 fl Interpret:/600/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201272.599260:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+18:15001:x1875064442670848:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 2144us (2385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201272.599289:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5198 00000100:00100000:3.0:1788201272.599328:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+18:14999:x1875064442670976:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1788201272.599352:0:12968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201272.599377:0:12968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3e88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4ebf expref: -99 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.599452:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3e8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.599468:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3e8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.599480:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3e8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201272.599866:0:12968:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788201272.599871:0:12968:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201272.599965:0:12968:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3e8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.599994:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3e88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ebf expref: 20 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.600014:0:12968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3e8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ebf expref: 19 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.600024:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33edf00) 00010000:00010000:3.0:1788201272.600028:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201272.600031:0:12968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bdc00, rc 0) 00010000:00000080:3.0:1788201272.600040:0:12968:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e03c5422a00 x1875064442670976/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:393/0 lens 576/688 e 0 to 0 dl 1788201283 ref 1 fl Interpret:/600/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201272.600084:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:14999:x1875064442670976:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 767us (3133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201272.606977:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201272.607079:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201272.607170:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201272.607200:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442671104 00000100:00100000:1.0:1788201272.607214:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442671104 00000100:00100000:1.0:1788201272.607270:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442671232 00000100:00100000:1.0:1788201272.607274:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442671232 00000100:00100000:1.0:1788201272.607285:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442671360 00000100:00100000:1.0:1788201272.607288:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442671360 00000100:00100000:1.0:1788201272.607328:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5199 00000100:00100000:1.0:1788201272.607340:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:14998:x1875064442671104:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1788201272.607371:0:13406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201272.607400:0:13406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3e96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4ec6 expref: -99 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.607492:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ba00/0x9383f985bc4d3e9d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.607509:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ba00/0x9383f985bc4d3e9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.607524:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ba00/0x9383f985bc4d3e9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201272.607802:0:13406:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1788201272.607807:0:13406:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201272.607907:0:13406:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ba00/0x9383f985bc4d3e9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.607941:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d3e96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ec6 expref: 24 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.607964:0:13406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ba00/0x9383f985bc4d3e9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ec6 expref: 23 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.607980:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33edf00) 00010000:00010000:1.0:1788201272.607984:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201272.607988:0:13406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9c0ba00, rc 0) 00010000:00000080:1.0:1788201272.607999:0:13406:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e04f000e300 x1875064442671104/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:393/0 lens 576/688 e 0 to 0 dl 1788201283 ref 1 fl Interpret:/600/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788201272.608103:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:14998:x1875064442671104:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 763us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201272.608112:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5199 00000100:00100000:1.0:1788201272.608138:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5200 00000100:00100000:1.0:1788201272.608148:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:15002:x1875064442671232:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1788201272.608158:0:13406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201272.608169:0:13406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3ea4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4ecd expref: -99 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.608207:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3eab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.608217:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3eab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.608225:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3eab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201272.608351:0:13406:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1788201272.608355:0:13406:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201272.608429:0:13406:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3eab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.608451:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0be00/0x9383f985bc4d3ea4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ecd expref: 24 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.608465:0:13406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3eab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ecd expref: 23 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.608472:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33edf00) 00010000:00010000:1.0:1788201272.608475:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201272.608477:0:13406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9c0b800, rc 0) 00010000:00000080:1.0:1788201272.608482:0:13406:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e04f000d180 x1875064442671232/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:393/0 lens 576/688 e 0 to 0 dl 1788201283 ref 1 fl Interpret:/600/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788201272.608513:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:15002:x1875064442671232:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 367us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201272.608519:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5200 00000100:00100000:1.0:1788201272.608533:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5201 00000100:00100000:1.0:1788201272.608540:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:14997:x1875064442671360:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1788201272.608548:0:13406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201272.608557:0:13406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b000/0x9383f985bc4d3eb2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4ed4 expref: -99 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.608591:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d3eb9 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.608600:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d3eb9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.608607:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d3eb9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.608622:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3ec0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.608629:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.608635:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.608914:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a400/0x9383f985bc4d3ec7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.608924:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a400/0x9383f985bc4d3ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.608932:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a400/0x9383f985bc4d3ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201272.608958:0:13406:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3fb:0x0]: returning size 0 00000004:00200000:1.0:1788201272.608962:0:13406:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201272.608971:0:13406:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a400/0x9383f985bc4d3ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.608982:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a400/0x9383f985bc4d3ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.608992:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d3eb9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.608999:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d3eb9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.609010:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d3eb9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.609017:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0b600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201272.609022:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d3eb9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.609031:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d3eb9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.609045:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:1.0:1788201272.609048:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201272.609053:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d3eb9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.609060:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b600/0x9383f985bc4d3eb9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.609069:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.609074:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3ec0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.609080:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3ec0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.609085:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0a600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201272.609087:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3ec0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.609097:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3ec0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.609103:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x15fcbbea (ffff9e03c5173400) 00010000:00010000:1.0:1788201272.609105:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201272.609108:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3ec0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.609113:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d3ec0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.609140:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b000/0x9383f985bc4d3eb2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ed4 expref: 24 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.609151:0:13406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a400/0x9383f985bc4d3ec7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ed4 expref: 23 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.609158:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fb:0x0].0x0 (ffff9e03c33ed900) 00010000:00010000:1.0:1788201272.609161:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201272.609164:0:13406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9c0a400, rc 0) 00010000:00000080:1.0:1788201272.609169:0:13406:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e04f000df80 x1875064442671360/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:393/0 lens 576/640 e 0 to 0 dl 1788201283 ref 1 fl Interpret:/600/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788201272.609205:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:14997:x1875064442671360:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 665us (2035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201272.609212:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5201 00000100:00100000:2.0:1788201272.613682:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5197 00000100:00100000:3.0:1788201272.614516:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5198 00000100:00100000:3.0:1788201272.614911:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201272.614957:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201272.614987:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201272.615010:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201272.615031:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201272.615050:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201272.615072:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201272.615186:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201272.615221:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442671616 00000100:00100000:3.0:1788201272.615233:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442671616 00000100:00100000:3.0:1788201272.615323:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442671872 00000100:00100000:3.0:1788201272.615327:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442671872 00000100:00100000:3.0:1788201272.615348:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442672128 00000100:00100000:3.0:1788201272.615351:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442672128 00000100:00100000:3.0:1788201272.615368:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442672384 00000100:00100000:3.0:1788201272.615371:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442672384 00000100:00100000:3.0:1788201272.615388:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:3.0:1788201272.615400:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5439500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:2359:x1875064442671616:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201272.615421:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201272.615457:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d3e73 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4eb1 expref: 24 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.615485:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33edf00) 00010000:00010000:3.0:1788201272.615493:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201272.615562:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5439500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:2359:x1875064442671616:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 163us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201272.615570:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:3.0:1788201272.615588:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:3.0:1788201272.615595:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:2361:x1875064442671872:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201272.615603:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201272.615613:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d3e57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ea3 expref: 22 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.615623:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33edf00) 00010000:00010000:3.0:1788201272.615626:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201272.616897:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442671488 00000100:00100000:2.0:1788201272.616909:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442671488 00000100:00100000:2.0:1788201272.616961:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442671744 00000100:00100000:2.0:1788201272.616965:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442671744 00000100:00100000:2.0:1788201272.616978:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442672000 00000100:00100000:2.0:1788201272.616981:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442672000 00000100:00100000:2.0:1788201272.616992:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442672256 00000100:00100000:2.0:1788201272.616994:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442672256 00000100:00100000:2.0:1788201272.617014:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5202 00000100:00100000:2.0:1788201272.617024:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d80f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+25:15000:x1875064442671488:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1788201272.617050:0:12971:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201272.617074:0:12971:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d3ece lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4edb expref: -99 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201272.617372:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:2361:x1875064442671872:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1772us (2356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201272.617385:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:3.0:1788201272.617416:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:3.0:1788201272.617425:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+25:2360:x1875064442672128:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201272.617439:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201272.617464:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d3e8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ebf expref: 25 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.617483:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33edf00) 00010000:00010000:3.0:1788201272.617488:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201272.617540:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:2360:x1875064442672128:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 116us (2489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201272.617546:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:3.0:1788201272.617562:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:2.0:1788201272.618336:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201272.618461:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:2.0:1788201272.618590:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d3ed5 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.618610:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d3ed5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.618623:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d3ed5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.619967:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d3edc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.619989:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d3edc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.620002:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d3edc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201272.620606:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:2361:x1875064442672384:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201272.620639:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788201272.620877:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5203 00000100:00100000:0.0:1788201272.620908:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:14996:x1875064442671744:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1788201272.620934:0:13406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201272.620956:0:13406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d3ee3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4ee2 expref: -99 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.621027:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3eea lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.621039:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3eea lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.621049:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3eea lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.621065:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3ef1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.621072:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.621079:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.621285:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3ef8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.621315:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.621323:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201272.621366:0:13406:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3fa:0x0]: returning size 0 00000004:00200000:0.0:1788201272.621371:0:13406:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201272.621391:0:13406:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.621404:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.621413:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3eea lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.621420:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3eea lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.621428:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3eea lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.621435:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a8000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201272.621439:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3eea lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.621447:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3eea lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.621460:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:0.0:1788201272.621463:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201272.621469:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3eea lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.621476:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d3eea lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.621489:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.621495:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3ef1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.621501:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.621507:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a8e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201272.621509:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.621516:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3ef1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.621523:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0xcda302ea (ffff9e04ff181500) 00010000:00010000:0.0:1788201272.621525:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201272.621527:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3ef1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.621533:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d3ef1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.621566:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d3ee3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ee2 expref: 25 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.621580:0:13406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ee2 expref: 24 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.621588:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fa:0x0].0x0 (ffff9e03c33edc00) 00010000:00010000:0.0:1788201272.621590:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201272.621593:0:13406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c19a9400, rc 0) 00010000:00000080:0.0:1788201272.621602:0:13406:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e03c51a2d80 x1875064442671744/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:393/0 lens 576/640 e 0 to 0 dl 1788201283 ref 1 fl Interpret:/600/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1788201272.622788:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d3e81 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4eb8 expref: 24 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.622808:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33edf00) 00010000:00010000:3.0:1788201272.622813:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201272.622889:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:2361:x1875064442672384:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 5310us (7693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201272.622902:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:3.0:1788201272.622953:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442672640 00000100:00100000:3.0:1788201272.622962:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442672640 00000100:00100000:3.0:1788201272.623004:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:3.0:1788201272.623014:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5420700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:2360:x1875064442672640:12345-192.168.201.30@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788201272.623015:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1788201272.623031:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201272.623042:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0ba00/0x9383f985bc4d3e9d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ec6 expref: 23 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.623052:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33edf00) 00010000:00010000:3.0:1788201272.623055:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201272.623073:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5420700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:2360:x1875064442672640:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 60us (4741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201272.623082:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:3.0:1788201272.623138:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442672768 00000100:00100000:3.0:1788201272.623142:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442672768 00000100:00100000:3.0:1788201272.623165:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5204 00000100:00100000:3.0:1788201272.623173:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:14999:x1875064442672000:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1788201272.623195:0:12968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201272.623213:0:12968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d3eff lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4ee9 expref: -99 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.623278:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d3f06 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.623315:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d3f06 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.623328:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d3f06 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.623345:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3f0d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.623353:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3f0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.623360:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3f0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.624059:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d3f14 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.624071:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d3f14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.624079:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d3f14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201272.624588:0:12971:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3fe:0x0]: returning size 0 00000004:00200000:2.0:1788201272.624594:0:12971:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201272.624622:0:12971:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d3f14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.624636:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d3f14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.624646:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d3ed5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.624653:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d3ed5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.624662:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d3ed5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.624668:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201272.624673:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d3ed5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.624680:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d3ed5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.624692:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:2.0:1788201272.624695:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201272.624700:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d3ed5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.624707:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d3ed5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.624720:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d3edc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.624726:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d3edc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.624733:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d3edc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.624738:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201272.624741:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d3edc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.624751:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d3edc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.624758:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0xef09e6ea (ffff9e03c33ed600) 00010000:00010000:2.0:1788201272.624760:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201272.624763:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d3edc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.624953:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d3edc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.625001:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d3ece lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4edb expref: 24 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.625016:0:12971:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d3f14 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4edb expref: 23 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.625025:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fe:0x0].0x0 (ffff9e04ff181900) 00010000:00010000:2.0:1788201272.625027:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201272.625030:0:12971:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5065600, rc 0) 00010000:00000080:2.0:1788201272.625042:0:12971:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e04d80f1c00 x1875064442671488/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:393/0 lens 576/640 e 0 to 0 dl 1788201283 ref 1 fl Interpret:/600/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201272.625245:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:14996:x1875064442671744:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 4342us (10253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201272.625255:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5203 00000100:00100000:0.0:1788201272.625312:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5205 00000100:00100000:0.0:1788201272.625327:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:15001:x1875064442672256:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1788201272.625348:0:13406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201272.625363:0:13406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d3f1b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4ef0 expref: -99 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201272.625388:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d80f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:15000:x1875064442671488:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 8366us (10749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201272.625395:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5202 00000100:00100000:2.0:1788201272.625412:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5206 00000100:00100000:2.0:1788201272.625420:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:15002:x1875064442672768:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1788201272.625423:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3f22 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.625429:0:12971:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201272.625434:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3f22 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.625436:0:12971:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d3f29 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4efe expref: -99 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.625445:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3f22 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.625463:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d3f30 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.625471:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d3f30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.625475:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d3f37 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.625478:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d3f30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.625484:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d3f37 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.625489:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d3f37 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.625500:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d3f3e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.625505:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d3f3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.625512:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d3f3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.626288:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3f45 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.626323:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3f45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.626332:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3f45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201272.626372:0:12968:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3fd:0x0]: returning size 0 00000004:00200000:3.0:1788201272.626376:0:12968:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201272.626393:0:12968:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3f45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.626405:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3f45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.626414:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d3f06 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.626420:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d3f06 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.626427:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d3f06 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.626433:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bce00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201272.626437:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d3f06 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.626444:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d3f06 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.626455:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:3.0:1788201272.626458:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201272.626462:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d3f06 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.626469:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d3f06 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.626482:0:12968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3f0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.626487:0:12968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3f0d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.626493:0:12968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3f0d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.626498:0:12968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201272.626501:0:12968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3f0d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.626506:0:12968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3f0d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.626513:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0xa6b02dea (ffff9e03c33e8600) 00010000:00010000:2.0:1788201272.626516:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d3f4c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.626516:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201272.626519:0:12968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3f0d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.626524:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d3f4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.626525:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d3f0d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.626532:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d3f4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201272.626553:0:12971:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x400:0x0]: returning size 0 00000004:00200000:2.0:1788201272.626556:0:12971:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:3.0:1788201272.626557:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d3eff lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ee9 expref: 24 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201272.626566:0:12971:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d3f4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.626571:0:12968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3f45 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ee9 expref: 23 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.626574:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d3f4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.626578:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fd:0x0].0x0 (ffff9e03c33ed000) 00010000:00010000:2.0:1788201272.626581:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d3f37 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.626581:0:12968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201272.626583:0:12968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bda00, rc 0) 00010000:00010000:2.0:1788201272.626587:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d3f37 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:3.0:1788201272.626591:0:12968:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e03c12d0380 x1875064442672000/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:393/0 lens 576/640 e 0 to 0 dl 1788201283 ref 1 fl Interpret:/600/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1788201272.626593:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d3f37 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.626599:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201272.626602:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d3f37 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.626606:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d3f37 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.626613:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:2.0:1788201272.626616:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201272.626618:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d3f37 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.626622:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d3f37 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.626631:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d3f3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.626641:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d3f3e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.626647:0:12971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d3f3e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.626652:0:12971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201272.626655:0:12971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d3f3e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.626661:0:12971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d3f3e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.626667:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x7fbd58ea (ffff9e03c33ed800) 00010000:00010000:2.0:1788201272.626670:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201272.626673:0:12971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d3f3e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.626678:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d3f3e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.626699:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d3f29 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4efe expref: 24 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.626712:0:12971:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d3f4c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4efe expref: 23 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.626719:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x400:0x0].0x0 (ffff9e03c33ed200) 00010000:00010000:2.0:1788201272.626721:0:12971:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201272.626724:0:12971:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5064200, rc 0) 00010000:00000080:2.0:1788201272.626729:0:12971:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e03c5421f80 x1875064442672768/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:393/0 lens 576/640 e 0 to 0 dl 1788201283 ref 1 fl Interpret:/600/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201272.626758:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:15002:x1875064442672768:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 1339us (3743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201272.626765:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5206 00010000:00010000:0.0:1788201272.627288:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8a00/0x9383f985bc4d3f53 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.627315:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8a00/0x9383f985bc4d3f53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.627322:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8a00/0x9383f985bc4d3f53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201272.627351:0:13406:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3ff:0x0]: returning size 0 00000004:00200000:0.0:1788201272.627354:0:13406:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201272.627365:0:13406:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8a00/0x9383f985bc4d3f53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.627374:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8a00/0x9383f985bc4d3f53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.627381:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3f22 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.627387:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3f22 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.627398:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3f22 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.627403:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a8200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201272.627406:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3f22 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.627413:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3f22 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.627421:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:0.0:1788201272.627423:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201272.627425:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3f22 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.627431:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d3f22 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.627443:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d3f30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.627448:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d3f30 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.627453:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d3f30 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.627458:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a8800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201272.627461:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d3f30 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.627470:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d3f30 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.627476:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x37639fea (ffff9e04ff181400) 00010000:00010000:0.0:1788201272.627478:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201272.627480:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d3f30 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.627486:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d3f30 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.627513:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d3f1b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ef0 expref: 24 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.627526:0:13406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8a00/0x9383f985bc4d3f53 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ef0 expref: 23 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.627532:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ff:0x0].0x0 (ffff9e03c33e8500) 00010000:00010000:0.0:1788201272.627534:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201272.627537:0:13406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c19a8a00, rc 0) 00010000:00000080:0.0:1788201272.627542:0:13406:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e03c12d2300 x1875064442672256/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:393/0 lens 576/640 e 0 to 0 dl 1788201283 ref 1 fl Interpret:/600/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201272.627579:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:15001:x1875064442672256:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 2258us (12506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201272.627587:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5205 00000100:00100000:0.0:1788201272.628981:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201272.629094:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:14999:x1875064442672000:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 3470us (11611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201272.629105:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5204 00000100:00100000:3.0:1788201272.629160:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442672512 00000100:00100000:3.0:1788201272.629170:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442672512 00000100:00100000:3.0:1788201272.629253:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4215 00000100:00100000:3.0:1788201272.629264:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2362:x1875064442672512:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1788201272.629287:0:13440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201272.629329:0:13440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000700c6050/0x9383f985bc4d3f5a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4ef7 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201272.629364:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x41d:0x0] initial LVB size: 0, mtime: 0x6a95c933, atime: 0x6a95c933, ctime: 0x6a95c933, blocks: 0x1 00010000:00010000:3.0:1788201272.629388:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41d:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1788201272.629394:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201272.629404:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000700c6050/0x9383f985bc4d3f5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ef7 expref: 6 pid: 13440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.629435:0:13440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000700c6050/0x9383f985bc4d3f5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ef7 expref: 6 pid: 13440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.629448:0:13440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bc000, rc 0) 00000100:00100000:3.0:1788201272.629498:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2362:x1875064442672512:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 237us (11037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201272.629506:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4215 00000100:00080000:3.0:1788201272.629523:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201272.630859:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442672896 00000100:00100000:2.0:1788201272.630872:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442672896 00000100:00100000:2.0:1788201272.630952:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:2.0:1788201272.630961:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c7e14450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:2361:x1875064442672896:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201272.630978:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201272.631006:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b800/0x9383f985bc4d3eab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ecd expref: 21 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.631026:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33edf00) 00010000:00010000:2.0:1788201272.631032:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201272.635677:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c7e14450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:2361:x1875064442672896:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 4697us (6686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201272.635697:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:0.0:1788201272.637849:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201272.637923:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442673024 00000100:00100000:0.0:1788201272.637936:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442673024 00000100:00100000:0.0:1788201272.638015:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5207 00000100:00100000:0.0:1788201272.638027:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:14998:x1875064442673024:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1788201272.638059:0:13406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201272.638089:0:13406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d3f61 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4f05 expref: -99 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.638181:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3f68 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.638199:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3f68 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.638213:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3f68 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.638230:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d3f6f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.638237:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d3f6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.638244:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d3f6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.638639:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d3f76 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.638664:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d3f76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.638677:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d3f76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201272.638722:0:13406:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3fc:0x0]: returning size 0 00000004:00200000:0.0:1788201272.638727:0:13406:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201272.638749:0:13406:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d3f76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.638761:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d3f76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.638771:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3f68 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.638778:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3f68 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.638785:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3f68 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.638793:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201272.638798:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3f68 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.638806:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3f68 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.638820:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:0.0:1788201272.638824:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201272.638829:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3f68 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.638841:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d3f68 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.638856:0:13406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d3f6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.638862:0:13406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d3f6f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.638868:0:13406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d3f6f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.638873:0:13406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201272.638875:0:13406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d3f6f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.638889:0:13406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d3f6f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.638897:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x5e5674ea (ffff9e04ff181000) 00010000:00010000:0.0:1788201272.638899:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201272.638902:0:13406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d3f6f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.638907:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d3f6f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.638944:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d3f61 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f05 expref: 22 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.638965:0:13406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d3f76 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f05 expref: 21 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.638972:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fc:0x0].0x0 (ffff9e03c33ed100) 00010000:00010000:0.0:1788201272.638975:0:13406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201272.638977:0:13406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc7c00, rc 0) 00010000:00000080:0.0:1788201272.638988:0:13406:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e03c2b7c000 x1875064442673024/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:393/0 lens 576/640 e 0 to 0 dl 1788201283 ref 1 fl Interpret:/600/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201272.639061:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:14998:x1875064442673024:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 1037us (1226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201272.639069:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5207 00000100:00100000:0.0:1788201272.641005:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201272.641109:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201272.641134:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201272.641156:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201272.641184:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201272.641341:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442673152 00000100:00100000:3.0:1788201272.641354:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442673152 00000100:00100000:3.0:1788201272.641419:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442673280 00000100:00100000:3.0:1788201272.641422:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442673280 00000100:00100000:3.0:1788201272.641440:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442673408 00000100:00100000:3.0:1788201272.641443:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442673408 00000100:00100000:3.0:1788201272.641464:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442673536 00000100:00100000:3.0:1788201272.641466:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442673536 00000100:00100000:3.0:1788201272.641482:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442673664 00000100:00100000:3.0:1788201272.641484:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442673664 00000100:00100000:3.0:1788201272.641506:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4216 00000100:00100000:3.0:1788201272.641518:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+507:2360:x1875064442673152:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1788201272.641540:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201272.641566:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000232c8587/0x9383f985bc4d3f7d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4f0c expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201272.641601:0:13443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x41d:0x0] initial LVB size: 0, mtime: 0x6a95c933, atime: 0x6a95c933, ctime: 0x6a95c933, blocks: 0x1 00010000:00010000:3.0:1788201272.641625:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41d:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1788201272.641631:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201272.641655:0:13443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000232c8587/0x9383f985bc4d3f7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f0c expref: 508 pid: 13443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.641677:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000232c8587/0x9383f985bc4d3f7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f0c expref: 508 pid: 13443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.641692:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bd800, rc 0) 00000100:00100000:3.0:1788201272.641753:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2360:x1875064442673152:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 237us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201272.641760:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4216 00000100:00100000:3.0:1788201272.641785:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4217 00000100:00100000:3.0:1788201272.641792:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+507:2361:x1875064442673280:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1788201272.641799:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201272.641811:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d3f84 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4f13 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201272.641824:0:13443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x41f:0x0] initial LVB size: 0, mtime: 0x6a95c933, atime: 0x6a95c933, ctime: 0x6a95c933, blocks: 0x1 00010000:00010000:3.0:1788201272.641833:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41f:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1788201272.641836:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201272.641841:0:13443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d3f84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f13 expref: 508 pid: 13443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.641851:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d3f84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f13 expref: 508 pid: 13443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.641864:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3e00, rc 0) 00000100:00100000:3.0:1788201272.641896:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2361:x1875064442673280:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 105us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201272.641902:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4217 00000100:00100000:3.0:1788201272.641917:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4218 00000100:00100000:3.0:1788201272.641923:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2362:x1875064442673408:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1788201272.641931:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201272.641944:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d3f8b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4f1a expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201272.641961:0:13443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x41f:0x0] initial LVB size: 0, mtime: 0x6a95c933, atime: 0x6a95c933, ctime: 0x6a95c933, blocks: 0x1 00010000:00010000:3.0:1788201272.641971:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41f:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1788201272.641974:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201272.641980:0:13443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d3f8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f1a expref: 8 pid: 13443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.642106:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d3f8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f1a expref: 8 pid: 13443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.642115:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3000, rc 0) 00000100:00100000:3.0:1788201272.642138:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2362:x1875064442673408:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 215us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201272.642145:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4218 00000100:00100000:3.0:1788201272.642160:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4219 00000100:00100000:3.0:1788201272.642166:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+507:2359:x1875064442673536:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1788201272.642174:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201272.642184:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9237659/0x9383f985bc4d3f92 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4f21 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201272.642199:0:13443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x420:0x0] initial LVB size: 0, mtime: 0x6a95c933, atime: 0x6a95c933, ctime: 0x6a95c933, blocks: 0x1 00010000:00010000:3.0:1788201272.642209:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x420:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1788201272.642212:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x420:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201272.642217:0:13443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9237659/0x9383f985bc4d3f92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f21 expref: 508 pid: 13443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.642228:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9237659/0x9383f985bc4d3f92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f21 expref: 508 pid: 13443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.642237:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2e00, rc 0) 00000100:00100000:3.0:1788201272.642258:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2359:x1875064442673536:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 92us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201272.642265:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4219 00000100:00100000:3.0:1788201272.642277:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4220 00000100:00100000:3.0:1788201272.642284:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442673664:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1788201272.642291:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201272.642338:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008bd623ea/0x9383f985bc4d3f99 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4f28 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201272.642357:0:13443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x41e:0x0] initial LVB size: 0, mtime: 0x6a95c933, atime: 0x6a95c933, ctime: 0x6a95c933, blocks: 0x1 00010000:00010000:3.0:1788201272.642366:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41e:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1788201272.642369:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201272.642376:0:13443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008bd623ea/0x9383f985bc4d3f99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f28 expref: 8 pid: 13443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.642387:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008bd623ea/0x9383f985bc4d3f99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f28 expref: 8 pid: 13443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.642396:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2200, rc 0) 00000100:00100000:3.0:1788201272.642417:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2360:x1875064442673664:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 133us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201272.642422:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4220 00000100:00080000:3.0:1788201272.642465:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201272.645267:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201272.645481:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442673792 00000100:00100000:3.0:1788201272.645495:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442673792 00000100:00100000:3.0:1788201272.645576:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 875 00000100:00100000:3.0:1788201272.645588:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:2361:x1875064442673792:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:3.0:1788201272.645636:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201272.645794:0:6715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d3fa0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4f2f expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.645875:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d3fa7 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.645905:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d3fa7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.645919:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d3fa7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.645938:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d3fae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xc81711ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.645945:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d3fae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.645951:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d3fae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.646290:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d3fa7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.646378:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d3fa7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.646385:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d3fa7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.646393:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201272.646397:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d3fa7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.646406:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d3fa7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.646421:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:3.0:1788201272.646426:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201272.646432:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d3fa7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.646439:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d3fa7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.646454:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d3fae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.646460:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d3fae lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.646466:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d3fae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.646472:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201272.646475:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d3fae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.646480:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d3fae lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.646487:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0xc81711ea (ffff9e03c23c1f00) 00010000:00010000:3.0:1788201272.646489:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201272.646492:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d3fae lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.646497:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d3fae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.646536:0:6715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d3fa0 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f2f expref: 22 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.646549:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:3.0:1788201272.646551:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201272.646554:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d3fa0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f2f expref: 22 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.646564:0:6715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2a00, rc -2) 00010000:00000080:3.0:1788201272.646942:0:6715:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e03c2b7f800 x1875064442673792/t0(0) o63->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:393/0 lens 2232/5072 e 0 to 0 dl 1788201283 ref 1 fl Interpret:/200/0 rc -2/0 job:'ll_sa.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201272.647081:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:2361:x1875064442673792:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 1494us (1824us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201272.647092:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 875 00000100:00100000:1.0:1788201272.647475:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201272.647693:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201272.650831:0:12971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442674176 00000100:00100000:2.0:1788201272.650853:0:12971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442674176 00000100:00100000:2.0:1788201272.650956:0:12971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5208 00000100:00100000:2.0:1788201272.650970:0:12971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:15002:x1875064442674176:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:2.0:1788201272.651074:0:12971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201272.651109:0:12971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d3f4c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4efe expref: 21 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.651133:0:12971:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x400:0x0].0x0 (ffff9e03c33ed200) 00010000:00010000:2.0:1788201272.651138:0:12971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201272.651189:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d3fb5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.651206:0:12971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d3fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.651217:0:12971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d3fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201272.651568:0:12971:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000027182b61 reply state 00000000703ef0dc transno 8589938725 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d3fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201272.651580:0:12971:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:2.0:1788201272.651631:0:12971:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e04f000fb80 x1875064442674176/t8589938725(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:393/0 lens 488/456 e 0 to 0 dl 1788201283 ref 1 fl Interpret:/200/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788201272.652373:0:12971:0:(ldlm_lib.c:3355:target_send_reply_msg()) *** cfs_fail_loc=15a, val=0*** 00000100:00100000:3.0:1788201272.656009:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442673920 00000100:00100000:3.0:1788201272.656031:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442673920 00000100:00100000:3.0:1788201272.656355:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4221 00000100:00100000:3.0:1788201272.656369:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2359:x1875064442673920:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1788201272.656395:0:13450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201272.656424:0:13450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e0303fe/0x9383f985bc4d3fbc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4f52 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201272.656461:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x41e:0x0] initial LVB size: 0, mtime: 0x6a95c933, atime: 0x6a95c933, ctime: 0x6a95c933, blocks: 0x1 00010000:00010000:3.0:1788201272.656490:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41e:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1788201272.656496:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201272.656509:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e0303fe/0x9383f985bc4d3fbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f52 expref: 509 pid: 13450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.656538:0:13450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002e0303fe/0x9383f985bc4d3fbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f52 expref: 509 pid: 13450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.656555:0:13450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2000, rc 0) 00000100:00100000:3.0:1788201272.656644:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2359:x1875064442673920:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 278us (9169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201272.656652:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4221 00000100:00100000:3.0:1788201272.656756:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201272.656862:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201272.656913:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201272.656941:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442674560 00000100:00100000:3.0:1788201272.656946:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442674560 00000100:00100000:3.0:1788201272.656980:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 876 00000100:00100000:3.0:1788201272.656988:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:2361:x1875064442674560:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:3.0:1788201272.657020:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201272.657038:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3fc3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4f59 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.657112:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3fca lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.657127:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3fca lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.657139:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3fca lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.657160:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d3fd1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xad7e02ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.657167:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d3fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.657174:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d3fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.657536:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3fca lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.657546:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3fca lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.657552:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3fca lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.657558:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201272.657563:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3fca lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.657571:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3fca lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.657585:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:3.0:1788201272.657588:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201272.657594:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3fca lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.657601:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d3fca lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.657618:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d3fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.657624:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d3fd1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.657631:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d3fd1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.657637:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201272.657640:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d3fd1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.657646:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d3fd1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.657653:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0xad7e02ea (ffff9e03c23c1c00) 00010000:00010000:3.0:1788201272.657655:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201272.657657:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d3fd1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.657662:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d3fd1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.657697:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3fc3 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f59 expref: 24 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.657708:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:3.0:1788201272.657711:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201272.657715:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d3fc3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f59 expref: 24 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.657725:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2800, rc -2) 00010000:00000080:3.0:1788201272.657742:0:6714:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e03c12d2a00 x1875064442674560/t0(0) o63->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:393/0 lens 664/4320 e 0 to 0 dl 1788201283 ref 1 fl Interpret:/200/0 rc -2/0 job:'ll_sa.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201272.657806:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:2361:x1875064442674560:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 818us (1050us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201272.657815:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 876 00000100:00100000:3.0:1788201272.657939:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442674432 00000100:00100000:3.0:1788201272.657946:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442674432 00000100:00100000:3.0:1788201272.657977:0:12969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442674816 00000100:00100000:3.0:1788201272.657981:0:12969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442674816 00000100:00100000:3.0:1788201272.658003:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5209 00000100:00100000:3.0:1788201272.658012:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:14999:x1875064442674432:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:3.0:1788201272.658057:0:12969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201272.658073:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d3f45 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ee9 expref: 24 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.658084:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fd:0x0].0x0 (ffff9e03c33ed000) 00010000:00010000:3.0:1788201272.658088:0:12969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201272.658112:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d3fd8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.658124:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d3fd8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.658132:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d3fd8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201272.658450:0:12969:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008fdee25d reply state 0000000048c863b7 transno 8589938726 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d3fd8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201272.658462:0:12969:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:3.0:1788201272.658503:0:12969:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e03c12d0e00 x1875064442674432/t8589938726(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:393/0 lens 488/456 e 0 to 0 dl 1788201283 ref 1 fl Interpret:/200/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1788201272.658515:0:12969:0:(ldlm_lib.c:3355:target_send_reply_msg()) *** cfs_fail_loc=15a, val=0*** 00010000:00080000:3.0:1788201272.658518:0:12969:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788201272.658534:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+25:14999:x1875064442674432:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 524us (1673us total) trans 8589938726 rc 0/0 00000100:00100000:3.0:1788201272.658541:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5209 00000100:00100000:3.0:1788201272.658560:0:12969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5210 00000100:00100000:3.0:1788201272.658568:0:12969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:15000:x1875064442674816:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:3.0:1788201272.658590:0:12969:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201272.658604:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d3f14 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4edb expref: 24 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.658617:0:12969:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fe:0x0].0x0 (ffff9e04ff181900) 00010000:00010000:3.0:1788201272.658620:0:12969:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201272.658635:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3fdf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.658644:0:12969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3fdf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.658651:0:12969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3fdf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201272.658755:0:12969:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a72ab4ac reply state 000000006c6a1eb6 transno 8589938727 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3fdf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201272.658763:0:12969:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:3.0:1788201272.658781:0:12969:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e03c12d0000 x1875064442674816/t8589938727(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:393/0 lens 488/456 e 0 to 0 dl 1788201283 ref 1 fl Interpret:/200/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1788201272.658790:0:12969:0:(ldlm_lib.c:3355:target_send_reply_msg()) *** cfs_fail_loc=15a, val=0*** 00010000:00080000:3.0:1788201272.658793:0:12969:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788201272.658805:0:12969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+25:15000:x1875064442674816:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 239us (1892us total) trans 8589938727 rc 0/0 00000100:00100000:3.0:1788201272.658812:0:12969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5210 00010000:00010000:3.0:1788201272.658840:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d3fd8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.658849:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d3fd8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.658855:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d3fd8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.658861:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201272.658866:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d3fd8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.658873:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d3fd8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1788201272.665366:0:12971:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788201272.665401:0:12971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:15002:x1875064442674176:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 14420us (17693us total) trans 8589938725 rc 0/0 00000100:00100000:2.0:1788201272.665416:0:12971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5208 00010000:00010000:3.0:1788201272.668034:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fd:0x0].0x0 (ffff9e03c33ed000) 00010000:00010000:3.0:1788201272.668049:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788201272.668061:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d3fd8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.668075:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d3fd8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.668108:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d3fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.668117:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d3fb5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.668125:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d3fb5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.668132:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201272.668137:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d3fb5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.668145:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d3fb5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.668160:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x400:0x0].0x0 (ffff9e03c33ed200) 00010000:00010000:3.0:1788201272.668163:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788201272.668166:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d3fb5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.668172:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d3fb5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.668197:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3fdf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.668210:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3fdf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.668216:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3fdf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.668221:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201272.668224:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3fdf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.668230:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3fdf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.668239:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fe:0x0].0x0 (ffff9e04ff181900) 00010000:00010000:3.0:1788201272.668241:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788201272.668245:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3fdf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.668251:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d3fdf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201272.668944:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201272.668979:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201272.669069:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201272.669096:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201272.669135:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442675072 00000100:00100000:2.0:1788201272.669148:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442675072 00000100:00100000:2.0:1788201272.669207:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442675328 00000100:00100000:2.0:1788201272.669211:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442675328 00000100:00100000:2.0:1788201272.669229:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442675712 00000100:00100000:2.0:1788201272.669232:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442675712 00000100:00100000:2.0:1788201272.669249:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5211 00000100:00100000:2.0:1788201272.669260:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:15001:x1875064442675072:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:2.0:1788201272.669370:0:12968:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201272.669402:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8a00/0x9383f985bc4d3f53 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ef0 expref: 23 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.669421:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ff:0x0].0x0 (ffff9e03c33e8500) 00010000:00010000:2.0:1788201272.669426:0:12968:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201272.669470:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d3fe6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.669486:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d3fe6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.669497:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d3fe6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201272.672124:0:12968:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000019cca41e reply state 000000006a8934de transno 8589938728 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d3fe6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201272.672148:0:12968:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:2.0:1788201272.672234:0:12968:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e03c53e8e00 x1875064442675072/t8589938728(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:393/0 lens 488/456 e 0 to 0 dl 1788201283 ref 1 fl Interpret:/200/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788201272.672255:0:12968:0:(ldlm_lib.c:3355:target_send_reply_msg()) *** cfs_fail_loc=15a, val=0*** 00010000:00080000:2.0:1788201272.672258:0:12968:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788201272.672286:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:15001:x1875064442675072:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 3027us (3347us total) trans 8589938728 rc 0/0 00000100:00100000:2.0:1788201272.672311:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5211 00000100:00100000:2.0:1788201272.672362:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5212 00000100:00100000:2.0:1788201272.672379:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:14996:x1875064442675328:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:2.0:1788201272.672437:0:12968:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201272.672854:0:12968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d3ef8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ee2 expref: 23 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.672871:0:12968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fa:0x0].0x0 (ffff9e03c33edc00) 00010000:00010000:2.0:1788201272.672878:0:12968:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201272.672947:0:12968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d3fed lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.672964:0:12968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d3fed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.672975:0:12968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d3fed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201272.673210:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201272.673280:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5213 00000100:00100000:0.0:1788201272.673310:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:14997:x1875064442675712:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:0.0:1788201272.673351:0:13406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201272.673368:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a400/0x9383f985bc4d3ec7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ed4 expref: 22 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.673380:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fb:0x0].0x0 (ffff9e03c33ed900) 00010000:00010000:0.0:1788201272.673383:0:13406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201272.673400:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d3ff4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.673411:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d3ff4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201272.673418:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d3ff4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201272.674285:0:13406:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bdb8fa8b reply state 00000000ddf0bdae transno 8589938729 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d3ff4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201272.674324:0:13406:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:0.0:1788201272.674378:0:13406:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e03c53e9c00 x1875064442675712/t8589938729(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:393/0 lens 488/456 e 0 to 0 dl 1788201283 ref 1 fl Interpret:/200/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1788201272.674391:0:13406:0:(ldlm_lib.c:3355:target_send_reply_msg()) *** cfs_fail_loc=15a, val=0*** 00010000:00080000:0.0:1788201272.674394:0:13406:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788201272.674416:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:14997:x1875064442675712:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 1127us (5347us total) trans 8589938729 rc 0/0 00000100:00100000:0.0:1788201272.674426:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5213 00000004:00010000:2.0:1788201272.674749:0:12968:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000db21fc26 reply state 0000000061f05493 transno 8589938730 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d3fed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201272.674758:0:12968:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788201272.674911:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d3fe6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.674921:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d3fe6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.674929:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d3fe6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.674937:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201272.674943:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d3fe6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.674953:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d3fe6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.674969:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ff:0x0].0x0 (ffff9e03c33e8500) 00010000:00010000:3.0:1788201272.674973:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788201272.674978:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d3fe6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:2.0:1788201272.675574:0:12968:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e03c53eb480 x1875064442675328/t8589938730(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:393/0 lens 488/456 e 0 to 0 dl 1788201283 ref 1 fl Interpret:/200/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788201272.675593:0:12968:0:(ldlm_lib.c:3355:target_send_reply_msg()) *** cfs_fail_loc=15a, val=0*** 00010000:00080000:2.0:1788201272.675595:0:12968:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788201272.675602:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:14996:x1875064442675328:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 3231us (6623us total) trans 8589938730 rc 0/0 00000100:00100000:2.0:1788201272.675609:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5212 00000100:00100000:2.0:1788201272.675657:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442675840 00000100:00100000:2.0:1788201272.675668:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442675840 00000100:00100000:2.0:1788201272.675704:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442675456 00000100:00100000:2.0:1788201272.675708:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442675456 00000100:00100000:2.0:1788201272.675723:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 877 00000100:00100000:2.0:1788201272.675732:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+25:2360:x1875064442675840:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:2.0:1788201272.676750:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201272.676900:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d3fe6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.676940:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d3fed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.676948:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d3fed lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.676956:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d3fed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.676962:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201272.676967:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d3fed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.676975:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d3fed lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.677053:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fa:0x0].0x0 (ffff9e03c33edc00) 00010000:00010000:3.0:1788201272.677057:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788201272.677064:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d3fed lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.677071:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d3fed lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.677105:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d3ff4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.677113:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d3ff4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.677119:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d3ff4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.677125:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201272.677128:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d3ff4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.677134:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d3ff4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.677143:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fb:0x0].0x0 (ffff9e03c33ed900) 00010000:00010000:3.0:1788201272.677145:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788201272.677148:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d3ff4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.677154:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d3ff4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.677247:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d3ffb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4f8a expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.677352:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d4002 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.677367:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d4002 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.677379:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d4002 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.677397:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d4009 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xa05302ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.677404:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d4009 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.677414:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d4009 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201272.677840:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201272.678081:0:13406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442676096 00000100:00100000:1.0:1788201272.678092:0:13406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442676096 00000100:00100000:1.0:1788201272.678161:0:13406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5214 00000100:00100000:1.0:1788201272.678172:0:13406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:14998:x1875064442676096:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:1.0:1788201272.678226:0:13406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201272.678248:0:13406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d3f76 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f05 expref: 24 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.678264:0:13406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fc:0x0].0x0 (ffff9e03c33ed100) 00010000:00010000:1.0:1788201272.678269:0:13406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201272.678329:0:13406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d4010 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.678340:0:13406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d4010 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201272.678348:0:13406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d4010 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.679733:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d4002 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.679751:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d4002 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.679759:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d4002 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201272.680283:0:13406:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8b52900 reply state 00000000d3265022 transno 8589938731 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d4010 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201272.680320:0:13406:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:1.0:1788201272.680387:0:13406:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e03c2b7fb80 x1875064442676096/t8589938731(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:393/0 lens 488/456 e 0 to 0 dl 1788201283 ref 1 fl Interpret:/200/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1788201272.680402:0:13406:0:(ldlm_lib.c:3355:target_send_reply_msg()) *** cfs_fail_loc=15a, val=0*** 00010000:00080000:1.0:1788201272.680405:0:13406:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788201272.680428:0:13406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+25:14998:x1875064442676096:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 2258us (2667us total) trans 8589938731 rc 0/0 00000100:00100000:1.0:1788201272.680438:0:13406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5214 00010000:00010000:2.0:1788201272.680539:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201272.680544:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d4002 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.680555:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d4002 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.680572:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:2.0:1788201272.680575:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201272.680580:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d4002 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.680587:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d4002 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.680602:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d4009 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.680609:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d4009 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.680615:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d4009 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.680620:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201272.680623:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d4009 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.680630:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d4009 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.680637:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0xa05302ea (ffff9e03c33ed800) 00010000:00010000:2.0:1788201272.680639:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201272.680642:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d4009 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.680649:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d4009 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.680688:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d3ffb lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f8a expref: 25 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.680699:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:2.0:1788201272.680701:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201272.680705:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d3ffb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f8a expref: 25 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.680714:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5064e00, rc -2) 00010000:00000080:2.0:1788201272.680730:0:6714:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e03c53eb800 x1875064442675840/t0(0) o63->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:393/0 lens 664/4320 e 0 to 0 dl 1788201283 ref 1 fl Interpret:/200/0 rc -2/0 job:'ll_sa.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788201272.681094:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d4010 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.681107:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d4010 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.681113:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d4010 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.681119:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0a600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201272.681122:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d4010 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.681129:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d4010 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.681140:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fc:0x0].0x0 (ffff9e03c33ed100) 00010000:00010000:3.0:1788201272.681143:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788201272.681146:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d4010 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201272.681152:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0a600/0x9383f985bc4d4010 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201272.681465:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:2360:x1875064442675840:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 5724us (12357us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201272.681476:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 877 00000100:00100000:2.0:1788201272.681510:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 878 00000100:00100000:2.0:1788201272.681526:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f977e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:2360:x1875064442675456:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:2.0:1788201272.681570:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201272.681588:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d4017 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4f60 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.681656:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d401e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.681671:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d401e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.681681:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d401e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.681698:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d4025 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.681706:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d4025 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.681712:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d4025 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.682220:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d402c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.682232:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d402c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.682240:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d402c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201272.682261:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3fd:0x0]: returning size 0 00000004:00200000:2.0:1788201272.682267:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201272.682288:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d402c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.682327:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d402c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.682337:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d401e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.682343:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d401e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.682349:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d401e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.682355:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201272.682359:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d401e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.682366:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d401e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.682375:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:2.0:1788201272.682379:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201272.682383:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d401e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.682390:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d401e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.682402:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d4025 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.682408:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d4025 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.682414:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d4025 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.682419:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201272.682422:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d4025 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.682429:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d4025 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.682436:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0xa6b02dea (ffff9e03c33ed600) 00010000:00010000:2.0:1788201272.682438:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201272.682441:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d4025 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.682447:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d4025 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.682479:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d4017 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f60 expref: 24 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.682496:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d402c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f60 expref: 23 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.682503:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fd:0x0].0x0 (ffff9e03c33ed000) 00010000:00010000:2.0:1788201272.682506:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201272.682508:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5065000, rc 0) 00010000:00010000:2.0:1788201272.682515:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201272.682523:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d4033 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4f67 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.682554:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d403a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.682562:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d403a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.682569:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d403a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.682583:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d4041 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.682591:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d4041 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.682597:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d4041 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.685679:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d4048 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.685717:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d4048 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.685732:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d4048 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201272.685778:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3fe:0x0]: returning size 0 00000004:00200000:2.0:1788201272.685784:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201272.685812:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d4048 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.685826:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d4048 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.685839:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d403a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.685846:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d403a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.685853:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d403a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.685860:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201272.685865:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d403a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.685872:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d403a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.685898:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:2.0:1788201272.685902:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201272.685908:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d403a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.685914:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d403a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.685931:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d4041 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.685937:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d4041 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.685943:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d4041 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.685947:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201272.685950:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d4041 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.685955:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d4041 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.685963:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0xef09e6ea (ffff9e03c33ede00) 00010000:00010000:2.0:1788201272.685965:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201272.685968:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d4041 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.685972:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d4041 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.686138:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d4033 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f67 expref: 24 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.686157:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d4048 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f67 expref: 23 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.686165:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fe:0x0].0x0 (ffff9e04ff181900) 00010000:00010000:2.0:1788201272.686168:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201272.686170:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031800, rc 0) 00010000:00010000:2.0:1788201272.686183:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201272.686195:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d404f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4f6e expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.686245:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d4056 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.686254:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d4056 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.686261:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d4056 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.686283:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d405d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.686290:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d405d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.686379:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d405d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.689347:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97400/0x9383f985bc4d4064 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.689374:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97400/0x9383f985bc4d4064 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.689390:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97400/0x9383f985bc4d4064 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201272.689425:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3ff:0x0]: returning size 0 00000004:00200000:2.0:1788201272.689431:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201272.689460:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97400/0x9383f985bc4d4064 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.689475:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97400/0x9383f985bc4d4064 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.689487:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d4056 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.689493:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d4056 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.689500:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d4056 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.689507:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201272.689511:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d4056 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.689520:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d4056 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.689532:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:2.0:1788201272.689536:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201272.689541:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d4056 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.689547:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d4056 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.689565:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d405d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.689572:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d405d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.689578:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d405d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.689583:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201272.689586:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d405d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.689592:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d405d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.689601:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x37639fea (ffff9e03c33ed700) 00010000:00010000:2.0:1788201272.689605:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201272.689608:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d405d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.689613:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d405d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.689661:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d404f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f6e expref: 25 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.689679:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97400/0x9383f985bc4d4064 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f6e expref: 24 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.689687:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ff:0x0].0x0 (ffff9e03c33e8500) 00010000:00010000:2.0:1788201272.689689:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201272.689692:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c1b97400, rc 0) 00010000:00010000:2.0:1788201272.689705:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201272.689717:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97200/0x9383f985bc4d406b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4f75 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.691099:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97000/0x9383f985bc4d4072 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.691122:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97000/0x9383f985bc4d4072 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.691133:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97000/0x9383f985bc4d4072 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.691150:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96600/0x9383f985bc4d4079 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.691156:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96600/0x9383f985bc4d4079 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.691163:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96600/0x9383f985bc4d4079 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.692590:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96200/0x9383f985bc4d4080 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.692611:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96200/0x9383f985bc4d4080 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.692624:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96200/0x9383f985bc4d4080 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201272.692657:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x400:0x0]: returning size 0 00000004:00200000:2.0:1788201272.692662:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201272.692689:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96200/0x9383f985bc4d4080 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.692704:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96200/0x9383f985bc4d4080 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.692714:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97000/0x9383f985bc4d4072 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.692721:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97000/0x9383f985bc4d4072 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.692728:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97000/0x9383f985bc4d4072 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.692735:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201272.692740:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97000/0x9383f985bc4d4072 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.692748:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97000/0x9383f985bc4d4072 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.692924:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:2.0:1788201272.692930:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201272.692936:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97000/0x9383f985bc4d4072 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.692942:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97000/0x9383f985bc4d4072 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.692959:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96600/0x9383f985bc4d4079 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.692966:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96600/0x9383f985bc4d4079 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.692972:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96600/0x9383f985bc4d4079 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.692977:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b96600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201272.692980:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96600/0x9383f985bc4d4079 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.694088:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96600/0x9383f985bc4d4079 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.694108:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x7fbd58ea (ffff9e03c33ed400) 00010000:00010000:2.0:1788201272.694111:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201272.694117:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96600/0x9383f985bc4d4079 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.694123:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96600/0x9383f985bc4d4079 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.694179:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97200/0x9383f985bc4d406b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f75 expref: 26 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.694196:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96200/0x9383f985bc4d4080 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f75 expref: 25 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.694204:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x400:0x0].0x0 (ffff9e03c33ed200) 00010000:00010000:2.0:1788201272.694206:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201272.694209:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c1b96200, rc 0) 00010000:00010000:2.0:1788201272.694223:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201272.694238:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96a00/0x9383f985bc4d4087 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4f7c expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.694325:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d408e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.694339:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d408e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.694349:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d408e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.694366:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96000/0x9383f985bc4d4095 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xc81711ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.694373:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96000/0x9383f985bc4d4095 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.694380:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96000/0x9383f985bc4d4095 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.694655:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d408e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.694664:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d408e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.694670:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d408e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.694676:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201272.694680:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d408e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.694685:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d408e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.694694:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:2.0:1788201272.694696:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201272.694699:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d408e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.694705:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d408e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.694715:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96000/0x9383f985bc4d4095 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.694721:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96000/0x9383f985bc4d4095 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.694726:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96000/0x9383f985bc4d4095 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.694731:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b96000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201272.694734:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96000/0x9383f985bc4d4095 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.694739:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96000/0x9383f985bc4d4095 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.694745:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0xc81711ea (ffff9e03c33edb00) 00010000:00010000:2.0:1788201272.694747:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201272.694749:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96000/0x9383f985bc4d4095 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.694754:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96000/0x9383f985bc4d4095 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.695402:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96a00/0x9383f985bc4d4087 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f7c expref: 26 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.695417:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:2.0:1788201272.695420:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201272.695423:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96a00/0x9383f985bc4d4087 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f7c expref: 26 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201272.695434:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c1b96a00, rc -2) 00010000:00000080:2.0:1788201272.695456:0:6714:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e04f977e850 x1875064442675456/t0(0) o63->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:393/0 lens 2624/6040 e 0 to 0 dl 1788201283 ref 1 fl Interpret:/200/0 rc -2/0 job:'ll_sa.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201272.696073:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f977e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+25:2360:x1875064442675456:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 14548us (22858us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201272.696085:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 878 00010000:00010000:0.0:1788201273.189682:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201273.573689:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458229248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201273.573810:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201273.573936:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458229248 00000100:00100000:1.0:1788201273.573947:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458229248 00000100:00100000:1.0:1788201273.574033:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788201273.574045:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458229248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201273.574097:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 525008896 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1788201273.575612:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458229248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1547us (1780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201273.575763:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788201273.575995:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458229248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201273.748611:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201273.749277:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201273.749345:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201273.749391:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201273.749462:0:13379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442676352 00000100:00100000:0.0:1788201273.749479:0:13379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442676352 00000100:00100000:0.0:1788201273.749556:0:13379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 103 00000100:00100000:0.0:1788201273.749570:0:13379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+25:2360:x1875064442676352:12345-192.168.201.30@tcp:400:kworker.0 00010000:00000080:0.0:1788201273.749625:0:13379:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e03c2b7ca80 x1875064442676352/t0(0) o400->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:394/0 lens 224/224 e 0 to 0 dl 1788201284 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201273.749712:0:13379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+25:2360:x1875064442676352:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 142us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201273.749722:0:13379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 103 00000100:00100000:0.0:1788201273.750422:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442676480 00000100:00100000:0.0:1788201273.750431:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442676480 00000100:00100000:0.0:1788201273.750464:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442676608 00000100:00100000:0.0:1788201273.750467:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442676608 00000100:00100000:0.0:1788201273.750490:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 169 00000100:00100000:0.0:1788201273.750498:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2360:x1875064442676480:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201273.751517:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2360:x1875064442676480:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 1011us (2240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201273.751529:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 169 00000100:00100000:0.0:1788201273.751564:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 170 00000100:00100000:0.0:1788201273.751575:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2360:x1875064442676608:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201273.751606:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2360:x1875064442676608:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 34us (2214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201273.751612:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 170 00000100:00100000:3.0:1788201273.755427:0:12965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442676224 00000100:00100000:3.0:1788201273.755445:0:12965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442676224 00000100:00100000:3.0:1788201273.755519:0:12965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 120 00000100:00100000:3.0:1788201273.755532:0:12965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c648f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442676224:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201273.755649:0:12965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c648f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442676224:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 119us (7053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201273.755657:0:12965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 120 00010000:00010000:1.0:1788201274.217248:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201275.239476:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788201275.696522:0:12980:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938729 is committed 00000001:00080000:0.0:1788201275.696545:0:12980:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938731 is committed 00000100:00100000:3.0:1788201276.133799:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201276.133845:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458229376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201276.133949:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201276.136085:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458229376 00000100:00100000:0.0:1788201276.136105:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458229376 00000100:00100000:0.0:1788201276.136199:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788201276.136211:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458229376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201276.136266:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 13631488 granted 525008896 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201276.136401:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458229376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 192us (2452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201276.136409:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788201276.136615:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458229376:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788201276.136698:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788201276.265601:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788201276.779465:0:14723:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788201276.779529:0:14723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c237a600/0x9383f985bc4b061c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4b0623 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.779547:0:14723:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c237a600/0x9383f985bc4b061c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4b0623 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.779555:0:14723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c237a600/0x9383f985bc4b061c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4b0623 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.779564:0:14723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e03c237a600/0x9383f985bc4b061c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4b0623 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.779600:0:14723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788201276.779607:0:14723:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1788201276.779808:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201276.779825:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e03c237a600/0x9383f985bc4b061c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4b0623 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.779834:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c237a600 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1788201276.779838:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e03c237a600/0x9383f985bc4b061c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4b0623 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.779847:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c237a600/0x9383f985bc4b061c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x9383f985bc4b0623 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201276.779855:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c237a600/0x9383f985bc4b061c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x9383f985bc4b0623 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201276.779861:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788201276.779864:0:5845:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788201276.779866:0:5845:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788201276.779912:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e03c237a600/0x9383f985bc4b061c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4b0623 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.779931:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201276.779968:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e03c237a600/0x9383f985bc4b061c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4b0623 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.779976:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c237a600/0x9383f985bc4b061c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4b0623 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.779991:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201276.779993:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201276.779995:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201276.780019:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458229504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201276.780108:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201276.780192:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458229504 00000100:00100000:3.0:1788201276.780200:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458229504 00000100:00100000:3.0:1788201276.780257:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788201276.780267:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3313:x1875064458229504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201276.780284:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201276.780331:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c233d800/0x9383f985bc4b0623 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4b061c expref: 19 pid: 12964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.780347:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201276.780386:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b60c000b-7335-444d-a8dc-1a5956712fb2+18:3313:x1875064458229504:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201276.780394:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788201276.780442:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458229504:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788201276.780637:0:14723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201276.780642:0:14723:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788201276.780659:0:14723:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788201276.780677:0:14723:0:(import.c:65:import_set_state_nolock()) ffff9e04c6b1d000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788201276.780985:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875064458229632:0@lo:39:umount.0 00000100:00100000:3.0:1788201276.781027:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201276.781071:0:12968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458229632 00000100:00100000:3.0:1788201276.781076:0:12968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458229632 00000100:00100000:3.0:1788201276.781111:0:12968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5215 00000100:00100000:3.0:1788201276.781120:0:12968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875064458229632:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788201276.781149:0:12968:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4b1183 00000100:00080000:3.0:1788201276.781158:0:12968:0:(import.c:65:import_set_state_nolock()) ffff9e04ff7d5800 : changing import state from FULL to CLOSED 00010000:00000080:3.0:1788201276.781192:0:12968:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e04c56f6300 x1875064458229632/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:397/0 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201276.781236:0:12968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3309:x1875064458229632:12345-0@lo:39:umount.0 Request processed in 118us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201276.781243:0:12968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5215 00000020:00000080:3.0:1788201276.781251:0:12968:0:(genops.c:906:class_export_put()) final put ffff9e04fae43000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1788201276.781278:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788201276.781325:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04c6b1d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788201276.781334:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875064458229632:0@lo:39:umount.0 00000020:00000080:3.0:1788201276.781362:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04fae43000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788201276.781416:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04ff7d5800 for lustre-MDT0000 00000100:00080000:2.0:1788201276.781616:0:14723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201276.781620:0:14723:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788201276.781625:0:14723:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788201276.786547:0:14723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c232fe00/0x9383f985bc4b056d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4b0574 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.786571:0:14723:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c232fe00/0x9383f985bc4b056d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4b0574 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.786585:0:14723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c232fe00/0x9383f985bc4b056d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4b0574 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.786593:0:14723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e03c232fe00/0x9383f985bc4b056d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4b0574 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.786627:0:14723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201276.786635:0:14723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c237ac00/0x9383f985bc4b07f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4b07f8 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.786641:0:14723:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c237ac00/0x9383f985bc4b07f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4b07f8 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.786647:0:14723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c237ac00/0x9383f985bc4b07f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4b07f8 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.786653:0:14723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e03c237ac00/0x9383f985bc4b07f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4b07f8 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.786666:0:14723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788201276.786674:0:14723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c232e400/0x9383f985bc4b060e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4b0615 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.786681:0:14723:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c232e400/0x9383f985bc4b060e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4b0615 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.786687:0:14723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c232e400/0x9383f985bc4b060e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4b0615 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.788853:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201276.788872:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e03c232fe00/0x9383f985bc4b056d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4b0574 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.788886:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c232fe00 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1788201276.788890:0:7645:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e03c232fe00/0x9383f985bc4b056d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4b0574 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.788901:0:7645:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c232fe00/0x9383f985bc4b056d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x9383f985bc4b0574 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201276.788909:0:7645:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c232fe00/0x9383f985bc4b056d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x9383f985bc4b0574 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201276.788928:0:7645:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788201276.788932:0:7645:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788201276.788987:0:7645:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e03c232fe00/0x9383f985bc4b056d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4b0574 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.788999:0:7645:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201276.789032:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e03c232fe00/0x9383f985bc4b056d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4b0574 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.789040:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c232fe00/0x9383f985bc4b056d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4b0574 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.789056:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201276.789060:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e03c237ac00/0x9383f985bc4b07f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4b07f8 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.789066:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c237ac00 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1788201276.789070:0:7645:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e03c237ac00/0x9383f985bc4b07f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4b07f8 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.789076:0:7645:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c237ac00/0x9383f985bc4b07f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9383f985bc4b07f8 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201276.789083:0:7645:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c237ac00/0x9383f985bc4b07f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9383f985bc4b07f8 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201276.789088:0:7645:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788201276.789090:0:7645:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788201276.789093:0:7645:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788201276.789109:0:7645:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e03c237ac00/0x9383f985bc4b07f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4b07f8 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.789115:0:7645:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201276.789121:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e03c237ac00/0x9383f985bc4b07f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4b07f8 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.789133:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c237ac00/0x9383f985bc4b07f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4b07f8 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.789148:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201276.789150:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201276.789152:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201276.789163:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201276.789188:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458229760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201276.789282:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201276.789363:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201276.789370:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458229888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201276.789393:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201276.789451:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458229760 00000100:00100000:3.0:1788201276.789459:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458229760 00000100:00100000:3.0:1788201276.789514:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458229888 00000100:00100000:3.0:1788201276.789517:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458229888 00000100:00100000:3.0:1788201276.789544:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788201276.789553:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458229760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201276.789570:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201276.789589:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c232ea00/0x9383f985bc4b0574 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4b056d expref: 19 pid: 12965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.789604:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201276.789645:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b60c000b-7335-444d-a8dc-1a5956712fb2+18:3310:x1875064458229760:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201276.789652:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788201276.789672:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788201276.789700:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b60c000b-7335-444d-a8dc-1a5956712fb2+17:3310:x1875064458229888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201276.789712:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201276.789721:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c232e200/0x9383f985bc4b07f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4b07f1 expref: 17 pid: 12964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.789730:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201276.789754:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b60c000b-7335-444d-a8dc-1a5956712fb2+16:3310:x1875064458229888:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201276.789759:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788201276.789828:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458229888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201276.789838:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458229760:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201276.793508:0:14723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e03c232e400/0x9383f985bc4b060e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4b0615 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.794595:0:14723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201276.794614:0:14723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c232f600/0x9383f985bc4b055f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4b0566 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.794624:0:14723:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c232f600/0x9383f985bc4b055f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4b0566 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.794631:0:14723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c232f600/0x9383f985bc4b055f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4b0566 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.794638:0:14723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e03c232f600/0x9383f985bc4b055f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4b0566 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201276.794651:0:14723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788201276.794657:0:14723:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788201276.794663:0:14723:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788201276.794715:0:14723:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788201276.794721:0:14723:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:2.0:1788201276.794726:0:14723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1788201276.794733:0:14723:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:3.0:1788201276.797520:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201276.797541:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e03c232e400/0x9383f985bc4b060e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4b0615 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.797557:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c232e400 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1788201276.797562:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e03c232e400/0x9383f985bc4b060e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4b0615 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.797573:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c232e400/0x9383f985bc4b060e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9383f985bc4b0615 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201276.797581:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c232e400/0x9383f985bc4b060e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9383f985bc4b0615 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201276.797588:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788201276.797591:0:5846:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788201276.797595:0:5846:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788201276.797650:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e03c232e400/0x9383f985bc4b060e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4b0615 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.797657:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201276.797709:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e03c232e400/0x9383f985bc4b060e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4b0615 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.797718:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c232e400/0x9383f985bc4b060e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4b0615 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.797738:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201276.797742:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e03c232f600/0x9383f985bc4b055f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4b0566 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.797748:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c232f600 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1788201276.797751:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e03c232f600/0x9383f985bc4b055f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4b0566 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.797758:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c232f600/0x9383f985bc4b055f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9383f985bc4b0566 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201276.797764:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c232f600/0x9383f985bc4b055f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9383f985bc4b0566 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201276.797769:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788201276.797771:0:5846:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788201276.797773:0:5846:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788201276.797786:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e03c232f600/0x9383f985bc4b055f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4b0566 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.797792:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201276.797797:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e03c232f600/0x9383f985bc4b055f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4b0566 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.797804:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c232f600/0x9383f985bc4b055f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4b0566 expref: -99 pid: 12959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.797830:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201276.797832:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201276.797834:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201276.798129:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458230144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201276.798221:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201276.798316:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201276.798323:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458230016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201276.798348:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201276.798384:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458230144 00000100:00100000:3.0:1788201276.798393:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458230144 00000100:00100000:3.0:1788201276.798451:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458230016 00000100:00100000:3.0:1788201276.798455:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458230016 00000100:00100000:3.0:1788201276.798480:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788201276.798490:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b60c000b-7335-444d-a8dc-1a5956712fb2+17:3313:x1875064458230144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201276.798508:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201276.798529:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c343c600/0x9383f985bc4b0566 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4b055f expref: 17 pid: 12964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.798548:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201276.798588:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b60c000b-7335-444d-a8dc-1a5956712fb2+16:3313:x1875064458230144:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201276.798596:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788201276.798615:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788201276.798621:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b60c000b-7335-444d-a8dc-1a5956712fb2+15:3313:x1875064458230016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201276.798630:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201276.798638:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c232fc00/0x9383f985bc4b0615 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4b060e expref: 15 pid: 12963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201276.798647:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201276.798667:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b60c000b-7335-444d-a8dc-1a5956712fb2+14:3313:x1875064458230016:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201276.798672:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788201276.798718:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458230016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201276.798728:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458230144:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201276.798752:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:2.0:1788201276.808999:0:14723:0:(mdt_handler.c:8183:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:0.0:1788201276.818380:0:14723:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 3/7 00000020:00080000:0.0:1788201276.818397:0:14723:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e04f9d84000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201276.818404:0:14723:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e04f9d82000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201276.818413:0:14723:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e04fae42000 35604eb4-baf9-45be-a20a-4883a2cd8cf9 192.168.201.30@tcp 17 (0 0 13) 0 0 0 0: 0000000000000000 8589938731 stale:0 00000020:00080000:0.0:1788201276.818419:0:14723:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9e04c56c19c0) has exports, disconnecting them 00000020:00080000:0.0:1788201276.818438:0:14723:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e04f9d84000), last request at 1788201272 00000020:00000080:0.0:1788201276.821121:0:14723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4b15ce 00000100:00080000:0.0:1788201276.821146:0:14723:0:(import.c:65:import_set_state_nolock()) ffff9e04f9d87000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788201276.821196:0:14723:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e04f9d84000): rc 0 00000020:00000080:0.0:1788201276.821199:0:14723:0:(genops.c:906:class_export_put()) final put ffff9e04f9d84000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788201276.821219:0:14723:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e04f9d82000), last request at 1788201272 00000020:00000080:0.0:1788201276.821237:0:14723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4b15c7 00000100:00080000:0.0:1788201276.821255:0:14723:0:(import.c:65:import_set_state_nolock()) ffff9e04f9d81000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788201276.821345:0:14723:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e04f9d82000): rc 0 00000020:00000080:0.0:1788201276.821347:0:14723:0:(genops.c:906:class_export_put()) final put ffff9e04f9d82000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1788201276.821354:0:14723:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.201.30@tcp (ffff9e04fae42000), last request at 1788201273 00000020:00000080:0.0:1788201276.821358:0:14723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4b09b1 00000020:00010000:0.0:1788201276.821367:0:14723:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e04fae42000: total 2 00000100:00080000:0.0:1788201276.821371:0:14723:0:(import.c:65:import_set_state_nolock()) ffff9e04fae46000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788201276.821383:0:14723:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.30@tcp (ffff9e04fae42000): rc 0 00000004:00000080:0.0:1788201276.821391:0:14723:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffad61019cbae0 00000100:00080000:0.0:1788201276.821419:0:14723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788201276.821424:0:14723:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968852 gen 3 00000004:00080000:0.0:1788201276.821438:0:14723:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788201276.821520:0:14723:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788201276.821555:0:14723:0:(import.c:65:import_set_state_nolock()) ffff9e04c4cb9000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788201276.821576:0:14723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788201276.821578:0:14723:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968854 gen 3 00000004:00080000:0.0:1788201276.821587:0:14723:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:2.0:1788201276.821612:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04f9d84000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00080000:0.0:1788201276.821658:0:14723:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788201276.821667:0:14723:0:(import.c:65:import_set_state_nolock()) ffff9e04d8182800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00000080:2.0:1788201276.821716:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04f9d82000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788201276.821737:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04f9d87000 for lustre-MDT0000 00000020:00000080:2.0:1788201276.821742:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04f9d81000 for lustre-MDT0000 00000020:00010000:1.0:1788201276.821962:0:5845:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e04fae42000: total 0 00010000:00010000:1.0:1788201276.822018:0:5845:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e04fae42000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788201276.822068:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bca00/0x9383f985bc4d3d8c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e6b expref: 14 pid: 13379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788201276.822071:0:14723:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9e04c56c19c0) has no exports 00010000:00010000:1.0:1788201276.822092:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d3e65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4eaa expref: 13 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.822114:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d3dbd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e79 expref: 12 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.822128:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d4048 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f67 expref: 11 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.822146:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064a00/0x9383f985bc4d3dee lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x400:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e87 expref: 10 pid: 12969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.822160:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96200/0x9383f985bc4d4080 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f75 expref: 9 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.822185:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d3c97 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e25 expref: 8 pid: 12968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.822203:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d3cc8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e33 expref: 7 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.822221:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065000/0x9383f985bc4d402c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f60 expref: 6 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.822234:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d3cf9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e41 expref: 5 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.822252:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97400/0x9383f985bc4d4064 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f6e expref: 4 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.822269:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d3d2a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e4f expref: 3 pid: 12971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.822287:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d3d5b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4e5d expref: 2 pid: 13406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201276.822518:0:5845:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e04fae42000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1788201276.824378:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201276.824391:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201276.825625:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458230272:0@lo:9:umount.0 00000100:00100000:3.0:1788201276.825873:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201276.825984:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458230400:0@lo:9:umount.0 00000100:00100000:3.0:1788201276.826011:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201276.842800:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458230272 00000100:00100000:2.0:1788201276.842854:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458230272 00000100:00080000:3.0:1788201276.843011:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201276.843407:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458230400 00000100:00100000:2.0:1788201276.843413:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458230400 00000100:00100000:3.0:1788201276.843512:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4222 00000100:00100000:3.0:1788201276.843530:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3309:x1875064458230272:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788201276.843575:0:13446:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4b05dd 00000100:00080000:3.0:1788201276.843588:0:13446:0:(import.c:65:import_set_state_nolock()) ffff9e04ff7d7800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788201276.843638:0:13446:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968856 00000100:00100000:3.0:1788201276.844070:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+2:3309:x1875064458230272:12345-0@lo:9:umount.0 Request processed in 546us (18197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201276.844078:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4222 00000100:00080000:3.0:1788201276.844139:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04c4cb9000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788201276.844159:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788201276.844162:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788201276.844167:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458230272:0@lo:9:umount.0 00000100:00100000:2.0:1788201276.844566:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4223 00000100:00100000:2.0:1788201276.844576:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3309:x1875064458230400:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788201276.844599:0:12363:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4b0600 00000100:00080000:2.0:1788201276.844607:0:12363:0:(import.c:65:import_set_state_nolock()) ffff9e04c8356800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788201276.844651:0:12363:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968857 00000100:00100000:2.0:1788201276.846658:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3309:x1875064458230400:12345-0@lo:9:umount.0 Request processed in 2071us (20632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201276.846675:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4223 00010000:00010000:2.0:1788201276.846781:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201276.846789:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788201276.855944:0:14723:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9e04c56c19c0) has no exports 00000100:00080000:3.0:1788201276.859024:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04d8182800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788201276.859052:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788201276.859054:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788201276.859063:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458230400:0@lo:9:umount.0 00000020:00000080:1.0:1788201276.885655:0:5845:0:(genops.c:906:class_export_put()) final put ffff9e04fae42000/35604eb4-baf9-45be-a20a-4883a2cd8cf9 00000020:00000080:2.0:1788201276.885760:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04fae42000/35604eb4-baf9-45be-a20a-4883a2cd8cf9 for lustre-MDT0000 00000020:00000080:2.0:1788201276.885917:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04fae46000 for lustre-MDT0000 00010000:00010000:2.0:1788201276.887374:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201276.887382:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201276.887386:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788201276.960677:0:14723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4b05c1 00000020:00000080:0.0:1788201276.960710:0:14723:0:(genops.c:906:class_export_put()) final put ffff9e04d20b0800/lustre-QMT0000_UUID 00000020:01000000:0.0:1788201276.960738:0:14723:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788201276.960777:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04d20b0800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788201276.960851:0:14723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201276.960865:0:14723:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788201276.960870:0:14723:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9e04f9773380) has no exports 00000020:00000080:1.0:1788201276.961254:0:14723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4b05ba 00000020:00000080:1.0:1788201276.961261:0:14723:0:(genops.c:906:class_export_put()) final put ffff9e04f48ce800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788201276.961352:0:14723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201276.961361:0:14723:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788201276.961365:0:14723:0:(genops.c:906:class_export_put()) final put ffff9e04f48cb800/lustre-QMT0000_UUID 00000020:00000080:1.0:1788201276.961367:0:14723:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04f48cb800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788201276.961375:0:14723:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1788201276.961648:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04f48ce800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788201276.961799:0:14723:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e04d0870660 - data ffff9e04e152dbd0/ffff9e04c7c4a800 00000020:01000000:1.0:1788201276.961972:0:14723:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e03c2997240 - data ffff9e04dd015870/ffff9e04d9cb8000 00000100:00080000:2.0:1788201277.044893:0:14723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788201277.044904:0:14723:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968852 gen 4 00000004:00080000:2.0:1788201277.045612:0:14723:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788201277.045616:0:14723:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788201277.051879:0:12993:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788201277.051890:0:12993:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 508 count 1 00000040:00080000:0.0:1788201277.051977:0:12993:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1788201277.056865:0:14723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788201277.056877:0:14723:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968854 gen 4 00000004:00080000:2.0:1788201277.056903:0:14723:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788201277.056907:0:14723:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788201277.058212:0:12995:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788201277.058221:0:12995:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 509 count 1 00000040:00080000:0.0:1788201277.058233:0:12995:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1788201277.126711:0:14723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4b0582 00000020:00000080:1.0:1788201277.126731:0:14723:0:(genops.c:906:class_export_put()) final put ffff9e04f5750000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788201277.127554:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04f5750000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788201277.128058:0:14723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4b0597 00000020:00000080:1.0:1788201277.128069:0:14723:0:(genops.c:906:class_export_put()) final put ffff9e04c8352800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788201277.128086:0:14723:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788201277.128094:0:14723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201277.128106:0:14723:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788201277.128111:0:14723:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9e04f9774d40) has no exports 00000004:01000000:1.0:1788201277.128343:0:14723:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788201277.128354:0:14723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4b05f2 00000020:00000080:1.0:1788201277.128359:0:14723:0:(genops.c:906:class_export_put()) final put ffff9e04fae25000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788201277.128363:0:14723:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788201277.128367:0:14723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201277.128373:0:14723:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788201277.128376:0:14723:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9e04f9650000) has no exports 00000020:00000080:1.0:1788201277.128384:0:14723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4b05eb 00000020:00000080:1.0:1788201277.128388:0:14723:0:(genops.c:906:class_export_put()) final put ffff9e04c8367000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788201277.128816:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c8352800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1788201277.128828:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04fae25000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788201277.128832:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c8367000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788201277.129008:0:14723:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788201277.129015:0:14723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788201277.129020:0:14723:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968854 gen 5 00000004:00080000:1.0:1788201277.129027:0:14723:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201277.129030:0:14723:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201277.129115:0:14723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201277.129128:0:14723:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201277.129135:0:14723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4b05d6 00000020:00000080:1.0:1788201277.129140:0:14723:0:(genops.c:906:class_export_put()) final put ffff9e04c8362000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201277.129241:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04d8182800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788201277.129248:0:38:0:(genops.c:906:class_export_put()) final put ffff9e04c8366000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201277.129251:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c8366000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788201277.129257:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788201277.129498:0:14723:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788201277.129503:0:14723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201277.129509:0:14723:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788201277.129513:0:14723:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff9e03c1fab380) has no exports 00000020:00000080:1.0:1788201277.129519:0:14723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4b05cf 00000020:00000080:1.0:1788201277.129524:0:14723:0:(genops.c:906:class_export_put()) final put ffff9e04c4cbf800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788201277.129769:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c8362000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788201277.129777:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c4cbf800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788201277.130199:0:14723:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788201277.130204:0:14723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788201277.130208:0:14723:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968852 gen 5 00000004:00080000:1.0:1788201277.130213:0:14723:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201277.130215:0:14723:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201277.130324:0:14723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201277.130332:0:14723:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201277.130369:0:14723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201277.130373:0:14723:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201277.130377:0:14723:0:(genops.c:906:class_export_put()) final put ffff9e04f5755000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788201277.130380:0:14723:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04f5755000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788201277.130385:0:14723:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201277.130567:0:14723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4b059e 00000020:00000080:1.0:1788201277.130574:0:14723:0:(genops.c:906:class_export_put()) final put ffff9e04c8353000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788201277.130642:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04c4cb9000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788201277.130649:0:38:0:(genops.c:906:class_export_put()) final put ffff9e04cb798800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201277.130651:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04cb798800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788201277.130657:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788201277.130917:0:14723:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788201277.130924:0:14723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201277.130930:0:14723:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788201277.130934:0:14723:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9e04d1c319c0) has no exports 00000020:00000080:1.0:1788201277.130963:0:14723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201277.130968:0:14723:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788201277.130973:0:14723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4b05a5 00000020:00000080:1.0:1788201277.130978:0:14723:0:(genops.c:906:class_export_put()) final put ffff9e04c8353800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788201277.131091:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c8353000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788201277.131096:0:38:0:(genops.c:906:class_export_put()) final put ffff9e04d8185000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788201277.131098:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04d8185000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788201277.131103:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:1.0:1788201277.131358:0:14723:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e04c6717000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788201277.131364:0:14723:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e04c6717000 3 00000020:01000004:1.0:1788201277.131368:0:14723:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e04c6717000 from lustre-MDT0000 00000020:00000080:1.0:1788201277.131389:0:14723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201277.131393:0:14723:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788201277.131397:0:14723:0:(genops.c:906:class_export_put()) final put ffff9e04d8183800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788201277.131399:0:14723:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04d8183800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788201277.131407:0:14723:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788201277.131440:0:14723:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1788201277.131445:0:14723:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788201277.131449:0:14723:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788201277.131452:0:14723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201277.131455:0:14723:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788201277.131467:0:14723:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9e04ff44d000 7ad49433-54fa-4e21-b756-859420d95603 192.168.201.30@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201277.131474:0:14723:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9e04ff7d2800 b60c000b-7335-444d-a8dc-1a5956712fb2 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201277.131479:0:14723:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9e04c56c3380) has exports, disconnecting them 00000020:00080000:1.0:1788201277.131484:0:14723:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.201.30@tcp (ffff9e04ff44d000), last request at 1788201116 00000020:00000080:1.0:1788201277.131506:0:14723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4b09b8 00000020:00010000:1.0:1788201277.131513:0:14723:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e04ff44d000: total 1 00000100:00080000:1.0:1788201277.131518:0:14723:0:(import.c:65:import_set_state_nolock()) ffff9e04ff44f000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788201277.131578:0:14723:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.30@tcp (ffff9e04ff44d000): rc 0 00000020:00080000:1.0:1788201277.131582:0:14723:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9e04ff7d2800), last request at 1788201114 00000020:00000080:1.0:1788201277.131591:0:14723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4b0543 00000020:00010000:1.0:1788201277.131594:0:14723:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e04ff7d2800: total 1 00000100:00080000:1.0:1788201277.131596:0:14723:0:(import.c:65:import_set_state_nolock()) ffff9e04ff7d3800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788201277.131632:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c8353800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:0.0:1788201277.131662:0:7645:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e04ff44d000: total 0 00010000:00010000:0.0:1788201277.131713:0:7645:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e04ff44d000, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1788201277.131751:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e050214da00/0x9383f985bc4b0c82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bbe7b expref: 5 pid: 12963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201277.131775:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c2356600/0x9383f985bc4b0cba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bbe89 expref: 4 pid: 12987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201277.131786:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c2357400/0x9383f985bc4b0c97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bbe82 expref: 3 pid: 12963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201277.131801:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c2356a00/0x9383f985bc4b0cd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1bbe90 expref: 2 pid: 12965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201277.131823:0:7645:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e04ff44d000, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1788201277.131843:0:7645:0:(genops.c:906:class_export_put()) final put ffff9e04ff44d000/7ad49433-54fa-4e21-b756-859420d95603 00000020:00010000:0.0:1788201277.131859:0:7645:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e04ff7d2800: total 1 00010000:00010000:0.0:1788201277.131863:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201277.131877:0:7645:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e04ff7d2800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788201277.131893:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c233c200/0x9383f985bc4b083e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4b0837 expref: 11 pid: 12963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201277.131905:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c232fa00/0x9383f985bc4b087d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4b0876 expref: 10 pid: 12963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788201277.132046:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04ff44d000/7ad49433-54fa-4e21-b756-859420d95603 for MGS 00000020:00000080:2.0:1788201277.132081:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04ff44f000 for MGS 00010000:00010000:0.0:1788201277.132121:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c2357a00/0x9383f985bc4b080d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4b0806 expref: 9 pid: 12964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201277.132131:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e050214c200/0x9383f985bc4b08a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4b0899 expref: 8 pid: 12963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201277.132142:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c232f400/0x9383f985bc4b0830 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4b0829 expref: 7 pid: 12964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201277.132151:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c2356200/0x9383f985bc4b0892 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4b0884 expref: 6 pid: 12964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201277.132161:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c2356400/0x9383f985bc4b081b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4b0814 expref: 5 pid: 12963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201277.132175:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c2357200/0x9383f985bc4b085a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4b0853 expref: 4 pid: 12964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201277.132185:0:7645:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e04ff7d2800, canceled 8 locks, left on hash table 0. 00010000:00010000:0.0:1788201277.132208:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201277.132211:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201277.132214:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788201277.132404:0:14723:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e04ff7d2800): rc 0 00000020:00000080:1.0:1788201277.132407:0:14723:0:(genops.c:906:class_export_put()) final put ffff9e04ff7d2800/b60c000b-7335-444d-a8dc-1a5956712fb2 00000020:00080000:1.0:1788201277.132423:0:14723:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9e04c56c3380) has no exports 00000100:00100000:1.0:1788201277.132493:0:12964:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9e04d80d0e00:12964] 1 exiting: rc = 0 00000100:00100000:3.0:1788201277.132571:0:12987:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff9e03c3477400:12987] 3 exiting: rc = 0 00000020:00000080:0.0:1788201277.132698:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04ff7d2800/b60c000b-7335-444d-a8dc-1a5956712fb2 for MGS 00000020:00000080:0.0:1788201277.132733:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04ff7d3800 for MGS 00010000:00010000:2.0:1788201277.132845:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201277.132875:0:12963:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9e04d80d0800:12963] 0 exiting: rc = 1 00000100:00100000:3.0:1788201277.132909:0:12965:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9e04d80d1e00:12965] 2 exiting: rc = 0 00000100:00100000:1.0:1788201277.133003:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133012:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133022:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133029:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133036:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133042:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133049:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133056:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133063:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133069:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133075:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133082:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133089:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133096:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133102:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133108:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133116:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133124:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133130:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133136:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133142:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133149:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133155:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133160:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133166:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133178:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133186:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133196:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133202:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133209:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133216:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133223:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133230:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133237:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133243:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133251:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133256:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133263:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133270:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133277:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133284:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133322:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133332:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133349:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133357:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133365:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133372:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133379:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133386:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133392:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133399:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133407:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133413:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133420:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133427:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133439:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133446:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133458:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133465:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133471:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133477:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133483:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133489:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201277.133497:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1788201277.133964:0:14723:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788201277.133969:0:14723:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1788201277.139815:0:14723:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e04f9d15900 - data ffff9e04ddbc6d80/ffff9e04d9cbe800 00000020:01000000:1.0:1788201277.140013:0:14723:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e04f4e7ea20 - data ffff9e04ff8d6a20/ffff9e04c8ed7000 00000020:00000080:1.0:1788201277.142216:0:14723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4b053c 00000020:00000080:1.0:1788201277.142230:0:14723:0:(genops.c:906:class_export_put()) final put ffff9e03c330d000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788201277.142446:0:14723:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e04c6717000 from MGS, refs=2 00000020:01000004:1.0:1788201277.142453:0:14723:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e04c6717000 2 00000020:01000004:1.0:1788201277.142456:0:14723:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e04c6717000 from MGS 00000020:00000080:1.0:1788201277.142504:0:14723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201277.142514:0:14723:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788201277.142517:0:14723:0:(genops.c:906:class_export_put()) final put ffff9e03c3309800/MGS 00000020:00000080:1.0:1788201277.142520:0:14723:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03c3309800/MGS for MGS 00000020:01000000:1.0:1788201277.142530:0:14723:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788201277.142614:0:14723:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788201277.142619:0:14723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201277.142628:0:14723:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788201277.142761:0:14723:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9e04c6b18800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201277.142769:0:14723:0:(genops.c:1574:class_disconnect_exports()) OBD device 17 (ffff9e03c1fa99c0) has exports, disconnecting them 00000020:00080000:1.0:1788201277.142775:0:14723:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9e04c6b18800), last request at 1788201114 00000020:00000080:1.0:1788201277.142780:0:14723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4b0631 00000020:00080000:1.0:1788201277.142793:0:14723:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e04c6b18800): rc 0 00000020:00000080:1.0:1788201277.142798:0:14723:0:(genops.c:906:class_export_put()) final put ffff9e04c6b18800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788201277.142854:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03c330d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788201277.145269:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c6b18800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788201277.161990:0:14723:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788201277.162003:0:14723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201277.162010:0:14723:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788201277.162020:0:14723:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788201277.162208:0:14723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201277.162224:0:14723:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788201277.162234:0:14723:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e04c6717000 1 00000020:00000080:0.0:1788201277.162251:0:14723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4b052e 00000020:00000080:0.0:1788201277.162263:0:14723:0:(genops.c:906:class_export_put()) final put ffff9e03c3309000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788201277.162270:0:14723:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788201277.162277:0:14723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201277.162283:0:14723:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788201277.162288:0:14723:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9e04f9654d40) has no exports 00000020:00000080:2.0:1788201277.169474:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04c6b1d000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788201277.169496:0:38:0:(genops.c:906:class_export_put()) final put ffff9e04c6b1f000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788201277.169502:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c6b1f000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788201277.169518:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788201277.169601:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03c3309000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788201277.195524:0:14723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201277.195544:0:14723:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788201277.195552:0:14723:0:(genops.c:906:class_export_put()) final put ffff9e04c6713800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788201277.195557:0:14723:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c6713800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788201277.195570:0:14723:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788201277.195761:0:14723:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e04c6716800 00000020:01000000:0.0:1788201277.195792:0:14723:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788201277.195798:0:14723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201277.195812:0:14723:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788201277.195817:0:14723:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9e04f9653380) has no exports 00000100:00100000:0.0:1788201277.195916:0:13406:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9e03c2f5bc00:13406] 4 exiting: rc = 0 00000100:00100000:0.0:1788201277.196033:0:13379:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9e03c3185400:13379] 3 exiting: rc = 0 00000100:00100000:0.0:1788201277.196124:0:12969:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9e03c211fe00:12969] 1 exiting: rc = 0 00000100:00100000:2.0:1788201277.203254:0:12968:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9e03c211ea00:12968] 0 exiting: rc = 1 00000100:00100000:3.0:1788201277.209973:0:12971:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9e03c211f200:12971] 2 exiting: rc = 0 00000100:00100000:2.0:1788201277.210199:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.210212:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.210223:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.210235:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.210245:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.210257:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.210267:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215720:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215747:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215755:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215762:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215770:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215779:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215786:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215792:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215797:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215815:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215821:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215828:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215836:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215843:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215851:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215856:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215862:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215869:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215874:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215879:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215884:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215890:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215895:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215904:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215920:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215926:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215932:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215938:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215945:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215952:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215957:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215963:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215968:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215978:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215986:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.215991:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.216002:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.216007:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.216013:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.216019:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.216029:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.216035:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.216042:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.216048:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.216054:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.216060:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.216067:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.216074:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.216080:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.216085:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.216092:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.216099:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.216104:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.216110:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.216116:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.216122:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.216128:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.226393:0:13381:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff9e03c2781a00:13381] 2 exiting: rc = 0 00000100:00100000:0.0:1788201277.227417:0:12972:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9e03c346f600:12972] 0 exiting: rc = 1 00000100:00100000:3.0:1788201277.227535:0:12973:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9e04ff49ae00:12973] 1 exiting: rc = 0 00000100:00100000:2.0:1788201277.227876:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.227889:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.227897:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.227903:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.227978:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.227985:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.227992:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228000:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228006:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228011:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228017:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228024:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228030:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228036:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228042:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228049:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228054:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228061:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228066:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228077:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228084:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228091:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228101:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228112:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228120:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228126:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228132:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228138:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228143:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228149:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228159:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228170:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228183:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228192:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228199:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228205:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228211:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228216:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228222:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228227:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228232:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228323:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228333:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228341:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228347:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228358:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228365:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228371:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228377:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228383:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228389:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228395:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228401:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228407:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228412:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228419:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228771:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228780:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228791:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228798:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228815:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228826:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228841:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.228852:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.233161:0:12975:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9e04ff1bca00:12975] 1 exiting: rc = 0 00000100:00100000:2.0:1788201277.235041:0:12974:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9e04ff1bc800:12974] 0 exiting: rc = 1 00000100:00100000:0.0:1788201277.235287:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235324:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235340:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235347:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235354:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235369:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235377:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235384:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235390:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235397:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235403:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235411:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235418:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235435:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235443:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235450:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235457:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235481:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235488:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235496:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235504:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235511:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235517:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235524:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235531:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235539:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235546:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235552:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235560:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235583:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235592:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235599:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235607:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235614:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235620:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235626:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235634:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235641:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235648:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235654:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235661:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235683:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235704:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235710:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235717:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235723:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235729:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235735:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235742:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235749:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235756:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235767:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235773:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235797:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235817:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235824:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235835:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235843:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235848:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235855:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235861:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235869:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235875:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.235882:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.253464:0:12977:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9e04ff1bd400:12977] 1 exiting: rc = 0 00000100:00100000:2.0:1788201277.255922:0:12976:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9e04ff1bd800:12976] 0 exiting: rc = 1 00000100:00100000:0.0:1788201277.256474:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256484:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256489:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256495:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256501:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256507:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256512:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256517:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256523:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256528:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256533:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256538:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256543:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256550:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256556:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256561:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256566:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256571:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256577:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256582:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256588:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256593:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256598:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256603:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256608:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256614:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256619:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256624:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256629:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256633:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256639:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256645:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256650:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256655:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256661:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256666:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256671:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256676:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.256681:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.257162:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.257173:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.257179:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.257184:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.257189:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.257194:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.257199:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.257205:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.257211:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.257216:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.257222:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.257227:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.257233:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.257376:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.257385:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.257390:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.257395:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.257401:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.257406:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.257411:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.257416:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.257466:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.257474:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.257480:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.257486:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.258231:0:12978:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9e04ff1bce00:12978] 0 exiting: rc = 1 00000100:00100000:2.0:1788201277.258383:0:12981:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9e04e1ae0c00:12981] 1 exiting: rc = 0 00000100:00100000:0.0:1788201277.258765:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.258776:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.258782:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.258788:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.258793:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.258799:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.258813:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.258819:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.258825:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.258830:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.258836:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.258842:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.258848:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.258854:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.258860:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.258866:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.258872:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.258877:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.258883:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.258888:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.258894:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.258899:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259007:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259019:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259025:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259031:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259037:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259043:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259049:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259054:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259060:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259066:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259072:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259078:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259083:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259088:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259095:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259101:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259107:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259113:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259118:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259124:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259130:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259134:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259140:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259145:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259151:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259156:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259161:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259165:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259171:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259175:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259180:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259185:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259190:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259195:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259200:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259205:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259210:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259215:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259220:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259225:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259230:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.259235:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.260023:0:12983:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9e04f53f3000:12983] 1 exiting: rc = 0 00000100:00100000:2.0:1788201277.260219:0:12982:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9e04f53f3a00:12982] 0 exiting: rc = 1 00000100:00100000:0.0:1788201277.260823:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.260830:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.260835:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.260841:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.260849:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.260855:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.260861:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.260867:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.260874:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.260879:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.260885:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.260891:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.260896:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.260902:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.260970:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.260976:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.260982:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.260987:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.260992:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.260997:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261003:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261008:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261013:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261018:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261023:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261028:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261033:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261038:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261043:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261048:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261054:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261059:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261065:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261071:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261077:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261083:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261089:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261094:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261100:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261106:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261112:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261118:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261124:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261130:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261136:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261141:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261146:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261151:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261157:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261161:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261166:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261171:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261176:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261181:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261186:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261191:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261197:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261202:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261206:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261211:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261216:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261221:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261225:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.261230:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201277.264899:0:12984:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9e04f53f2c00:12984] 0 exiting: rc = 1 00000100:00100000:0.0:1788201277.265372:0:12985:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9e03c1c35a00:12985] 1 exiting: rc = 0 00000100:00100000:0.0:1788201277.265559:0:12986:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9e03c1c34a00:12986] 2 exiting: rc = 0 00000100:00100000:0.0:1788201277.265675:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.265878:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.265889:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.265896:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.265903:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.265982:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.265998:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.266006:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.266012:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.266018:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.266026:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.266033:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.266040:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.266047:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.266054:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.266080:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.266088:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.266095:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.266101:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.266108:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.266114:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.266120:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.266127:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.266134:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.266140:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.266147:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.266154:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.266160:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.266167:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.266173:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.266179:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.266185:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.266191:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.266196:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.266202:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.266207:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.266213:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.266218:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.266224:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.268012:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.268030:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.268036:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.268042:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.268048:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.268053:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.268060:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.268066:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.268073:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.268081:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.268089:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.268096:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.268103:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.268109:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.268116:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.268123:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.268130:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.268137:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.268143:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.268149:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.268155:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.268161:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.268168:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.268174:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201277.268181:0:14723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788201277.296885:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788201277.297113:0:14723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201277.297127:0:14723:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788201277.297133:0:14723:0:(genops.c:906:class_export_put()) final put ffff9e04ff1c1800/MDS_uuid 00000020:00000080:0.0:1788201277.297140:0:14723:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04ff1c1800/MDS_uuid for MDS 00000020:01000000:0.0:1788201277.297152:0:14723:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788201277.297490:0:14723:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:2.0:1788201277.678737:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875064458230656:0@lo:400:kworker.0 00000400:00000100:2.0:1788201277.678792:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458230656 offset 0 length 224: 4 00000100:00100000:2.0:1788201277.678837:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201277.678844:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458230528:0@lo:400:kworker.0 00000400:00000100:2.0:1788201277.678861:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458230528 offset 0 length 224: 4 00000001:00100000:0.0:1788201278.243030:0:6732:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201278.243043:0:6732:0:(genops.c:906:class_export_put()) final put ffff9e04ff7d5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201278.243075:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04ff7d5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788201278.243121:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04ff7d7800 for lustre-OST0000 00000001:00100000:3.0:1788201278.268095:0:7657:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788201278.268109:0:7657:0:(genops.c:906:class_export_put()) final put ffff9e04c8354000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788201278.268142:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c8354000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788201278.268202:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04c8356800 for lustre-OST0001 00010000:00010000:0.0:1788201278.314844:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1788201278.865928:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.30@tcp portal 12 match 1875064442676864 offset 0 length 224: 4 00000100:00100000:3.0:1788201278.865961:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000400:00000100:3.0:1788201278.865991:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.30@tcp portal 26 match 1875064442676736 offset 0 length 224: 4 00000100:00100000:3.0:1788201278.866011:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201278.866207:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442677120 00000100:00100000:1.0:1788201278.866225:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442677120 00000100:00100000:2.0:1788201278.866248:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442676992 00000100:00100000:2.0:1788201278.866263:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442676992 00000100:00100000:1.0:1788201278.866385:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 171 00000100:00080000:3.0:1788201278.866453:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201278.866472:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201278.866537:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2359:x1875064442677120:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201278.866644:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2359:x1875064442677120:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 247us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201278.870187:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 172 00000100:00100000:2.0:1788201278.870211:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2359:x1875064442676992:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201278.870306:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2359:x1875064442676992:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 108us (4295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201278.870312:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 172 00000100:00100000:1.0:1788201278.876071:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 171 00010000:00010000:0.0:1788201279.333435:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201280.358427:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201281.382690:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201282.405467:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201282.790015:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458230912:0@lo:400:kworker.0 00000400:00000100:3.0:1788201282.790075:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458230912 offset 0 length 224: 4 00000100:00100000:3.0:1788201282.790157:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201282.790164:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458230784:0@lo:400:kworker.0 00000400:00000100:3.0:1788201282.790183:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875064458230784 offset 0 length 224: 4 00000100:00100000:1.0:1788201282.790848:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875064458231040:0@lo:400:kworker.0 00000400:00000100:1.0:1788201282.790880:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458231040 offset 0 length 224: 4 00010000:00010000:2.0:1788201283.429802:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1788201283.991703:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.30@tcp portal 26 match 1875064442677248 offset 0 length 224: 4 00000100:00100000:3.0:1788201283.991875:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000400:00000100:3.0:1788201283.991913:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.30@tcp portal 12 match 1875064442677376 offset 0 length 224: 4 00000100:00100000:3.0:1788201283.991954:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201283.992066:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442677504 00000100:00100000:0.0:1788201283.992076:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442677504 00000100:00100000:0.0:1788201283.992166:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442677632 00000100:00100000:0.0:1788201283.992169:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442677632 00000100:00100000:0.0:1788201283.992196:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 173 00000100:00100000:0.0:1788201283.992207:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cfface00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2361:x1875064442677504:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201283.992327:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cfface00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2361:x1875064442677504:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 90us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201283.992334:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 173 00000100:00100000:0.0:1788201283.992351:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 174 00000100:00100000:0.0:1788201283.992358:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2361:x1875064442677632:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201283.992383:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2361:x1875064442677632:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201283.992389:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 174 00000100:00080000:3.0:1788201283.992950:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201283.992955:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788201284.455012:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201285.477570:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201286.501668:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201287.528995:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201287.911467:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458231168:0@lo:400:kworker.0 00000400:00000100:2.0:1788201287.911519:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875064458231168 offset 0 length 224: 4 00000100:00100000:0.0:1788201287.911648:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458231296:0@lo:400:kworker.0 00000400:00000100:0.0:1788201287.911679:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458231296 offset 0 length 224: 4 00000100:00100000:0.0:1788201287.911697:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201287.911703:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458231424:0@lo:400:kworker.0 00000400:00000100:0.0:1788201287.911717:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458231424 offset 0 length 224: 4 00000100:00100000:2.0:1788201288.189930:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000400:00000100:2.0:1788201288.189972:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.30@tcp portal 12 match 1875064442677888 offset 0 length 520: 4 00000400:00000100:2.0:1788201288.189987:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.30@tcp portal 26 match 1875064442677760 offset 0 length 224: 4 00000100:00100000:2.0:1788201288.190011:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201288.190268:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442678016 00000100:00100000:3.0:1788201288.190283:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442678016 00000100:00100000:3.0:1788201288.190415:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442678144 00000100:00100000:3.0:1788201288.190419:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442678144 00000100:00100000:3.0:1788201288.190446:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 175 00000100:00100000:3.0:1788201288.190459:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2362:x1875064442678016:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201288.190568:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2362:x1875064442678016:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 110us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201288.190576:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 175 00000100:00100000:3.0:1788201288.190595:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 176 00000100:00100000:3.0:1788201288.190601:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2362:x1875064442678144:12345-192.168.201.30@tcp:400:kworker.0 00000100:00080000:0.0:1788201288.190972:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201288.190978:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201288.191100:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2362:x1875064442678144:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 497us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201288.191108:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 176 00010000:00010000:0.0:1788201288.549974:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201289.573755:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201290.598353:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201291.622046:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201292.646372:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201293.033065:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458231552:0@lo:400:kworker.0 00000400:00000100:1.0:1788201293.033141:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875064458231552 offset 0 length 224: 4 00000100:00100000:1.0:1788201293.033208:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201293.033216:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875064458231680:0@lo:400:kworker.0 00000400:00000100:1.0:1788201293.033235:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458231680 offset 0 length 224: 4 00000100:00000400:1.0:1788201293.033265:0:3311:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201277/real 1788201277] req@ffff9e03c2b7f480 x1875064458230528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201293 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201293.055840:0:3311:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e03c2b7f480 x1875064458230528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201293 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788201293.056385:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788201293.056392:0:3311:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788201293.073659:0:3311:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00100000:1.0:1788201293.073756:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458231808:0@lo:400:kworker.0 00000100:00080000:2.0:1788201293.073774:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201293.073782:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201293.073788:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201293.073795:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 399 00000100:00080000:2.0:1788201293.073807:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e04ff4ba000 using connection 192.168.201.130@tcp/0@lo 00000400:00000100:1.0:1788201293.073848:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458231808 offset 0 length 224: 4 00000100:00100000:2.0:1788201293.073855:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e03c53e9f80 x1875064458231936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201293.073992:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875064458231936:0@lo:38:kworker.0 00000400:00000100:3.0:1788201293.074020:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458231936 offset 0 length 520: 4 00000100:00000400:1.0:1788201293.075042:0:3311:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201277/real 1788201277] req@ffff9e03c2b7f800 x1875064458230656/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201293 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201293.075073:0:3311:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e03c2b7f800 x1875064458230656/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201293 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788201293.075083:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788201293.075087:0:3311:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788201293.075093:0:3311:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00080000:1.0:1788201293.075111:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201293.075116:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201293.075118:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201293.075123:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 399 00000100:00080000:1.0:1788201293.075130:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e04f5751000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:1.0:1788201293.075157:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e04f000dc00 x1875064458232064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201293.075189:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875064458232064:0@lo:38:kworker.0 00000400:00000100:1.0:1788201293.075225:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458232064 offset 0 length 520: 4 00000100:00100000:1.0:1788201293.075253:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458230528:0@lo:400:kworker.0 00000100:00100000:1.0:1788201293.075259:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875064458230656:0@lo:400:kworker.0 00000100:00100000:3.0:1788201293.202936:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000400:00000100:3.0:1788201293.202995:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.30@tcp portal 26 match 1875064442678272 offset 0 length 224: 4 00000100:00100000:3.0:1788201293.203025:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201293.203093:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442678400 00000100:00100000:3.0:1788201293.203106:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442678400 00000100:00100000:3.0:1788201293.203188:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442678528 00000100:00100000:3.0:1788201293.203192:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442678528 00000100:00100000:3.0:1788201293.203221:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 177 00000100:00100000:3.0:1788201293.203234:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2359:x1875064442678400:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201293.203269:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 178 00000100:00100000:0.0:1788201293.203285:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2359:x1875064442678528:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201293.203353:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2359:x1875064442678400:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 120us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201293.203354:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2359:x1875064442678528:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 74us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201293.203369:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 177 00000100:00080000:3.0:1788201293.203566:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201293.203572:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201293.208551:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 178 00010000:00010000:2.0:1788201293.673964:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1788201294.300493:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.30@tcp portal 26 match 1875064442678656 offset 0 length 520: 4 00000100:00100000:0.0:1788201294.300565:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201294.300606:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201294.300701:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442678912 00000100:00100000:1.0:1788201294.300715:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442678912 00000100:00100000:1.0:1788201294.300784:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442678784 00000100:00100000:1.0:1788201294.300788:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442678784 00000100:00100000:1.0:1788201294.300824:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 179 00000100:00100000:1.0:1788201294.300835:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2360:x1875064442678912:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201294.300935:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2360:x1875064442678912:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 100us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201294.300943:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 179 00000100:00100000:1.0:1788201294.300964:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 180 00000100:00100000:1.0:1788201294.300971:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2360:x1875064442678784:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201294.300999:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2360:x1875064442678784:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 28us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201294.301005:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 180 00010000:00010000:0.0:1788201294.693651:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201295.717403:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788201296.307447:0:15168:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788201296.307453:0:15168:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788201296.308249:0:15168:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e03c371d800 00000020:01000004:0.0:1788201296.308268:0:15168:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788201296.308280:0:15168:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788201296.308322:0:15168:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9e04ff1e4d40) 00000020:00000080:0.0:1788201296.308339:0:15168:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788201296.363901:0:15168:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788201296.374652:0:15168:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:3.0:1788201296.376721:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 436: rc = 0 00100000:10000000:2.0:1788201296.378727:0:15168:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788201296.378978:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 436: rc = 0 00100000:10000000:2.0:1788201296.379109:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 436: rc = 0 00100000:10000000:2.0:1788201296.379205:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 436: rc = 0 00100000:10000000:2.0:1788201296.379331:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 436: rc = 0 00100000:10000000:2.0:1788201296.379515:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 436: rc = 0 00100000:10000000:2.0:1788201296.381123:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 438: rc = 0 00100000:10000000:2.0:1788201296.389180:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 474: rc = 0 00100000:10000000:2.0:1788201296.389322:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 474: rc = 0 00100000:10000000:2.0:1788201296.394212:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 363: rc = 0 00100000:10000000:2.0:1788201296.403685:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 363: rc = 0 00100000:10000000:2.0:1788201296.406014:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 363: rc = 0 00100000:10000000:2.0:1788201296.412232:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 363: rc = 0 00100000:10000000:2.0:1788201296.415333:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 363: rc = 0 00100000:10000000:2.0:1788201296.418045:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 363: rc = 0 00100000:10000000:2.0:1788201296.420678:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 363: rc = 0 00100000:10000000:2.0:1788201296.422009:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 363: rc = 0 00100000:10000000:2.0:1788201296.427073:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 363: rc = 0 00100000:10000000:3.0:1788201296.435926:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 363: rc = 0 00100000:10000000:2.0:1788201296.438003:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 363: rc = 0 00100000:10000000:3.0:1788201296.440887:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 363: rc = 0 00100000:10000000:1.0:1788201296.452490:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 595: rc = 0 00100000:10000000:1.0:1788201296.455068:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 595: rc = 0 00100000:10000000:1.0:1788201296.457268:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 595: rc = 0 00100000:10000000:1.0:1788201296.459079:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 595: rc = 0 00100000:10000000:1.0:1788201296.461178:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 595: rc = 0 00100000:10000000:1.0:1788201296.463024:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 595: rc = 0 00100000:10000000:1.0:1788201296.464664:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 595: rc = 0 00100000:10000000:1.0:1788201296.466143:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 595: rc = 0 00100000:10000000:1.0:1788201296.467707:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 595: rc = 0 00100000:10000000:1.0:1788201296.470122:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 595: rc = 0 00100000:10000000:1.0:1788201296.471730:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 595: rc = 0 00100000:10000000:1.0:1788201296.478051:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 595: rc = 0 00100000:10000000:0.0:1788201296.484958:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 595: rc = 0 00100000:10000000:3.0:1788201296.491935:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 595: rc = 0 00100000:10000000:3.0:1788201296.495707:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 595: rc = 0 00100000:10000000:0.0:1788201296.503233:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 595: rc = 0 00100000:10000000:0.0:1788201296.509461:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 595: rc = 0 00100000:10000000:3.0:1788201296.514271:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 595: rc = 0 00100000:10000000:3.0:1788201296.519907:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 595: rc = 0 00100000:10000000:1.0:1788201296.526158:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 595: rc = 0 00100000:10000000:2.0:1788201296.534794:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 595: rc = 0 00100000:10000000:2.0:1788201296.542090:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 595: rc = 0 00100000:10000000:2.0:1788201296.544287:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 595: rc = 0 00100000:10000000:3.0:1788201296.546910:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 595: rc = 0 00100000:10000000:3.0:1788201296.554987:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 595: rc = 0 00100000:10000000:3.0:1788201296.557216:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 595: rc = 0 00100000:10000000:3.0:1788201296.558996:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 595: rc = 0 00100000:10000000:3.0:1788201296.561266:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 595: rc = 0 00100000:10000000:3.0:1788201296.562768:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 595: rc = 0 00100000:10000000:3.0:1788201296.568283:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 595: rc = 0 00100000:10000000:3.0:1788201296.571222:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 595: rc = 0 00100000:10000000:3.0:1788201296.578090:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 595: rc = 0 00100000:10000000:3.0:1788201296.584593:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 590: rc = 0 00100000:10000000:3.0:1788201296.585996:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000bd0:0x1:0x0] under 590: rc = 0 00100000:10000000:2.0:1788201296.605547:0:15168:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788201296.607948:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 359: rc = 0 00100000:10000000:0.0:1788201296.612040:0:15168:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1788201296.612173:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 359: rc = 0 00100000:10000000:1.0:1788201296.619499:0:15168:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1788201296.620094:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 359: rc = 0 00100000:10000000:3.0:1788201296.629151:0:15168:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788201296.629261:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 475: rc = 0 00100000:10000000:3.0:1788201296.633155:0:15168:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788201296.633957:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 475: rc = 0 00100000:10000000:3.0:1788201296.636073:0:15168:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788201296.636162:0:15168:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 475: rc = 0 00000020:00000080:3.0:1788201296.637235:0:15168:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788201296.637243:0:15168:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788201296.637255:0:15168:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d40a3 00000020:01000004:3.0:1788201296.637263:0:15168:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788201296.637273:0:15168:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788201296.637278:0:15168:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e03c371d800 from MGS 00000020:01000004:3.0:1788201296.637281:0:15168:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788201296.637424:0:15168:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9e04d1c33380) 00000020:00000080:3.0:1788201296.637504:0:15168:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788201296.637622:0:15168:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e03c371d800 from MGS, refs=2 00080000:01000000:3.0:1788201296.637629:0:15168:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788201296.637635:0:15168:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d40b1 00010000:00010000:3.0:1788201296.637970:0:15168:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-2 is initialized 00000040:01000000:0.0:1788201296.673482:0:15168:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788201296.673504:0:15168:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788201296.673508:0:15168:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788201296.678331:0:15169:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788201296.678677:0:15168:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788201296.678796:0:15168:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788201296.688528:0:15168:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788201296.690204:0:15168:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201296.691127:0:15168:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788201296.691134:0:15168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788201296.692539:0:15168:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788201296.692553:0:15168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788201296.693215:0:15168:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788201296.693224:0:15168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788201296.694262:0:15168:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788201296.694288:0:15168:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1788201296.694289:0:15168:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.130@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1788201296.694450:0:15168:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.130@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:2.0:1788201296.694456:0:15168:0:(import.c:65:import_set_state_nolock()) ffff9e04c6711800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788201296.694471:0:15168:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788201296.703153:0:15168:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.130@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788201296.703160:0:15168:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788201296.703170:0:15168:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e03c53e8700 x1875064458230784/t0(0) o400->MGC192.168.201.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201298 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201296.703199:0:15168:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e04f000e680 x1875064458231168/t0(0) o400->MGC192.168.201.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201303 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201296.703215:0:15168:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e04f000d500 x1875064458231552/t0(0) o400->MGC192.168.201.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201309 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788201296.703234:0:15168:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788201296.703237:0:15168:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788201296.703239:0:15168:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788201296.703241:0:15168:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:2.0:1788201296.703354:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458231552:0@lo:400:kworker.0 00000100:00100000:1.0:1788201296.704760:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458231168:0@lo:400:kworker.0 00000100:00100000:3.0:1788201296.705151:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458230784:0@lo:400:kworker.0 10000000:01000000:3.0:1788201296.705179:0:15168:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:3.0:1788201296.705193:0:15168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c2357800/0x9383f985bc4b0876 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4b087d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201296.705200:0:15168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c2357800/0x9383f985bc4b0876 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4b087d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201296.705205:0:15168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788201296.705222:0:15168:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201296.705230:0:15168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c2357800/0x9383f985bc4b0876 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4b087d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201296.705242:0:15168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c232e800/0x9383f985bc4b0806 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4b080d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201296.705246:0:15168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c232e800/0x9383f985bc4b0806 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4b080d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201296.705250:0:15168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201296.705252:0:15168:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201296.705254:0:15168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c232e800/0x9383f985bc4b0806 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4b080d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201296.705259:0:15168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c2357600/0x9383f985bc4b0814 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4b081b expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201296.705262:0:15168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c2357600/0x9383f985bc4b0814 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4b081b expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201296.705265:0:15168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201296.705267:0:15168:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201296.705268:0:15168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c2357600/0x9383f985bc4b0814 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4b081b expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201296.705273:0:15168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c233ca00/0x9383f985bc4b0837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4b083e expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201296.705277:0:15168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c233ca00/0x9383f985bc4b0837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4b083e expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201296.705282:0:15168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201296.705285:0:15168:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201296.705287:0:15168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c233ca00/0x9383f985bc4b0837 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4b083e expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201296.705312:0:15168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c232e000/0x9383f985bc4b0853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4b085a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201296.705316:0:15168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c232e000/0x9383f985bc4b0853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4b085a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201296.705319:0:15168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201296.705321:0:15168:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201296.705323:0:15168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c232e000/0x9383f985bc4b0853 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4b085a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201296.705329:0:15168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e050214d000/0x9383f985bc4b0899 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4b08a0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201296.705333:0:15168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e050214d000/0x9383f985bc4b0899 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4b08a0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201296.705336:0:15168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201296.705338:0:15168:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201296.705340:0:15168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e050214d000/0x9383f985bc4b0899 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4b08a0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201296.705357:0:15168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c233da00/0x9383f985bc4b0829 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4b0830 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201296.705365:0:15168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c233da00/0x9383f985bc4b0829 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4b0830 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201296.705368:0:15168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788201296.705370:0:15168:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201296.705372:0:15168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c233da00/0x9383f985bc4b0829 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4b0830 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201296.705376:0:15168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c233c400/0x9383f985bc4b0884 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4b0892 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201296.705380:0:15168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c233c400/0x9383f985bc4b0884 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4b0892 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201296.705382:0:15168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788201296.705384:0:15168:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201296.705386:0:15168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c233c400/0x9383f985bc4b0884 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4b0892 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788201296.705397:0:15168:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9e04c6711800 already not connected (conn 2, was 0): DISCONN 00000100:00080000:3.0:1788201296.705402:0:15168:0:(import.c:65:import_set_state_nolock()) ffff9e04c6711800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201296.705405:0:15168:0:(import.c:510:import_select_connection()) MGC192.168.201.130@tcp: connect to NID 0@lo last attempt 389 00000100:00080000:3.0:1788201296.705411:0:15168:0:(import.c:624:import_select_connection()) MGC192.168.201.130@tcp: import ffff9e04c6711800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1788201296.705440:0:15168:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e04cffad500 x1875064458232192/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201296.705461:0:15168:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:1.0:1788201296.706737:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b60c000b-7335-444d-a8dc-1a5956712fb2:3309:1875064458232192:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788201296.706827:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201296.706978:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458232192 00000100:00100000:0.0:1788201296.706985:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458232192 00000100:00100000:0.0:1788201296.707019:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788201296.707025:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04fae07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3309:x1875064458232192:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788201296.707046:0:15172:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from b60c000b-7335-444d-a8dc-1a5956712fb2@0@lo t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:0.0:1788201296.707071:0:15172:0:(genops.c:1406:class_connect()) connect: client b60c000b-7335-444d-a8dc-1a5956712fb2, cookie 0x9383f985bc4d40b8 00000100:00080000:0.0:1788201296.707172:0:15172:0:(import.c:65:import_set_state_nolock()) ffff9e04ffc55000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201296.707222:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04fae07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+5:3309:x1875064458232192:12345-0@lo:250:mount.lustre.0 Request processed in 196us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201296.707227:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201296.707751:0:3309:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.130@tcp: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788201296.707760:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.130@tcp: connect to target with instance 0 00000100:00080000:3.0:1788201296.707767:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.130@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788201296.707772:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788201296.707774:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04c6711800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788201296.707776:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788201296.707819:0:3309:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788201296.707831:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b60c000b-7335-444d-a8dc-1a5956712fb2:3309:1875064458232192:0@lo:250:mount.lustre.0 00000100:00080000:3.0:1788201296.707859:0:15168:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:3.0:1788201296.707869:0:15168:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788201296.707877:0:15168:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788201296.707890:0:15168:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9e04d1c34d40) 00000020:00000080:3.0:1788201296.707902:0:15168:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000020:01000000:1.0:1788201296.709040:0:38:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.201.130@tcp 10000000:01000000:1.0:1788201296.709055:0:38:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1788201296.709058:0:38:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1788201296.709060:0:38:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201296.709061:0:38:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201296.709062:0:38:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201296.709063:0:38:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201296.709064:0:38:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201296.709065:0:38:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201296.709067:0:38:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201296.709068:0:38:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1788201296.709108:0:38:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1788201296.709114:0:38:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1788201296.709115:0:38:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1788201296.709116:0:38:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788201296.709117:0:38:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201296.709119:0:38:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201296.709120:0:38:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201296.709121:0:38:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201296.709122:0:38:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201296.709124:0:38:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201296.709125:0:38:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1788201296.709144:0:38:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 00000100:00100000:1.0:1788201296.709177:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458232320:0@lo:253:kworker.0 00000100:00100000:1.0:1788201296.709230:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201296.709277:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458232448:0@lo:253:kworker.0 00000100:00100000:1.0:1788201296.709322:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201296.709376:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458232320 00000100:00100000:1.0:1788201296.709382:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458232320 00000100:00100000:1.0:1788201296.709416:0:15173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458232448 00000100:00100000:1.0:1788201296.709419:0:15173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458232448 00000100:00100000:1.0:1788201296.709435:0:15173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201296.709443:0:15173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04fae06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+6:3313:x1875064458232320:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1788201296.709476:0:15173:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:1.0:1788201296.709584:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201296.709591:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04fae06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+6:3310:x1875064458232448:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1788201296.709604:0:15174:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 10000000:01000000:1.0:1788201296.709633:0:15175:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788201296.710184:0:15173:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 8 00000100:00100000:3.0:1788201296.736600:0:15168:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788201296.736787:0:15168:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788201296.736794:0:15168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788201296.739948:0:15168:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788201296.739959:0:15168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788201296.741711:0:15168:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788201296.741721:0:15168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788201296.743793:0:15168:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201296.744118:0:15168:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788201296.744125:0:15168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00010000:00010000:0.0:1788201296.745177:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1788201296.746140:0:15177:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788201296.746145:0:15177:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788201296.746148:0:15177:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788201296.746196:0:15177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788201296.746427:0:15173:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788201296.746448:0:15173:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788201296.747221:0:15168:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788201296.747648:0:15168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788201296.814835:0:15168:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201296.815005:0:15168:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788201296.815011:0:15168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788201296.816473:0:15168:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788201296.816483:0:15168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788201296.817694:0:15168:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201296.817872:0:15168:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788201296.817878:0:15168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788201296.820794:0:15168:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788201296.820984:0:15168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788201296.821710:0:15168:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788201296.821945:0:15168:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788201296.821950:0:15168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788201296.826340:0:15168:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788201296.826359:0:15168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788201296.827552:0:15168:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201296.827759:0:15168:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788201296.827764:0:15168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788201296.829498:0:15168:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788201296.829509:0:15168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788201296.852969:0:15168:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788201296.853159:0:15168:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788201296.853166:0:15168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788201296.855376:0:15168:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788201296.855388:0:15168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788201296.857194:0:15168:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788201296.857206:0:15168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788201296.858792:0:15168:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788201296.858886:0:15168:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788201296.858893:0:15168:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788201296.859205:0:15168:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.130@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788201296.859240:0:15168:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.130@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788201296.859244:0:15168:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788201296.859246:0:15168:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788201296.859247:0:15168:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201296.859248:0:15168:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201296.859250:0:15168:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201296.859251:0:15168:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201296.859252:0:15168:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201296.859253:0:15168:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788201296.859255:0:15168:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201296.859256:0:15168:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788201296.859259:0:15168:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788201296.859261:0:15168:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788201296.859262:0:15168:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788201296.859263:0:15168:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201296.859264:0:15168:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201296.859265:0:15168:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201296.859266:0:15168:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201296.859268:0:15168:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201296.859269:0:15168:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788201296.859270:0:15168:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201296.859271:0:15168:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788201296.859469:0:15168:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788201296.859491:0:15168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:15168:1875064458232576:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788201296.859561:0:15168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201296.859991:0:15168:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f9635900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201296.861027:0:15172:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:0.0:1788201296.861038:0:15172:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:0.0:1788201296.861333:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458232576 00000100:00100000:0.0:1788201296.861341:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458232576 00000100:00100000:2.0:1788201296.861536:0:15194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201296.861548:0:15194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cfeffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+7:15168:x1875064458232576:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788201296.861674:0:15194:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788201296.861678:0:15194:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788201296.861681:0:15194:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:2.0:1788201296.861687:0:15194:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788201296.863696:0:15173:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788201296.863705:0:15173:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788201296.863721:0:15175:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788201296.863725:0:15175:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788201296.863748:0:15175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e03c2cc7800/0x9383f985bc4d40c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201296.863763:0:15175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c2cc7800/0x9383f985bc4d40c6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788201296.863772:0:15175:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000048175s 00010000:00010000:0.0:1788201296.863776:0:15175:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03c2cc7800/0x9383f985bc4d40c6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201296.863783:0:15175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03c2cc7800/0x9383f985bc4d40c6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201296.863789:0:15175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e03c2cc7800/0x9383f985bc4d40c6 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201296.863796:0:15175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e03c2cc7800/0x9383f985bc4d40c6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788201296.863905:0:15174:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:0.0:1788201296.864720:0:15175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201296.864726:0:15175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e03c2cc7800/0x9383f985bc4d40c6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201296.864734:0:15175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e03c2cc7800/0x9383f985bc4d40c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201296.864748:0:15175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e03c2cc7800/0x9383f985bc4d40c6 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201296.864761:0:15175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e03c2cc7800/0x9383f985bc4d40c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201296.864768:0:15175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c2cc7800/0x9383f985bc4d40c6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788201296.896283:0:15174:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788201296.896329:0:15174:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788201296.896373:0:15175:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788201296.896378:0:15175:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788201296.896400:0:15175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e04f9c0be00/0x9383f985bc4d40cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201296.896416:0:15175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e04f9c0be00/0x9383f985bc4d40cd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788201296.896426:0:15175:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000049501s 00010000:00010000:1.0:1788201296.896430:0:15175:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e04f9c0be00/0x9383f985bc4d40cd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201296.896438:0:15175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e04f9c0be00/0x9383f985bc4d40cd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201296.896445:0:15175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e04f9c0be00/0x9383f985bc4d40cd lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201296.896451:0:15175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e04f9c0be00/0x9383f985bc4d40cd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201296.896457:0:15175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0be00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201296.896470:0:15175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e04f9c0be00/0x9383f985bc4d40cd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201296.896477:0:15175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e04f9c0be00/0x9383f985bc4d40cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201296.896494:0:15175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e04f9c0be00/0x9383f985bc4d40cd lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201296.896501:0:15175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e04f9c0be00/0x9383f985bc4d40cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201296.896507:0:15175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e04f9c0be00/0x9383f985bc4d40cd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201296.901103:0:15194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cfeffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+7:15168:x1875064458232576:12345-0@lo:253:mount.lustre.0 Request processed in 39549us (41533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201296.901119:0:15194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788201296.902545:0:15168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:15168:1875064458232576:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788201296.902574:0:15168:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788201296.902578:0:15168:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788201296.902580:0:15168:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788201296.902581:0:15168:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201296.902582:0:15168:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201296.902583:0:15168:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201296.902584:0:15168:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201296.902585:0:15168:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201296.902587:0:15168:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788201296.902588:0:15168:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201296.902590:0:15168:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788201296.902613:0:15168:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e03c371d800 from lustre-MDT0000 10000000:01000000:3.0:1788201296.902641:0:15168:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788201296.902643:0:15168:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788201296.902652:0:15168:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e03c371d800 10000000:01000000:3.0:1788201296.902656:0:15168:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788201296.902660:0:15168:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e03c371d800 10000000:01000000:3.0:1788201296.902663:0:15168:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788201296.902666:0:15168:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9e03c371d800 from 1 10000000:01000000:3.0:1788201296.902669:0:15168:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788201296.902704:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3400/0x9383f985bc4d40d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201296.902715:0:15168:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3400/0x9383f985bc4d40d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201296.902725:0:15168:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3400/0x9383f985bc4d40d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201296.902744:0:15168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:15168:1875064458232704:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201296.902793:0:15168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201296.902964:0:15168:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f85a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201296.903028:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458232704 00000100:00100000:0.0:1788201296.903034:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458232704 00000100:00100000:0.0:1788201296.903080:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788201296.903089:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cfeff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+7:15168:x1875064458232704:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201296.903101:0:15172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201296.903113:0:15172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c2cc7800/0x9383f985bc4d40db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d40d4 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201296.903134:0:15172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c2cc7800/0x9383f985bc4d40db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d40d4 expref: 8 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201296.903143:0:15172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c2cc7800/0x9383f985bc4d40db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d40d4 expref: 8 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201296.903152:0:15172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc7800, rc 0) 00000100:00100000:0.0:1788201296.903187:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cfeff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+8:15168:x1875064458232704:12345-0@lo:101:mount.lustre.0 Request processed in 99us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201296.903193:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788201296.903486:0:15173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04fae06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+7:3313:x1875064458232320:12345-0@lo:253:kworker.0 Request processed in 194043us (194254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201296.903493:0:15173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788201296.903889:0:15168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:15168:1875064458232704:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201296.903903:0:15168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3400/0x9383f985bc4d40d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d40db expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201296.903913:0:15168:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3400/0x9383f985bc4d40d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d40db expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201296.903929:0:15168:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788201296.903945:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3400/0x9383f985bc4d40d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d40db expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201296.903952:0:15168:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3400/0x9383f985bc4d40d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d40db expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201296.903959:0:15168:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788201296.903964:0:15168:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788201296.903969:0:15168:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e03c371d800 10000000:01000000:3.0:1788201296.903972:0:15168:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788201296.903975:0:15168:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788201296.903977:0:15168:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788201296.903994:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2c00/0x9383f985bc4d40e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201296.904002:0:15168:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2c00/0x9383f985bc4d40e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201296.904010:0:15168:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2c00/0x9383f985bc4d40e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201296.904022:0:15168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:15168:1875064458232832:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201296.904050:0:15168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201296.904067:0:15168:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f85a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201296.904085:0:15194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458232832 00000100:00100000:3.0:1788201296.904089:0:15194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458232832 00000100:00100000:3.0:1788201296.904110:0:15194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788201296.904116:0:15194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cfefe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+7:15168:x1875064458232832:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201296.904124:0:15194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201296.904134:0:15194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c20c2800/0x9383f985bc4d40e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d40e2 expref: -99 pid: 15194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201296.904148:0:15194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c20c2800/0x9383f985bc4d40e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d40e2 expref: 8 pid: 15194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201296.904156:0:15194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c20c2800/0x9383f985bc4d40e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d40e2 expref: 8 pid: 15194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201296.904168:0:15194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2800, rc 0) 00000100:00100000:3.0:1788201296.904196:0:15194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cfefe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+8:15168:x1875064458232832:12345-0@lo:101:mount.lustre.0 Request processed in 79us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201296.904202:0:15194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788201296.904235:0:15168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:15168:1875064458232832:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201296.904245:0:15168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2c00/0x9383f985bc4d40e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d40e9 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201296.904252:0:15168:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2c00/0x9383f985bc4d40e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d40e9 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201296.904290:0:15168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:15168:1875064458232960:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201296.904338:0:15168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201296.904626:0:15168:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f85a80 going to sleep for 11 seconds 00000020:01000004:1.0:1788201296.904783:0:3313:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1788201296.904787:0:3313:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201296.904788:0:3313:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201296.904789:0:3313:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201296.904790:0:3313:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201296.904792:0:3313:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201296.904794:0:3313:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201296.904795:0:3313:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201296.904796:0:3313:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1788201296.904809:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458232320:0@lo:253:kworker.0 00000100:00100000:0.0:1788201296.904919:0:15173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458232960 00000100:00100000:0.0:1788201296.904924:0:15173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458232960 00000100:00100000:0.0:1788201296.904945:0:15173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788201296.904951:0:15173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cfefcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+8:15168:x1875064458232960:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201296.905782:0:15173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cfefcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+9:15168:x1875064458232960:12345-0@lo:501:mount.lustre.0 Request processed in 828us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201296.905791:0:15173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788201296.906063:0:15168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:15168:1875064458232960:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201296.906106:0:15168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:15168:1875064458233088:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201296.906151:0:15168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201296.906184:0:15168:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f85a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201296.906240:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458233088 00000100:00100000:2.0:1788201296.906246:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458233088 00000100:00100000:2.0:1788201296.906283:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788201296.906291:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cfefdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+9:15168:x1875064458233088:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201296.910226:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cfefdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+9:15168:x1875064458233088:12345-0@lo:503:mount.lustre.0 Request processed in 3929us (4066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201296.910240:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788201296.910397:0:15168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:15168:1875064458233088:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201296.910984:0:15197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53e8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:15197:1875064458233216:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201296.911033:0:15197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201296.911072:0:15197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c1d213c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201296.911128:0:15173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458233216 00000100:00100000:1.0:1788201296.911135:0:15173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458233216 00000100:00100000:1.0:1788201296.911180:0:15173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788201296.911189:0:15173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cfefd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+9:15197:x1875064458233216:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201296.914085:0:15173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cfefd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+9:15197:x1875064458233216:12345-0@lo:502:llog_process_th.0 Request processed in 2890us (3044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201296.914099:0:15173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201296.914415:0:15197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53e8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:15197:1875064458233216:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201296.914468:0:15197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201296.914481:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201296.914484:0:15197:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788201296.914489:0:15197:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788201296.914492:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201296.914506:0:15197:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9e04d1c30000) 00000020:00000080:3.0:1788201296.914528:0:15197:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788201296.914534:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788201296.914622:0:15197:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788201296.914631:0:15197:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d40f7 00000020:00000080:3.0:1788201296.914969:0:15197:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788201296.914975:0:15197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201296.914979:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201296.914980:0:15197:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788201296.914983:0:15197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201296.914987:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201296.914988:0:15197:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788201296.914991:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201296.914998:0:15197:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9e04d1c319c0) 00000020:00000080:3.0:1788201296.915009:0:15197:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788201296.915012:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788201296.915014:0:15197:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788201296.915017:0:15197:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788201296.915022:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788201296.915062:0:15197:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e03c371d800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788201296.915081:0:15197:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9e04eadcb380) 00000020:00000080:3.0:1788201296.915091:0:15197:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788201296.915134:0:15197:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788201296.915139:0:15197:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9383f985bc4d410c 00000020:00000080:3.0:1788201296.915243:0:15197:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788201296.915249:0:15197:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788201296.915254:0:15197:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9383f985bc4d4113 00080000:01000000:3.0:1788201296.915259:0:15197:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788201296.915262:0:15197:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d411a 00000100:00100000:1.0:1788201296.923694:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04fae06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+8:3310:x1875064458232448:12345-0@lo:253:kworker.0 Request processed in 214094us (214362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201296.923709:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:2.0:1788201296.923718:0:3310:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788201296.923722:0:3310:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788201296.923723:0:3310:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201296.923724:0:3310:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201296.923725:0:3310:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201296.923727:0:3310:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201296.923728:0:3310:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201296.923730:0:3310:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201296.923731:0:3310:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788201296.923735:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458232448:0@lo:253:kworker.0 00010000:00010000:0.0:1788201296.990418:0:15197:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-3 is initialized 00000001:00080000:0.0:1788201296.993450:0:15197:0:(tgt_lastrcvd.c:1749:tgt_clients_data_init()) RCVRNG CLIENT uuid: 35604eb4-baf9-45be-a20a-4883a2cd8cf9 idx: 0 lr: 0 srv lr: 8589934592 lx: 0 gen 2 00000001:00000004:0.0:1788201296.993514:0:15197:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934592 00000001:00080000:0.0:1788201296.994674:0:15197:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:0.0:1788201296.994761:0:15197:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04c1370780: xid 1875064442669696, transno 8589938723, client gen 2, slot idx 0 00000001:00080000:0.0:1788201296.994774:0:15197:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04d20ce9c0: xid 1875064442670208, transno 8589938724, client gen 2, slot idx 1 00000001:00080000:0.0:1788201296.994781:0:15197:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04d20ce840: xid 1875064442645120, transno 8589938679, client gen 2, slot idx 2 00000001:00080000:0.0:1788201296.994791:0:15197:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04d20ce6c0: xid 1875064442645888, transno 8589938680, client gen 2, slot idx 3 00000001:00080000:0.0:1788201296.994867:0:15197:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04d20cef00: xid 1875064442646912, transno 8589938681, client gen 2, slot idx 4 00000001:00080000:0.0:1788201296.994889:0:15197:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04d20ced80: xid 1875064442648192, transno 8589938682, client gen 2, slot idx 5 00000001:00080000:0.0:1788201296.994899:0:15197:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04d20cee40: xid 1875064442647552, transno 8589938683, client gen 2, slot idx 6 00000001:00080000:0.0:1788201296.994905:0:15197:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04d20ce300: xid 1875064442648576, transno 8589938684, client gen 2, slot idx 7 00000020:00000080:0.0:1788201296.995265:0:15197:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9e04ff1e3380) 00000020:00000080:0.0:1788201296.995289:0:15197:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788201296.995387:0:15197:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788201296.995394:0:15197:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d412f 00000020:00000080:0.0:1788201296.998414:0:15197:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788201297.015675:0:15197:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9383f985bc4d4136 00000020:00000080:3.0:1788201297.016271:0:15197:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788201297.016284:0:15197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201297.016290:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201297.016313:0:15197:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788201297.016317:0:15197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201297.016323:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201297.016325:0:15197:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788201297.016329:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788201297.016363:0:15197:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788201297.016376:0:15197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201297.016379:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201297.016380:0:15197:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788201297.016383:0:15197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788201297.016385:0:15197:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #10 00000020:01000000:3.0:1788201297.016387:0:15197:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201297.016389:0:15197:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201297.016390:0:15197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788201297.016392:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201297.016393:0:15197:0:(obd_config.c:1561:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788201297.016396:0:15197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788201297.016399:0:15197:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788201297.016402:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201297.016404:0:15197:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788201297.016407:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788201297.016412:0:15197:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.130@tcp to nid 0x20000c0a8c982 (192.168.201.130@tcp) 00000020:01000000:3.0:1788201297.016437:0:15197:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788201297.016440:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201297.016454:0:15197:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9e04eadc99c0) 00000020:00000080:3.0:1788201297.016481:0:15197:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788201297.016486:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788201297.016537:0:15197:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788201297.016542:0:15197:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788201297.016547:0:15197:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d4144 00010000:00080000:3.0:1788201297.016578:0:15197:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e04cff4b000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.130@tcp at head 00010000:00010000:3.0:1788201297.016818:0:15197:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788201297.017123:0:15197:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788201297.017163:0:15197:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788201297.025596:0:15197:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 1, last_idx 2 00000040:00080000:3.0:1788201297.026625:0:15197:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201297.027238:0:15197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1788201297.027575:0:15197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1788201297.028073:0:15201:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 3 synced_idx: 0 lgh_last_idx: 3 00000040:00080000:0.0:1788201297.028079:0:15201:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1788201297.029196:0:15201:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 2, last_idx 3 00000040:00080000:0.0:1788201297.029219:0:15201:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1788201297.029265:0:15201:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788201297.029268:0:15201:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788201297.030168:0:15197:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201297.030181:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788201297.030215:0:15197:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788201297.030239:0:15197:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9383f985bc4d414b 00000100:00080000:3.0:1788201297.030249:0:15197:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201297.030255:0:15197:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e04cff4b000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1788201297.030290:0:15197:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e04cffaea00 x1875064458233344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201297.030529:0:15197:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788201297.030622:0:15197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201297.030627:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201297.030629:0:15197:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788201297.030632:0:15197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788201297.030635:0:15197:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1788201297.030637:0:15197:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201297.030638:0:15197:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201297.030639:0:15197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788201297.030642:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201297.030643:0:15197:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788201297.030645:0:15197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788201297.030649:0:15197:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788201297.030653:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201297.030654:0:15197:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788201297.030657:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788201297.030660:0:15197:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.130@tcp to nid 0x20000c0a8c982 (192.168.201.130@tcp) 00000020:01000000:3.0:1788201297.030684:0:15197:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788201297.030686:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201297.030697:0:15197:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9e04eadc8000) 00000020:00000080:3.0:1788201297.030714:0:15197:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788201297.030718:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788201297.030775:0:15197:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788201297.030780:0:15197:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788201297.030785:0:15197:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d4159 00010000:00080000:3.0:1788201297.030918:0:15197:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e04c8363800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.130@tcp at head 00010000:00010000:3.0:1788201297.031140:0:15197:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-4 is initialized 00000100:00100000:1.0:1788201297.031487:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458233344:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788201297.031555:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201297.031718:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458233344 00000100:00100000:3.0:1788201297.031725:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458233344 00000100:00100000:3.0:1788201297.031757:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4224 00000100:00100000:3.0:1788201297.031765:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3309:x1875064458233344:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1788201297.031791:0:13438:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 572 last 0 00000040:01000000:2.0:1788201297.031971:0:15197:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788201297.032003:0:15197:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000020:00000080:3.0:1788201297.032928:0:13438:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9383f985bc4d4160 00002000:00100000:3.0:1788201297.032947:0:13438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9e04c6b8b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788201297.032952:0:13438:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788201297.032954:0:13438:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788201297.033121:0:13438:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788201297.033148:0:13438:0:(import.c:65:import_set_state_nolock()) ffff9e04c8354000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201297.033219:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3309:x1875064458233344:12345-0@lo:8:llog_process_th.0 Request processed in 1452us (1662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201297.033228:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4224 00000100:00100000:3.0:1788201297.033278:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201297.033286:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788201297.033310:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788201297.033315:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788201297.033318:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04cff4b000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788201297.033333:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788201297.033338:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458233344:0@lo:8:llog_process_th.0 00000040:00080000:2.0:1788201297.033485:0:15197:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 1, last_idx 2 00000004:00080000:3.0:1788201297.034110:0:15201:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788201297.034178:0:15201:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 572291883668ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788201297.034377:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458233472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201297.034425:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201297.034491:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458233472 00000100:00100000:2.0:1788201297.034497:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458233472 00000100:00100000:2.0:1788201297.034542:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788201297.034552:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875064458233472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201297.034581:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 525008896 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1788201297.034619:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875064458233472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201297.034626:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788201297.034668:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458233472:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788201297.034696:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201297.035153:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201297.035159:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201297.035162:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201297.035165:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788201297.035387:0:15197:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201297.035989:0:15197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1788201297.036067:0:15197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:2.0:1788201297.037220:0:15203:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 3 synced_idx: 0 lgh_last_idx: 3 00000040:00080000:2.0:1788201297.037225:0:15203:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788201297.038727:0:15197:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201297.038741:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788201297.038772:0:15197:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788201297.038793:0:15197:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9383f985bc4d4167 00000100:00080000:3.0:1788201297.038886:0:15197:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201297.038893:0:15197:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e04c8363800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1788201297.038928:0:15197:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e04cffaea00 x1875064458233600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201297.038954:0:15197:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788201297.038983:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201297.038988:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201297.038992:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201297.038995:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1788201297.039032:0:15197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201297.039036:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201297.039037:0:15197:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788201297.039040:0:15197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201297.039043:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201297.039045:0:15197:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788201297.039048:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788201297.039050:0:15197:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788201297.039053:0:15197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201297.039055:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201297.039056:0:15197:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788201297.039059:0:15197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201297.039061:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201297.039062:0:15197:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788201297.039065:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788201297.039094:0:15197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffadc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:15197:1875064458233728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201297.039168:0:15197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201297.039202:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458233728 00000100:00100000:3.0:1788201297.039208:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458233728 00000100:00100000:3.0:1788201297.039242:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201297.039252:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cfefc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+8:15197:x1875064458233728:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201297.039468:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458233600:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788201297.039504:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201297.039560:0:15197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04e18a8900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201297.039797:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cfefc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+8:15197:x1875064458233728:12345-0@lo:502:llog_process_th.0 Request processed in 546us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201297.041180:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788201297.046973:0:13442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458233600 00000100:00100000:0.0:1788201297.046987:0:13442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458233600 00000100:00100000:0.0:1788201297.047024:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4225 00000100:00100000:0.0:1788201297.047032:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:3309:x1875064458233600:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1788201297.047061:0:13442:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 572 last 0 00000020:00000080:0.0:1788201297.047094:0:13442:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9383f985bc4d416e 00002000:00100000:0.0:1788201297.047109:0:13442:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9e04f0044800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788201297.047114:0:13442:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788201297.047117:0:13442:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788201297.047325:0:13442:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788201297.047497:0:13442:0:(import.c:65:import_set_state_nolock()) ffff9e04ff44d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201297.047711:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3309:x1875064458233600:12345-0@lo:8:llog_process_th.0 Request processed in 678us (8205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201297.047720:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4225 00000100:00100000:2.0:1788201297.048034:0:15197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffadc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:15197:1875064458233728:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788201297.048072:0:15197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201297.048079:0:15197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201297.048081:0:15197:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788201297.048086:0:15197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788201297.048500:0:15168:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1788201297.048521:0:15168:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788201297.048539:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2c00/0x9383f985bc4d40e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d40e9 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.048549:0:15168:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2c00/0x9383f985bc4d40e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d40e9 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201297.048557:0:15168:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e03c371d800 from 1 10000000:01000000:3.0:1788201297.048560:0:15168:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788201297.048591:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2400/0x9383f985bc4d4175 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.048598:0:15168:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2400/0x9383f985bc4d4175 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.048608:0:15168:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2400/0x9383f985bc4d4175 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201297.048627:0:15168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:15168:1875064458233856:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201297.048672:0:15168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201297.048704:0:15168:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04e18a8900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201297.049308:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788201297.049318:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788201297.049325:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788201297.049330:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788201297.049333:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04c8363800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788201297.049465:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788201297.049473:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458233600:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788201297.049507:0:15173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458233856 00000100:00100000:1.0:1788201297.049513:0:15173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458233856 00000100:00100000:1.0:1788201297.049552:0:15173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788201297.049560:0:15173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cfeff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+8:15168:x1875064458233856:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201297.049572:0:15173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201297.049585:0:15173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e04f9c0be00/0x9383f985bc4d417c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d4175 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201297.049607:0:15173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e04f9c0be00/0x9383f985bc4d417c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d4175 expref: 9 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201297.049618:0:15173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e04f9c0be00/0x9383f985bc4d417c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d4175 expref: 9 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201297.049626:0:15173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9c0be00, rc 0) 00000100:00100000:1.0:1788201297.049669:0:15173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cfeff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+9:15168:x1875064458233856:12345-0@lo:101:mount.lustre.0 Request processed in 111us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201297.049676:0:15173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788201297.049747:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458233984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201297.049775:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201297.049819:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458233984 00000100:00100000:1.0:1788201297.049824:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458233984 00000100:00100000:1.0:1788201297.049856:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788201297.049863:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875064458233984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201297.049886:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 13631488 granted 525008896 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201297.049918:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875064458233984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201297.049924:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:1.0:1788201297.049938:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201297.049962:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458233984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201297.050031:0:15168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:15168:1875064458233856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201297.050044:0:15168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2400/0x9383f985bc4d4175 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d417c expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.050055:0:15168:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2400/0x9383f985bc4d4175 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d417c expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201297.050638:0:15168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:15168:1875064458234112:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788201297.050679:0:15168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201297.050704:0:15168:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04e18a8900 going to sleep for 11 seconds 00000040:00080000:3.0:1788201297.050819:0:15203:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 510 count 4 00000040:00080000:3.0:1788201297.050847:0:15203:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788201297.050850:0:15203:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000004:00080000:3.0:1788201297.050878:0:15203:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788201297.051112:0:15203:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572308817099ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788201297.051264:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458234240:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201297.051329:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201297.051485:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458234240 00000100:00100000:3.0:1788201297.051491:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458234240 00000100:00100000:3.0:1788201297.051533:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4226 00000100:00100000:3.0:1788201297.051543:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3313:x1875064458234240:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788201297.051568:0:13439:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1051 count 1 00000100:00100000:3.0:1788201297.051813:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3313:x1875064458234240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 271us (482us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201297.051820:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4226 00000004:00080000:1.0:1788201297.051896:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cffadf80, transno 0 00000004:00080000:1.0:1788201297.051902:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04cffadf80/1, rc -2, transno 0 00000100:00100000:1.0:1788201297.051917:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458234240:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201297.053102:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458234368:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201297.053147:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201297.053184:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201297.053190:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458234496:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201297.053208:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201297.053243:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458234368 00000100:00100000:2.0:1788201297.053248:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458234368 00000100:00100000:2.0:1788201297.053278:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458234496 00000100:00100000:2.0:1788201297.053281:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458234496 00000100:00100000:2.0:1788201297.053316:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4227 00000100:00100000:2.0:1788201297.053323:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+7:3310:x1875064458234368:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201297.053353:0:13445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1052 count 1 00000100:00100000:2.0:1788201297.053600:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+7:3310:x1875064458234368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 276us (451us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201297.053607:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4227 00000100:00100000:2.0:1788201297.053622:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4228 00000100:00100000:2.0:1788201297.053627:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3310:x1875064458234496:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201297.053637:0:13445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1050 count 1 00000100:00100000:2.0:1788201297.053819:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3310:x1875064458234496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 191us (609us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201297.053825:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4228 00000004:00080000:2.0:1788201297.053856:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cffaea00, transno 0 00000004:00080000:2.0:1788201297.053861:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04cffaea00/1, rc -2, transno 0 00000100:00100000:2.0:1788201297.053871:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458234496:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788201297.053878:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04cffad180, transno 0 00000004:00080000:2.0:1788201297.053881:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04cffad180/1, rc -2, transno 0 00000100:00100000:2.0:1788201297.053884:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458234368:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201297.053901:0:15194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458234112 00000100:00100000:2.0:1788201297.053905:0:15194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458234112 00000100:00100000:2.0:1788201297.053928:0:15194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788201297.053935:0:15194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cfefd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+9:15168:x1875064458234112:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788201297.053949:0:15194:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788201297.053966:0:15194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788201297.053970:0:15194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788201297.053972:0:15194:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 10 00000100:00100000:2.0:1788201297.054050:0:15194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cfefd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+9:15168:x1875064458234112:12345-0@lo:256:mount.lustre.0 Request processed in 115us (3370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201297.054057:0:15194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000040:00080000:2.0:1788201297.054486:0:15203:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 2, last_idx 3 00000040:00080000:2.0:1788201297.054519:0:15203:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:3.0:1788201297.055185:0:15168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:15168:1875064458234112:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788201297.055967:0:15168:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788201297.055991:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2400/0x9383f985bc4d4175 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d417c expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.056002:0:15168:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2400/0x9383f985bc4d4175 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d417c expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201297.056011:0:15168:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e03c371d800 from 1 10000000:01000000:3.0:1788201297.056013:0:15168:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788201297.056046:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3200/0x9383f985bc4d4183 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.056053:0:15168:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3200/0x9383f985bc4d4183 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.056063:0:15168:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3200/0x9383f985bc4d4183 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201297.056082:0:15168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:15168:1875064458234624:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201297.056138:0:15168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201297.056180:0:15168:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04e18a8900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201297.056286:0:15173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458234624 00000100:00100000:0.0:1788201297.056306:0:15173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458234624 00000100:00100000:0.0:1788201297.056427:0:15173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788201297.056436:0:15173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cfefec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+9:15168:x1875064458234624:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201297.056449:0:15173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201297.056472:0:15173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c2cc7a00/0x9383f985bc4d418a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d4183 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201297.056493:0:15173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c2cc7a00/0x9383f985bc4d418a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d4183 expref: 10 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201297.056502:0:15173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c2cc7a00/0x9383f985bc4d418a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d4183 expref: 10 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201297.056511:0:15173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc7a00, rc 0) 00000100:00100000:0.0:1788201297.056546:0:15173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cfefec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+10:15168:x1875064458234624:12345-0@lo:101:mount.lustre.0 Request processed in 112us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201297.056553:0:15173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788201297.056687:0:15168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:15168:1875064458234624:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201297.056701:0:15168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3200/0x9383f985bc4d4183 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d418a expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.056713:0:15168:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3200/0x9383f985bc4d4183 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d418a expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201297.056765:0:15168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:15168:1875064458234752:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201297.056789:0:15168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201297.056847:0:15168:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04e18a8900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201297.061505:0:15194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458234752 00000100:00100000:2.0:1788201297.061519:0:15194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458234752 00000100:00100000:2.0:1788201297.061574:0:15194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788201297.061584:0:15194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cfefe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+10:15168:x1875064458234752:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201297.062034:0:15194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cfefe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+10:15168:x1875064458234752:12345-0@lo:501:mount.lustre.0 Request processed in 450us (5242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201297.062042:0:15194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788201297.062367:0:15168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:15168:1875064458234752:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201297.062439:0:15168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:15168:1875064458234880:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201297.062516:0:15168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201297.062552:0:15168:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04e18a8900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201297.062708:0:15173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458234880 00000100:00100000:2.0:1788201297.062713:0:15173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458234880 00000100:00100000:2.0:1788201297.062748:0:15173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788201297.062756:0:15173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1c9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+10:15168:x1875064458234880:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201297.062980:0:15173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1c9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+10:15168:x1875064458234880:12345-0@lo:503:mount.lustre.0 Request processed in 226us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201297.062987:0:15173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788201297.063073:0:15168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:15168:1875064458234880:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201297.064429:0:15205:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:15205:1875064458235008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201297.064515:0:15205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201297.064553:0:15205:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04e18a8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201297.064676:0:15194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458235008 00000100:00100000:2.0:1788201297.064683:0:15194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458235008 00000100:00100000:2.0:1788201297.064724:0:15194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788201297.064732:0:15194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1c9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+10:15205:x1875064458235008:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201297.068025:0:15194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1c9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+10:15205:x1875064458235008:12345-0@lo:502:llog_process_th.0 Request processed in 3285us (3502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201297.068040:0:15194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788201297.071108:0:15205:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:15205:1875064458235008:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201297.071156:0:15205:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201297.071168:0:15205:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201297.071171:0:15205:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788201297.071180:0:15205:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e03c371d800 00000020:00000080:3.0:1788201297.071183:0:15205:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788201297.071190:0:15205:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201297.071192:0:15205:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201297.071193:0:15205:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788201297.071195:0:15205:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201297.071198:0:15205:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201297.071200:0:15205:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788201297.071203:0:15205:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e03c371d800 00000020:00000080:3.0:1788201297.071205:0:15205:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788201297.072936:0:15205:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:15205:1875064458235136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201297.073015:0:15205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201297.073052:0:15205:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04e18a8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201297.073395:0:15173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458235136 00000100:00100000:3.0:1788201297.073402:0:15173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458235136 00000100:00100000:3.0:1788201297.074055:0:15173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788201297.074067:0:15173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1c9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+10:15205:x1875064458235136:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201297.074273:0:15173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1c9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+10:15205:x1875064458235136:12345-0@lo:502:llog_process_th.0 Request processed in 209us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201297.074281:0:15173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788201297.078413:0:15205:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:15205:1875064458235136:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788201297.078466:0:15205:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201297.078474:0:15205:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201297.078476:0:15205:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788201297.078481:0:15205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788201297.084909:0:15168:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1788201297.084944:0:15168:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788201297.084963:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3200/0x9383f985bc4d4183 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d418a expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201297.084975:0:15168:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3200/0x9383f985bc4d4183 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d418a expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201297.085022:0:15168:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788201297.085024:0:15168:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e03c371d800 10000000:01000000:2.0:1788201297.085027:0:15168:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e03c371d800 10000000:01000000:2.0:1788201297.085032:0:15168:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788201297.085037:0:15168:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e03c371d800 from 1 10000000:01000000:2.0:1788201297.085039:0:15168:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788201297.085073:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97e00/0x9383f985bc4d4191 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201297.085080:0:15168:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97e00/0x9383f985bc4d4191 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201297.085090:0:15168:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97e00/0x9383f985bc4d4191 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201297.085114:0:15168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:15168:1875064458235264:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201297.085176:0:15168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201297.085213:0:15168:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c5e34b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201297.085240:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458235264 00000100:00100000:2.0:1788201297.085246:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458235264 00000100:00100000:2.0:1788201297.085286:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788201297.085313:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1c9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+10:15168:x1875064458235264:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201297.085329:0:15172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201297.086428:0:15172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c1b96200/0x9383f985bc4d4198 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d4191 expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201297.086472:0:15172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c1b96200/0x9383f985bc4d4198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d4191 expref: 11 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201297.086483:0:15172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c1b96200/0x9383f985bc4d4198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d4191 expref: 11 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201297.086492:0:15172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c1b96200, rc 0) 00000100:00100000:2.0:1788201297.086548:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1c9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+11:15168:x1875064458235264:12345-0@lo:101:mount.lustre.0 Request processed in 1254us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201297.086555:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788201297.086682:0:15168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:15168:1875064458235264:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201297.086698:0:15168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97e00/0x9383f985bc4d4191 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4198 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201297.086707:0:15168:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97e00/0x9383f985bc4d4191 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d4198 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201297.086764:0:15168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:15168:1875064458235392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201297.086794:0:15168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201297.086979:0:15168:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c5e34b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201297.088427:0:15194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458235392 00000100:00100000:3.0:1788201297.088437:0:15194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458235392 00000100:00100000:3.0:1788201297.088490:0:15194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788201297.088499:0:15194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1c98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+11:15168:x1875064458235392:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201297.088731:0:15194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1c98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+11:15168:x1875064458235392:12345-0@lo:501:mount.lustre.0 Request processed in 233us (1935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201297.088738:0:15194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788201297.088853:0:15168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:15168:1875064458235392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201297.088903:0:15168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:15168:1875064458235520:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201297.088958:0:15168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201297.088992:0:15168:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c5e34b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201297.089113:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458235520 00000100:00100000:3.0:1788201297.089117:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458235520 00000100:00100000:3.0:1788201297.089142:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788201297.089148:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1c99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+11:15168:x1875064458235520:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201297.089484:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1c99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+11:15168:x1875064458235520:12345-0@lo:503:mount.lustre.0 Request processed in 334us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201297.089492:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788201297.090758:0:15168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:15168:1875064458235520:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201297.091025:0:15208:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffadf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:15208:1875064458235648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201297.091080:0:15208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201297.091113:0:15173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458235648 00000100:00100000:3.0:1788201297.091118:0:15173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458235648 00000100:00100000:3.0:1788201297.091149:0:15173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788201297.091156:0:15173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1c9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+11:15208:x1875064458235648:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201297.091466:0:15173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1c9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+11:15208:x1875064458235648:12345-0@lo:502:llog_process_th.0 Request processed in 300us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201297.091474:0:15173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788201297.091521:0:15208:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c5e34b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201297.091534:0:15208:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffadf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:15208:1875064458235648:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788201297.091583:0:15208:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788201297.091598:0:15208:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9e04eadccd40) 00000020:00000080:3.0:1788201297.091621:0:15208:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788201297.093468:0:15208:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e03c371d800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788201297.093477:0:15208:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e03c371d800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788201297.093480:0:15208:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e03c371d800 4 00010000:00080000:3.0:1788201297.093528:0:15208:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e04c8284000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.130@tcp at head 00010000:00010000:3.0:1788201297.103661:0:15208:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-5 is initialized 00000020:00000080:3.0:1788201297.103772:0:15208:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788201297.103812:0:15208:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788201297.103826:0:15208:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9383f985bc4d41a6 00000100:00080000:3.0:1788201297.103837:0:15208:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201297.103843:0:15208:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e04c8284000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1788201297.103877:0:15208:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e04cffadf80 x1875064458235776/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201297.103927:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875064458235776:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788201297.103997:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201297.104070:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458235776 00000100:00100000:3.0:1788201297.104076:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458235776 00000100:00100000:3.0:1788201297.104105:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201297.104113:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875064458235776:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788201297.104163:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875064458235776:12345-0@lo:38:llog_process_th.0 Request processed in 50us (166us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788201297.104170:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201297.104203:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201297.104211:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04c8284000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201297.104223:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788201297.104227:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875064458235776:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788201297.104248:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201297.104253:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201297.104256:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201297.104258:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201297.104267:0:15208:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788201297.104277:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201297.104280:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201297.104282:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201297.104284:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788201297.108831:0:15208:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:15208:1875064458235904:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201297.108912:0:15208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201297.108957:0:15208:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d0405cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201297.109072:0:15194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458235904 00000100:00100000:3.0:1788201297.109079:0:15194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458235904 00000100:00100000:3.0:1788201297.109129:0:15194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788201297.109138:0:15194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1c9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+11:15208:x1875064458235904:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201297.109484:0:15194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1c9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+11:15208:x1875064458235904:12345-0@lo:502:llog_process_th.0 Request processed in 347us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201297.109492:0:15194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788201297.109584:0:15208:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:15208:1875064458235904:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788201297.109611:0:15208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788201297.109731:0:15168:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788201297.109751:0:15168:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788201297.109767:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97e00/0x9383f985bc4d4191 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4198 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.109778:0:15168:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97e00/0x9383f985bc4d4191 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4198 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788201297.109822:0:15168:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788201297.109825:0:15168:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788201297.109826:0:15168:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201297.109827:0:15168:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201297.109829:0:15168:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201297.109830:0:15168:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201297.109832:0:15168:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201297.109833:0:15168:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788201297.109835:0:15168:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201297.109836:0:15168:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788201297.109840:0:15168:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788201297.109842:0:15168:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788201297.109843:0:15168:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788201297.109844:0:15168:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201297.109846:0:15168:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201297.109846:0:15168:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201297.109847:0:15168:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201297.109848:0:15168:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201297.109850:0:15168:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788201297.109851:0:15168:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201297.109852:0:15168:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788201297.109866:0:15168:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788201297.109877:0:15168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:15168:1875064458236032:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788201297.109918:0:15168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201297.109935:0:15168:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c1d210c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201297.109958:0:15173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458236032 00000100:00100000:3.0:1788201297.109962:0:15173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458236032 00000100:00100000:3.0:1788201297.109987:0:15173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788201297.109993:0:15173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1c9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+11:15168:x1875064458236032:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788201297.110014:0:15173:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788201297.110027:0:15173:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000004:00080000:3.0:1788201297.113757:0:15196:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788201297.137986:0:15196:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 20000000:01000000:2.0:1788201297.162695:0:15173:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788201297.162744:0:15173:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788201297.164071:0:15175:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788201297.164079:0:15175:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788201297.164102:0:15175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e03c2cc7600/0x9383f985bc4d41ad lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201297.164120:0:15175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e04f9c0be00/0x9383f985bc4d417c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d4175 expref: 11 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201297.164128:0:15175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e03c2cc7600/0x9383f985bc4d41ad lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201297.164172:0:15175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e04f9c0be00/0x9383f985bc4d417c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9383f985bc4d4175 expref: 11 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201297.164184:0:15175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e04f9c0be00/0x9383f985bc4d417c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9383f985bc4d4175 expref: 11 pid: 15173 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201297.164198:0:15175:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:15175:1875064458236160:0@lo:104: 00000100:00100000:0.0:1788201297.164262:0:15175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201297.164332:0:15175:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8073000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201297.164418:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458236160 00000100:00100000:3.0:1788201297.164426:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458236160 00000100:00100000:3.0:1788201297.164476:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788201297.164485:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b60c000b-7335-444d-a8dc-1a5956712fb2+3:15175:x1875064458236160:12345-0@lo:104: 00010000:00010000:3.0:1788201297.164497:0:8463:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2400/0x9383f985bc4d4175 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9383f985bc4d417c expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.164669:0:8463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201297.164675:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b60c000b-7335-444d-a8dc-1a5956712fb2+3:15175:x1875064458236160:12345-0@lo:104: Request processed in 192us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201297.164682:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1788201297.164703:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201297.164709:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2400/0x9383f985bc4d4175 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9383f985bc4d417c expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.164720:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2400 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1788201297.164723:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2400/0x9383f985bc4d4175 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9383f985bc4d417c expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.164731:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2400/0x9383f985bc4d4175 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9383f985bc4d417c expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201297.164738:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2400/0x9383f985bc4d4175 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9383f985bc4d417c expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201297.164745:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201297.164772:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2400/0x9383f985bc4d4175 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9383f985bc4d417c expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.164779:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201297.164799:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2400/0x9383f985bc4d4175 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9383f985bc4d417c expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.164806:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2400/0x9383f985bc4d4175 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9383f985bc4d417c expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.164822:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201297.164823:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201297.164825:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201297.164907:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458236288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201297.164937:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201297.165328:0:15175:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:15175:1875064458236160:0@lo:104: 00010000:00010000:0.0:1788201297.165348:0:15175:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e03c2cc7600/0x9383f985bc4d41ad lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201297.167934:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458236288 00000100:00100000:3.0:1788201297.167947:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458236288 00010000:00010000:3.0:1788201297.167981:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e04f9c0be00/0x9383f985bc4d417c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9383f985bc4d4175 expref: 12 pid: 15173 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201297.168021:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1551 00000100:00100000:3.0:1788201297.168030:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b60c000b-7335-444d-a8dc-1a5956712fb2+12:3312:x1875064458236288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201297.168044:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201297.168050:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e04f9c0be00/0x9383f985bc4d417c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9383f985bc4d4175 expref: 12 pid: 15173 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.168062:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e04f9c0be00/0x9383f985bc4d417c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9383f985bc4d4175 expref: 12 pid: 15173 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.168077:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e04f9c0be00/0x9383f985bc4d417c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9383f985bc4d4175 expref: 12 pid: 15173 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.168092:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e03c2cc7600/0x9383f985bc4d41ad lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.168099:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c2cc7600/0x9383f985bc4d41ad lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788201297.168113:0:8524:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004034812s 00010000:00010000:3.0:1788201297.168117:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03c2cc7600/0x9383f985bc4d41ad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.168123:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03c2cc7600/0x9383f985bc4d41ad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.168129:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e03c2cc7600/0x9383f985bc4d41ad lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.168134:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e03c2cc7600/0x9383f985bc4d41ad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.168139:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201297.168144:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e03c2cc7600/0x9383f985bc4d41ad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.168150:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e03c2cc7600/0x9383f985bc4d41ad lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.168166:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e03c2cc7600/0x9383f985bc4d41ad lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.168175:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201297.168241:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b60c000b-7335-444d-a8dc-1a5956712fb2+11:3312:x1875064458236288:12345-0@lo:103:ldlm_bl.0 Request processed in 212us (3302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201297.168248:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1551 00000100:00100000:3.0:1788201297.168289:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458236288:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201297.168434:0:15175:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e03c2cc7600/0x9383f985bc4d41ad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.168443:0:15175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e03c2cc7600/0x9383f985bc4d41ad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.168449:0:15175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c2cc7600/0x9383f985bc4d41ad lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201297.168706:0:15173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1c9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+10:15168:x1875064458236032:12345-0@lo:253:mount.lustre.0 Request processed in 58711us (58786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201297.168715:0:15173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788201297.168813:0:15168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:15168:1875064458236032:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788201297.168826:0:15168:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788201297.168829:0:15168:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788201297.168830:0:15168:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788201297.168832:0:15168:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201297.168833:0:15168:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201297.168835:0:15168:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201297.168836:0:15168:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201297.168837:0:15168:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201297.168840:0:15168:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788201297.168841:0:15168:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201297.168843:0:15168:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788201297.168856:0:15168:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788201297.173770:0:15168:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788201297.174019:0:15168:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788201297.174284:0:15168:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788201297.174580:0:15168:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788201297.174848:0:15168:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788201297.174998:0:15168:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788201297.175856:0:15168:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788201297.176011:0:15168:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788201297.176261:0:15168:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788201297.176796:0:15168:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788201297.177045:0:15168:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788201297.177198:0:15168:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000040:01000000:1.0:1788201297.199132:0:15168:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788201297.199506:0:15214:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1788201297.202274:0:15214:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201297.204245:0:15214:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000bd0:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788201297.204371:0:15214:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788201297.204376:0:15214:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00080000:0.0:1788201297.204849:0:15213:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1788201297.204854:0:15213:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788201297.206565:0:15168:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788201297.206709:0:15168:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788201297.207122:0:15168:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788201297.207129:0:15168:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788201297.207248:0:15168:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201297.208603:0:15168:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788201297.209517:0:15168:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788201297.209559:0:15168:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788201297.209800:0:15168:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788201297.210759:0:15168:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00010000:00080000:2.0:1788201297.215973:0:15168:0:(ldlm_lib.c:3054:target_recovery_init()) RECOVERY: service lustre-MDT0000, 1 recoverable clients, last_transno 8589938724 00010000:00080000:1.0:1788201297.217011:0:15215:0:(ldlm_lib.c:2854:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 15215 00010000:00080000:1.0:1788201297.217185:0:15215:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 1 abort 0 expired 0 00010000:00080000:1.0:1788201297.217189:0:15215:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 1 abort 0 expired 0 00000020:01000004:2.0:1788201297.217262:0:15168:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788201297.217280:0:15168:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.130@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788201297.217661:0:15168:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788201297.217678:0:15168:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788201297.767139:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788201297.767391:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788201297.767396:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e03c371d800 from 11 10000000:01000000:0.0:1788201297.767400:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788201297.767452:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7400/0x9383f985bc4d41b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201297.767465:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7400/0x9383f985bc4d41b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201297.767476:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7400/0x9383f985bc4d41b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201297.767502:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458236416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201297.767570:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201297.767603:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c1177840 going to sleep for 11 seconds 00000100:00100000:3.0:1788201297.767660:0:15194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458236416 00000100:00100000:3.0:1788201297.767668:0:15194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458236416 00000100:00100000:3.0:1788201297.767723:0:15194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788201297.767732:0:15194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1c98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+10:5855:x1875064458236416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201297.767747:0:15194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201297.767760:0:15194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c20c2400/0x9383f985bc4d41bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d41b4 expref: -99 pid: 15194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.767782:0:15194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c20c2400/0x9383f985bc4d41bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d41b4 expref: 11 pid: 15194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.767791:0:15194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c20c2400/0x9383f985bc4d41bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d41b4 expref: 11 pid: 15194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.767800:0:15194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2400, rc 0) 00000100:00100000:3.0:1788201297.767840:0:15194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1c98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+11:5855:x1875064458236416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201297.767847:0:15194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788201297.768047:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458236416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201297.768061:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7400/0x9383f985bc4d41b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d41bb expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.768069:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7400/0x9383f985bc4d41b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d41bb expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201297.768125:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458236544:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788201297.768154:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201297.768171:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8073a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201297.768234:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458236544 00000100:00100000:0.0:1788201297.768239:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458236544 00000100:00100000:0.0:1788201297.768269:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788201297.768276:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1c99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+11:5855:x1875064458236544:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788201297.768290:0:15172:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788201297.768329:0:15172:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788201297.768332:0:15172:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1788201297.768405:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1c99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+11:5855:x1875064458236544:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201297.768412:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788201297.768514:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458236544:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788201297.768553:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788201297.768559:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7400/0x9383f985bc4d41b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d41bb expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.768567:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7400/0x9383f985bc4d41b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d41bb expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201297.768575:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788201297.768577:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e04c6b8b800 from 42 10000000:01000000:3.0:1788201297.768579:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201297.768592:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3800/0x9383f985bc4d41c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.768599:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3800/0x9383f985bc4d41c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.768606:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3800/0x9383f985bc4d41c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201297.768617:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458236672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201297.768640:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201297.768665:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8073a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201297.772067:0:15194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458236672 00000100:00100000:0.0:1788201297.772084:0:15194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458236672 00000100:00100000:0.0:1788201297.772152:0:15194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788201297.772163:0:15194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+11:5855:x1875064458236672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201297.772179:0:15194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201297.772197:0:15194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c2cc7c00/0x9383f985bc4d41c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d41c2 expref: -99 pid: 15194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201297.772224:0:15194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c2cc7c00/0x9383f985bc4d41c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d41c2 expref: 12 pid: 15194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201297.772235:0:15194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c2cc7c00/0x9383f985bc4d41c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d41c2 expref: 12 pid: 15194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201297.772243:0:15194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc7c00, rc 0) 00000100:00100000:0.0:1788201297.772340:0:15194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+12:5855:x1875064458236672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (3699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201297.772348:0:15194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788201297.772402:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458236672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201297.772419:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3800/0x9383f985bc4d41c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d41c9 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201297.772428:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3800/0x9383f985bc4d41c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d41c9 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201297.772507:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458236800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201297.772540:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201297.772567:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c1177900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201297.772581:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458236800 00000100:00100000:0.0:1788201297.772585:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458236800 00000100:00100000:0.0:1788201297.772609:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788201297.772615:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+12:5855:x1875064458236800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201297.772855:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+12:5855:x1875064458236800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201297.772862:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788201297.772906:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458236800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201297.772947:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458236928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201297.772984:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201297.772997:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c1177900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201297.773009:0:15194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458236928 00000100:00100000:0.0:1788201297.773013:0:15194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458236928 00000100:00100000:0.0:1788201297.773031:0:15194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788201297.773036:0:15194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+12:5855:x1875064458236928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201297.773158:0:15194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+12:5855:x1875064458236928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201297.773165:0:15194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788201297.773197:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458236928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788201297.773825:0:15235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 42 00000020:01000000:0.0:1788201297.773872:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 42-41 (rc=0) 10000000:01000000:0.0:1788201297.773888:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788201297.773896:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3800/0x9383f985bc4d41c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d41c9 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201297.773905:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3800/0x9383f985bc4d41c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d41c9 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201297.773914:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788201297.773917:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1788201297.773920:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788201297.773943:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7600/0x9383f985bc4d41d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201297.773950:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7600/0x9383f985bc4d41d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201297.773958:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7600/0x9383f985bc4d41d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201297.773971:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458237056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201297.774002:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201297.774023:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c11770c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201297.774030:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458237056 00000100:00100000:2.0:1788201297.774034:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458237056 00000100:00100000:2.0:1788201297.774064:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788201297.774072:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+12:5855:x1875064458237056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201297.774080:0:15174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201297.774090:0:15174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c1b97000/0x9383f985bc4d41d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d41d0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201297.774107:0:15174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c1b97000/0x9383f985bc4d41d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d41d0 expref: 13 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201297.774116:0:15174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c1b97000/0x9383f985bc4d41d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d41d0 expref: 13 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201297.774128:0:15174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c1b97000, rc 0) 00000100:00100000:2.0:1788201297.774166:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+13:5855:x1875064458237056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201297.774171:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788201297.781660:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458237056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201297.781690:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7600/0x9383f985bc4d41d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d41d7 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201297.781702:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7600/0x9383f985bc4d41d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d41d7 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201297.781786:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458237184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201297.781845:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201297.781978:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c11770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201297.787024:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458237184 00000100:00100000:1.0:1788201297.787040:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458237184 00000100:00100000:1.0:1788201297.787107:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788201297.787117:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+13:5855:x1875064458237184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201297.787590:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+13:5855:x1875064458237184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 474us (5743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201297.787600:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788201297.787673:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458237184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201297.787728:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458237312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201297.787776:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201297.787808:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f08f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201297.787822:0:15194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458237312 00000100:00100000:1.0:1788201297.787827:0:15194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458237312 00000100:00100000:1.0:1788201297.787853:0:15194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788201297.787860:0:15194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+13:5855:x1875064458237312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201297.806015:0:15194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+13:5855:x1875064458237312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 18146us (18230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201297.806032:0:15194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788201297.806147:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458237312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788201297.810435:0:15237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 11 00000020:01000000:0.0:1788201297.818480:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1788201297.818513:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788201297.818525:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7600/0x9383f985bc4d41d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d41d7 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201297.818538:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7600/0x9383f985bc4d41d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d41d7 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201297.818547:0:5855:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788201297.818550:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e04c6b8b800 from 7 10000000:01000000:0.0:1788201297.818553:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201297.818589:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d41de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201297.818597:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d41de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201297.818613:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d41de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201297.818638:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458237440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201297.818702:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201297.818740:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c1177900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201297.818761:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458237440 00000100:00100000:0.0:1788201297.818767:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458237440 00000100:00100000:0.0:1788201297.818807:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788201297.818816:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+13:5855:x1875064458237440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201297.818828:0:15172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201297.818840:0:15172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c2cc6000/0x9383f985bc4d41e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d41de expref: -99 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201297.818864:0:15172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c2cc6000/0x9383f985bc4d41e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d41de expref: 14 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201297.818875:0:15172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c2cc6000/0x9383f985bc4d41e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d41de expref: 14 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201297.818884:0:15172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc6000, rc 0) 00000100:00100000:0.0:1788201297.818936:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+14:5855:x1875064458237440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201297.818942:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788201297.818987:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458237440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201297.819000:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d41de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d41e5 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201297.819009:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d41de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d41e5 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201297.819054:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458237568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201297.819074:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201297.819085:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c1177900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201297.819524:0:15173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458237568 00000100:00100000:3.0:1788201297.819529:0:15173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458237568 00000100:00100000:3.0:1788201297.819561:0:15173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788201297.819569:0:15173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+14:5855:x1875064458237568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201297.819805:0:15173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+14:5855:x1875064458237568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201297.819813:0:15173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788201297.819861:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458237568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201297.819894:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458237696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201297.819933:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201297.819949:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8073300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201297.819961:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458237696 00000100:00100000:3.0:1788201297.819965:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458237696 00000100:00100000:3.0:1788201297.819986:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788201297.819991:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+14:5855:x1875064458237696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201297.820124:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+14:5855:x1875064458237696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201297.820131:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788201297.820167:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458237696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788201297.820883:0:15239:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788201297.820934:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788201297.820954:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201297.820962:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d41de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d41e5 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.820972:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d41de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d41e5 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201297.820980:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788201297.820982:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e04f9036000 from 42 10000000:01000000:3.0:1788201297.820985:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201297.821009:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2a00/0x9383f985bc4d41ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.821017:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2a00/0x9383f985bc4d41ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.821026:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2a00/0x9383f985bc4d41ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201297.821041:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458237824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201297.821072:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201297.821089:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8073b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201297.821105:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458237824 00000100:00100000:3.0:1788201297.821108:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458237824 00000100:00100000:3.0:1788201297.821133:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788201297.821140:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+14:5855:x1875064458237824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201297.821149:0:15174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201297.821160:0:15174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c20c3a00/0x9383f985bc4d41f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d41ec expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.821178:0:15174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c20c3a00/0x9383f985bc4d41f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d41ec expref: 15 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.821188:0:15174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c20c3a00/0x9383f985bc4d41f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d41ec expref: 15 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.821195:0:15174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3a00, rc 0) 00000100:00100000:3.0:1788201297.821223:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+15:5855:x1875064458237824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201297.821229:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788201297.821262:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458237824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201297.821273:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2a00/0x9383f985bc4d41ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d41f3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.821281:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2a00/0x9383f985bc4d41ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d41f3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201297.827885:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458237952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201297.827959:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201297.828010:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8073b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201297.828100:0:15173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458237952 00000100:00100000:1.0:1788201297.828109:0:15173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458237952 00000100:00100000:1.0:1788201297.828163:0:15173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788201297.828172:0:15173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cff09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+15:5855:x1875064458237952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201297.828471:0:15173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cff09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+15:5855:x1875064458237952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 299us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201297.828478:0:15173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788201297.828523:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458237952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201297.828560:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458238080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201297.828597:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201297.828612:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f080c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201297.828626:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458238080 00000100:00100000:1.0:1788201297.828629:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458238080 00000100:00100000:1.0:1788201297.828652:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788201297.828659:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1bee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+15:5855:x1875064458238080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201297.828794:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1bee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+15:5855:x1875064458238080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201297.828801:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788201297.828836:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458238080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788201297.840975:0:15240:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 42 00000020:01000000:3.0:1788201297.845354:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 42-41 (rc=0) 10000000:01000000:3.0:1788201297.845393:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788201297.845405:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2a00/0x9383f985bc4d41ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d41f3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.845418:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2a00/0x9383f985bc4d41ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d41f3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201297.845428:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788201297.845430:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1788201297.845434:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788201297.845485:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2600/0x9383f985bc4d41fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.845494:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2600/0x9383f985bc4d41fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.845506:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2600/0x9383f985bc4d41fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201297.845532:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458238208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201297.845905:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201297.845942:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8073b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201297.846006:0:15173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458238208 00000100:00100000:1.0:1788201297.846013:0:15173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458238208 00000100:00100000:1.0:1788201297.846065:0:15173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788201297.846076:0:15173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1bed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+15:5855:x1875064458238208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201297.846090:0:15173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201297.846102:0:15173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e04f9c0ac00/0x9383f985bc4d4201 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d41fa expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201297.846124:0:15173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e04f9c0ac00/0x9383f985bc4d4201 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d41fa expref: 16 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201297.846133:0:15173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e04f9c0ac00/0x9383f985bc4d4201 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d41fa expref: 16 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201297.846142:0:15173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9c0ac00, rc 0) 00000100:00100000:1.0:1788201297.846185:0:15173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1bed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+16:5855:x1875064458238208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201297.846192:0:15173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788201297.846347:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458238208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201297.846363:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2600/0x9383f985bc4d41fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4201 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.846372:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2600/0x9383f985bc4d41fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d4201 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201297.846423:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458238336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201297.846459:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201297.846477:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8073b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201297.846528:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458238336 00000100:00100000:1.0:1788201297.846532:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458238336 00000100:00100000:1.0:1788201297.846570:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788201297.846577:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1bef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+16:5855:x1875064458238336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201297.846970:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1bef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+16:5855:x1875064458238336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 393us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201297.846978:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788201297.847526:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458238336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201297.847574:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458238464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201297.847619:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201297.847640:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8073b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201297.847659:0:15194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458238464 00000100:00100000:3.0:1788201297.847663:0:15194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458238464 00000100:00100000:3.0:1788201297.847697:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201297.847705:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1bec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+16:5855:x1875064458238464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201297.853741:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1bec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+16:5855:x1875064458238464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 6028us (6113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201297.853756:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201297.857524:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458238464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788201297.869972:0:15242:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 14 00000020:01000000:3.0:1788201297.870040:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1788201297.870063:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788201297.870075:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2600/0x9383f985bc4d41fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4201 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.870087:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2600/0x9383f985bc4d41fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4201 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201297.870101:0:5855:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788201297.870104:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9e04c6718000 from 1 10000000:01000000:3.0:1788201297.870106:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788201297.870144:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3c00/0x9383f985bc4d4208 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.870152:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3c00/0x9383f985bc4d4208 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.870162:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3c00/0x9383f985bc4d4208 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201297.870186:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458238592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201297.870248:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201297.870311:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8073b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201297.870627:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458238592 00000100:00100000:1.0:1788201297.870635:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458238592 00000100:00100000:1.0:1788201297.870682:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788201297.870692:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1bee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+16:5855:x1875064458238592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201297.870705:0:15174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201297.870720:0:15174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e04f9c0b200/0x9383f985bc4d420f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d4208 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201297.870742:0:15174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e04f9c0b200/0x9383f985bc4d420f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d4208 expref: 17 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201297.870764:0:15174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e04f9c0b200/0x9383f985bc4d420f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d4208 expref: 17 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201297.870774:0:15174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9c0b200, rc 0) 00000100:00100000:1.0:1788201297.870815:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1bee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+17:5855:x1875064458238592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201297.870822:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788201297.871462:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458238592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201297.871479:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3c00/0x9383f985bc4d4208 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d420f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.871488:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3c00/0x9383f985bc4d4208 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d420f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201297.871506:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788201297.871511:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3c00/0x9383f985bc4d4208 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d420f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.871518:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3c00/0x9383f985bc4d4208 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d420f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201297.871530:0:5855:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788201297.871533:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e04f9036000 from 7 10000000:01000000:3.0:1788201297.871535:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788201297.871669:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3600/0x9383f985bc4d4216 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.871676:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3600/0x9383f985bc4d4216 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.871684:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3600/0x9383f985bc4d4216 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201297.871700:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458238720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201297.871736:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201297.871758:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8073b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201297.871778:0:15173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458238720 00000100:00100000:3.0:1788201297.871782:0:15173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458238720 00000100:00100000:3.0:1788201297.871815:0:15173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788201297.871822:0:15173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+17:5855:x1875064458238720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201297.871832:0:15173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201297.871844:0:15173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c5065000/0x9383f985bc4d421d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d4216 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.871859:0:15173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c5065000/0x9383f985bc4d421d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d4216 expref: 18 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.871868:0:15173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c5065000/0x9383f985bc4d421d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d4216 expref: 18 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.871879:0:15173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5065000, rc 0) 00000100:00100000:3.0:1788201297.871920:0:15173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+18:5855:x1875064458238720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201297.871927:0:15173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788201297.871956:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458238720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201297.871966:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3600/0x9383f985bc4d4216 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d421d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.871974:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3600/0x9383f985bc4d4216 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d421d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201297.872015:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458238848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201297.872039:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201297.872058:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8073b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201297.872072:0:15194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458238848 00000100:00100000:3.0:1788201297.872075:0:15194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458238848 00000100:00100000:3.0:1788201297.872097:0:15173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788201297.872102:0:15173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1befc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+18:5855:x1875064458238848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201297.874690:0:15173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1befc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+18:5855:x1875064458238848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2580us (2642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201297.874703:0:15173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788201297.874811:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458238848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201297.874861:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458238976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201297.874916:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201297.874946:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c1849cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201297.875039:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458238976 00000100:00100000:3.0:1788201297.875045:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458238976 00000100:00100000:3.0:1788201297.875083:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788201297.875090:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1bef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+18:5855:x1875064458238976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201297.875249:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1bef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+18:5855:x1875064458238976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201297.875256:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788201297.877588:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458238976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788201297.878998:0:15244:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788201297.884577:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788201297.884608:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201297.884620:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3600/0x9383f985bc4d4216 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d421d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.884632:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3600/0x9383f985bc4d4216 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d421d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201297.884641:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788201297.884644:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9e04c6718000 from 1 10000000:01000000:3.0:1788201297.884647:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788201297.884685:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c5064a00/0x9383f985bc4d4224 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.884694:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c5064a00/0x9383f985bc4d4224 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201297.884705:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c5064a00/0x9383f985bc4d4224 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201297.884729:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458239104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201297.884795:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201297.884840:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8073300 going to sleep for 11 seconds 00000100:00100000:2.0:1788201297.884963:0:15194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458239104 00000100:00100000:2.0:1788201297.884971:0:15194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458239104 00000100:00100000:2.0:1788201297.885022:0:15194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788201297.885031:0:15194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1bee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+18:5855:x1875064458239104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201297.885042:0:15194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201297.885055:0:15194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c1b96600/0x9383f985bc4d422b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d4224 expref: -99 pid: 15194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201297.885077:0:15194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c1b96600/0x9383f985bc4d422b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d4224 expref: 19 pid: 15194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201297.885090:0:15194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c1b96600/0x9383f985bc4d422b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d4224 expref: 19 pid: 15194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201297.885098:0:15194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c1b96600, rc 0) 00000100:00100000:2.0:1788201297.885148:0:15194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1bee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:5855:x1875064458239104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201297.885154:0:15194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788201297.885238:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458239104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201297.885253:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c5064a00/0x9383f985bc4d4224 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d422b expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201297.885261:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c5064a00/0x9383f985bc4d4224 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d422b expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201297.885354:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458239232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201297.885381:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201297.885402:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c1177840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201297.885521:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458239232 00000100:00100000:2.0:1788201297.885525:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458239232 00000100:00100000:2.0:1788201297.885562:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788201297.885569:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1becc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+19:5855:x1875064458239232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201297.885792:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1becc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+19:5855:x1875064458239232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 223us (410us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201297.885800:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788201297.885832:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458239232:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788201297.885855:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788201297.885860:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c5064a00/0x9383f985bc4d4224 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d422b expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201297.885867:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c5064a00/0x9383f985bc4d4224 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d422b expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000400:0.0:1788201298.086011:0:3310:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201282/real 1788201282] req@ffff9e03c53ea680 x1875064458231040/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201298 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000400:2.0:1788201298.088136:0:3313:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201282/real 1788201282] req@ffff9e03c53eaa00 x1875064458230912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201298 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201298.088168:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e03c53eaa00 x1875064458230912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201298 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201298.088178:0:3313:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff9e04ff4ba000 already not connected (conn 5, was 4): CONNECTING 00000100:00100000:2.0:1788201298.088193:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458230912:0@lo:400:kworker.0 00000100:00100000:0.0:1788201298.139815:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e03c53ea680 x1875064458231040/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201298 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201298.139829:0:3310:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff9e04f5751000 already not connected (conn 5, was 4): CONNECTING 00000100:00100000:0.0:1788201298.139847:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875064458231040:0@lo:400:kworker.0 00000100:00080000:1.0:1788201298.163961:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201298.163971:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201298.163974:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201298.163977:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201298.164053:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788201298.164057:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201298.164061:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e04c8284000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201298.164072:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e04c8284000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:1.0:1788201298.164096:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e04f000d180 x1875064458239616/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201298.164144:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458239360:0@lo:400:kworker.0 00000100:00100000:1.0:1788201298.164214:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201298.164278:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458239488:0@lo:400:kworker.0 00000100:00100000:1.0:1788201298.164349:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201298.165288:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875064458239616:0@lo:38:kworker.0 00000100:00100000:3.0:1788201298.165373:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201298.165417:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458239360 00000100:00100000:3.0:1788201298.165423:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458239360 00000100:00100000:3.0:1788201298.165473:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458239488 00000100:00100000:3.0:1788201298.165476:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458239488 00000100:00100000:3.0:1788201298.165493:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788201298.165502:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3313:x1875064458239360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201298.165745:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3313:x1875064458239360:12345-0@lo:400:kworker.0 Request processed in 242us (1529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201298.165753:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788201298.165769:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788201298.165776:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c23d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3310:x1875064458239488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201298.165812:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c23d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3310:x1875064458239488:12345-0@lo:400:kworker.0 Request processed in 37us (1462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201298.165818:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788201298.165850:0:15180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458239616 00000100:00100000:3.0:1788201298.165854:0:15180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458239616 00000100:00100000:3.0:1788201298.165872:0:15180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788201298.165877:0:15180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1875064458239616:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788201298.165914:0:15180:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 573 last 0 00000020:00000080:3.0:1788201298.165949:0:15180:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9383f985bc4d4232 00000004:00100000:3.0:1788201298.165965:0:15180:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788201298.166090:0:15180:0:(import.c:65:import_set_state_nolock()) ffff9e04f48ce800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201298.166132:0:15180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875064458239616:12345-0@lo:38:kworker.0 Request processed in 253us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201298.166139:0:15180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788201298.166181:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e04f000d180 x1875064458239616/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201298.166203:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788201298.166210:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788201298.166215:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788201298.166218:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04c8284000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788201298.166224:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875064458239616:0@lo:38:kworker.0 00000100:00100000:3.0:1788201298.175523:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458239488:0@lo:400:kworker.0 00000100:00100000:3.0:1788201298.175580:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458239360:0@lo:400:kworker.0 00000100:00100000:2.0:1788201298.391213:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201298.391287:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201298.393419:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201298.393494:0:15179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442679040 00000100:00100000:2.0:1788201298.393504:0:15179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442679040 00000100:00100000:2.0:1788201298.393541:0:15179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:2.0:1788201298.393549:0:15179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2358:x1875064442679040:12345-192.168.201.30@tcp:38:kworker.0 00010000:00080000:2.0:1788201298.393579:0:15179:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '35604eb4-baf9-45be-a20a-4883a2cd8cf9' at ffff9e04f48d2000, cookie 0x9383f985bc4d4121 00010000:00080000:2.0:1788201298.393586:0:15179:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp recovering/t8589938697 exp ffff9e04f48d2000 cur 573 last 1788201296 00010000:02000400:2.0:1788201298.393594:0:15179:0:(ldlm_lib.c:2037:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 1 client reconnects 00000100:00100000:0.0:1788201298.399787:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442679168 00000100:00100000:0.0:1788201298.399803:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442679168 00000100:00100000:1.0:1788201298.404683:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442679296 00000100:00100000:1.0:1788201298.404699:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442679296 00000100:00100000:1.0:1788201298.405268:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 183 00000100:00100000:1.0:1788201298.405280:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2359:x1875064442679168:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201298.405530:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2359:x1875064442679168:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 253us (14325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201298.405538:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 183 00000100:00100000:1.0:1788201298.405558:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 184 00000100:00100000:1.0:1788201298.405565:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2359:x1875064442679296:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201298.405596:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2359:x1875064442679296:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 32us (14309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201298.405602:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 184 00010000:00080000:2.0:1788201298.409967:0:15179:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1788201298.409998:0:15179:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type 77, return 77 00000100:00080000:2.0:1788201298.410145:0:15179:0:(import.c:65:import_set_state_nolock()) ffff9e04f9d82000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201298.410228:0:15179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2358:x1875064442679040:12345-192.168.201.30@tcp:38:kworker.0 Request processed in 16677us (16814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201298.410238:0:15179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2 00010000:00080000:1.0:1788201298.411665:0:15215:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 1 abort 0 expired 0 00010000:00080000:1.0:1788201298.411674:0:15215:0:(ldlm_lib.c:2684:replay_request_or_update()) Waiting for transno 8589938725 00000020:00080000:1.0:1788201298.411680:0:15215:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788201298.411683:0:15215:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 0, req_transno: 0, next_transno: 8589938725 00000020:00080000:1.0:1788201298.411686:0:15215:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788201298.411688:0:15215:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 0, req_transno: 0, next_transno: 8589938725 00000100:00080000:1.0:1788201298.412486:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201298.412493:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201298.430063:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201298.431059:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442679424 00000100:00100000:3.0:1788201298.431069:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442679424 00000100:00100000:3.0:1788201298.431130:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:3.0:1788201298.431140:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c23d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2358:x1875064442679424:12345-192.168.201.30@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1788201298.431167:0:15178:0:(ldlm_lib.c:3188:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9e03c23d9c00 x1875064442679424/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:419/0 lens 328/0 e 0 to 0 dl 1788201309 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201298.431189:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c23d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2358:x1875064442679424:12345-192.168.201.30@tcp:101:ldlm_lock_repla.0 Request processed in 52us (1138us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201298.431196:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3 00000020:00080000:1.0:1788201298.431476:0:15215:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788201298.431481:0:15215:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 1, connected: 1, completed: 1, queue_len: 0, req_transno: 0, next_transno: 8589938725 00010000:00080000:1.0:1788201298.431484:0:15215:0:(ldlm_lib.c:2263:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1788201298.431487:0:15215:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788201298.431492:0:15215:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1788201298.431495:0:15215:0:(ldlm_lib.c:2283:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1788201298.431502:0:15215:0:(ldlm_lib.c:2889:target_recovery_thread()) @@@ processing lock from 192.168.201.30@tcp: req@ffff9e03c23d9c00 x1875064442679424/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:419/0 lens 328/0 e 0 to 0 dl 1788201309 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788201298.431520:0:15215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201298.431561:0:15215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d4239 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4eaa expref: -99 pid: 15215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.431589:0:15215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d4239 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4eaa expref: 7 pid: 15215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.431606:0:15215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d4239 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4eaa expref: 7 pid: 15215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.431615:0:15215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9c0b400, rc 0) 00010000:00080000:1.0:1788201298.431689:0:15215:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00010000:00080000:1.0:1788201298.431701:0:15215:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1788201298.442016:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201298.442056:0:15180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442679552 00000100:00100000:3.0:1788201298.442066:0:15180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442679552 00000100:00100000:3.0:1788201298.442117:0:15180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:3.0:1788201298.442128:0:15180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2358:x1875064442679552:12345-192.168.201.30@tcp:400:ptlrpcd_rcv.0 00010000:00080000:3.0:1788201298.442148:0:15180:0:(ldlm_lib.c:3138:target_queue_recovery_request()) @@@ queue final req req@ffff9e04cffad180 x1875064442679552/t0(0) o400->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:419/0 lens 224/0 e 0 to 0 dl 1788201309 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201298.442172:0:15180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2358:x1875064442679552:12345-192.168.201.30@tcp:400:ptlrpcd_rcv.0 Request processed in 47us (167us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201298.442179:0:15180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00010000:00080000:3.0:1788201298.442196:0:15215:0:(ldlm_lib.c:2286:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1788201298.442479:0:15215:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00100000:0.0:1788201298.510739:0:15196:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 35604eb4-baf9-45be-a20a-4883a2cd8cf9 00000001:00080000:3.0:1788201298.510842:0:15215:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1788201298.510884:0:15215:0:(ldlm_lib.c:1997:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1788201298.510902:0:15215:0:(ldlm_lib.c:2941:target_recovery_thread()) @@@ processing final ping from 192.168.201.30@tcp: req@ffff9e04cffad180 x1875064442679552/t0(0) o400->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:419/0 lens 224/0 e 0 to 0 dl 1788201309 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1788201298.511007:0:15215:0:(ldlm_lib.c:1869:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:01, of 1 clients 1 recovered and 0 were evicted. 00000100:00100000:0.0:1788201298.562822:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201298.562863:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201298.562885:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201298.562904:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201298.562919:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201298.562932:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201298.562950:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201298.562976:0:15180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442674432 00000100:00100000:0.0:1788201298.562986:0:15180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442674432 00000100:00100000:0.0:1788201298.563030:0:15180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442675712 00000100:00100000:0.0:1788201298.563033:0:15180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442675712 00000100:00100000:0.0:1788201298.563044:0:15180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442675072 00000100:00100000:0.0:1788201298.563046:0:15180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442675072 00000100:00100000:0.0:1788201298.563070:0:15180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442675328 00000100:00100000:0.0:1788201298.563073:0:15180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442675328 00000100:00100000:0.0:1788201298.563082:0:15180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442674816 00000100:00100000:0.0:1788201298.563085:0:15180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442674816 00000100:00100000:0.0:1788201298.563093:0:15180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442674176 00000100:00100000:0.0:1788201298.563095:0:15180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442674176 00000100:00100000:0.0:1788201298.563103:0:15180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442676096 00000100:00100000:0.0:1788201298.563105:0:15180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442676096 00000100:00100000:0.0:1788201298.563119:0:15180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:0.0:1788201298.563128:0:15180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:14999:x1875064442674432:12345-192.168.201.30@tcp:36:chmod.0 00000004:00000080:3.0:1788201298.565267:0:15215:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffad61045efe10 00100000:10000000:3.0:1788201298.565279:0:15215:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0:1788201298.571424:0:15180:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 8244us 00000004:00080000:1.0:1788201298.580480:0:15202:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x420:0x0] 00000100:00100000:1.0:1788201298.580525:0:15202:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c23d8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:15202:1875064458239744:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788201298.580591:0:15202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201298.580621:0:15202:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d20cee40 going to sleep for 50 seconds 00000100:00100000:1.0:1788201298.580644:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458239744 00000100:00100000:1.0:1788201298.580653:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458239744 00000100:00100000:1.0:1788201298.580699:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4229 00000100:00100000:1.0:1788201298.580709:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:15202:x1875064458239744:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788201298.580736:0:13441:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1089 -> diff = -33 00002000:02000040:1.0:1788201298.580741:0:13441:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:1057 to 0x240000400:1089) 00000004:00080000:0.0:1788201298.584360:0:15204:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x41f:0x0] 00000100:00100000:0.0:1788201298.584420:0:15204:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:15204:1875064458239872:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788201298.584503:0:15204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201298.584545:0:15204:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c1177840 going to sleep for 50 seconds 00000100:00100000:3.0:1788201298.587836:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458239872 00000100:00100000:3.0:1788201298.587851:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458239872 00000100:00100000:3.0:1788201298.587900:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4230 00000100:00100000:3.0:1788201298.587910:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:15204:x1875064458239872:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788201298.587939:0:13444:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1089 -> diff = -34 00002000:02000040:3.0:1788201298.587943:0:13444:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:1056 to 0x280000400:1089) 00000004:00080000:2.0:1788201298.596089:0:15180:0:(mdt_internal.h:1254:mdt_check_resent()) @@@ no reply data found for RESENT req, rc = 0 req@ffff9e03c2b7c000 x1875064442674432/t0(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:419/0 lens 488/3152 e 0 to 0 dl 1788201309 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788201298.596108:0:15180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201298.596113:0:15180:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9383f985bc4d3f45) 00010000:00010000:2.0:1788201298.596115:0:15180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:1.0:1788201298.597199:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x441:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.597212:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095eef7c5/0x9383f985bc4d4240 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x441:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.597228:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x441:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.597233:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x441:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.597240:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095eef7c5/0x9383f985bc4d4240 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x441:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.597253:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095eef7c5/0x9383f985bc4d4240 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x441:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.597262:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095eef7c5/0x9383f985bc4d4240 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x441:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.597269:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095eef7c5/0x9383f985bc4d4240 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x441:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.597288:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201298.597811:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x440:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.597818:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a2c29de/0x9383f985bc4d4247 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x440:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.597826:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x440:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.597830:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x440:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.597834:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a2c29de/0x9383f985bc4d4247 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x440:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.597842:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a2c29de/0x9383f985bc4d4247 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x440:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.597849:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a2c29de/0x9383f985bc4d4247 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x440:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.597855:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a2c29de/0x9383f985bc4d4247 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x440:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.599154:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788201298.599621:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x43f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.599630:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000af26e2c/0x9383f985bc4d424e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x43f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.599642:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x43f:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.599645:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x43f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.599650:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000af26e2c/0x9383f985bc4d424e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x43f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.599661:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000af26e2c/0x9383f985bc4d424e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x43f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.599670:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000af26e2c/0x9383f985bc4d424e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x43f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.599678:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000af26e2c/0x9383f985bc4d424e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x43f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.599702:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788201298.599983:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x43e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.599989:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057a642d0/0x9383f985bc4d4255 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x43e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.599997:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x43e:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.599999:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x43e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.600003:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057a642d0/0x9383f985bc4d4255 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x43e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.600011:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057a642d0/0x9383f985bc4d4255 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x43e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.600018:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057a642d0/0x9383f985bc4d4255 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x43e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.600025:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057a642d0/0x9383f985bc4d4255 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x43e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.600033:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788201298.600846:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788201298.600854:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095eef7c5/0x9383f985bc4d4240 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x441:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.600864:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0be00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201298.600869:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095eef7c5/0x9383f985bc4d4240 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x441:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.600879:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095eef7c5/0x9383f985bc4d4240 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x441:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.600898:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095eef7c5/0x9383f985bc4d4240 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x441:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.600906:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095eef7c5/0x9383f985bc4d4240 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x441:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.600924:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201298.600929:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a2c29de/0x9383f985bc4d4247 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x440:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.600935:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0a600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201298.600939:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a2c29de/0x9383f985bc4d4247 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x440:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.600948:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a2c29de/0x9383f985bc4d4247 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x440:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.600956:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a2c29de/0x9383f985bc4d4247 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x440:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.600963:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a2c29de/0x9383f985bc4d4247 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x440:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.600974:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201298.600977:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000af26e2c/0x9383f985bc4d424e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x43f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.600983:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0a400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201298.600986:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000af26e2c/0x9383f985bc4d424e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x43f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.600993:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000af26e2c/0x9383f985bc4d424e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x43f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.601003:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000af26e2c/0x9383f985bc4d424e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x43f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.601010:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000af26e2c/0x9383f985bc4d424e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x43f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.602156:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201298.602164:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057a642d0/0x9383f985bc4d4255 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x43e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.602175:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0b600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201298.602179:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057a642d0/0x9383f985bc4d4255 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x43e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.602187:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057a642d0/0x9383f985bc4d4255 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x43e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.602199:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057a642d0/0x9383f985bc4d4255 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x43e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.602206:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057a642d0/0x9383f985bc4d4255 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x43e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.602220:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201298.602222:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201298.602224:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201298.602234:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201298.602872:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x43d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.602881:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9dfc6c3/0x9383f985bc4d425c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x43d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.602893:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x43d:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.602896:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x43d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.602902:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9dfc6c3/0x9383f985bc4d425c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x43d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.602913:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9dfc6c3/0x9383f985bc4d425c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x43d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.602921:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9dfc6c3/0x9383f985bc4d425c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x43d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.602928:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9dfc6c3/0x9383f985bc4d425c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x43d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.602947:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201298.603221:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201298.603226:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9dfc6c3/0x9383f985bc4d425c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x43d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.603235:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0b000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201298.603239:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9dfc6c3/0x9383f985bc4d425c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x43d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.603247:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9dfc6c3/0x9383f985bc4d425c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x43d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.603260:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9dfc6c3/0x9383f985bc4d425c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x43d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.603268:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9dfc6c3/0x9383f985bc4d425c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x43d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.603283:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201298.603285:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201298.603286:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.606363:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201298.608211:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x441:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201298.608224:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d4263 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x441:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.608241:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x441:0x0].0x0 since=573s v=(0 0) 00010000:00010000:3.0:1788201298.608246:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x441:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201298.608266:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d4263 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x441:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.608282:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d4263 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x441:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.608308:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d4263 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x441:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.608317:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d4263 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x441:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.608335:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201298.608346:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201298.608351:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d4263 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x441:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.608359:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201298.608364:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d4263 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x441:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.608372:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d4263 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x441:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.608386:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d4263 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x441:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.608395:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d4263 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x441:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.608410:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201298.608412:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201298.608414:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201298.609735:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x43c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.609743:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025c635db/0x9383f985bc4d426a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x43c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.609754:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x43c:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.609758:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x43c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.609762:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025c635db/0x9383f985bc4d426a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x43c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.609773:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025c635db/0x9383f985bc4d426a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x43c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.609786:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025c635db/0x9383f985bc4d426a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x43c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.609793:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025c635db/0x9383f985bc4d426a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x43c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.609817:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201298.610239:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x43b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.610245:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd359a11/0x9383f985bc4d4271 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x43b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.610254:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x43b:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.610258:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x43b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.610261:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd359a11/0x9383f985bc4d4271 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x43b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.610270:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd359a11/0x9383f985bc4d4271 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x43b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.610277:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd359a11/0x9383f985bc4d4271 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x43b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.610285:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd359a11/0x9383f985bc4d4271 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x43b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.610345:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788201298.610673:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x43a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.610679:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0b0eb24/0x9383f985bc4d4278 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x43a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.610687:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x43a:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.610690:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x43a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.610695:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0b0eb24/0x9383f985bc4d4278 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x43a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.610704:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0b0eb24/0x9383f985bc4d4278 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x43a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.610711:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0b0eb24/0x9383f985bc4d4278 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x43a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.610717:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0b0eb24/0x9383f985bc4d4278 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x43a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.610739:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788201298.611015:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x439:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.611021:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d427f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x439:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.611029:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x439:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.611032:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x439:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.611036:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d427f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x439:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.611044:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d427f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x439:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.611050:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d427f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x439:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.611057:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d427f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x439:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.611064:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788201298.611371:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x438:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.611377:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004dfe810/0x9383f985bc4d4286 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x438:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.611385:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x438:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.611388:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x438:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.611392:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004dfe810/0x9383f985bc4d4286 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x438:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.611400:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004dfe810/0x9383f985bc4d4286 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x438:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.611407:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004dfe810/0x9383f985bc4d4286 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x438:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.611414:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004dfe810/0x9383f985bc4d4286 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x438:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.611423:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788201298.611713:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x437:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.611718:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d428d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x437:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.611726:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x437:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.611729:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x437:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.611733:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d428d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x437:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.611741:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d428d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x437:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.611747:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d428d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x437:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.611753:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d428d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x437:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.611760:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1788201298.612043:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x436:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.612049:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d4294 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x436:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.612057:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x436:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.612060:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x436:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.612064:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d4294 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x436:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.612073:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d4294 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x436:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.612081:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d4294 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x436:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.612088:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d4294 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x436:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.612096:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1788201298.612392:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x435:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.612398:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d429b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x435:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.612407:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x435:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.612409:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x435:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.612413:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d429b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x435:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.612422:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d429b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x435:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612672:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788201298.612680:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025c635db/0x9383f985bc4d426a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x43c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612689:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0b800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201298.612693:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025c635db/0x9383f985bc4d426a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x43c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612701:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025c635db/0x9383f985bc4d426a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x43c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612717:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025c635db/0x9383f985bc4d426a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x43c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612724:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025c635db/0x9383f985bc4d426a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x43c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612743:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788201298.612746:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd359a11/0x9383f985bc4d4271 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x43b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612752:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0ba00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201298.612755:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd359a11/0x9383f985bc4d4271 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x43b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612761:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd359a11/0x9383f985bc4d4271 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x43b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612769:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd359a11/0x9383f985bc4d4271 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x43b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612776:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd359a11/0x9383f985bc4d4271 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x43b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612786:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788201298.612790:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0b0eb24/0x9383f985bc4d4278 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x43a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612796:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9c0a800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201298.612798:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0b0eb24/0x9383f985bc4d4278 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x43a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612806:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0b0eb24/0x9383f985bc4d4278 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x43a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612814:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0b0eb24/0x9383f985bc4d4278 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x43a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612821:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0b0eb24/0x9383f985bc4d4278 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x43a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612832:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788201298.612836:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d427f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x439:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612841:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201298.612843:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d427f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x439:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612850:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d427f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x439:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612856:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d427f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x439:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612862:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d427f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x439:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612871:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201298.612875:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004dfe810/0x9383f985bc4d4286 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x438:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612881:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201298.612884:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004dfe810/0x9383f985bc4d4286 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x438:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612890:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004dfe810/0x9383f985bc4d4286 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x438:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612897:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004dfe810/0x9383f985bc4d4286 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x438:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612902:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004dfe810/0x9383f985bc4d4286 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x438:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612912:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201298.612915:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d428d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x437:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612920:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507ce00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201298.612922:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d428d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x437:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612929:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d428d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x437:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612936:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d428d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x437:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612942:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d428d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x437:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612952:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201298.612954:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d4294 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x436:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612961:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507c600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201298.612964:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d4294 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x436:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612970:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d4294 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x436:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612977:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d4294 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x436:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612983:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d4294 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x436:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.612992:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201298.612994:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201298.612996:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201298.614159:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201298.616566:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x440:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201298.616578:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d307c09/0x9383f985bc4d42a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x440:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.616595:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x440:0x0].0x0 since=573s v=(0 0) 00010000:00010000:3.0:1788201298.616600:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x440:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201298.616606:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d307c09/0x9383f985bc4d42a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x440:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.616619:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d307c09/0x9383f985bc4d42a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x440:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.616630:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d307c09/0x9383f985bc4d42a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x440:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.616638:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d307c09/0x9383f985bc4d42a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x440:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.616666:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201298.616681:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201298.616687:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d307c09/0x9383f985bc4d42a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x440:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.616699:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201298.616703:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d307c09/0x9383f985bc4d42a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x440:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.616711:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d307c09/0x9383f985bc4d42a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x440:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.616725:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d307c09/0x9383f985bc4d42a2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x440:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.616731:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d307c09/0x9383f985bc4d42a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x440:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.616745:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201298.616747:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201298.616748:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201298.617027:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x43f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201298.617034:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fe5b943/0x9383f985bc4d42a9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x43f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.617041:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43f:0x0].0x0 since=573s v=(0 0) 00010000:00010000:3.0:1788201298.617045:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201298.617216:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201298.618462:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d429b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x435:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.618471:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d429b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x435:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.618501:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201298.618894:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x434:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.618901:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee9d20ef/0x9383f985bc4d42b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x434:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.618912:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x434:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.618917:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x434:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.618922:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee9d20ef/0x9383f985bc4d42b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x434:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.618935:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee9d20ef/0x9383f985bc4d42b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x434:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.618944:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee9d20ef/0x9383f985bc4d42b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x434:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.618951:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee9d20ef/0x9383f985bc4d42b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x434:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.618970:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788201298.619445:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fe5b943/0x9383f985bc4d42a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.619458:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fe5b943/0x9383f985bc4d42a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.619466:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fe5b943/0x9383f985bc4d42a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.619473:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fe5b943/0x9383f985bc4d42a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x43f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.619498:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201298.619504:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d429b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x435:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.619512:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507cc00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201298.619516:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d429b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x435:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.619525:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d429b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x435:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.619541:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d429b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x435:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.619549:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d429b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x435:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.619567:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201298.619571:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee9d20ef/0x9383f985bc4d42b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x434:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.619576:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201298.619579:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee9d20ef/0x9383f985bc4d42b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x434:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.619586:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee9d20ef/0x9383f985bc4d42b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x434:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.619594:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee9d20ef/0x9383f985bc4d42b0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x434:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.619600:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee9d20ef/0x9383f985bc4d42b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x434:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.619610:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201298.619611:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201298.619613:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201298.619619:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201298.619645:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201298.619653:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201298.619656:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fe5b943/0x9383f985bc4d42a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x43f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.619663:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201298.619665:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fe5b943/0x9383f985bc4d42a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x43f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.619676:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fe5b943/0x9383f985bc4d42a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x43f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.619685:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fe5b943/0x9383f985bc4d42a9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x43f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.619692:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fe5b943/0x9383f985bc4d42a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x43f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.619704:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201298.619705:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201298.619707:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201298.622176:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x433:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.622189:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000927e33d1/0x9383f985bc4d42be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x433:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.622204:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x433:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.622208:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x433:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.622214:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000927e33d1/0x9383f985bc4d42be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x433:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.622226:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000927e33d1/0x9383f985bc4d42be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x433:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.622236:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000927e33d1/0x9383f985bc4d42be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x433:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.622243:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000927e33d1/0x9383f985bc4d42be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x433:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.622268:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201298.622440:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201298.622447:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000927e33d1/0x9383f985bc4d42be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x433:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.622457:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201298.622462:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000927e33d1/0x9383f985bc4d42be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x433:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.622470:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000927e33d1/0x9383f985bc4d42be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x433:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.622485:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000927e33d1/0x9383f985bc4d42be lrc: 1/0,0 mode: --/PW res: [0x240000400:0x433:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.622496:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000927e33d1/0x9383f985bc4d42be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x433:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.622511:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201298.622512:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201298.622514:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201298.622539:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x43e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201298.622546:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb412d5a/0x9383f985bc4d42b7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x43e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.622555:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43e:0x0].0x0 since=573s v=(0 0) 00010000:00010000:3.0:1788201298.622558:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201298.622562:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb412d5a/0x9383f985bc4d42b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.622572:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb412d5a/0x9383f985bc4d42b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.622580:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb412d5a/0x9383f985bc4d42b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.622586:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb412d5a/0x9383f985bc4d42b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x43e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.622601:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201298.622610:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201298.622614:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb412d5a/0x9383f985bc4d42b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x43e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.622620:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201298.622624:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb412d5a/0x9383f985bc4d42b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x43e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.622631:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb412d5a/0x9383f985bc4d42b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x43e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.622642:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb412d5a/0x9383f985bc4d42b7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x43e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.622649:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb412d5a/0x9383f985bc4d42b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x43e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.622662:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201298.622664:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201298.622665:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201298.623534:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x432:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.623542:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007be97ade/0x9383f985bc4d42cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x432:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.623552:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x432:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.623556:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x432:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.623560:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007be97ade/0x9383f985bc4d42cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x432:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.623571:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007be97ade/0x9383f985bc4d42cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x432:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.623580:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007be97ade/0x9383f985bc4d42cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x432:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.623588:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007be97ade/0x9383f985bc4d42cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x432:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.623613:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201298.623905:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x431:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.623911:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004525f602/0x9383f985bc4d42d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x431:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.623920:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x431:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.623922:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x431:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.623926:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004525f602/0x9383f985bc4d42d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x431:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.623934:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004525f602/0x9383f985bc4d42d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x431:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.623942:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004525f602/0x9383f985bc4d42d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x431:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.623949:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004525f602/0x9383f985bc4d42d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x431:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.623963:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788201298.627413:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x43d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201298.627428:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d42c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x43d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.627453:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43d:0x0].0x0 since=573s v=(0 0) 00010000:00010000:3.0:1788201298.627457:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201298.627478:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d42c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.627498:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d42c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.627510:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d42c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.627518:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d42c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x43d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.627538:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201298.627545:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007be97ade/0x9383f985bc4d42cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x432:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.627553:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507c000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201298.627559:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007be97ade/0x9383f985bc4d42cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x432:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.627568:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007be97ade/0x9383f985bc4d42cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x432:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.627585:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007be97ade/0x9383f985bc4d42cc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x432:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.627593:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007be97ade/0x9383f985bc4d42cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x432:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.627619:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201298.627624:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004525f602/0x9383f985bc4d42d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x431:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.627630:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507dc00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201298.627633:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004525f602/0x9383f985bc4d42d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x431:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.627641:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004525f602/0x9383f985bc4d42d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x431:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.627650:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004525f602/0x9383f985bc4d42d3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x431:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.627657:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004525f602/0x9383f985bc4d42d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x431:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.627668:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201298.627670:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201298.627672:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201298.627679:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201298.628156:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x430:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.628164:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d42da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x430:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.628172:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x430:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.628176:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x430:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.628179:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d42da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x430:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.628188:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d42da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x430:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.628195:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d42da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x430:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.628201:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d42da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x430:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.628222:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201298.631687:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.631700:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008baee9f0/0x9383f985bc4d42e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.631714:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42f:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.631718:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.631724:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008baee9f0/0x9383f985bc4d42e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.631736:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008baee9f0/0x9383f985bc4d42e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.631745:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008baee9f0/0x9383f985bc4d42e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.631753:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008baee9f0/0x9383f985bc4d42e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.631772:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788201298.632896:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d42e8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.632911:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d42e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.632923:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d42e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.633419:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201298.633439:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d42da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x430:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.633451:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507c800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201298.633456:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d42da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x430:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.633466:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d42da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x430:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.633483:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d42da lrc: 1/0,0 mode: --/PW res: [0x240000400:0x430:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.633491:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d42da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x430:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.633513:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201298.633517:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008baee9f0/0x9383f985bc4d42e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.633524:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507c200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201298.633527:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008baee9f0/0x9383f985bc4d42e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.633534:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008baee9f0/0x9383f985bc4d42e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.633542:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008baee9f0/0x9383f985bc4d42e1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x42f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.633549:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008baee9f0/0x9383f985bc4d42e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.633561:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201298.633562:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201298.633564:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201298.633571:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201298.634521:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.634532:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b13647a1/0x9383f985bc4d42ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.634544:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42e:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.634549:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.634555:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b13647a1/0x9383f985bc4d42ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.634566:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b13647a1/0x9383f985bc4d42ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.634581:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b13647a1/0x9383f985bc4d42ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.634589:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b13647a1/0x9383f985bc4d42ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.634609:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201298.634991:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.634997:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d42f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.635005:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42d:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.635008:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.635012:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d42f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.635021:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d42f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.635031:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d42f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.635038:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d42f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201298.635309:0:15180:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009572a57b reply state 0000000075a59205 transno 12884901889 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d42e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201298.636133:0:15180:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201298.636274:0:15180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:14999:x1875064442674432:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 73143us (73458us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788201298.636283:0:15180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4 00010000:00010000:1.0:1788201298.637115:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788201298.637478:0:15180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:0.0:1788201298.637491:0:15180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:14997:x1875064442675712:12345-192.168.201.30@tcp:36:chmod.0 00000004:00080000:0.0:1788201298.637543:0:15180:0:(mdt_internal.h:1254:mdt_check_resent()) @@@ no reply data found for RESENT req, rc = 0 req@ffff9e03c2b7fb80 x1875064442675712/t0(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:419/0 lens 488/3152 e 0 to 0 dl 1788201309 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788201298.637554:0:15180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201298.637558:0:15180:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9383f985bc4d3ec7) 00010000:00010000:0.0:1788201298.637561:0:15180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:1.0:1788201298.638149:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.638157:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8bee2d2/0x9383f985bc4d42fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.638171:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42c:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.638175:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.638180:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8bee2d2/0x9383f985bc4d42fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.638192:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8bee2d2/0x9383f985bc4d42fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.638200:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8bee2d2/0x9383f985bc4d42fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.638207:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8bee2d2/0x9383f985bc4d42fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.638227:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788201298.639458:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d4304 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.639474:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d4304 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.639486:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d4304 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201298.639656:0:15180:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8b52900 reply state 0000000069cf1485 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d4304 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201298.639664:0:15180:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201298.639766:0:15180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:14997:x1875064442675712:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 2274us (76897us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788201298.639774:0:15180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:0.0:1788201298.639810:0:15180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:0.0:1788201298.639822:0:15180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:15001:x1875064442675072:12345-192.168.201.30@tcp:36:chmod.0 00000004:00080000:0.0:1788201298.639864:0:15180:0:(mdt_internal.h:1254:mdt_check_resent()) @@@ no reply data found for RESENT req, rc = 0 req@ffff9e03c2b7ca80 x1875064442675072/t0(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:419/0 lens 488/3152 e 0 to 0 dl 1788201309 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788201298.639875:0:15180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201298.639878:0:15180:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9383f985bc4d3f53) 00010000:00010000:0.0:1788201298.639881:0:15180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:1.0:1788201298.641148:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.641158:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000345b80e5/0x9383f985bc4d430b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.641171:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42b:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.641176:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.641182:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000345b80e5/0x9383f985bc4d430b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.641194:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000345b80e5/0x9383f985bc4d430b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.641202:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000345b80e5/0x9383f985bc4d430b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.641209:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000345b80e5/0x9383f985bc4d430b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.641221:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788201298.642370:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d4312 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.642388:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d4312 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.642398:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d4312 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201298.642706:0:15180:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da0994ce reply state 00000000927d31b8 transno 12884901891 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d4312 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201298.642717:0:15180:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201298.642825:0:15180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+17:15001:x1875064442675072:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 3003us (79935us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1788201298.642835:0:15180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:0.0:1788201298.642871:0:15180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:0.0:1788201298.642882:0:15180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:14996:x1875064442675328:12345-192.168.201.30@tcp:36:chmod.0 00000004:00080000:0.0:1788201298.642948:0:15180:0:(mdt_internal.h:1254:mdt_check_resent()) @@@ no reply data found for RESENT req, rc = 0 req@ffff9e03c2b7e680 x1875064442675328/t0(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:419/0 lens 488/3152 e 0 to 0 dl 1788201309 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788201298.642958:0:15180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201298.642961:0:15180:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9383f985bc4d3ef8) 00010000:00010000:0.0:1788201298.642964:0:15180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:1.0:1788201298.643899:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.643909:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0d4f162/0x9383f985bc4d4319 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.643921:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42a:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.643925:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.643931:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0d4f162/0x9383f985bc4d4319 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.643942:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0d4f162/0x9383f985bc4d4319 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.643952:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0d4f162/0x9383f985bc4d4319 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.643960:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0d4f162/0x9383f985bc4d4319 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.643971:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788201298.644276:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x429:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.644283:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040097fff/0x9383f985bc4d4320 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x429:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.644317:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x429:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.644321:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x429:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.644325:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040097fff/0x9383f985bc4d4320 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x429:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.644337:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040097fff/0x9383f985bc4d4320 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x429:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.644346:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040097fff/0x9383f985bc4d4320 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x429:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.644353:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040097fff/0x9383f985bc4d4320 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x429:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.644362:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1788201298.644671:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x428:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.644677:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c30a815/0x9383f985bc4d4327 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x428:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.644685:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x428:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.644688:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x428:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.644692:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c30a815/0x9383f985bc4d4327 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x428:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.644701:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c30a815/0x9383f985bc4d4327 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x428:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.644709:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c30a815/0x9383f985bc4d4327 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x428:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.644716:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c30a815/0x9383f985bc4d4327 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x428:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.644724:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1788201298.645008:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x427:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.645014:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075aceb8e/0x9383f985bc4d432e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x427:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.645022:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x427:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.645025:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x427:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.645028:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075aceb8e/0x9383f985bc4d432e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x427:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.645036:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075aceb8e/0x9383f985bc4d432e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x427:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.645048:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075aceb8e/0x9383f985bc4d432e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x427:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.645053:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075aceb8e/0x9383f985bc4d432e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x427:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.645060:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1788201298.645363:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x426:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.645369:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f025b68e/0x9383f985bc4d4335 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.645378:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x426:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.645380:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x426:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.645384:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f025b68e/0x9383f985bc4d4335 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.645392:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f025b68e/0x9383f985bc4d4335 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.645400:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f025b68e/0x9383f985bc4d4335 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.645407:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f025b68e/0x9383f985bc4d4335 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.645419:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:1.0:1788201298.645702:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x425:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.645707:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007f5270e/0x9383f985bc4d433c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.645716:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x425:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.645719:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x425:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.645724:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007f5270e/0x9383f985bc4d433c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.645732:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007f5270e/0x9383f985bc4d433c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.645741:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007f5270e/0x9383f985bc4d433c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.645748:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007f5270e/0x9383f985bc4d433c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.645757:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:1.0:1788201298.646036:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x424:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.646041:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b6707ed/0x9383f985bc4d4343 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x424:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.646049:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x424:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.646052:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x424:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.646056:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b6707ed/0x9383f985bc4d4343 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x424:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.646064:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b6707ed/0x9383f985bc4d4343 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x424:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.646071:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b6707ed/0x9383f985bc4d4343 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x424:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.646077:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b6707ed/0x9383f985bc4d4343 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x424:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.646084:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:1.0:1788201298.646395:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x423:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.646401:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6d23568/0x9383f985bc4d434a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.646408:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x423:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.646411:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x423:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.646415:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d23568/0x9383f985bc4d434a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.646424:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6d23568/0x9383f985bc4d434a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646568:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:2.0:1788201298.646577:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b13647a1/0x9383f985bc4d42ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646585:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507ca00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.646590:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b13647a1/0x9383f985bc4d42ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646600:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b13647a1/0x9383f985bc4d42ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646616:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b13647a1/0x9383f985bc4d42ef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x42e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646622:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b13647a1/0x9383f985bc4d42ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646641:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:2.0:1788201298.646645:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d42f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646652:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.646655:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d42f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646662:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d42f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646672:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d42f6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x42d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646678:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d42f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646692:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1788201298.646696:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8bee2d2/0x9383f985bc4d42fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646702:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507de00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.646705:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8bee2d2/0x9383f985bc4d42fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646712:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8bee2d2/0x9383f985bc4d42fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646720:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8bee2d2/0x9383f985bc4d42fd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x42c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646726:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8bee2d2/0x9383f985bc4d42fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646736:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1788201298.646740:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000345b80e5/0x9383f985bc4d430b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646746:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507c400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.646748:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000345b80e5/0x9383f985bc4d430b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646756:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000345b80e5/0x9383f985bc4d430b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646765:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000345b80e5/0x9383f985bc4d430b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x42b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646772:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000345b80e5/0x9383f985bc4d430b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646784:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788201298.646788:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0d4f162/0x9383f985bc4d4319 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646793:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507da00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.646796:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0d4f162/0x9383f985bc4d4319 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646802:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0d4f162/0x9383f985bc4d4319 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646812:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0d4f162/0x9383f985bc4d4319 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x42a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646819:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0d4f162/0x9383f985bc4d4319 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646831:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788201298.646835:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040097fff/0x9383f985bc4d4320 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x429:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646840:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.646843:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040097fff/0x9383f985bc4d4320 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x429:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646849:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040097fff/0x9383f985bc4d4320 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x429:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646858:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040097fff/0x9383f985bc4d4320 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x429:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646864:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040097fff/0x9383f985bc4d4320 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x429:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646875:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788201298.646878:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c30a815/0x9383f985bc4d4327 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x428:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646883:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.646886:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c30a815/0x9383f985bc4d4327 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x428:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646893:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c30a815/0x9383f985bc4d4327 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x428:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646900:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c30a815/0x9383f985bc4d4327 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x428:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646905:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c30a815/0x9383f985bc4d4327 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x428:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646915:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788201298.646917:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075aceb8e/0x9383f985bc4d432e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x427:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646923:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.646926:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075aceb8e/0x9383f985bc4d432e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x427:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646932:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075aceb8e/0x9383f985bc4d432e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x427:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646939:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075aceb8e/0x9383f985bc4d432e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x427:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646945:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075aceb8e/0x9383f985bc4d432e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x427:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646955:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788201298.646958:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f025b68e/0x9383f985bc4d4335 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646964:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.646967:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f025b68e/0x9383f985bc4d4335 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646974:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f025b68e/0x9383f985bc4d4335 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646982:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f025b68e/0x9383f985bc4d4335 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646988:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f025b68e/0x9383f985bc4d4335 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.646998:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201298.647001:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007f5270e/0x9383f985bc4d433c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.647007:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.647010:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007f5270e/0x9383f985bc4d433c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.647021:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007f5270e/0x9383f985bc4d433c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.647030:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007f5270e/0x9383f985bc4d433c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.647037:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007f5270e/0x9383f985bc4d433c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.647049:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201298.647052:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b6707ed/0x9383f985bc4d4343 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x424:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.647058:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.647061:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b6707ed/0x9383f985bc4d4343 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x424:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.647068:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b6707ed/0x9383f985bc4d4343 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x424:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.647078:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b6707ed/0x9383f985bc4d4343 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x424:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.647084:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b6707ed/0x9383f985bc4d4343 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x424:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.647099:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.647101:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.647103:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.647133:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201298.647143:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201298.647148:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d42c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x43d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.647155:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.647158:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d42c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x43d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.647166:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d42c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x43d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.647177:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d42c5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x43d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.647184:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d42c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x43d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.647199:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.647201:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.647202:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201298.647595:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x43c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201298.647601:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d4351 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x43c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.647612:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43c:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1788201298.647615:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201298.647620:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d4351 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.647630:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d4351 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.647639:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d4351 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.647647:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d4351 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x43c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.647663:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201298.647671:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201298.647675:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d4351 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x43c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.647683:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.647686:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d4351 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x43c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.647693:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d4351 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x43c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.647708:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d4351 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x43c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.647715:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d4351 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x43c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.647728:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.647729:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.647731:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201298.647944:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x43b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201298.647950:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdbe346a/0x9383f985bc4d4358 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x43b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.647958:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43b:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1788201298.647961:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201298.647964:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdbe346a/0x9383f985bc4d4358 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.647973:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdbe346a/0x9383f985bc4d4358 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.647981:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdbe346a/0x9383f985bc4d4358 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.647988:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fdbe346a/0x9383f985bc4d4358 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x43b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.648007:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201298.648014:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201298.648017:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fdbe346a/0x9383f985bc4d4358 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x43b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.648023:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.648026:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdbe346a/0x9383f985bc4d4358 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x43b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.648033:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdbe346a/0x9383f985bc4d4358 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x43b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.648042:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fdbe346a/0x9383f985bc4d4358 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x43b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.648048:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdbe346a/0x9383f985bc4d4358 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x43b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.648059:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.648060:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.648062:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201298.648241:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x43a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201298.648246:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cb2fb41/0x9383f985bc4d435f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x43a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.648254:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43a:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1788201298.648258:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201298.648262:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cb2fb41/0x9383f985bc4d435f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.648270:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cb2fb41/0x9383f985bc4d435f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.648278:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cb2fb41/0x9383f985bc4d435f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.648285:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cb2fb41/0x9383f985bc4d435f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x43a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.648320:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201298.648327:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201298.648330:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cb2fb41/0x9383f985bc4d435f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x43a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.648336:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.648339:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cb2fb41/0x9383f985bc4d435f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x43a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.648345:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cb2fb41/0x9383f985bc4d435f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x43a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.648355:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cb2fb41/0x9383f985bc4d435f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x43a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.648365:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cb2fb41/0x9383f985bc4d435f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x43a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.648375:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.648377:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.648378:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201298.652630:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x439:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201298.652644:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d4366 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x439:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.652661:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x439:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1788201298.652666:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x439:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201298.652672:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d4366 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x439:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.652685:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d4366 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x439:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.652695:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d4366 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x439:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.652703:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d4366 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x439:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.652720:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201298.652738:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201298.652744:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d4366 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x439:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.652751:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.652755:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d4366 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x439:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.652763:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d4366 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x439:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.652778:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d4366 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x439:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.652786:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d4366 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x439:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.652804:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.652806:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.652808:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201298.653687:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d436d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.653703:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d436d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.653711:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d436d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201298.654287:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x438:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201298.654309:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004b61b04/0x9383f985bc4d4374 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x438:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201298.655193:0:15180:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006471c2cf reply state 00000000bfa50076 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d436d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201298.655203:0:15180:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201298.655456:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x438:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1788201298.655461:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x438:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201298.655467:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004b61b04/0x9383f985bc4d4374 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x438:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.655486:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004b61b04/0x9383f985bc4d4374 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x438:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.655495:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004b61b04/0x9383f985bc4d4374 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x438:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.655502:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004b61b04/0x9383f985bc4d4374 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x438:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.655523:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201298.655548:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201298.655553:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004b61b04/0x9383f985bc4d4374 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x438:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.655561:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b96c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.655565:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004b61b04/0x9383f985bc4d4374 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x438:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.655573:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004b61b04/0x9383f985bc4d4374 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x438:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.655587:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004b61b04/0x9383f985bc4d4374 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x438:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.655594:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004b61b04/0x9383f985bc4d4374 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x438:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.655610:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.655612:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.655613:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201298.655975:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x437:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201298.655981:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002790950b/0x9383f985bc4d437b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x437:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.655989:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x437:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1788201298.655992:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x437:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201298.655995:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002790950b/0x9383f985bc4d437b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x437:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.656004:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002790950b/0x9383f985bc4d437b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x437:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.656011:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002790950b/0x9383f985bc4d437b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x437:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.656017:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002790950b/0x9383f985bc4d437b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x437:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.656031:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201298.656038:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201298.656042:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002790950b/0x9383f985bc4d437b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x437:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201298.656138:0:15180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+18:14996:x1875064442675328:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 13255us (93228us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1788201298.656148:0:15180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:0.0:1788201298.656652:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201298.656674:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201298.656712:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442680576 00000100:00100000:0.0:1788201298.656721:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442680576 00000100:00100000:0.0:1788201298.656752:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442680704 00000100:00100000:0.0:1788201298.656755:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442680704 00000100:00100000:0.0:1788201298.656770:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:0.0:1788201298.656779:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:15000:x1875064442674816:12345-192.168.201.30@tcp:36:chmod.0 00000004:00080000:0.0:1788201298.656832:0:15178:0:(mdt_internal.h:1254:mdt_check_resent()) @@@ no reply data found for RESENT req, rc = 0 req@ffff9e03c2b7e300 x1875064442674816/t0(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:419/0 lens 488/3152 e 0 to 0 dl 1788201309 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788201298.656844:0:15178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201298.656846:0:15178:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9383f985bc4d3f14) 00010000:00010000:0.0:1788201298.656848:0:15178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201298.657158:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6d23568/0x9383f985bc4d434a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.657167:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d23568/0x9383f985bc4d434a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.657178:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201298.657598:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x422:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.657604:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d4382 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.657615:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x422:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.657619:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x422:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.657624:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d4382 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.657635:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d4382 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.657644:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d4382 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.657652:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d4382 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.657660:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788201298.657941:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x421:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201298.657947:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d4389 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.657955:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x421:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788201298.657959:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x421:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201298.657962:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d4389 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.657970:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d4389 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.657978:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d4389 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.657984:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d4389 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.657992:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788201298.658637:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b96a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.658642:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002790950b/0x9383f985bc4d437b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x437:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.658651:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002790950b/0x9383f985bc4d437b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x437:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.658669:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002790950b/0x9383f985bc4d437b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x437:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.658676:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002790950b/0x9383f985bc4d437b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x437:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.658695:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788201298.658699:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6d23568/0x9383f985bc4d434a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.658705:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.658708:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6d23568/0x9383f985bc4d434a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.658714:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6d23568/0x9383f985bc4d434a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.658723:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6d23568/0x9383f985bc4d434a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.658729:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6d23568/0x9383f985bc4d434a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.658741:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201298.658744:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d4382 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.658750:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.658753:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d4382 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.658761:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d4382 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.658770:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d4382 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.658777:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d4382 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.658788:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201298.658791:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d4389 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.658797:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.658800:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d4389 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.658808:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d4389 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.658818:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d4389 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.658824:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d4389 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.658834:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.658836:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.658838:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201298.659464:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4390 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.659477:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4390 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.659486:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4390 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201298.659751:0:15178:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000109f3cff reply state 00000000df5c4161 transno 12884901893 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4390 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201298.659759:0:15178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201298.659873:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:15000:x1875064442674816:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 3091us (96949us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1788201298.659882:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:0.0:1788201298.659915:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:0.0:1788201298.659925:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:15002:x1875064442674176:12345-192.168.201.30@tcp:36:chmod.0 00000004:00080000:0.0:1788201298.659967:0:15178:0:(mdt_internal.h:1254:mdt_check_resent()) @@@ no reply data found for RESENT req, rc = 0 req@ffff9e03c2b7ea00 x1875064442674176/t0(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:419/0 lens 488/3152 e 0 to 0 dl 1788201309 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788201298.659977:0:15178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201298.659980:0:15178:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9383f985bc4d3f4c) 00010000:00010000:0.0:1788201298.659983:0:15178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:1.0:1788201298.660519:0:13441:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:1056 00000100:00100000:1.0:1788201298.660607:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:15202:x1875064458239744:12345-0@lo:5:osp-pre-0-0.0 Request processed in 79897us (80014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201298.660616:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4229 00000100:00100000:1.0:1788201298.660664:0:15202:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c23d8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:15202:1875064458239744:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788201298.660677:0:15202:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x441:0x0] from OST, last_created [0x240000400:0x441:0x0]last_used is [0x240000400:0x420:0x0] 00000100:00100000:1.0:1788201298.660718:0:15202:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c33f3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:15202:1875064458240000:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788201298.660752:0:15202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201298.660777:0:15202:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1c24480 going to sleep for 50 seconds 00000100:00100000:1.0:1788201298.660793:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458240000 00000100:00100000:1.0:1788201298.660799:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458240000 00000100:00100000:1.0:1788201298.660833:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4231 00000100:00100000:1.0:1788201298.660841:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:15202:x1875064458240000:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788201298.660878:0:13441:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1090 00002000:00010000:2.0:1788201298.662713:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x436:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201298.662725:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008e3c192/0x9383f985bc4d4397 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x436:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.662741:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x436:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1788201298.662745:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x436:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201298.662751:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008e3c192/0x9383f985bc4d4397 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x436:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.662765:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008e3c192/0x9383f985bc4d4397 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x436:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.662780:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008e3c192/0x9383f985bc4d4397 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x436:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.662787:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008e3c192/0x9383f985bc4d4397 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x436:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.662805:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201298.662821:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201298.662827:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008e3c192/0x9383f985bc4d4397 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x436:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.662835:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b96000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.662840:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008e3c192/0x9383f985bc4d4397 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x436:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.662849:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008e3c192/0x9383f985bc4d4397 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x436:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.662866:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008e3c192/0x9383f985bc4d4397 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x436:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.662874:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008e3c192/0x9383f985bc4d4397 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x436:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.662893:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.662896:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.662898:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201298.664659:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d439e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.664678:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d439e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.664688:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d439e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201298.664863:0:15178:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007605a9f2 reply state 00000000c22578f3 transno 12884901894 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d439e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201298.664872:0:15178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201298.664973:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:15002:x1875064442674176:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 5047us (102036us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1788201298.664982:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:0.0:1788201298.665015:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:0.0:1788201298.665027:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:14998:x1875064442676096:12345-192.168.201.30@tcp:36:chmod.0 00002000:00010000:2.0:1788201298.666847:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x435:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201298.666859:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1c58db5/0x9383f985bc4d43a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x435:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.666875:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x435:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1788201298.666880:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x435:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201298.666886:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1c58db5/0x9383f985bc4d43a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x435:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.666900:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1c58db5/0x9383f985bc4d43a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x435:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.666910:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1c58db5/0x9383f985bc4d43a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x435:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.666918:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1c58db5/0x9383f985bc4d43a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x435:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.666944:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201298.666962:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201298.666967:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1c58db5/0x9383f985bc4d43a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x435:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.666976:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.666980:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1c58db5/0x9383f985bc4d43a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x435:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.666995:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1c58db5/0x9383f985bc4d43a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x435:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.667014:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1c58db5/0x9383f985bc4d43a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x435:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.667020:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1c58db5/0x9383f985bc4d43a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x435:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.667037:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.667039:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.667040:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788201298.668695:0:15178:0:(mdt_internal.h:1254:mdt_check_resent()) @@@ no reply data found for RESENT req, rc = 0 req@ffff9e03c2b7ce00 x1875064442676096/t0(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:419/0 lens 488/3152 e 0 to 0 dl 1788201309 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788201298.668712:0:15178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201298.668716:0:15178:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9383f985bc4d3f76) 00010000:00010000:0.0:1788201298.668718:0:15178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201298.668934:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d43ac lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.668949:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d43ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.668963:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d43ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201298.669447:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00002000:00010000:2.0:1788201298.669881:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x434:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201298.669889:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c5ceffe/0x9383f985bc4d43b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x434:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.669903:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x434:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1788201298.669907:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x434:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201298.669914:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c5ceffe/0x9383f985bc4d43b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x434:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.669924:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c5ceffe/0x9383f985bc4d43b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x434:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.669933:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c5ceffe/0x9383f985bc4d43b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x434:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.669942:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c5ceffe/0x9383f985bc4d43b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x434:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.669966:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201298.669978:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201298.669984:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c5ceffe/0x9383f985bc4d43b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x434:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.669992:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.669996:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c5ceffe/0x9383f985bc4d43b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x434:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.670004:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c5ceffe/0x9383f985bc4d43b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x434:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.670020:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c5ceffe/0x9383f985bc4d43b3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x434:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.670028:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c5ceffe/0x9383f985bc4d43b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x434:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201298.670231:0:15178:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9675ed1 reply state 00000000b86eeabb transno 12884901895 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d43ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201298.670240:0:15178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201298.673319:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:15202:x1875064458240000:12345-0@lo:5:osp-pre-0-0.0 Request processed in 12451us (12539us total) trans 4294968857 rc 0/0 00000100:00100000:1.0:1788201298.673328:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4231 00000100:00100000:1.0:1788201298.673386:0:15202:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c33f3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:15202:1875064458240000:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788201298.673401:0:15202:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x441:0x0]-[0x240000400:0x461:0x0] 00010000:00010000:2.0:1788201298.673517:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.673675:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.673678:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.673750:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d436d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.673769:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d436d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.673775:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d436d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.673782:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201298.673786:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d436d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.673793:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d436d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.673819:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fa:0x0].0x0 (ffff9e03c2fc5900) 00010000:00010000:2.0:1788201298.673822:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788201298.673827:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d436d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.673833:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d436d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201298.673919:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:14998:x1875064442676096:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 8892us (110964us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788201298.673931:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:0.0:1788201298.673953:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442680832 00000100:00100000:0.0:1788201298.673959:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442680832 00000100:00100000:0.0:1788201298.673984:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:0.0:1788201298.673993:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:14997:x1875064442680576:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1788201298.674000:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d4312 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.674007:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d4312 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.674010:0:15178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201298.674012:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d4312 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.674017:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201298.674026:0:15178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d43ba lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4f91 expref: -99 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.674084:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d43ba lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f91 expref: 24 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.674097:0:15178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d43ba lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f91 expref: 24 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.674115:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fb:0x0].0x0 (ffff9e03c2fc5c00) 00010000:00010000:0.0:1788201298.674117:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788201298.674120:0:15178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c19a9000, rc 0) 00010000:00010000:3.0:1788201298.674152:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d4312 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.674170:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d4312 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.674181:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ff:0x0].0x0 (ffff9e03c2fc5500) 00010000:00010000:3.0:1788201298.674183:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788201298.674186:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d4312 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.674192:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d4312 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.674213:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d42e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.674220:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d42e8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.674226:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d42e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.674232:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201298.674234:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d42e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.674240:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d42e8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.674247:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fd:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:3.0:1788201298.674249:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788201298.674251:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d42e8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.674256:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d42e8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201298.676290:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:2.0:1788201298.676303:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d4304 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.676324:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d4304 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.676330:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d4304 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.676337:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201298.676341:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d4304 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.676349:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d4304 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201298.676355:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:2.0:1788201298.676361:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fb:0x0].0x0 (ffff9e03c2fc5c00) 00010000:00010000:2.0:1788201298.676363:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788201298.676367:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d4304 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.676372:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d4304 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.676399:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.676405:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201298.676444:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d439e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.676451:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d439e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.676456:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d439e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.676461:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201298.676464:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d439e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.676469:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d439e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.676477:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x400:0x0].0x0 (ffff9e03c2fc5600) 00010000:00010000:1.0:1788201298.676480:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788201298.676483:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d439e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201298.676487:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d439e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.676612:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4390 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.676620:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4390 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.676626:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4390 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.676631:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201298.676635:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4390 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.676641:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4390 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.676650:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fe:0x0].0x0 (ffff9e03c2fc5800) 00010000:00010000:3.0:1788201298.676652:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788201298.676656:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4390 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.676661:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4390 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201298.678313:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1788201298.678334:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d43ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.678343:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d43ac lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.678350:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d43ac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.678355:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201298.678359:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d43ac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.678365:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d43ac lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.678376:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fc:0x0].0x0 (ffff9e03c2fc5d00) 00010000:00010000:3.0:1788201298.678380:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788201298.678383:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d43ac lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.678388:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d43ac lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201298.679885:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x433:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201298.679894:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d43c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x433:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.679906:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x433:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1788201298.679909:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x433:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201298.679913:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d43c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x433:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.679923:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d43c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x433:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.679929:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d43c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x433:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.679937:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d43c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x433:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.679957:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201298.679987:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201298.679994:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d43c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x433:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.680003:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201298.680007:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d43c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x433:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.680016:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d43c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x433:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.680170:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d43c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x433:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.680178:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e08abbd/0x9383f985bc4d43c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x433:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.680196:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201298.680198:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201298.680200:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201298.680250:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x432:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201298.680254:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d43c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x432:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.680260:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x432:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1788201298.680262:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x432:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201298.680264:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d43c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x432:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.680270:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d43c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x432:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.680275:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d43c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x432:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.680279:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d43c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x432:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.680308:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201298.680384:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201298.680390:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d43c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x432:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.680398:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201298.680402:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d43c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x432:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.680409:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d43c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x432:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.680420:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d43c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x432:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.680442:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d43c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x432:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.680455:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201298.680457:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201298.680459:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201298.681701:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x431:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201298.681710:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d43cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x431:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.681721:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x431:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1788201298.681724:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x431:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201298.681729:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d43cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x431:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.681738:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d43cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x431:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.681746:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d43cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x431:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201298.681844:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201298.681884:0:13451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442681344 00000100:00100000:3.0:1788201298.681893:0:13451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442681344 00000100:00100000:3.0:1788201298.681936:0:13451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4232 00000100:00100000:3.0:1788201298.681946:0:13451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2359:x1875064442681344:12345-192.168.201.30@tcp:2:chmod.0 00010000:00010000:2.0:1788201298.682014:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d43cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x431:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.682033:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201298.682042:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201298.682047:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d43cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x431:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.682055:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.682059:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d43cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x431:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.682067:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d43cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x431:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.682084:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d43cf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x431:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.682091:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d43cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x431:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.682108:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.682110:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.682112:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201298.682243:0:13451:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788201298.682246:0:13451:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb mtime from disk: 1788201267 -> 1788201267 00002000:00010000:2.0:1788201298.682248:0:13451:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb atime from disk: 1788201267 -> 1788201267 00002000:00010000:2.0:1788201298.682249:0:13451:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb ctime from disk: 1788201267 -> 1788201272 00002000:00010000:2.0:1788201298.682251:0:13451:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x41d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788201298.682319:0:13451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:2359:x1875064442681344:12345-192.168.201.30@tcp:2:chmod.0 Request processed in 374us (478us total) trans 4294968858 rc 0/0 00000100:00100000:2.0:1788201298.682327:0:13451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4232 00000100:00100000:0.0:1788201298.682536:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:14997:x1875064442680576:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 2242us (19583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201298.682548:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:0.0:1788201298.682567:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442680960 00000100:00100000:0.0:1788201298.682571:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442680960 00000100:00100000:0.0:1788201298.682653:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442681088 00000100:00100000:0.0:1788201298.682657:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442681088 00000100:00100000:0.0:1788201298.682671:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442681216 00000100:00100000:0.0:1788201298.682673:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442681216 00000100:00100000:0.0:1788201298.682685:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:0.0:1788201298.682691:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0007100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:14999:x1875064442680704:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1788201298.682705:0:15178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201298.682721:0:15178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d43d6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4f98 expref: -99 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.686251:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d43d6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f98 expref: 20 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.686273:0:15178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d43d6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f98 expref: 20 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201298.686909:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x430:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201298.686917:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d43dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x430:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.686930:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x430:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1788201298.686935:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x430:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201298.686940:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d43dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x430:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.686957:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d43dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x430:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.686967:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d43dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x430:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.686974:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d43dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x430:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.686993:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201298.687262:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201298.687270:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d43dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x430:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201298.687282:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201298.687283:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.687287:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d43e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.687288:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d43dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x430:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.687310:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d43dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x430:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.687321:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42f:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1788201298.687324:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201298.687327:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d43dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x430:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.687328:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d43e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.687335:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d43dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x430:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.687338:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d43e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.687346:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d43e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.687356:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.687357:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d43e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.687358:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201298.687360:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.687392:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201298.687703:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201298.687709:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4d43eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.687717:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42e:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1788201298.687720:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201298.687723:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4d43eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.687731:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4d43eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.687738:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4d43eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.687743:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4d43eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.687757:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788201298.687765:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201298.687770:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d43e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.687771:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201298.687776:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4d43eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.687777:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.687780:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d43e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.687784:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201298.687787:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4d43eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.687788:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d43e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.687794:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4d43eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.687804:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4d43eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x42e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.687811:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4d43eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.687826:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201298.687828:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201298.687829:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201298.687890:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201298.687922:0:15179:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788201298.687930:0:15179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788201298.688030:0:15179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442681472 00000100:00100000:3.0:1788201298.688039:0:15179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442681472 00010000:00010000:2.0:1788201298.688156:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d43e4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x42f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.688170:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d43e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.688186:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.688188:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.688189:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201298.688194:0:15284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:3.0:1788201298.688205:0:15284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:15001:x1875064442680832:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1788201298.688224:0:15284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201298.688238:0:15284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d43f2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4f9f expref: -99 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.688283:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d43f2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f9f expref: 22 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.688329:0:15284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d43f2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f9f expref: 22 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.688353:0:15284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ff:0x0].0x0 (ffff9e05020e0300) 00010000:00010000:3.0:1788201298.688356:0:15284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201298.688358:0:15284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5064600, rc 0) 00000100:00100000:3.0:1788201298.688413:0:15284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:15001:x1875064442680832:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 208us (18967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201298.688419:0:15284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00010000:00010000:0.0:1788201298.688491:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fd:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:0.0:1788201298.688495:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788201298.688497:0:15178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c19a8800, rc 0) 00000100:00100000:3.0:1788201298.688557:0:15284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:0.0:1788201298.688573:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0007100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:14999:x1875064442680704:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 5828us (31845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201298.688575:0:15284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c23d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:14996:x1875064442680960:12345-192.168.201.30@tcp:101:chmod.0 00000100:00100000:0.0:1788201298.688580:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00010000:00010000:3.0:1788201298.688584:0:15284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1788201298.688595:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15 00010000:00010000:3.0:1788201298.688595:0:15284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d43f9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4fa6 expref: -99 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201298.688602:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:15000:x1875064442681088:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1788201298.688608:0:15178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201298.688618:0:15178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d4400 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4fad expref: -99 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.688619:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d43f9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fa6 expref: 21 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.688630:0:15284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d43f9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fa6 expref: 22 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.688641:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d4400 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fad expref: 22 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.688641:0:15284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fa:0x0].0x0 (ffff9e03c23c1500) 00010000:00010000:3.0:1788201298.688643:0:15284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201298.688646:0:15284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5065e00, rc 0) 00010000:00010000:0.0:1788201298.688650:0:15178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d4400 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fad expref: 22 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.688661:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fe:0x0].0x0 (ffff9e03c2fc5e00) 00010000:00010000:0.0:1788201298.688664:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788201298.688666:0:15178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c19a8200, rc 0) 00000100:00100000:3.0:1788201298.688669:0:15284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c23d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:14996:x1875064442680960:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 106us (12382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201298.688675:0:15284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:0.0:1788201298.688681:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:15000:x1875064442681088:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 80us (12325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201298.688686:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:0.0:1788201298.688697:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:0.0:1788201298.688705:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:14998:x1875064442681216:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1788201298.688713:0:15178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201298.688722:0:15178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d4407 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4fb4 expref: -99 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201298.688728:0:15284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:3.0:1788201298.688735:0:15284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:15002:x1875064442681472:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1788201298.688744:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d4407 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fb4 expref: 21 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.688747:0:15284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201298.688756:0:15284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d440e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x400:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4fbb expref: -99 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.688780:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d440e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x400:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fbb expref: 22 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.688790:0:15284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d440e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x400:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fbb expref: 22 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.688801:0:15284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x400:0x0].0x0 (ffff9e03c23c1300) 00010000:00010000:3.0:1788201298.688804:0:15284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201298.688806:0:15284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5064000, rc 0) 00000100:00100000:3.0:1788201298.688830:0:15284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:15002:x1875064442681472:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 95us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201298.688836:0:15284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 17 00002000:00010000:2.0:1788201298.689055:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201298.689062:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9ed0269/0x9383f985bc4d4415 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.689070:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42d:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1788201298.689074:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201298.689079:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9ed0269/0x9383f985bc4d4415 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.689089:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9ed0269/0x9383f985bc4d4415 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.689097:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9ed0269/0x9383f985bc4d4415 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.689104:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9ed0269/0x9383f985bc4d4415 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.689125:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201298.689497:0:15178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d4407 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fb4 expref: 21 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.689516:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fc:0x0].0x0 (ffff9e03c2fc5400) 00010000:00010000:0.0:1788201298.689519:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788201298.689967:0:15178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c19a9800, rc 0) 00000100:00100000:0.0:1788201298.690014:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:14998:x1875064442681216:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 1309us (11722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201298.690022:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 16 00002000:00010000:2.0:1788201298.690730:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201298.690738:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066520edc/0x9383f985bc4d441c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.690749:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42c:0x0].0x0 since=573s v=(0 0) 00010000:00010000:2.0:1788201298.691485:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201298.691495:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066520edc/0x9383f985bc4d441c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.691509:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066520edc/0x9383f985bc4d441c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.691518:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066520edc/0x9383f985bc4d441c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.691525:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066520edc/0x9383f985bc4d441c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.693240:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201298.693252:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9ed0269/0x9383f985bc4d4415 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.693265:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff128a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201298.693270:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9ed0269/0x9383f985bc4d4415 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.693280:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9ed0269/0x9383f985bc4d4415 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.693425:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9ed0269/0x9383f985bc4d4415 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x42d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.693446:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9ed0269/0x9383f985bc4d4415 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201298.693475:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201298.693477:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201298.693479:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.693952:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201298.695344:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201298.695355:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066520edc/0x9383f985bc4d441c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.695366:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.695370:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066520edc/0x9383f985bc4d441c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.695380:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066520edc/0x9383f985bc4d441c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.695478:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066520edc/0x9383f985bc4d441c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x42c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.695487:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066520edc/0x9383f985bc4d441c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.695507:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.695509:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.695511:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201298.697691:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201298.697721:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201298.697740:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201298.697800:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201298.697831:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442681600 00000100:00100000:2.0:1788201298.697841:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442681600 00000100:00100000:2.0:1788201298.697876:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442681728 00000100:00100000:2.0:1788201298.697879:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442681728 00000100:00100000:2.0:1788201298.697896:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442681856 00000100:00100000:2.0:1788201298.697899:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442681856 00000100:00100000:2.0:1788201298.697914:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442681984 00000100:00100000:2.0:1788201298.697917:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442681984 00000100:00100000:2.0:1788201298.697937:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4233 00000100:00100000:2.0:1788201298.697946:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2362:x1875064442681600:12345-192.168.201.30@tcp:2:chmod.0 00002000:00010000:2.0:1788201298.698141:0:6703:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788201298.698145:0:6703:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb mtime from disk: 1788201267 -> 1788201267 00002000:00010000:2.0:1788201298.698147:0:6703:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb atime from disk: 1788201267 -> 1788201267 00002000:00010000:2.0:1788201298.698149:0:6703:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb ctime from disk: 1788201267 -> 1788201272 00002000:00010000:2.0:1788201298.698151:0:6703:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x41e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788201298.698202:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:2362:x1875064442681600:12345-192.168.201.30@tcp:2:chmod.0 Request processed in 257us (519us total) trans 4294968859 rc 0/0 00000100:00100000:2.0:1788201298.698210:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4233 00000100:00100000:2.0:1788201298.698229:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4234 00000100:00100000:2.0:1788201298.698236:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+510:2361:x1875064442681728:12345-192.168.201.30@tcp:2:chmod.0 00002000:00010000:2.0:1788201298.698385:0:6703:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788201298.698388:0:6703:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb mtime from disk: 1788201267 -> 1788201267 00002000:00010000:2.0:1788201298.698390:0:6703:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb atime from disk: 1788201267 -> 1788201267 00002000:00010000:2.0:1788201298.698392:0:6703:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb ctime from disk: 1788201267 -> 1788201272 00002000:00010000:2.0:1788201298.698394:0:6703:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x41d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788201298.698415:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2361:x1875064442681728:12345-192.168.201.30@tcp:2:chmod.0 Request processed in 180us (693us total) trans 4294968858 rc 0/0 00000100:00100000:2.0:1788201298.698422:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4234 00000100:00100000:2.0:1788201298.698448:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4235 00000100:00100000:2.0:1788201298.698498:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+510:2361:x1875064442681856:12345-192.168.201.30@tcp:2:chmod.0 00002000:00010000:2.0:1788201298.698704:0:6703:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x41f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788201298.698708:0:6703:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x41f:0x0] updating lvb mtime from disk: 1788201267 -> 1788201267 00002000:00010000:2.0:1788201298.698710:0:6703:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x41f:0x0] updating lvb atime from disk: 1788201267 -> 1788201267 00002000:00010000:2.0:1788201298.698713:0:6703:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x41f:0x0] updating lvb ctime from disk: 1788201267 -> 1788201272 00002000:00010000:2.0:1788201298.698715:0:6703:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x41f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788201298.698735:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2361:x1875064442681856:12345-192.168.201.30@tcp:2:chmod.0 Request processed in 280us (994us total) trans 4294968859 rc 0/0 00000100:00100000:2.0:1788201298.698741:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4235 00000100:00100000:2.0:1788201298.698753:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4236 00000100:00100000:2.0:1788201298.698759:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2360:x1875064442681984:12345-192.168.201.30@tcp:2:chmod.0 00002000:00010000:2.0:1788201298.698824:0:6703:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x41f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788201298.698827:0:6703:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x41f:0x0] updating lvb mtime from disk: 1788201267 -> 1788201267 00002000:00010000:2.0:1788201298.698829:0:6703:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x41f:0x0] updating lvb atime from disk: 1788201267 -> 1788201267 00002000:00010000:2.0:1788201298.698831:0:6703:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x41f:0x0] updating lvb ctime from disk: 1788201267 -> 1788201272 00002000:00010000:2.0:1788201298.698833:0:6703:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x41f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788201298.698851:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:2360:x1875064442681984:12345-192.168.201.30@tcp:2:chmod.0 Request processed in 92us (1051us total) trans 4294968860 rc 0/0 00000100:00100000:2.0:1788201298.698858:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4236 00000100:00100000:0.0:1788201298.729643:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201298.729690:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201298.729909:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442682112 00000100:00100000:0.0:1788201298.729919:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442682112 00000100:00100000:0.0:1788201298.729959:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442682240 00000100:00100000:0.0:1788201298.729963:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442682240 00000100:00100000:0.0:1788201298.729984:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4237 00000100:00100000:0.0:1788201298.729992:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9659c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+512:2359:x1875064442682112:12345-192.168.201.30@tcp:2:chmod.0 00002000:00010000:0.0:1788201298.730170:0:12363:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788201298.730174:0:12363:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb mtime from disk: 1788201267 -> 1788201267 00002000:00010000:0.0:1788201298.730177:0:12363:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb atime from disk: 1788201267 -> 1788201267 00002000:00010000:0.0:1788201298.730179:0:12363:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb ctime from disk: 1788201267 -> 1788201272 00002000:00010000:0.0:1788201298.730181:0:12363:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x420:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788201298.730235:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9659c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+513:2359:x1875064442682112:12345-192.168.201.30@tcp:2:chmod.0 Request processed in 244us (602us total) trans 4294968860 rc 0/0 00000100:00100000:0.0:1788201298.730243:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4237 00000100:00100000:0.0:1788201298.730259:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4238 00000100:00100000:0.0:1788201298.730266:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+512:2362:x1875064442682240:12345-192.168.201.30@tcp:2:chmod.0 00002000:00010000:0.0:1788201298.730353:0:12363:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788201298.730356:0:12363:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb mtime from disk: 1788201267 -> 1788201267 00002000:00010000:0.0:1788201298.730358:0:12363:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb atime from disk: 1788201267 -> 1788201267 00002000:00010000:0.0:1788201298.730360:0:12363:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb ctime from disk: 1788201267 -> 1788201272 00002000:00010000:0.0:1788201298.730363:0:12363:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x41e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788201298.730381:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+513:2362:x1875064442682240:12345-192.168.201.30@tcp:2:chmod.0 Request processed in 116us (692us total) trans 4294968861 rc 0/0 00000100:00100000:0.0:1788201298.730387:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4238 00002000:00010000:2.0:1788201298.753680:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201298.753694:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7f7118e/0x9383f985bc4d4423 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.753711:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42b:0x0].0x0 since=574s v=(0 0) 00010000:00010000:2.0:1788201298.753716:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201298.753722:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7f7118e/0x9383f985bc4d4423 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.753737:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7f7118e/0x9383f985bc4d4423 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.753747:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7f7118e/0x9383f985bc4d4423 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.753756:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7f7118e/0x9383f985bc4d4423 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.753776:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201298.753787:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201298.753793:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7f7118e/0x9383f985bc4d4423 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.753801:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.753805:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7f7118e/0x9383f985bc4d4423 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.753814:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7f7118e/0x9383f985bc4d4423 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.753829:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7f7118e/0x9383f985bc4d4423 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x42b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.753841:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7f7118e/0x9383f985bc4d4423 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.753857:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.753859:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.753860:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201298.758235:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201298.758247:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d442a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.758265:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42a:0x0].0x0 since=574s v=(0 0) 00010000:00010000:2.0:1788201298.758269:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201298.758275:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d442a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.758288:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d442a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.758314:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d442a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.758323:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d442a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.758348:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201298.758748:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x429:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201298.758754:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d4431 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x429:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.758764:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x429:0x0].0x0 since=574s v=(0 0) 00010000:00010000:2.0:1788201298.758766:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x429:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201298.758770:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d4431 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x429:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.758779:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d4431 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x429:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.758786:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d4431 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x429:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.758792:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d4431 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x429:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.758824:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788201298.758840:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201298.758845:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d442a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.758852:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.758856:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d442a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.758868:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d442a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.758883:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d442a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x42a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.758889:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d442a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.758906:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201298.760364:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.760445:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d4431 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x429:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.760459:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff128600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.760464:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d4431 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x429:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.760474:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d4431 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x429:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.760490:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d4431 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x429:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.760497:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d4431 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x429:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.760518:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.760520:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.760522:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201298.761600:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x428:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201298.761609:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001687b5b9/0x9383f985bc4d4438 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x428:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.761621:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x428:0x0].0x0 since=574s v=(0 0) 00010000:00010000:2.0:1788201298.761625:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x428:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201298.761631:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001687b5b9/0x9383f985bc4d4438 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x428:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.761641:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001687b5b9/0x9383f985bc4d4438 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x428:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.761651:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001687b5b9/0x9383f985bc4d4438 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x428:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.761658:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001687b5b9/0x9383f985bc4d4438 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x428:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.761678:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201298.762546:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x427:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201298.762553:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e9d4bc7/0x9383f985bc4d443f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x427:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.762568:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x427:0x0].0x0 since=574s v=(0 0) 00010000:00010000:2.0:1788201298.762571:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x427:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201298.762575:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e9d4bc7/0x9383f985bc4d443f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x427:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.762585:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e9d4bc7/0x9383f985bc4d443f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x427:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.762593:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e9d4bc7/0x9383f985bc4d443f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x427:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.762601:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e9d4bc7/0x9383f985bc4d443f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x427:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.762614:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788201298.764133:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x426:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201298.764144:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d4446 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.764173:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x426:0x0].0x0 since=574s v=(0 0) 00010000:00010000:2.0:1788201298.764177:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x426:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201298.764182:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d4446 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.764193:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d4446 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.764208:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d4446 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.764215:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d4446 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.764282:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788201298.764310:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788201298.764317:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001687b5b9/0x9383f985bc4d4438 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x428:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.764326:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff128400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.764331:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001687b5b9/0x9383f985bc4d4438 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x428:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.764340:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001687b5b9/0x9383f985bc4d4438 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x428:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.764358:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001687b5b9/0x9383f985bc4d4438 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x428:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.764366:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001687b5b9/0x9383f985bc4d4438 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x428:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.764385:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201298.764390:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e9d4bc7/0x9383f985bc4d443f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x427:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.764411:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.764414:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e9d4bc7/0x9383f985bc4d443f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x427:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.764422:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e9d4bc7/0x9383f985bc4d443f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x427:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.764441:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e9d4bc7/0x9383f985bc4d443f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x427:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.764447:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e9d4bc7/0x9383f985bc4d443f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x427:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.764470:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201298.764474:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d4446 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.764481:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.764484:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d4446 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.764491:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d4446 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.764506:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d4446 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.764514:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d4446 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x426:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.764524:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.764526:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.764528:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201298.771328:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201298.771351:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201298.775569:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x425:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201298.775582:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e4d980a/0x9383f985bc4d444d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.775601:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x425:0x0].0x0 since=574s v=(0 0) 00010000:00010000:2.0:1788201298.775606:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x425:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201298.775612:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e4d980a/0x9383f985bc4d444d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.775626:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e4d980a/0x9383f985bc4d444d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.775637:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e4d980a/0x9383f985bc4d444d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.775645:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e4d980a/0x9383f985bc4d444d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.775671:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201298.775683:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201298.775689:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e4d980a/0x9383f985bc4d444d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.775697:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff128200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201298.775701:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e4d980a/0x9383f985bc4d444d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.775709:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e4d980a/0x9383f985bc4d444d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.775724:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e4d980a/0x9383f985bc4d444d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.775731:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e4d980a/0x9383f985bc4d444d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x425:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.775747:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.775749:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.775750:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201298.776179:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x424:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201298.776185:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fc7740f/0x9383f985bc4d4454 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x424:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.776193:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x424:0x0].0x0 since=574s v=(0 0) 00010000:00010000:2.0:1788201298.776197:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x424:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201298.776201:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fc7740f/0x9383f985bc4d4454 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x424:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.776210:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fc7740f/0x9383f985bc4d4454 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x424:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.776218:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fc7740f/0x9383f985bc4d4454 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x424:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.776225:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005fc7740f/0x9383f985bc4d4454 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x424:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.776234:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201298.778697:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201298.778710:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005fc7740f/0x9383f985bc4d4454 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x424:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.778723:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201298.778727:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005fc7740f/0x9383f985bc4d4454 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x424:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.778738:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005fc7740f/0x9383f985bc4d4454 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x424:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.778759:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005fc7740f/0x9383f985bc4d4454 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x424:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.778766:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fc7740f/0x9383f985bc4d4454 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x424:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.778789:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201298.778791:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201298.778793:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201298.780442:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x423:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201298.780628:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000170145d5/0x9383f985bc4d445b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.780645:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x423:0x0].0x0 since=574s v=(0 0) 00010000:00010000:2.0:1788201298.780650:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x423:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201298.780657:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000170145d5/0x9383f985bc4d445b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.780670:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000170145d5/0x9383f985bc4d445b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.780680:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000170145d5/0x9383f985bc4d445b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.780689:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000170145d5/0x9383f985bc4d445b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.780743:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201298.781211:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x422:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201298.781217:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d4462 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.781227:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x422:0x0].0x0 since=574s v=(0 0) 00010000:00010000:2.0:1788201298.781230:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x422:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201298.781234:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d4462 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.781243:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d4462 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.781251:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d4462 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.781257:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d4462 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.781334:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201298.781341:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000170145d5/0x9383f985bc4d445b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.781350:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201298.781354:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000170145d5/0x9383f985bc4d445b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.781363:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000170145d5/0x9383f985bc4d445b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.781378:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000170145d5/0x9383f985bc4d445b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.781385:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000170145d5/0x9383f985bc4d445b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x423:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.781400:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201298.781403:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d4462 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.781409:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201298.781413:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d4462 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.781420:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d4462 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.781440:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d4462 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.781448:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201298.781450:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201298.781452:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201298.781722:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201298.781727:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d4462 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x422:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.781752:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201298.783261:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x421:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201298.783270:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d4469 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.783281:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x421:0x0].0x0 since=574s v=(0 0) 00010000:00010000:2.0:1788201298.783284:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x421:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201298.783289:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d4469 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.783325:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d4469 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.783334:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d4469 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.783340:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d4469 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.783356:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201298.783661:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201298.783667:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d4469 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.783676:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201298.783680:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d4469 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.783689:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d4469 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.783704:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d4469 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.783710:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d4469 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x421:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.783726:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201298.783728:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201298.783729:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201298.783991:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x420:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201298.783998:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d4470 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.784006:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x420:0x0].0x0 since=574s v=(0 0) 00010000:00010000:2.0:1788201298.784010:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x420:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201298.784014:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d4470 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.784022:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d4470 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.784029:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d4470 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.784035:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d4470 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201298.784152:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788201298.784359:0:13444:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:1055 00000100:00100000:2.0:1788201298.784469:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:15204:x1875064458239872:12345-0@lo:5:osp-pre-1-0.0 Request processed in 196546us (199951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201298.784479:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4230 00000100:00100000:2.0:1788201298.784681:0:15204:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:15204:1875064458239872:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788201298.784695:0:15204:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x441:0x0] from OST, last_created [0x280000400:0x441:0x0]last_used is [0x280000400:0x41f:0x0] 00000100:00100000:2.0:1788201298.784736:0:15204:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53ebb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:15204:1875064458240128:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788201298.784770:0:15204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201298.784791:0:15204:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c1849000 going to sleep for 50 seconds 00000100:00100000:2.0:1788201298.784822:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458240128 00000100:00100000:2.0:1788201298.784828:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458240128 00000100:00100000:2.0:1788201298.784867:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4239 00000100:00100000:2.0:1788201298.784877:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:15204:x1875064458240128:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788201298.784924:0:6706:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1090 00010000:00010000:0.0:1788201298.788817:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201298.788829:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d4470 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.788845:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201298.788852:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d4470 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.788864:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d4470 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.788886:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d4470 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.788894:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053e3adb2/0x9383f985bc4d4470 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201298.788918:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201298.788920:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201298.788922:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201298.793419:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201298.799137:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:15204:x1875064458240128:12345-0@lo:5:osp-pre-1-0.0 Request processed in 14254us (14359us total) trans 4294968861 rc 0/0 00000100:00100000:2.0:1788201298.799151:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4239 00000100:00100000:2.0:1788201298.799275:0:15204:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53ebb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:15204:1875064458240128:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788201298.799290:0:15204:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x441:0x0]-[0x280000400:0x461:0x0] 00000001:00100000:2.0:1788201298.841466:0:7657:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788201298.841525:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968858 is committed 00000001:00080000:0.0:1788201298.871564:0:6732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294968857 is committed 00000001:00100000:0.0:1788201298.871622:0:6732:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788201299.815122:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201300.846389:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201301.861578:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201302.245547:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458240256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201302.245620:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201302.245828:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201302.245838:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458240384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201302.245868:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201302.245901:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458240256 00000100:00100000:1.0:1788201302.245909:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458240256 00000100:00100000:1.0:1788201302.245956:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458240384 00000100:00100000:1.0:1788201302.245960:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458240384 00000100:00100000:1.0:1788201302.245977:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788201302.245986:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875064458240256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201302.246024:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 13631488 granted 524877824 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201302.246069:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875064458240256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201302.246076:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788201302.246093:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788201302.246100:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d1f0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458240384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201302.246117:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524877824 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1788201302.246144:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d1f0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458240384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201302.246150:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:1.0:1788201302.246164:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201302.246168:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201302.246356:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458240256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201302.246396:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968857 gen 2 00000100:00100000:1.0:1788201302.246409:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d1f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458240384:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788201302.353128:0:15469:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788201302.885509:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201303.270738:0:3309:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201293/real 1788201293] req@ffff9e04f000dc00 x1875064458232064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201303 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201303.270767:0:3309:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e04f000dc00 x1875064458232064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201303 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201303.270778:0:3309:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201293/real 1788201293] req@ffff9e03c53e9f80 x1875064458231936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201303 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201303.270790:0:3309:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e03c53e9f80 x1875064458231936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201303 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201303.270807:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201303.270830:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788201303.270834:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875064458232064:0@lo:38:kworker.0 00000100:00080000:2.0:1788201303.270839:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201303.270844:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788201303.270847:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875064458231936:0@lo:38:kworker.0 00000100:00080000:0.0:1788201303.270941:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201303.270945:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201303.270948:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201303.270953:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 568 00000100:00080000:0.0:1788201303.270959:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788201303.270965:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e04ff4ba000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1788201303.270985:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e04f0004e00 x1875064458240640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201303.270997:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201303.271000:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201303.271001:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201303.271004:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 568 00000100:00080000:0.0:1788201303.271007:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788201303.271009:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e04f5751000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1788201303.271019:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e04f0006d80 x1875064458240768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201303.271066:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0007800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458241152:0@lo:400:kworker.0 00000100:00100000:0.0:1788201303.271128:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201303.271170:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201303.271175:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0007b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458240512:0@lo:400:kworker.0 00000100:00100000:0.0:1788201303.271200:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201303.271225:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458240896:0@lo:400:kworker.0 00000100:00100000:0.0:1788201303.271250:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201303.271263:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201303.271267:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458241024:0@lo:400:kworker.0 00000100:00100000:0.0:1788201303.271282:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201303.271326:0:15179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458241152 00000100:00100000:0.0:1788201303.271332:0:15179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458241152 00000100:00100000:0.0:1788201303.271379:0:15179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788201303.271388:0:15179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458241152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201303.271432:0:15179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458241152:12345-0@lo:400:kworker.0 Request processed in 46us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201303.271439:0:15179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788201303.271503:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0007800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458241152:0@lo:400:kworker.0 00000100:00100000:2.0:1788201303.271657:0:15194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458240512 00000100:00100000:2.0:1788201303.271662:0:15194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458240512 00000100:00100000:2.0:1788201303.271701:0:15194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788201303.271707:0:15194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1bed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3312:x1875064458240512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201303.271745:0:15194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1bed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3312:x1875064458240512:12345-0@lo:400:kworker.0 Request processed in 38us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201303.271751:0:15194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788201303.271784:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458240896 00000100:00100000:2.0:1788201303.271787:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458240896 00000100:00100000:2.0:1788201303.271813:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458241024 00000100:00100000:2.0:1788201303.271816:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458241024 00000100:00100000:2.0:1788201303.271835:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788201303.271842:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458240896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201303.271879:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458240896:12345-0@lo:400:kworker.0 Request processed in 37us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201303.271884:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788201303.271896:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788201303.271902:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0004a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3310:x1875064458241024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201303.271928:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0004a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3310:x1875064458241024:12345-0@lo:400:kworker.0 Request processed in 26us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201303.271933:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788201303.271970:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458241024:0@lo:400:kworker.0 00000100:00100000:2.0:1788201303.271980:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458240896:0@lo:400:kworker.0 00000100:00100000:2.0:1788201303.271999:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875064458240640:0@lo:38:kworker.0 00000100:00100000:2.0:1788201303.272026:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201303.272051:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875064458240768:0@lo:38:kworker.0 00000100:00100000:2.0:1788201303.272072:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201303.272102:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0007b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458240512:0@lo:400:kworker.0 00000100:00100000:3.0:1788201303.272270:0:15284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458240640 00000100:00100000:3.0:1788201303.272274:0:15284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458240640 00000100:00100000:3.0:1788201303.272321:0:15284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458240768 00000100:00100000:3.0:1788201303.272325:0:15284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458240768 00000100:00100000:3.0:1788201303.272340:0:15284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788201303.272346:0:15284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3309:x1875064458240640:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788201303.272379:0:15284:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 578 last 0 00000020:00000080:3.0:1788201303.272425:0:15284:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9383f985bc4d4477 00000004:00100000:3.0:1788201303.272442:0:15284:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1788201303.272636:0:15179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788201303.272641:0:15179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3309:x1875064458240768:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788201303.272655:0:15179:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 578 last 0 00000020:00000080:2.0:1788201303.272676:0:15179:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9383f985bc4d447e 00000004:00100000:2.0:1788201303.272682:0:15179:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788201303.272706:0:15179:0:(import.c:65:import_set_state_nolock()) ffff9e04fae20800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201303.272750:0:15179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875064458240768:12345-0@lo:38:kworker.0 Request processed in 107us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201303.272757:0:15179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1788201303.272787:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1788201303.273654:0:15284:0:(import.c:65:import_set_state_nolock()) ffff9e04f9768000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201303.273705:0:15284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875064458240640:12345-0@lo:38:kworker.0 Request processed in 1358us (1677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201303.273715:0:15284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788201303.274624:0:3309:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9e04f0006d80 x1875064458240768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201318 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201303.274635:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788201303.274640:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788201303.274643:0:3309:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788201303.302784:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875064458240768:0@lo:38:kworker.0 00000100:00080000:2.0:1788201303.302852:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1788201303.304750:0:3309:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9e04f0004e00 x1875064458240640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201318 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201303.304764:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788201303.304770:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788201303.304776:0:3309:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788201303.304782:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875064458240640:0@lo:38:kworker.0 00000100:00100000:3.0:1788201303.442584:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201303.442626:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442682496 00000100:00100000:3.0:1788201303.442636:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442682496 00000100:00100000:3.0:1788201303.442701:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 187 00000100:00100000:3.0:1788201303.442712:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+513:2361:x1875064442682496:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201303.442795:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+513:2361:x1875064442682496:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 85us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201303.442802:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 187 00000100:00080000:3.0:1788201303.442825:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201303.457764:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201303.457804:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201303.457830:0:15179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442682368 00000100:00100000:3.0:1788201303.457839:0:15179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442682368 00000100:00100000:3.0:1788201303.457899:0:15179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:3.0:1788201303.457911:0:15179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:2362:x1875064442682368:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201303.457985:0:15179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:2362:x1875064442682368:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 76us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201303.457993:0:15179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:3.0:1788201303.458017:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442682624 00000100:00100000:3.0:1788201303.458021:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442682624 00000100:00100000:3.0:1788201303.458050:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 188 00000100:00100000:3.0:1788201303.458057:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2362:x1875064442682624:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201303.458082:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2362:x1875064442682624:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201303.458093:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 188 00000100:00080000:3.0:1788201303.458114:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201303.458119:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1788201303.868728:0:6732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294968861 is committed 00000001:00080000:0.0:1788201303.868905:0:15196:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000001:00080000:3.0:1788201303.892139:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968861 is committed 00000001:00080000:3.0:1788201303.892172:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968860 is committed 00010000:00010000:0.0:1788201303.910012:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1788201304.293481:0:3312:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201287/real 1788201287] req@ffff9e04f000c700 x1875064458231424/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201303 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201304.309875:0:3312:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e04f000c700 x1875064458231424/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201303 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000400:2.0:1788201304.309893:0:3312:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201287/real 1788201287] req@ffff9e04f000c380 x1875064458231296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201303 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201304.309905:0:3312:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e04f000c380 x1875064458231296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201303 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201304.309923:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458231424:0@lo:400:kworker.0 00000100:00100000:2.0:1788201304.309928:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458231296:0@lo:400:kworker.0 00000100:00100000:3.0:1788201304.657455:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201304.657488:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201304.657630:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201304.657687:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442682880 00000100:00100000:0.0:1788201304.657697:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442682880 00000100:00100000:0.0:1788201304.657771:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:0.0:1788201304.657782:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:2360:x1875064442682880:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201304.657859:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:2360:x1875064442682880:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 78us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201304.657866:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:3.0:1788201304.662499:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201304.662582:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442682752 00000100:00100000:1.0:1788201304.662592:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442682752 00000100:00100000:1.0:1788201304.662640:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00100000:1.0:1788201304.662649:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2358:x1875064442682752:12345-192.168.201.30@tcp:250:kworker.0 00010000:00080000:1.0:1788201304.662679:0:15174:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 7ad49433-54fa-4e21-b756-859420d95603@192.168.201.30@tcp t0 exp 0000000000000000 cur 579 last 0 00000020:00000080:1.0:1788201304.662707:0:15174:0:(genops.c:1406:class_connect()) connect: client 7ad49433-54fa-4e21-b756-859420d95603, cookie 0x9383f985bc4d4485 00000100:00080000:1.0:1788201304.662842:0:15174:0:(import.c:65:import_set_state_nolock()) ffff9e03c5132000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201304.662915:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+5:2358:x1875064442682752:12345-192.168.201.30@tcp:250:kworker.0 Request processed in 265us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201304.662922:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00100000:2.0:1788201304.673877:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442683136 00000100:00100000:2.0:1788201304.673893:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442683136 00000100:00100000:2.0:1788201304.673973:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442683008 00000100:00100000:2.0:1788201304.673977:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442683008 00000100:00100000:2.0:1788201304.674022:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 189 00000100:00100000:2.0:1788201304.674033:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2360:x1875064442683136:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201304.674040:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 190 00000100:00100000:1.0:1788201304.674049:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2360:x1875064442683008:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201304.680405:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2360:x1875064442683136:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 6358us (22900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201304.680423:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 189 00000100:00100000:1.0:1788201304.680448:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2360:x1875064442683008:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 6400us (22816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201304.680456:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 190 00010000:00010000:0.0:1788201304.933514:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201305.958557:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201306.368594:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201306.369215:0:15179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442683264 00000100:00100000:2.0:1788201306.369225:0:15179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442683264 00000100:00100000:2.0:1788201306.369355:0:15179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:2.0:1788201306.369368:0:15179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:15312:x1875064442683264:12345-192.168.201.30@tcp:41:lfs.0 00000004:00000024:2.0:1788201306.369416:0:15179:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788201306.369525:0:15179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:15312:x1875064442683264:12345-192.168.201.30@tcp:41:lfs.0 Request processed in 160us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201306.369532:0:15179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00080000:3.0:1788201306.369908:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201306.373558:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201306.373709:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442683392 00000100:00100000:1.0:1788201306.373720:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442683392 00000100:00100000:1.0:1788201306.373809:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 150 00000100:00100000:1.0:1788201306.373820:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0007800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:15312:x1875064442683392:12345-192.168.201.30@tcp:13:lfs.0 00002000:00000024:1.0:1788201306.373862:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524877824 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1788201306.373946:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0007800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:15312:x1875064442683392:12345-192.168.201.30@tcp:13:lfs.0 Request processed in 127us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201306.373958:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 150 00000100:00080000:3.0:1788201306.374647:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201306.376845:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201306.377025:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442683520 00000100:00100000:2.0:1788201306.377036:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442683520 00000100:00100000:2.0:1788201306.377145:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 151 00000100:00100000:2.0:1788201306.377157:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d1f0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:15312:x1875064442683520:12345-192.168.201.30@tcp:13:lfs.0 00002000:00000024:2.0:1788201306.377196:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 13631488 granted 524877824 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201306.377272:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d1f0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:15312:x1875064442683520:12345-192.168.201.30@tcp:13:lfs.0 Request processed in 118us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201306.377280:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 151 00000100:00080000:3.0:1788201306.377886:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201306.586009:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201306.586140:0:15194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442683648 00000100:00100000:2.0:1788201306.586151:0:15194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442683648 00000100:00100000:2.0:1788201306.586208:0:15194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:2.0:1788201306.586219:0:15194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7ad49433-54fa-4e21-b756-859420d95603+5:5601:x1875064442683648:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201306.586236:0:15194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201306.586255:0:15194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e04c0030a00/0x9383f985bc4d448c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4fc2 expref: -99 pid: 15194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.586283:0:15194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e04c0030a00/0x9383f985bc4d448c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fc2 expref: 6 pid: 15194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.586334:0:15194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e04c0030a00/0x9383f985bc4d448c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fc2 expref: 6 pid: 15194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.586347:0:15194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0030a00, rc 0) 00000100:00100000:2.0:1788201306.586411:0:15194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7ad49433-54fa-4e21-b756-859420d95603+6:5601:x1875064442683648:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 193us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201306.586418:0:15194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:0.0:1788201306.600446:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201306.600687:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442683776 00000100:00100000:1.0:1788201306.600702:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442683776 00000100:00100000:1.0:1788201306.600784:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:1.0:1788201306.600797:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+6:5601:x1875064442683776:12345-192.168.201.30@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788201306.600835:0:15174:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1788201306.600869:0:15174:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788201306.600875:0:15174:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1788201306.600878:0:15174:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1788201306.600881:0:15174:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:0.0:1788201306.623465:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+6:5601:x1875064442683776:12345-192.168.201.30@tcp:256:ll_cfg_requeue.0 Request processed in 22637us (23002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201306.623485:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:0.0:1788201306.633634:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201306.635424:0:15194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442683904 00000100:00100000:2.0:1788201306.635441:0:15194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442683904 00000100:00100000:2.0:1788201306.635546:0:15194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:2.0:1788201306.635556:0:15194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7ad49433-54fa-4e21-b756-859420d95603+6:5601:x1875064442683904:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201306.635572:0:15194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201306.635590:0:15194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e04c0031c00/0x9383f985bc4d4493 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4fc9 expref: -99 pid: 15194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.635617:0:15194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e04c0031c00/0x9383f985bc4d4493 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fc9 expref: 7 pid: 15194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.635628:0:15194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e04c0031c00/0x9383f985bc4d4493 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fc9 expref: 7 pid: 15194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.635637:0:15194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031c00, rc 0) 00000100:00100000:2.0:1788201306.635711:0:15194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7ad49433-54fa-4e21-b756-859420d95603+7:5601:x1875064442683904:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 156us (2088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201306.635718:0:15194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:2.0:1788201306.677176:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201306.677357:0:15173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442684032 00000100:00100000:3.0:1788201306.677373:0:15173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442684032 00000100:00100000:3.0:1788201306.677441:0:15173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00100000:3.0:1788201306.677452:0:15173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+7:5601:x1875064442684032:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201306.680230:0:15173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+8:5601:x1875064442684032:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 2769us (3054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201306.680245:0:15173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00100000:1.0:1788201306.703887:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201306.704042:0:15194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442684160 00000100:00100000:2.0:1788201306.704055:0:15194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442684160 00000100:00100000:2.0:1788201306.704113:0:15194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:2.0:1788201306.704126:0:15194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7ad49433-54fa-4e21-b756-859420d95603+8:5601:x1875064442684160:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201306.704615:0:15194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7ad49433-54fa-4e21-b756-859420d95603+8:5601:x1875064442684160:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 Request processed in 490us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201306.704624:0:15194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:0.0:1788201306.732452:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201306.732588:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442684288 00000100:00100000:1.0:1788201306.732603:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442684288 00000100:00100000:1.0:1788201306.732673:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:1.0:1788201306.732684:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+8:5601:x1875064442684288:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201306.732701:0:15174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201306.732719:0:15174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c2ef2400/0x9383f985bc4d449a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4fd0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201306.733096:0:15174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c2ef2400/0x9383f985bc4d449a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fd0 expref: 9 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201306.733111:0:15174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c2ef2400/0x9383f985bc4d449a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fd0 expref: 9 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201306.733120:0:15174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2ef2400, rc 0) 00000100:00100000:1.0:1788201306.733205:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442684288:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 522us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201306.733213:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:0.0:1788201306.747256:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201306.747447:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442684416 00000100:00100000:2.0:1788201306.747458:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442684416 00000100:00100000:2.0:1788201306.747521:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00100000:2.0:1788201306.747532:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442684416:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201306.747820:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442684416:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 289us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201306.747829:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00100000:1.0:1788201306.751702:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201306.752081:0:15173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442684544 00000100:00100000:3.0:1788201306.752092:0:15173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442684544 00000100:00100000:3.0:1788201306.752148:0:15173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 55 00000100:00100000:3.0:1788201306.752159:0:15173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442684544:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201306.752661:0:15173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442684544:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 Request processed in 502us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201306.752671:0:15173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 55 00000100:00100000:3.0:1788201306.785405:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201306.785541:0:15194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442684672 00000100:00100000:2.0:1788201306.785551:0:15194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442684672 00000100:00100000:2.0:1788201306.785611:0:15194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 56 00000100:00100000:2.0:1788201306.785621:0:15194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442684672:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201306.785641:0:15194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201306.785661:0:15194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e04c0031400/0x9383f985bc4d44a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4fd7 expref: -99 pid: 15194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.785691:0:15194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e04c0031400/0x9383f985bc4d44a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fd7 expref: 10 pid: 15194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.785702:0:15194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e04c0031400/0x9383f985bc4d44a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fd7 expref: 10 pid: 15194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201306.785711:0:15194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031400, rc 0) 00000100:00100000:2.0:1788201306.785775:0:15194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7ad49433-54fa-4e21-b756-859420d95603+10:5601:x1875064442684672:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 155us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201306.785791:0:15194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 56 00000100:00100000:0.0:1788201306.790434:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201306.790536:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442684800 00000100:00100000:1.0:1788201306.790547:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442684800 00000100:00100000:1.0:1788201306.790609:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:1.0:1788201306.790618:0:15174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:5601:x1875064442684800:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201306.793004:0:15174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:5601:x1875064442684800:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 2377us (2569us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201306.793020:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 57 00010000:00010000:0.0:1788201306.982220:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201307.365571:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201307.365590:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0004000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458241280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201307.365674:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201307.365832:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458241408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201307.365844:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458241280 00000100:00100000:1.0:1788201307.365854:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458241280 00000100:00100000:0.0:1788201307.365868:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201307.365911:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458241408 00000100:00100000:1.0:1788201307.365915:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458241408 00000100:00100000:1.0:1788201307.365937:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788201307.365947:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0006680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458241280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201307.365985:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524877824 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1788201307.366111:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0006680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458241280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201307.366118:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788201307.366139:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788201307.366148:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458241408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201307.366161:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 13631488 granted 524877824 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788201307.366182:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201307.366192:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201307.366207:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458241408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201307.366220:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788201307.366268:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968861 gen 2 00000100:00100000:1.0:1788201307.367214:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458241408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201307.377563:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0004000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458241280:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788201308.005679:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201308.390010:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458241536:0@lo:400:kworker.0 00000100:00100000:3.0:1788201308.390042:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458241792:0@lo:400:kworker.0 00000100:00100000:2.0:1788201308.390086:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201308.390130:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201308.390154:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1a71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458242048:0@lo:400:kworker.0 00000100:00100000:3.0:1788201308.390161:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788201308.390171:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458241664:0@lo:400:kworker.0 00000100:00100000:2.0:1788201308.390184:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201308.390205:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201308.390210:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201308.390218:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458241920:0@lo:400:kworker.0 00000100:00100000:3.0:1788201308.390231:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875064458242176:0@lo:400:kworker.0 00000100:00100000:2.0:1788201308.390244:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201308.390276:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201308.390320:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458242048 00000100:00100000:2.0:1788201308.390327:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458242048 00000100:00100000:3.0:1788201308.390333:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458241792 00000100:00100000:3.0:1788201308.390339:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458241792 00000100:00100000:3.0:1788201308.390379:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458241664 00000100:00100000:3.0:1788201308.390382:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458241664 00000100:00100000:2.0:1788201308.390392:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458241920 00000100:00100000:2.0:1788201308.390396:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458241920 00000100:00100000:3.0:1788201308.390403:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458242176 00000100:00100000:3.0:1788201308.390408:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458242176 00000100:00100000:2.0:1788201308.390424:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788201308.390432:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788201308.390437:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458242048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201308.390444:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458241792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201308.390496:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458242048:12345-0@lo:400:kworker.0 Request processed in 63us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201308.390504:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458241792:12345-0@lo:400:kworker.0 Request processed in 62us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201308.390507:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788201308.390515:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788201308.390531:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788201308.390539:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458241920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201308.390554:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788201308.390564:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875064458241664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201308.390570:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458241920:12345-0@lo:400:kworker.0 Request processed in 30us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201308.390599:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875064458241664:12345-0@lo:400:kworker.0 Request processed in 38us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201308.390605:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788201308.390617:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788201308.390623:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875064458242176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201308.390649:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875064458242176:12345-0@lo:400:kworker.0 Request processed in 27us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201308.390655:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788201308.390679:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201308.390693:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788201308.390721:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d1f0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458241664:0@lo:400:kworker.0 00000100:00100000:3.0:1788201308.390735:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875064458242176:0@lo:400:kworker.0 00000100:00100000:2.0:1788201308.390744:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458241920:0@lo:400:kworker.0 00000100:00100000:3.0:1788201308.390752:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d1f0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458241792:0@lo:400:kworker.0 00000100:00100000:2.0:1788201308.390762:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1a71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458242048:0@lo:400:kworker.0 00000100:00100000:1.0:1788201308.390964:0:15194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458241536 00000100:00100000:1.0:1788201308.390969:0:15194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458241536 00000100:00100000:1.0:1788201308.391006:0:15194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788201308.391014:0:15194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458241536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201308.391062:0:15194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458241536:12345-0@lo:400:kworker.0 Request processed in 49us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201308.391068:0:15194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788201308.391248:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d1f0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458241536:0@lo:400:kworker.0 00010000:00010000:0.0:1788201309.030089:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1788201309.420367:0:3312:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201293/real 1788201293] req@ffff9e04f000ce00 x1875064458231808/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201309 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000400:1.0:1788201309.423714:0:3310:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201293/real 1788201293] req@ffff9e04f000d880 x1875064458231680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201309 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201309.423752:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e04f000d880 x1875064458231680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201309 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201309.423772:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875064458231680:0@lo:400:kworker.0 00000100:00100000:0.0:1788201309.476337:0:3312:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e04f000ce00 x1875064458231808/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201309 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201309.476398:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458231808:0@lo:400:kworker.0 00010000:00010000:0.0:1788201310.053718:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201310.103783:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201310.103881:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201310.104692:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442685056 00000100:00100000:2.0:1788201310.104704:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442685056 00000100:00100000:2.0:1788201310.104770:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:2.0:1788201310.104781:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:2359:x1875064442685056:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201310.104863:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:2359:x1875064442685056:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 83us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201310.104871:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00080000:1.0:1788201310.105290:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201310.107149:0:15173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442684928 00000100:00100000:3.0:1788201310.107164:0:15173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442684928 00000100:00100000:3.0:1788201310.107324:0:15173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:3.0:1788201310.107343:0:15173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442684928:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201310.107433:0:15173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442684928:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 99us (3661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201310.107442:0:15173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:0.0:1788201310.123366:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201310.123525:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442685312 00000100:00100000:2.0:1788201310.123536:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442685312 00000100:00100000:2.0:1788201310.123601:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 193 00000100:00100000:2.0:1788201310.123611:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2360:x1875064442685312:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201310.123683:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2360:x1875064442685312:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 74us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201310.123690:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 193 00000100:00080000:2.0:1788201310.123714:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201310.124084:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201310.125613:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442685184 00000100:00100000:2.0:1788201310.125624:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442685184 00000100:00100000:2.0:1788201310.125686:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 194 00000100:00100000:2.0:1788201310.125697:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0005f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2359:x1875064442685184:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201310.125763:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0005f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2359:x1875064442685184:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 68us (2355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201310.125771:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 194 00000100:00080000:2.0:1788201310.126084:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788201311.077760:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201312.104502:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201312.485480:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201312.485503:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458242304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201312.486043:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201312.486126:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458242304 00000100:00100000:0.0:1788201312.486133:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458242304 00000100:00100000:0.0:1788201312.486202:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788201312.486212:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458242304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201312.486248:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524877824 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1788201312.486313:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458242304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201312.486321:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:0.0:1788201312.486343:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201312.486378:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458242304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201312.491450:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201312.492338:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458242432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201312.492408:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201312.492481:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458242432 00000100:00100000:0.0:1788201312.492488:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458242432 00000100:00100000:0.0:1788201312.492541:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788201312.492550:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0004700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458242432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201312.492588:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 13631488 granted 524877824 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201312.492632:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0004700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458242432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201312.492639:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788201312.492690:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458242432:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788201312.492715:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:2.0:1788201312.571621:0:15766:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:0.0:1788201313.125583:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201313.511288:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458242560:0@lo:400:kworker.0 00000100:00100000:2.0:1788201313.511393:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201313.511470:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458243072:0@lo:400:kworker.0 00000100:00100000:0.0:1788201313.511511:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458242688:0@lo:400:kworker.0 00000100:00100000:2.0:1788201313.511520:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201313.511560:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201313.511565:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201313.511571:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0007b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458242944:0@lo:400:kworker.0 00000100:00100000:2.0:1788201313.511605:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201313.511605:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458242816:0@lo:400:kworker.0 00000100:00100000:0.0:1788201313.511608:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458243200:0@lo:400:kworker.0 00000100:00100000:2.0:1788201313.511658:0:15194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458242560 00000100:00100000:0.0:1788201313.511665:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201313.511668:0:15194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458242560 00000100:00100000:3.0:1788201313.511709:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201313.511726:0:15194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788201313.511735:0:15194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458242560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201313.511813:0:13451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458243072 00000100:00100000:3.0:1788201313.511821:0:13451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458243072 00000100:00100000:3.0:1788201313.511864:0:13451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458242944 00000100:00100000:3.0:1788201313.511869:0:13451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458242944 00000100:00100000:3.0:1788201313.511909:0:13451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788201313.511917:0:13451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458243072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201313.511979:0:13451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458243072:12345-0@lo:400:kworker.0 Request processed in 61us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201313.511987:0:13451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788201313.512009:0:13451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788201313.512016:0:13451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458242944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201313.512061:0:15194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458242560:12345-0@lo:400:kworker.0 Request processed in 326us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201313.512069:0:15194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788201313.512084:0:13451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458242944:12345-0@lo:400:kworker.0 Request processed in 64us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201313.512094:0:15179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458242688 00000100:00100000:3.0:1788201313.512094:0:13451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788201313.512108:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458243200 00000100:00100000:0.0:1788201313.512109:0:15179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458242688 00000100:00100000:2.0:1788201313.512113:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458243200 00000100:00100000:2.0:1788201313.512155:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458242816 00000100:00100000:2.0:1788201313.512159:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458242816 00000100:00100000:0.0:1788201313.512164:0:15179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788201313.512186:0:15179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458243200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201313.512209:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788201313.512220:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458242688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201313.512238:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0007b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458242944:0@lo:400:kworker.0 00000100:00100000:0.0:1788201313.512260:0:15179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458243200:12345-0@lo:400:kworker.0 Request processed in 84us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201313.512273:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458242560:0@lo:400:kworker.0 00000100:00100000:2.0:1788201313.512275:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458242688:12345-0@lo:400:kworker.0 Request processed in 53us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201313.512276:0:15179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788201313.512315:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788201313.512330:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788201313.512336:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458242816:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788201313.512364:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201313.512374:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458242816:12345-0@lo:400:kworker.0 Request processed in 36us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201313.512385:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788201313.512402:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458243072:0@lo:400:kworker.0 00000100:00100000:0.0:1788201313.512453:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458242688:0@lo:400:kworker.0 00000100:00100000:2.0:1788201313.512460:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458242816:0@lo:400:kworker.0 00000100:00100000:0.0:1788201313.512480:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458243200:0@lo:400:kworker.0 00010000:00010000:1.0:1788201314.169284:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201314.347740:0:15815:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:0.0:1788201315.173841:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201315.218408:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201315.218454:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201315.218488:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201315.218527:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201315.218585:0:15173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442685440 00000100:00100000:1.0:1788201315.218596:0:15173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442685440 00000100:00100000:3.0:1788201315.218602:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442685824 00000100:00100000:3.0:1788201315.218608:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442685824 00000100:00100000:1.0:1788201315.218653:0:15173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00100000:1.0:1788201315.218665:0:15173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2dcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442685440:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201315.218666:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442685696 00000100:00100000:3.0:1788201315.218671:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442685696 00000100:00100000:3.0:1788201315.218700:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 197 00000100:00100000:3.0:1788201315.218710:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2360:x1875064442685824:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201315.218748:0:15173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2dcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442685440:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 86us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201315.218752:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2360:x1875064442685824:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 42us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201315.218763:0:15173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00100000:3.0:1788201315.218767:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 197 00000100:00100000:3.0:1788201315.218788:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 198 00000100:00100000:3.0:1788201315.218797:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2360:x1875064442685696:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201315.218825:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2360:x1875064442685696:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 30us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201315.218832:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 198 00000100:00080000:2.0:1788201315.218911:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201315.218916:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201315.219185:0:15179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442685568 00000100:00100000:0.0:1788201315.219190:0:15179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442685568 00000100:00100000:0.0:1788201315.219258:0:15179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:0.0:1788201315.219267:0:15179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:2360:x1875064442685568:12345-192.168.201.30@tcp:400:kworker.0 00000100:00080000:2.0:1788201315.219313:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201315.219340:0:15179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:2360:x1875064442685568:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 74us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201315.219347:0:15179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00010000:00010000:0.0:1788201316.197471:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201316.301661:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201316.302238:0:15180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442685952 00000100:00100000:3.0:1788201316.302248:0:15180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442685952 00000100:00100000:3.0:1788201316.302345:0:15180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:3.0:1788201316.302355:0:15180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:15777:x1875064442685952:12345-192.168.201.30@tcp:41:lfs.0 00000004:00000024:3.0:1788201316.302401:0:15180:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788201316.302480:0:15180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:15777:x1875064442685952:12345-192.168.201.30@tcp:41:lfs.0 Request processed in 126us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201316.302488:0:15180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:2.0:1788201316.309589:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201316.310542:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442686080 00000100:00100000:0.0:1788201316.310553:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442686080 00000100:00100000:0.0:1788201316.310673:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 156 00000100:00100000:0.0:1788201316.310683:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:15777:x1875064442686080:12345-192.168.201.30@tcp:13:lfs.0 00002000:00000024:0.0:1788201316.310732:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524877824 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1788201316.310812:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:15777:x1875064442686080:12345-192.168.201.30@tcp:13:lfs.0 Request processed in 130us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201316.310832:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 156 00000100:00100000:3.0:1788201316.313188:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201316.323540:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442686208 00000100:00100000:2.0:1788201316.323557:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442686208 00000100:00100000:2.0:1788201316.323630:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 157 00000100:00100000:2.0:1788201316.323642:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:15777:x1875064442686208:12345-192.168.201.30@tcp:13:lfs.0 00002000:00000024:2.0:1788201316.323680:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 13631488 granted 524877824 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201316.323771:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:15777:x1875064442686208:12345-192.168.201.30@tcp:13:lfs.0 Request processed in 132us (10593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201316.323777:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 157 00000100:00100000:1.0:1788201316.399288:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201316.399430:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442686336 00000100:00100000:2.0:1788201316.399440:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442686336 00000100:00100000:2.0:1788201316.399500:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:2.0:1788201316.399511:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1a73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:15798:x1875064442686336:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:2.0:1788201316.399531:0:15178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201316.399554:0:15178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d44a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4fde expref: -99 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.399640:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d44af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.399653:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d44af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.399663:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d44af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.399712:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d44b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.399720:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d44b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.399727:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d44b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.404279:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d44bd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.404473:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d44bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.404487:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d44bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201316.404580:0:15178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f9:0x0]: returning size 7680 00000004:00200000:2.0:1788201316.404584:0:15178:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 7 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201316.404664:0:15178:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d44bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.404683:0:15178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d44af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.404689:0:15178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d44af lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.404695:0:15178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d44af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.404700:0:15178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201316.404704:0:15178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d44af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.404710:0:15178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d44af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.404722:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173c00) 00010000:00010000:2.0:1788201316.404725:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201316.404730:0:15178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d44af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.404735:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d44af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.404747:0:15178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d44b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.404753:0:15178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d44b6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.404759:0:15178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d44b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.404764:0:15178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201316.404767:0:15178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d44b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.404773:0:15178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d44b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.404781:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1317f023 (ffff9e03c2ac6700) 00010000:00010000:2.0:1788201316.404783:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201316.404786:0:15178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d44b6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.404791:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d44b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.405788:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d44a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fde expref: 16 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.405811:0:15178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d44bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fde expref: 15 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.405828:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c2ac6f00) 00010000:00010000:2.0:1788201316.405830:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201316.405833:0:15178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031a00, rc 0) 00000100:00100000:2.0:1788201316.405999:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1a73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:15798:x1875064442686336:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 6489us (6718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201316.406016:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:3.0:1788201316.409001:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201316.410380:0:15180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442686464 00000100:00100000:2.0:1788201316.411242:0:15180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442686464 00000100:00100000:3.0:1788201316.413218:0:15180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:3.0:1788201316.413245:0:15180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:15798:x1875064442686464:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:3.0:1788201316.413269:0:15180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201316.413290:0:15180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d44c4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4fe5 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.413459:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d44cb lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.413473:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d44cb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.413486:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d44cb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.413534:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d44d2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.413541:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d44d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.413547:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d44d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.416703:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d44d9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.416722:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d44d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.416734:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d44d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201316.416778:0:15180:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3fa:0x0]: returning size 0 00000004:00200000:3.0:1788201316.416783:0:15180:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201316.416806:0:15180:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d44d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.421053:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d44d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.421079:0:15180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d44cb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.421087:0:15180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d44cb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.421343:0:15180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d44cb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.421355:0:15180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201316.421360:0:15180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d44cb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.421369:0:15180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d44cb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.421385:0:15180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c2ac6f00) 00010000:00010000:3.0:1788201316.421389:0:15180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201316.422071:0:15180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d44cb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.422080:0:15180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d44cb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.422172:0:15180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d44d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.422180:0:15180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d44d2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.422186:0:15180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d44d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.422192:0:15180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201316.422195:0:15180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d44d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.422201:0:15180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d44d2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.422215:0:15180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0xcda302ea (ffff9e04c98a6800) 00010000:00010000:3.0:1788201316.422218:0:15180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201316.422221:0:15180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d44d2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.422227:0:15180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d44d2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.422280:0:15180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d44c4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fe5 expref: 17 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.422326:0:15180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d44d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fe5 expref: 16 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.422334:0:15180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fa:0x0].0x0 (ffff9e03c23c1500) 00010000:00010000:3.0:1788201316.422336:0:15180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201316.422339:0:15180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5065a00, rc 0) 00000100:00100000:3.0:1788201316.422612:0:15180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:15798:x1875064442686464:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 9379us (13617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201316.422621:0:15180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:3.0:1788201316.433375:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201316.433592:0:15179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442686592 00000100:00100000:0.0:1788201316.433603:0:15179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442686592 00000100:00100000:0.0:1788201316.433664:0:15179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:0.0:1788201316.433674:0:15179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:15803:x1875064442686592:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:0.0:1788201316.433694:0:15179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201316.433717:0:15179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d44e0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4fec expref: -99 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.433784:0:15179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d44e7 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.433798:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d44e7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.433810:0:15179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d44e7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.433834:0:15179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d44ee lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.433842:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d44ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.433849:0:15179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d44ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.434215:0:15179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d44f5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.434225:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d44f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.434232:0:15179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d44f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201316.434265:0:15179:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3fb:0x0]: returning size 0 00000004:00200000:0.0:1788201316.434269:0:15179:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201316.434339:0:15179:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d44f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.434352:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d44f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.434362:0:15179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d44e7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.434367:0:15179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d44e7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.434373:0:15179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d44e7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.434379:0:15179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201316.434805:0:15179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d44e7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.434816:0:15179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d44e7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.434827:0:15179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c2ac6f00) 00010000:00010000:0.0:1788201316.434831:0:15179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201316.434835:0:15179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d44e7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.434841:0:15179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d44e7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.434907:0:15179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d44ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.434913:0:15179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d44ee lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.434919:0:15179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d44ee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.434925:0:15179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a8e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201316.434927:0:15179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d44ee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.434933:0:15179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d44ee lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.434940:0:15179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x15fcbbea (ffff9e03c2fc5d00) 00010000:00010000:0.0:1788201316.434942:0:15179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201316.434944:0:15179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d44ee lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.434949:0:15179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d44ee lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.434985:0:15179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d44e0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fec expref: 18 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.434999:0:15179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d44f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fec expref: 17 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.435006:0:15179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fb:0x0].0x0 (ffff9e03c2fc5c00) 00010000:00010000:0.0:1788201316.435008:0:15179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201316.435010:0:15179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c19a8000, rc 0) 00000100:00100000:1.0:1788201316.443264:0:15179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+17:15803:x1875064442686592:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 9580us (9887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201316.443277:0:15179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:2.0:1788201316.455666:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201316.455774:0:15284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442686720 00000100:00100000:1.0:1788201316.455784:0:15284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442686720 00000100:00100000:1.0:1788201316.455852:0:15284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:1.0:1788201316.455946:0:15284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+17:15806:x1875064442686720:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:1.0:1788201316.455967:0:15284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201316.455984:0:15284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d44fc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4ff3 expref: -99 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.456046:0:15284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d4503 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.456059:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d4503 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.456069:0:15284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d4503 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.456084:0:15284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3a00/0x9383f985bc4d450a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.456090:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3a00/0x9383f985bc4d450a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.456342:0:15284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3a00/0x9383f985bc4d450a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.456667:0:15284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d4511 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.456677:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d4511 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.456684:0:15284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d4511 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201316.456716:0:15284:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3fc:0x0]: returning size 0 00000004:00200000:1.0:1788201316.456720:0:15284:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201316.456741:0:15284:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d4511 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.456753:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d4511 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.456762:0:15284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d4503 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.456768:0:15284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d4503 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.456774:0:15284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d4503 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.456780:0:15284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201316.456783:0:15284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d4503 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.456791:0:15284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d4503 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.456802:0:15284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c2ac6f00) 00010000:00010000:1.0:1788201316.456805:0:15284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201316.456808:0:15284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d4503 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.456825:0:15284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d4503 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.456836:0:15284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3a00/0x9383f985bc4d450a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.456842:0:15284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3a00/0x9383f985bc4d450a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.456847:0:15284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3a00/0x9383f985bc4d450a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.456851:0:15284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201316.457169:0:15284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3a00/0x9383f985bc4d450a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.457179:0:15284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3a00/0x9383f985bc4d450a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.457187:0:15284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x5e5674ea (ffff9e03c26be100) 00010000:00010000:1.0:1788201316.457189:0:15284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201316.457192:0:15284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3a00/0x9383f985bc4d450a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.457197:0:15284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3a00/0x9383f985bc4d450a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.457231:0:15284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d44fc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ff3 expref: 19 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.457244:0:15284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d4511 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ff3 expref: 18 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.457251:0:15284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fc:0x0].0x0 (ffff9e03c2fc5400) 00010000:00010000:1.0:1788201316.457252:0:15284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201316.457255:0:15284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2ef3c00, rc 0) 00000100:00100000:1.0:1788201316.457431:0:15284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+18:15806:x1875064442686720:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 1497us (1772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201316.457441:0:15284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:3.0:1788201316.482533:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201316.483553:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442686848 00000100:00100000:2.0:1788201316.483566:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442686848 00000100:00100000:2.0:1788201316.483623:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 879 00000100:00100000:2.0:1788201316.483633:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+18:2361:x1875064442686848:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:2.0:1788201316.483686:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201316.483706:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d4518 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c4ffa expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.483760:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d451f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.483772:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d451f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.483783:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d451f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.483796:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d4526 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.483802:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d4526 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.483808:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d4526 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.484674:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96000/0x9383f985bc4d452d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.484685:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96000/0x9383f985bc4d452d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.484693:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96000/0x9383f985bc4d452d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201316.484713:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3fd:0x0]: returning size 0 00000004:00200000:2.0:1788201316.484717:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201316.484748:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96000/0x9383f985bc4d452d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.484758:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96000/0x9383f985bc4d452d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.484767:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d451f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.484773:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d451f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.484779:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d451f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.484785:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201316.484788:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d451f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.484795:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d451f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.485474:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c2ac6f00) 00010000:00010000:2.0:1788201316.485480:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201316.485484:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d451f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.485494:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d451f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.485510:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d4526 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.485515:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d4526 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.485520:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d4526 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.485524:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201316.485526:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d4526 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.485531:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d4526 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.485538:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0xa6b02dea (ffff9e03c2ac6700) 00010000:00010000:2.0:1788201316.485540:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201316.485543:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d4526 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.485547:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d4526 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.485580:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d4518 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ffa expref: 20 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.485597:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96000/0x9383f985bc4d452d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ffa expref: 19 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.485603:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fd:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:2.0:1788201316.485606:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201316.485608:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c1b96000, rc 0) 00010000:00010000:2.0:1788201316.485617:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201316.485626:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96a00/0x9383f985bc4d4534 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5001 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.485657:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d453b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.485667:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d453b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.485673:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d453b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.485684:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97400/0x9383f985bc4d4542 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.485689:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97400/0x9383f985bc4d4542 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.485695:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97400/0x9383f985bc4d4542 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201316.486733:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201316.486960:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442686976 00000100:00100000:3.0:1788201316.486969:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442686976 00000100:00100000:3.0:1788201316.487032:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 26 00000100:00100000:3.0:1788201316.487042:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:15810:x1875064442686976:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:3.0:1788201316.487062:0:15178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201316.487077:0:15178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d4549 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5032 expref: -99 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.487474:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d4550 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.487488:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d4550 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.487499:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d4550 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.487513:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d4557 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.487520:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d4557 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.487527:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d4557 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.488738:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d455e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.488754:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d455e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.488763:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d455e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201316.488782:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3fe:0x0]: returning size 0 00000004:00200000:2.0:1788201316.488786:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201316.488801:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d455e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.488821:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d455e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.488830:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d453b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.488836:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d453b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.488842:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d453b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.488847:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b96c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201316.488857:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d453b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.488865:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d453b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.488876:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c2ac6f00) 00010000:00010000:2.0:1788201316.488879:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201316.488883:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d453b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.488889:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d453b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.488903:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97400/0x9383f985bc4d4542 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.488908:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97400/0x9383f985bc4d4542 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.488913:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97400/0x9383f985bc4d4542 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.488918:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201316.488921:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97400/0x9383f985bc4d4542 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.488926:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97400/0x9383f985bc4d4542 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.488931:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0xef09e6ea (ffff9e03c2ac6300) 00010000:00010000:2.0:1788201316.488933:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201316.488947:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97400/0x9383f985bc4d4542 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.488952:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97400/0x9383f985bc4d4542 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.488982:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96a00/0x9383f985bc4d4534 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5001 expref: 23 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.488993:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d455e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5001 expref: 22 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.489000:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fe:0x0].0x0 (ffff9e03c2fc5e00) 00010000:00010000:2.0:1788201316.489009:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201316.489012:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c1b97800, rc 0) 00010000:00010000:2.0:1788201316.489020:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201316.489028:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97200/0x9383f985bc4d4565 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5008 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.489058:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d456c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.489065:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d456c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.489072:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d456c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.489089:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29800/0x9383f985bc4d4573 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.489185:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d457a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.489199:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d457a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.489207:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d457a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201316.489236:0:15178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3fd:0x0]: returning size 0 00000004:00200000:3.0:1788201316.489240:0:15178:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201316.489250:0:15178:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d457a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.489259:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d457a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.489265:0:15178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d4550 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.489270:0:15178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d4550 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.489275:0:15178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d4550 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.489280:0:15178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201316.489282:0:15178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d4550 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.489287:0:15178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d4550 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.489311:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c2ac6f00) 00010000:00010000:3.0:1788201316.489314:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201316.489316:0:15178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d4550 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.489322:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d4550 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.489332:0:15178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d4557 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.489337:0:15178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d4557 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.489343:0:15178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d4557 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.489348:0:15178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201316.489351:0:15178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d4557 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.489357:0:15178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d4557 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.489364:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0xa6b02dea (ffff9e04c98a6800) 00010000:00010000:3.0:1788201316.489366:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201316.489369:0:15178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d4557 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.489374:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d4557 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.489551:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d4549 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5032 expref: 24 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.489570:0:15178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d457a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5032 expref: 23 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.489577:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fd:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:3.0:1788201316.489579:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201316.489581:0:15178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5064e00, rc 0) 00010000:00010000:2.0:1788201316.489730:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29800/0x9383f985bc4d4573 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.489738:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29800/0x9383f985bc4d4573 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490048:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28000/0x9383f985bc4d4581 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490056:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28000/0x9383f985bc4d4581 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490063:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28000/0x9383f985bc4d4581 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201316.490076:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3ff:0x0]: returning size 0 00000004:00200000:2.0:1788201316.490080:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201316.490349:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28000/0x9383f985bc4d4581 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490359:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28000/0x9383f985bc4d4581 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490366:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d456c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490371:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d456c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490376:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d456c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490381:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201316.490384:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d456c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490397:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d456c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490406:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c2ac6f00) 00010000:00010000:2.0:1788201316.490409:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201316.490412:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d456c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490418:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d456c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490428:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29800/0x9383f985bc4d4573 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490434:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29800/0x9383f985bc4d4573 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490440:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29800/0x9383f985bc4d4573 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490445:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b29800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201316.490447:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29800/0x9383f985bc4d4573 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490453:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29800/0x9383f985bc4d4573 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490459:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x37639fea (ffff9e03c2ac6900) 00010000:00010000:2.0:1788201316.490462:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201316.490465:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29800/0x9383f985bc4d4573 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490470:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29800/0x9383f985bc4d4573 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490493:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97200/0x9383f985bc4d4565 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5008 expref: 24 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490504:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28000/0x9383f985bc4d4581 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5008 expref: 23 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490510:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ff:0x0].0x0 (ffff9e05020e0300) 00010000:00010000:2.0:1788201316.490512:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201316.490514:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0501b28000, rc 0) 00010000:00010000:2.0:1788201316.490520:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201316.490528:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d4588 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c500f expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490554:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d458f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490562:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d458f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490568:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d458f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490578:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d4596 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490584:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d4596 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490590:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d4596 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490792:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29600/0x9383f985bc4d459d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490800:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29600/0x9383f985bc4d459d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490807:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29600/0x9383f985bc4d459d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201316.490835:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x400:0x0]: returning size 0 00000004:00200000:2.0:1788201316.490838:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201316.490849:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29600/0x9383f985bc4d459d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490857:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29600/0x9383f985bc4d459d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490864:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d458f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490869:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d458f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490876:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d458f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490880:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b28600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201316.490883:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d458f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490889:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d458f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490896:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c2ac6f00) 00010000:00010000:2.0:1788201316.490899:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201316.490902:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d458f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490908:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d458f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490917:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d4596 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490922:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d4596 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490928:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d4596 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.490933:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b28a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201316.494548:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d4596 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.494573:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d4596 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.494592:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x7fbd58ea (ffff9e03c2ac6100) 00010000:00010000:2.0:1788201316.494595:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201316.494601:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d4596 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.494609:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d4596 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.494668:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d4588 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c500f expref: 25 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.494683:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29600/0x9383f985bc4d459d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c500f expref: 24 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.494690:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x400:0x0].0x0 (ffff9e03c23c1300) 00010000:00010000:2.0:1788201316.494692:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201316.494695:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0501b29600, rc 0) 00010000:00010000:2.0:1788201316.494707:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201316.494726:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29c00/0x9383f985bc4d45a4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5016 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.494769:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d45ab lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.494780:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d45ab lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.494788:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d45ab lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.494802:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d45b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xc81711ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.494808:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d45b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.495381:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d45b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.495687:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d45ab lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.495696:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d45ab lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.495702:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d45ab lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.495708:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b29a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201316.495712:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d45ab lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.495719:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d45ab lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.495728:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c2ac6f00) 00010000:00010000:2.0:1788201316.495730:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201316.495733:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d45ab lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.495738:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d45ab lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.495748:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d45b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.495754:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d45b2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.495760:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d45b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.495766:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b29400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201316.495770:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d45b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.495775:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d45b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.495781:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0xc81711ea (ffff9e03c2ac6e00) 00010000:00010000:2.0:1788201316.495783:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201316.495785:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d45b2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.495790:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d45b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.496220:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29c00/0x9383f985bc4d45a4 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5016 expref: 25 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.496241:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c2ac6f00) 00010000:00010000:2.0:1788201316.496243:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201316.496247:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29c00/0x9383f985bc4d45a4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5016 expref: 25 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.496256:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0501b29c00, rc -2) 00000100:00100000:3.0:1788201316.497520:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:15810:x1875064442686976:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 10473us (10785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201316.497535:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 26 00000100:00100000:2.0:1788201316.501804:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:2361:x1875064442686848:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 18160us (19267us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201316.501828:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 879 00000100:00100000:3.0:1788201316.502461:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201316.502686:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442687104 00000100:00100000:2.0:1788201316.502696:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442687104 00000100:00100000:2.0:1788201316.502738:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 880 00000100:00100000:2.0:1788201316.502747:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:2360:x1875064442687104:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:2.0:1788201316.502781:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201316.502801:0:6715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d45b9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5039 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.502855:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29200/0x9383f985bc4d45c0 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.502868:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29200/0x9383f985bc4d45c0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.502879:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29200/0x9383f985bc4d45c0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.502893:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28400/0x9383f985bc4d45c7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x53c502ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.502900:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28400/0x9383f985bc4d45c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.502907:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28400/0x9383f985bc4d45c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.503180:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29200/0x9383f985bc4d45c0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.503189:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29200/0x9383f985bc4d45c0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.503195:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29200/0x9383f985bc4d45c0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.503201:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b29200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201316.503206:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29200/0x9383f985bc4d45c0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.503213:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29200/0x9383f985bc4d45c0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.503235:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c2ac6f00) 00010000:00010000:2.0:1788201316.503239:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201316.503243:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29200/0x9383f985bc4d45c0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.503249:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29200/0x9383f985bc4d45c0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.503260:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28400/0x9383f985bc4d45c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.503266:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28400/0x9383f985bc4d45c7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.503272:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28400/0x9383f985bc4d45c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.503277:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b28400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201316.503280:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28400/0x9383f985bc4d45c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.503285:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28400/0x9383f985bc4d45c7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.503320:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x53c502ea (ffff9e03c2ac6400) 00010000:00010000:2.0:1788201316.503323:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201316.503327:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28400/0x9383f985bc4d45c7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.503333:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28400/0x9383f985bc4d45c7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.503363:0:6715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d45b9 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5039 expref: 24 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.503372:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c2ac6f00) 00010000:00010000:2.0:1788201316.503374:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201316.503377:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d45b9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5039 expref: 24 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.503386:0:6715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0501b28200, rc -2) 00000100:00100000:2.0:1788201316.503624:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:2360:x1875064442687104:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 877us (1164us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201316.503633:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 880 00000100:00100000:1.0:1788201316.515601:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201316.517618:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442687232 00000100:00100000:3.0:1788201316.517632:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442687232 00000100:00100000:3.0:1788201316.517694:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:3.0:1788201316.517704:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c7e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:2362:x1875064442687232:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201316.517720:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201316.517744:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d457a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5032 expref: 23 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.517764:0:13458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fd:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:3.0:1788201316.517769:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201316.517838:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c7e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:2362:x1875064442687232:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 135us (2245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201316.517846:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:1.0:1788201316.529669:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201316.529812:0:15180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442687360 00000100:00100000:3.0:1788201316.529823:0:15180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442687360 00000100:00100000:3.0:1788201316.529890:0:15180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:3.0:1788201316.529900:0:15180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0501b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:15811:x1875064442687360:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:3.0:1788201316.529921:0:15180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201316.530179:0:15180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d45ce lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5040 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.530245:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d45d5 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.530266:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d45d5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.530276:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d45d5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.530290:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d45dc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.530333:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d45dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.530339:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d45dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.530688:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d45e3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.530697:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d45e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.530704:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d45e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201316.530734:0:15180:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3fe:0x0]: returning size 0 00000004:00200000:3.0:1788201316.530738:0:15180:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201316.530753:0:15180:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d45e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.530763:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d45e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.531755:0:15180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d45d5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.531763:0:15180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d45d5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.531769:0:15180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d45d5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.531775:0:15180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201316.531779:0:15180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d45d5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.531786:0:15180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d45d5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.531799:0:15180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c2ac6f00) 00010000:00010000:3.0:1788201316.531802:0:15180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201316.531807:0:15180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d45d5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.531822:0:15180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d45d5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.531836:0:15180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d45dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.531841:0:15180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d45dc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.531847:0:15180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d45dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.531853:0:15180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201316.531856:0:15180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d45dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.531862:0:15180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d45dc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.531868:0:15180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0xef09e6ea (ffff9e04c98a6800) 00010000:00010000:3.0:1788201316.531871:0:15180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201316.531874:0:15180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d45dc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.531880:0:15180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d45dc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.531919:0:15180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d45ce lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5040 expref: 24 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.531933:0:15180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d45e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5040 expref: 23 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.532168:0:15180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fe:0x0].0x0 (ffff9e03c2fc5e00) 00010000:00010000:3.0:1788201316.532171:0:15180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201316.532174:0:15180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5064800, rc 0) 00000100:00100000:3.0:1788201316.532844:0:15180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0501b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:15811:x1875064442687360:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 2942us (3180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201316.532853:0:15180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:0.0:1788201316.540657:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201316.541543:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442687488 00000100:00100000:3.0:1788201316.541556:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442687488 00000100:00100000:3.0:1788201316.541633:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 30 00000100:00100000:3.0:1788201316.541644:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:2360:x1875064442687488:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201316.541662:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201316.541689:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d45e3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5040 expref: 23 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.541710:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fe:0x0].0x0 (ffff9e03c2fc5e00) 00010000:00010000:3.0:1788201316.541716:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201316.541848:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:2360:x1875064442687488:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 206us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201316.541856:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 30 00000100:00100000:0.0:1788201316.558845:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201316.558976:0:15179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442687616 00000100:00100000:1.0:1788201316.558987:0:15179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442687616 00000100:00100000:1.0:1788201316.559050:0:15179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 28 00000100:00100000:1.0:1788201316.559061:0:15179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:15812:x1875064442687616:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:1.0:1788201316.559084:0:15179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201316.559114:0:15179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d45ea lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5047 expref: -99 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.561061:0:15179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d45f1 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.561079:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d45f1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.561229:0:15179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d45f1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.561249:0:15179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28400/0x9383f985bc4d45f8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.561257:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28400/0x9383f985bc4d45f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.561265:0:15179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28400/0x9383f985bc4d45f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.561866:0:15179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29200/0x9383f985bc4d45ff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.562015:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29200/0x9383f985bc4d45ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.562025:0:15179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29200/0x9383f985bc4d45ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201316.562063:0:15179:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3ff:0x0]: returning size 0 00000004:00200000:2.0:1788201316.562068:0:15179:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201316.562086:0:15179:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29200/0x9383f985bc4d45ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.562170:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29200/0x9383f985bc4d45ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.562179:0:15179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d45f1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.562185:0:15179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d45f1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.562191:0:15179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d45f1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.562197:0:15179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b28200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201316.562200:0:15179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d45f1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.562207:0:15179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d45f1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.562219:0:15179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c2ac6f00) 00010000:00010000:2.0:1788201316.562285:0:15179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201316.562316:0:15179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d45f1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.562323:0:15179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d45f1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.562337:0:15179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28400/0x9383f985bc4d45f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.562343:0:15179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28400/0x9383f985bc4d45f8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.562348:0:15179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28400/0x9383f985bc4d45f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.562353:0:15179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b28400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201316.562355:0:15179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28400/0x9383f985bc4d45f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.562361:0:15179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28400/0x9383f985bc4d45f8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.562368:0:15179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x37639fea (ffff9e03c2ac6400) 00010000:00010000:2.0:1788201316.562370:0:15179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201316.562373:0:15179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28400/0x9383f985bc4d45f8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.562379:0:15179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28400/0x9383f985bc4d45f8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.562424:0:15179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d45ea lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5047 expref: 24 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.562439:0:15179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29200/0x9383f985bc4d45ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5047 expref: 23 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.562447:0:15179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ff:0x0].0x0 (ffff9e05020e0300) 00010000:00010000:2.0:1788201316.562449:0:15179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201316.562452:0:15179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0501b29200, rc 0) 00000100:00100000:2.0:1788201316.562602:0:15179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:15812:x1875064442687616:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 3540us (3763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201316.562610:0:15179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 28 00000100:00100000:1.0:1788201316.567524:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201316.568104:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442687744 00000100:00100000:3.0:1788201316.568115:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442687744 00000100:00100000:3.0:1788201316.568195:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:3.0:1788201316.568206:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c6630700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:2361:x1875064442687744:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201316.568235:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201316.568261:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29200/0x9383f985bc4d45ff lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5047 expref: 23 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.568280:0:8524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ff:0x0].0x0 (ffff9e05020e0300) 00010000:00010000:3.0:1788201316.568285:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201316.568364:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c6630700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:2361:x1875064442687744:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 160us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201316.568371:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:0.0:1788201316.596698:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201316.596915:0:15284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442687872 00000100:00100000:1.0:1788201316.596926:0:15284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442687872 00000100:00100000:1.0:1788201316.596986:0:15284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:1.0:1788201316.596996:0:15284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:15813:x1875064442687872:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:1.0:1788201316.597022:0:15284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201316.597044:0:15284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d4606 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c504e expref: -99 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.597132:0:15284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3000/0x9383f985bc4d460d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.597148:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3000/0x9383f985bc4d460d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.597160:0:15284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3000/0x9383f985bc4d460d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.597175:0:15284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d4614 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.597183:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d4614 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.597190:0:15284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d4614 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.597590:0:15284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3a00/0x9383f985bc4d461b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.597603:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3a00/0x9383f985bc4d461b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.597610:0:15284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3a00/0x9383f985bc4d461b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201316.597643:0:15284:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x400:0x0]: returning size 0 00000004:00200000:1.0:1788201316.597647:0:15284:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201316.597662:0:15284:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3a00/0x9383f985bc4d461b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.597672:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3a00/0x9383f985bc4d461b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.597679:0:15284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3000/0x9383f985bc4d460d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.597684:0:15284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3000/0x9383f985bc4d460d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.597691:0:15284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3000/0x9383f985bc4d460d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.597698:0:15284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201316.597702:0:15284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3000/0x9383f985bc4d460d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.597709:0:15284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3000/0x9383f985bc4d460d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.597722:0:15284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c2ac6f00) 00010000:00010000:1.0:1788201316.597726:0:15284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201316.597731:0:15284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3000/0x9383f985bc4d460d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.597736:0:15284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3000/0x9383f985bc4d460d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.597746:0:15284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d4614 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.597752:0:15284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d4614 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.597757:0:15284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d4614 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.597761:0:15284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201316.597764:0:15284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d4614 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.597769:0:15284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d4614 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.597775:0:15284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x7fbd58ea (ffff9e03c26be100) 00010000:00010000:1.0:1788201316.597778:0:15284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201316.597781:0:15284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d4614 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.597786:0:15284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d4614 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.597817:0:15284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d4606 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c504e expref: 24 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.597832:0:15284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3a00/0x9383f985bc4d461b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c504e expref: 23 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.597839:0:15284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x400:0x0].0x0 (ffff9e03c23c1300) 00010000:00010000:1.0:1788201316.597841:0:15284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201316.597844:0:15284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2ef3a00, rc 0) 00000100:00100000:1.0:1788201316.597903:0:15284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:15813:x1875064442687872:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 908us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201316.597910:0:15284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:0.0:1788201316.602500:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201316.603648:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442688000 00000100:00100000:3.0:1788201316.603659:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442688000 00000100:00100000:3.0:1788201316.603729:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 32 00000100:00100000:3.0:1788201316.603739:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:2362:x1875064442688000:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201316.603754:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201316.603777:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3a00/0x9383f985bc4d461b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c504e expref: 23 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.603796:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x400:0x0].0x0 (ffff9e03c23c1300) 00010000:00010000:3.0:1788201316.603800:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201316.603904:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:2362:x1875064442688000:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 165us (1411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201316.603912:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 32 00000100:00100000:0.0:1788201316.635546:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201316.636047:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442688256 00000100:00100000:3.0:1788201316.636058:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442688256 00000100:00100000:3.0:1788201316.636138:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 30 00000100:00100000:3.0:1788201316.636149:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:15814:x1875064442688256:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1788201316.636171:0:15178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201316.636192:0:15178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d4622 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5055 expref: -99 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201316.636524:0:15178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f9:0x0]: returning size 7680 00010000:00010000:3.0:1788201316.636743:0:15178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d4622 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5055 expref: 24 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.636758:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173c00) 00010000:00010000:3.0:1788201316.636761:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201316.636766:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d4622 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5055 expref: 24 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.636779:0:15178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5064800, rc 0) 00000100:00100000:3.0:1788201316.636837:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:15814:x1875064442688256:12345-192.168.201.30@tcp:101:rm.0 Request processed in 690us (1316us total) trans 12884901896 rc 301/301 00000100:00100000:3.0:1788201316.636845:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 30 00000100:00100000:1.0:1788201316.646629:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201316.647234:0:15181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442688384 00000100:00100000:2.0:1788201316.647247:0:15181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442688384 00000100:00100000:2.0:1788201316.647326:0:15181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:2.0:1788201316.647337:0:15181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c6632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:15814:x1875064442688384:12345-192.168.201.30@tcp:37:rm.0 00000100:00100000:2.0:1788201316.654145:0:15181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c6632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:15814:x1875064442688384:12345-192.168.201.30@tcp:37:rm.0 Request processed in 6744us (7460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201316.654161:0:15181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:0.0:1788201316.681904:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201316.682588:0:15182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442688640 00000100:00100000:3.0:1788201316.682598:0:15182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442688640 00000100:00100000:3.0:1788201316.682651:0:15182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:3.0:1788201316.682661:0:15182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:15814:x1875064442688640:12345-192.168.201.30@tcp:35:rm.0 00000100:00100000:3.0:1788201316.683130:0:15182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:15814:x1875064442688640:12345-192.168.201.30@tcp:35:rm.0 Request processed in 469us (1233us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1788201316.683138:0:15182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:1.0:1788201316.698325:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201316.698608:0:15284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442688896 00000100:00100000:3.0:1788201316.698619:0:15284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442688896 00000100:00100000:3.0:1788201316.698683:0:15284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:3.0:1788201316.698693:0:15284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c6630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:15814:x1875064442688896:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1788201316.698718:0:15284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201316.698741:0:15284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d4630 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c505c expref: -99 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.700593:0:15284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28400/0x9383f985bc4d4637 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.700616:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28400/0x9383f985bc4d4637 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.700630:0:15284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28400/0x9383f985bc4d4637 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201316.700646:0:15284:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f9:0x0]: returning size 7680 00010000:00010000:2.0:1788201316.700955:0:15284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d4630 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c505c expref: 27 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.700976:0:15284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28400/0x9383f985bc4d4637 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c505c expref: 26 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.700984:0:15284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c2ac6f00) 00010000:00010000:2.0:1788201316.700988:0:15284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788201316.700992:0:15284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0501b28400, rc 0) 00000100:00100000:2.0:1788201316.701861:0:15284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c6630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:15814:x1875064442688896:12345-192.168.201.30@tcp:101:rm.0 Request processed in 3164us (3569us total) trans 12884901898 rc 0/0 00000100:00100000:2.0:1788201316.701873:0:15284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:0.0:1788201316.709821:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201316.710032:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442689152 00000100:00100000:3.0:1788201316.710043:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442689152 00000100:00100000:3.0:1788201316.710103:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 32 00000100:00100000:3.0:1788201316.710122:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:15814:x1875064442689152:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:3.0:1788201316.710181:0:15178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788201316.710209:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d4511 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ff3 expref: 26 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.710232:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d4407 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fb4 expref: 25 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.710246:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fc:0x0].0x0 (ffff9e03c2fc5400) 00010000:00010000:3.0:1788201316.710266:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d44bd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fde expref: 24 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.710275:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c2ac6f00) 00010000:00010000:3.0:1788201316.710278:0:15178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201316.710330:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d4645 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.710344:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d4645 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.710352:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d4645 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.710367:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d464c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.710374:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d464c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.710380:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d464c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.710928:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d4653 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.710995:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d4653 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.711003:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d4653 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201316.718662:0:15178:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 64 off8320 00000004:00080000:2.0:1788201316.718681:0:15178:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 591976386215ns, next at 592976381927ns, rc = 0 00010000:00010000:2.0:1788201316.719201:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d465a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.719221:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d465a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.719236:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d465a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.719245:0:15178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d465a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.719252:0:15178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d465a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.719259:0:15178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d465a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.719383:0:15178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201316.719416:0:15178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d4653 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.719424:0:15178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d4653 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.719430:0:15178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d4653 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.719436:0:15178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201316.719440:0:15178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d4653 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.719448:0:15178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d4653 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.719460:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fc:0x0].0x0 (ffff9e04c98a6a00) 00010000:00010000:2.0:1788201316.719463:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201316.719468:0:15178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d4653 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.719474:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065c00/0x9383f985bc4d4653 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.719500:0:15178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d4645 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.719506:0:15178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d4645 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.719512:0:15178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d4645 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.719517:0:15178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201316.719520:0:15178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d4645 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.719688:0:15178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d4645 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.719700:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c2ac6f00) 00010000:00010000:2.0:1788201316.719703:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201316.719706:0:15178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d4645 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.719713:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d4645 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201316.719724:0:15178:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000095a15e21 reply state 000000002fb06996 transno 12884901899 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d464c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201316.719733:0:15178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201316.719833:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+25:15814:x1875064442689152:12345-192.168.201.30@tcp:36:rm.0 Request processed in 9718us (10017us total) trans 12884901899 rc 0/0 00000100:00100000:2.0:1788201316.719842:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 32 00010000:00010000:1.0:1788201316.724900:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201316.724913:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d465a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.724923:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b28200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201316.724927:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d465a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201316.725702:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:1.0:1788201316.725777:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d465a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.725798:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fc:0x0].0x0 (ffff9e04c98a6a00) 00010000:00010000:1.0:1788201316.725801:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201316.725807:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d465a lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.725813:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d465a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3fc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.725838:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201316.725841:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201316.725842:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201316.734398:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d464c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.734419:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d464c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.734428:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d464c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.734435:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201316.734439:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d464c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.734447:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d464c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.734466:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x5e5674ea (ffff9e04c98a6800) 00010000:00010000:2.0:1788201316.734469:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201316.734474:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d464c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.734479:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d464c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201316.734812:0:15180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442689408 00000100:00100000:3.0:1788201316.734823:0:15180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442689408 00000100:00100000:3.0:1788201316.734886:0:15180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:3.0:1788201316.734896:0:15180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:15814:x1875064442689408:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:3.0:1788201316.734956:0:15180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788201316.734973:0:15180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96000/0x9383f985bc4d452d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ffa expref: 24 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.734989:0:15180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d43d6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f98 expref: 23 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.735133:0:15180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fd:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:3.0:1788201316.735143:0:15180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201316.735164:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d4661 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.735177:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d4661 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.735187:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d4661 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.735200:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d4668 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.735207:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d4668 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.735213:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d4668 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.735356:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d466f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.735365:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d466f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.735371:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d466f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201316.736920:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].2, 64 off8320 00000004:00080000:3.0:1788201316.737142:0:15180:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 591994846709ns, next at 592994639772ns, rc = 0 00010000:00010000:3.0:1788201316.737221:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d4676 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.737235:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d4676 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.737246:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d4676 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.737254:0:15180:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d4676 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.737261:0:15180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d4676 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.737271:0:15180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d4676 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.737476:0:15180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201316.737500:0:15180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d466f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.737507:0:15180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d466f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.737514:0:15180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d466f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.737520:0:15180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201316.737589:0:15180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d466f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.737599:0:15180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d466f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.737610:0:15180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fd:0x0].0x0 (ffff9e04c98a6500) 00010000:00010000:3.0:1788201316.737613:0:15180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201316.737618:0:15180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d466f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.737624:0:15180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d466f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.737643:0:15180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d4661 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.737653:0:15180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d4661 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.737658:0:15180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d4661 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.737663:0:15180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201316.737665:0:15180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d4661 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.737671:0:15180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d4661 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.737677:0:15180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c2ac6f00) 00010000:00010000:3.0:1788201316.737680:0:15180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201316.737682:0:15180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d4661 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.737687:0:15180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d4661 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201316.737696:0:15180:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bbf9903e reply state 0000000049cde7c9 transno 12884901900 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d4668 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201316.737705:0:15180:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201316.737805:0:15180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:15814:x1875064442689408:12345-192.168.201.30@tcp:36:rm.0 Request processed in 2908us (12106us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1788201316.737813:0:15180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:3.0:1788201316.745905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201316.745945:0:15179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442689664 00000100:00100000:3.0:1788201316.745957:0:15179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442689664 00000100:00100000:3.0:1788201316.746046:0:15179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 34 00000100:00100000:3.0:1788201316.746057:0:15179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:15814:x1875064442689664:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1788201316.746279:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d4668 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.746291:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d4668 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.746314:0:15179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788201316.746324:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d4668 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.746335:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201316.746341:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d4668 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.746343:0:15179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29600/0x9383f985bc4d459d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x400:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c500f expref: 24 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.746353:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d4668 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.746368:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0xa6b02dea (ffff9e04c98a6200) 00010000:00010000:2.0:1788201316.746371:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201316.746374:0:15179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d440e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x400:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fbb expref: 23 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.746387:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d4668 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.746388:0:15179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x400:0x0].0x0 (ffff9e03c23c1300) 00010000:00010000:2.0:1788201316.746400:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d4668 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.746401:0:15179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201316.746425:0:15179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d467d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.746439:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d467d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.746448:0:15179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d467d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.746464:0:15179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d4684 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.746471:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d4684 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.746479:0:15179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d4684 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.746779:0:15179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d468b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x400:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.746788:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d468b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x400:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.746795:0:15179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d468b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x400:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201316.748156:0:15179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].3, 64 off8384 00010000:00010000:1.0:1788201316.748233:0:15179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d4692 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.748247:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d4692 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.748259:0:15179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d4692 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.748267:0:15179:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d4692 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.748274:0:15179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d4692 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.748280:0:15179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d4692 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.748782:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201316.748791:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d4676 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.748799:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201316.748804:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d4676 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.748812:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d4676 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.748826:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fd:0x0].0x0 (ffff9e04c98a6500) 00010000:00010000:0.0:1788201316.748830:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201316.748834:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d4676 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.748840:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d4676 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3fd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.748859:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201316.748862:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d4692 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.748867:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201316.748870:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d4692 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.748876:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d4692 lrc: 5/0,0 mode: PW/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.748882:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x400:0x0].0x0 (ffff9e03c23c1000) 00010000:00010000:0.0:1788201316.748884:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201316.748887:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d4692 lrc: 3/0,0 mode: --/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.748892:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201316.748894:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201316.748896:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201316.750539:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201316.750565:0:15179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788201316.750575:0:15179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d4692 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x400:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.750621:0:15179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d468b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x400:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.750628:0:15179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d468b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x400:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.750640:0:15179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d468b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x400:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.750646:0:15179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201316.750651:0:15179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d468b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x400:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.750658:0:15179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d468b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x400:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.750681:0:15179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x400:0x0].0x0 (ffff9e03c23c1000) 00010000:00010000:1.0:1788201316.750685:0:15179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201316.750689:0:15179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d468b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x400:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.750695:0:15179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d468b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x400:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.750718:0:15179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d467d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.750725:0:15179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d467d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.750730:0:15179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d467d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.750735:0:15179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201316.750738:0:15179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d467d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.750747:0:15179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d467d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.750754:0:15179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c2ac6f00) 00010000:00010000:1.0:1788201316.750756:0:15179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201316.750760:0:15179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d467d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.750765:0:15179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d467d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201316.750775:0:15179:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000061a9f125 reply state 000000001602b037 transno 12884901901 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d4684 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201316.750783:0:15179:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201316.750879:0:15179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:15814:x1875064442689664:12345-192.168.201.30@tcp:36:rm.0 Request processed in 4820us (4979us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1788201316.750888:0:15179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 34 00000100:00100000:3.0:1788201316.757231:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201316.757799:0:15284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442689920 00000100:00100000:2.0:1788201316.757810:0:15284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442689920 00000100:00100000:2.0:1788201316.757869:0:15284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 35 00000100:00100000:2.0:1788201316.757879:0:15284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:15814:x1875064442689920:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1788201316.757940:0:15284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788201316.757972:0:15284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d455e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5001 expref: 23 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.757992:0:15284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d4400 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fad expref: 22 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.758002:0:15284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fe:0x0].0x0 (ffff9e03c2fc5e00) 00010000:00010000:2.0:1788201316.758015:0:15284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201316.758036:0:15284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d4699 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.758049:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d4699 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.758057:0:15284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d4699 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.758070:0:15284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d46a0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.758077:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d46a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.758083:0:15284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d46a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.758210:0:15284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d46a7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.758218:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d46a7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.758225:0:15284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d46a7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201316.758823:0:15284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].4, 64 off8448 00010000:00010000:2.0:1788201316.758885:0:15284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d46ae lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.758895:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d46ae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.758907:0:15284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d46ae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.758914:0:15284:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d46ae lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.758919:0:15284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d46ae lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.758926:0:15284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d46ae lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.758956:0:15284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201316.758974:0:15284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d46a7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.758979:0:15284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d46a7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.758983:0:15284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d46a7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.758989:0:15284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b28800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201316.758992:0:15284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d46a7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.758998:0:15284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d46a7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.759006:0:15284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fe:0x0].0x0 (ffff9e03c2ac6e00) 00010000:00010000:2.0:1788201316.759008:0:15284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201316.759012:0:15284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d46a7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.759016:0:15284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d46a7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.759029:0:15284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d4699 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.759034:0:15284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d4699 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.759040:0:15284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d4699 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.759043:0:15284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b29400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201316.759045:0:15284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d4699 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.759050:0:15284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d4699 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.759056:0:15284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c2ac6f00) 00010000:00010000:2.0:1788201316.759058:0:15284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201316.759060:0:15284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d4699 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.759065:0:15284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d4699 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201316.759076:0:15284:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005eb4d2ca reply state 00000000a9d60090 transno 12884901902 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d46a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.759078:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201316.759085:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d46ae lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.759100:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b28a00 already unused, calling callback (ffffffffc13fbfe0) 00000100:00100000:2.0:1788201316.759102:0:15284:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201316.759105:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d46ae lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.759126:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d46ae lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.759137:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fe:0x0].0x0 (ffff9e03c2ac6e00) 00010000:00010000:0.0:1788201316.759140:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201316.759143:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d46ae lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.759149:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d46ae lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3fe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.759165:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201316.759167:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201316.759169:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201316.759194:0:15284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:15814:x1875064442689920:12345-192.168.201.30@tcp:36:rm.0 Request processed in 1315us (1980us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1788201316.759202:0:15284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 35 00010000:00010000:1.0:1788201316.760979:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d4684 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.760994:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d4684 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.761001:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d4684 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.761007:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201316.761011:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d4684 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.761023:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d4684 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.761998:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x7fbd58ea (ffff9e03c23c1200) 00010000:00010000:1.0:1788201316.762004:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201316.762010:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d4684 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.762018:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d4684 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.762043:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d46a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.762051:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d46a0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.762057:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d46a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.762062:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b29a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201316.762066:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d46a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.762073:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d46a0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.762084:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0xef09e6ea (ffff9e03c2ac6400) 00010000:00010000:3.0:1788201316.762087:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201316.762095:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d46a0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.762101:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d46a0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201316.762849:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201316.762974:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442690176 00000100:00100000:2.0:1788201316.762984:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442690176 00000100:00100000:2.0:1788201316.763047:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 36 00000100:00100000:2.0:1788201316.763057:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:15814:x1875064442690176:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1788201316.763864:0:15178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788201316.763894:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d44f5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fec expref: 21 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.763916:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d43ba lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f91 expref: 20 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.763927:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fb:0x0].0x0 (ffff9e03c2fc5c00) 00010000:00010000:2.0:1788201316.763937:0:15178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201316.763957:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d46b5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.763969:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d46b5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.763980:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d46b5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.763994:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29800/0x9383f985bc4d46bc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.764001:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29800/0x9383f985bc4d46bc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.764007:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29800/0x9383f985bc4d46bc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.765280:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d46c3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.765314:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d46c3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.765324:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d46c3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201316.768881:0:15178:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].3, 64 off8384 00010000:00010000:2.0:1788201316.768971:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d46ca lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.768989:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d46ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.769000:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d46ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.769010:0:15178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d46ca lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.769016:0:15178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d46ca lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.769022:0:15178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d46ca lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.769038:0:15178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201316.769063:0:15178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d46c3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.769357:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201316.769365:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d46ca lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.769418:0:15178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d46c3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.769425:0:15178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d46c3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.781772:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b28800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201316.781787:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d46ca lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.781802:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d46ca lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.781824:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fb:0x0].0x0 (ffff9e03c2ac6900) 00010000:00010000:0.0:1788201316.781827:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201316.781832:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d46ca lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.781838:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d46ca lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.781860:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201316.781862:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201316.781866:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201316.786230:0:15178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b29400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201316.786245:0:15178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d46c3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.786261:0:15178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d46c3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.786280:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fb:0x0].0x0 (ffff9e03c2ac6900) 00010000:00010000:2.0:1788201316.786284:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201316.786289:0:15178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d46c3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.786567:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d46c3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.786606:0:15178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d46b5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.786610:0:15178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d46b5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.786618:0:15178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d46b5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.786622:0:15178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b28600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201316.786624:0:15178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d46b5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.786627:0:15178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d46b5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.786633:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c2ac6f00) 00010000:00010000:2.0:1788201316.786635:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201316.786637:0:15178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d46b5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.786641:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d46b5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201316.786648:0:15178:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000080b0b116 reply state 000000003a8c398f transno 12884901903 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29800/0x9383f985bc4d46bc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201316.786653:0:15178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201316.792619:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:15814:x1875064442690176:12345-192.168.201.30@tcp:36:rm.0 Request processed in 29553us (29764us total) trans 12884901903 rc 0/0 00000100:00100000:3.0:1788201316.792630:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 36 00010000:00010000:3.0:1788201316.798329:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29800/0x9383f985bc4d46bc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.798348:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29800/0x9383f985bc4d46bc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.798356:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29800/0x9383f985bc4d46bc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.798364:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b29800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201316.798370:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29800/0x9383f985bc4d46bc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.798378:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29800/0x9383f985bc4d46bc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.798402:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x15fcbbea (ffff9e03c2ac6100) 00010000:00010000:3.0:1788201316.798405:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201316.798411:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29800/0x9383f985bc4d46bc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.798417:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29800/0x9383f985bc4d46bc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201316.803605:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201316.803674:0:15180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442690432 00000100:00100000:3.0:1788201316.803684:0:15180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442690432 00000100:00100000:3.0:1788201316.803750:0:15180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 37 00000100:00100000:3.0:1788201316.803759:0:15180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:15814:x1875064442690432:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:3.0:1788201316.803822:0:15180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788201316.803849:0:15180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28000/0x9383f985bc4d4581 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5008 expref: 20 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.803869:0:15180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d43f2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f9f expref: 19 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.803878:0:15180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ff:0x0].0x0 (ffff9e05020e0300) 00010000:00010000:3.0:1788201316.803887:0:15180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201316.803906:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d46d1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.803918:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d46d1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.803927:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d46d1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.803941:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d46d8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.803948:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d46d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.803954:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d46d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.804062:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d46df lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.804085:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d46df lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.804368:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d46df lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201316.806200:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4, 64 off8448 00010000:00010000:0.0:1788201316.806326:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d46e6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.806342:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d46e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.806354:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d46e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.806363:0:15180:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d46e6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.806371:0:15180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d46e6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.806596:0:15180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d46e6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.806626:0:15180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201316.806653:0:15180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d46df lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.806659:0:15180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d46df lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.806663:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201316.806665:0:15180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d46df lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.806671:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d46e6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.806676:0:15180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201316.806677:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201316.806680:0:15180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d46df lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.806681:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d46e6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.806689:0:15180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d46df lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.806692:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d46e6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.806791:0:7645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ff:0x0].0x0 (ffff9e03c23c1200) 00010000:00010000:2.0:1788201316.806795:0:7645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788201316.806799:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d46e6 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.806804:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d46e6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.806828:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201316.806831:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201316.806833:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201316.809808:0:15180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3ff:0x0].0x0 (ffff9e03c23c1200) 00010000:00010000:0.0:1788201316.809818:0:15180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201316.809829:0:15180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d46df lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.809840:0:15180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d46df lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.809882:0:15180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d46d1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.809888:0:15180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d46d1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.809893:0:15180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d46d1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.809897:0:15180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201316.809899:0:15180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d46d1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.809904:0:15180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d46d1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.809918:0:15180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c2ac6f00) 00010000:00010000:0.0:1788201316.809920:0:15180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201316.809922:0:15180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d46d1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.809926:0:15180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064000/0x9383f985bc4d46d1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201316.809932:0:15180:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000964af023 reply state 00000000693e5d1f transno 12884901904 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d46d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201316.809949:0:15180:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201316.810231:0:15180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:15814:x1875064442690432:12345-192.168.201.30@tcp:36:rm.0 Request processed in 6461us (6621us total) trans 12884901904 rc 0/0 00000100:00100000:1.0:1788201316.810241:0:15180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 37 00010000:00010000:3.0:1788201316.814059:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d46d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.814086:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d46d8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.814101:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d46d8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.814108:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201316.814120:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d46d8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.814129:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d46d8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.814144:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x37639fea (ffff9e03c23c1300) 00010000:00010000:3.0:1788201316.814147:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201316.814152:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d46d8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.814158:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d46d8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201316.819889:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201316.820057:0:15179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442690688 00000100:00100000:1.0:1788201316.820067:0:15179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442690688 00000100:00100000:1.0:1788201316.820309:0:15179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 38 00000100:00100000:1.0:1788201316.820322:0:15179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d1f0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:15814:x1875064442690688:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201316.820383:0:15179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201316.820468:0:15179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d44d9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fe5 expref: 19 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.820490:0:15179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d43f9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fa6 expref: 18 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.820500:0:15179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fa:0x0].0x0 (ffff9e03c23c1500) 00010000:00010000:1.0:1788201316.820510:0:15179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201316.820598:0:15179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d46ed lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.820610:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d46ed lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.820619:0:15179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d46ed lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.820634:0:15179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d46f4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.820641:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d46f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.820647:0:15179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d46f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.820900:0:15179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d46fb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.820908:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d46fb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.820916:0:15179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d46fb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201316.823081:0:15179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].5, 64 off8512 00010000:00010000:1.0:1788201316.823455:0:15179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4702 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.823472:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4702 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.823487:0:15179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4702 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.823496:0:15179:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4702 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.823503:0:15179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4702 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.823509:0:15179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4702 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.823627:0:15179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201316.823650:0:15179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d46fb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.823657:0:15179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d46fb lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.823663:0:15179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d46fb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.823669:0:15179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201316.823673:0:15179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d46fb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.823681:0:15179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d46fb lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.823693:0:15179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fa:0x0].0x0 (ffff9e03c26bec00) 00010000:00010000:1.0:1788201316.823696:0:15179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201316.823702:0:15179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d46fb lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.823719:0:15179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d46fb lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.823736:0:15179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d46ed lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.823742:0:15179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d46ed lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.823747:0:15179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d46ed lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.823752:0:15179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201316.823755:0:15179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d46ed lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.823761:0:15179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d46ed lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.823768:0:15179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c2ac6f00) 00010000:00010000:1.0:1788201316.823771:0:15179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201316.823774:0:15179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d46ed lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201316.823779:0:15179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d46ed lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201316.823789:0:15179:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe230ee5 reply state 00000000ea0adcbd transno 12884901905 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d46f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201316.823802:0:15179:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201316.823968:0:15179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d1f0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:15814:x1875064442690688:12345-192.168.201.30@tcp:36:rm.0 Request processed in 3645us (4085us total) trans 12884901905 rc 0/0 00000100:00100000:1.0:1788201316.823977:0:15179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 38 00010000:00010000:3.0:1788201316.826642:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d46f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.826661:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d46f4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.826668:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d46f4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.826675:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201316.826680:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d46f4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.826687:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d46f4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.826714:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0xcda302ea (ffff9e03c26be100) 00010000:00010000:3.0:1788201316.826717:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201316.826721:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d46f4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.826727:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d46f4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3f9:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201316.827927:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201316.829674:0:15284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442690816 00000100:00100000:2.0:1788201316.829687:0:15284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442690816 00000100:00100000:2.0:1788201316.829913:0:15284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:2.0:1788201316.829925:0:15284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d1f0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+18:15814:x1875064442690816:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1788201316.829951:0:15284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201316.829971:0:15284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d4709 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5063 expref: -99 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.830051:0:15284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d4710 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.830064:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d4710 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.830075:0:15284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d4710 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.830797:0:15284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28000/0x9383f985bc4d4717 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.831369:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28000/0x9383f985bc4d4717 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201316.831446:0:15284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28000/0x9383f985bc4d4717 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.833202:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201316.833212:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4702 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.833288:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201316.833673:0:15284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d471e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.833689:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d471e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.833700:0:15284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d471e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.833789:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4702 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.833801:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4702 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.834288:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3fa:0x0].0x0 (ffff9e03c26bec00) 00010000:00010000:0.0:1788201316.834316:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201316.834321:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4702 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.834328:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4702 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3fa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.834356:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201316.834358:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201316.834360:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00200000:3.0:1788201316.834509:0:15284:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f9:0x0]: returning size 7680 00000004:00200000:3.0:1788201316.834514:0:15284:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201316.834676:0:15284:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d471e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.834690:0:15284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d4710 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.834698:0:15284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d4710 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.834876:0:15284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d4710 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.834884:0:15284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b29400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201316.834887:0:15284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d4710 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.834894:0:15284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d4710 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.834903:0:15284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173c00) 00010000:00010000:3.0:1788201316.834906:0:15284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201316.834909:0:15284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d4710 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.834915:0:15284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d4710 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.834927:0:15284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28000/0x9383f985bc4d4717 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.834938:0:15284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28000/0x9383f985bc4d4717 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.834944:0:15284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28000/0x9383f985bc4d4717 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.834949:0:15284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b28000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201316.834952:0:15284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28000/0x9383f985bc4d4717 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.834958:0:15284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28000/0x9383f985bc4d4717 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.834965:0:15284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1317f023 (ffff9e03c2ac6900) 00010000:00010000:3.0:1788201316.834967:0:15284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201316.834970:0:15284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28000/0x9383f985bc4d4717 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.834976:0:15284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28000/0x9383f985bc4d4717 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.835026:0:15284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d4709 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5063 expref: 20 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.835042:0:15284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d471e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5063 expref: 19 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.835049:0:15284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c2ac6f00) 00010000:00010000:3.0:1788201316.835051:0:15284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201316.835053:0:15284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5064e00, rc 0) 00000100:00100000:3.0:1788201316.835925:0:15284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d1f0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:15814:x1875064442690816:12345-192.168.201.30@tcp:101:rm.0 Request processed in 5998us (8116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201316.835935:0:15284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:3.0:1788201316.840284:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201316.840499:0:15181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442691072 00000100:00100000:2.0:1788201316.840509:0:15181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442691072 00000100:00100000:2.0:1788201316.840651:0:15181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:2.0:1788201316.840662:0:15181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d1f0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:15814:x1875064442691072:12345-192.168.201.30@tcp:35:rm.0 00000100:00100000:2.0:1788201316.841138:0:15181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d1f0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:15814:x1875064442691072:12345-192.168.201.30@tcp:35:rm.0 Request processed in 476us (920us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1788201316.841147:0:15181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:0.0:1788201316.849084:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201316.849588:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442691328 00000100:00100000:3.0:1788201316.849599:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442691328 00000100:00100000:0.0:1788201316.849825:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 40 00000100:00100000:0.0:1788201316.849837:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:15814:x1875064442691328:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:0.0:1788201316.849893:0:15178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788201316.849917:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064e00/0x9383f985bc4d471e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5063 expref: 20 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.849939:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28400/0x9383f985bc4d4637 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c505c expref: 19 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.849950:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c2ac6f00) 00010000:00010000:0.0:1788201316.849963:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9c0b400/0x9383f985bc4d4239 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4eaa expref: 18 pid: 15215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.849970:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c5173c00) 00010000:00010000:0.0:1788201316.849977:0:15178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201316.850011:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d4725 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.850023:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d4725 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.850031:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d4725 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.850048:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d472c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1317f023 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.850055:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d472c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.850060:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d472c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.850608:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d4733 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.850618:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d4733 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.850624:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d4733 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201316.856377:0:15178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x3f9:0x0]: returning size 7680 00010000:00010000:0.0:1788201316.856664:0:15178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d4733 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.856675:0:15178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d4733 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.856683:0:15178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d4733 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.856688:0:15178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201316.856693:0:15178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d4733 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.857191:0:15178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d4733 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.857210:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3f9:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:0.0:1788201316.857214:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201316.857484:0:15178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d4733 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.857492:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d4733 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.857530:0:15178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d4725 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.857537:0:15178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d4725 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.857544:0:15178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d4725 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.857550:0:15178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201316.857553:0:15178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d4725 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.857559:0:15178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d4725 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.857568:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c2fc5d00) 00010000:00010000:0.0:1788201316.857570:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201316.857573:0:15178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d4725 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201316.857584:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d4725 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201316.857597:0:15178:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000172a7baa reply state 000000005000aa6d transno 12884901907 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d472c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201316.857606:0:15178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201316.859263:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:15814:x1875064442691328:12345-192.168.201.30@tcp:36:rm.0 Request processed in 7870us (8640us total) trans 12884901907 rc 0/0 00000100:00100000:0.0:1788201316.859275:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 40 00010000:00010000:3.0:1788201316.862119:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d472c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.862138:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d472c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.862146:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d472c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.862152:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a8800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201316.862156:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d472c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.862163:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d472c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.862178:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1317f023 (ffff9e03c2fc5800) 00010000:00010000:3.0:1788201316.862181:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201316.862185:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d472c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201316.862191:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d472c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1317f023 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201317.221497:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201317.605689:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201317.607773:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201317.607795:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c6bbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458243456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201317.607859:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201317.608004:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458243456 00000100:00100000:1.0:1788201317.608011:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458243456 00000100:00100000:1.0:1788201317.608080:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788201317.608091:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458243456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201317.608119:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524877824 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1788201317.608166:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458243456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201317.608173:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788201317.608230:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c6bbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458243456:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788201317.608473:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201317.608673:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c548f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458243328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201317.608708:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201317.609695:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458243328 00000100:00100000:1.0:1788201317.609703:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458243328 00000100:00100000:1.0:1788201317.609758:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788201317.609766:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458243328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201317.609785:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 13631488 granted 524877824 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201317.609838:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458243328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201317.609844:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788201317.609959:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c548f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458243328:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788201317.610070:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788201318.247623:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201318.629909:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c548f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458243968:0@lo:400:kworker.0 00000100:00100000:3.0:1788201318.630056:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c548c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458243584:0@lo:400:kworker.0 00000100:00100000:1.0:1788201318.631674:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c548ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458243712:0@lo:400:kworker.0 00000100:00100000:3.0:1788201318.632788:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201318.632866:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c548d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458244096:0@lo:400:kworker.0 00000100:00100000:3.0:1788201318.632909:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201318.633104:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201318.633777:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c548ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458243840:0@lo:400:kworker.0 00000100:00100000:0.0:1788201318.633828:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201318.633886:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458244096 00000100:00100000:0.0:1788201318.633896:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458244096 00000100:00100000:0.0:1788201318.633952:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458243968 00000100:00100000:0.0:1788201318.633955:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458243968 00000100:00100000:3.0:1788201318.634105:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788201318.634119:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458244096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201318.634282:0:15194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458243584 00000100:00100000:2.0:1788201318.634287:0:15194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458243584 00000100:00100000:2.0:1788201318.634464:0:15194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788201318.634473:0:15194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2dcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458243584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201318.634720:0:15194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2dcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458243584:12345-0@lo:400:kworker.0 Request processed in 247us (1936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201318.634729:0:15194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788201318.634940:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201318.635051:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458244096:12345-0@lo:400:kworker.0 Request processed in 935us (2141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201318.635059:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788201318.635101:0:15180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458243840 00000100:00100000:3.0:1788201318.635106:0:15180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458243840 00000100:00100000:3.0:1788201318.635149:0:15180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458243712 00000100:00100000:3.0:1788201318.635152:0:15180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458243712 00000100:00100000:0.0:1788201318.635271:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788201318.635282:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458243968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201318.635483:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458243968:12345-0@lo:400:kworker.0 Request processed in 204us (2378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201318.635490:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788201318.635677:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c548c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458243584:0@lo:400:kworker.0 00000100:00100000:2.0:1788201318.635700:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c548d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458244096:0@lo:400:kworker.0 00000100:00100000:3.0:1788201318.635812:0:15180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788201318.635820:0:15180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458243840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201318.635863:0:15180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458243840:12345-0@lo:400:kworker.0 Request processed in 44us (2034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201318.635869:0:15180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788201318.635885:0:15180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788201318.635891:0:15180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c6bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458243712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201318.635925:0:15180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c6bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458243712:12345-0@lo:400:kworker.0 Request processed in 34us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201318.635934:0:15180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201318.636051:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c548f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458243968:0@lo:400:kworker.0 00000100:00100000:0.0:1788201318.636099:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c548ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458243840:0@lo:400:kworker.0 00000100:00100000:1.0:1788201318.636451:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c548ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458243712:0@lo:400:kworker.0 00000100:00100000:1.0:1788201318.636468:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c548f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458244224:0@lo:400:kworker.0 00000100:00100000:1.0:1788201318.636516:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201318.637596:0:15284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458244224 00000100:00100000:3.0:1788201318.637608:0:15284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458244224 00000100:00100000:3.0:1788201318.637660:0:15284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788201318.637671:0:15284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458244224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201318.637741:0:15284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458244224:12345-0@lo:400:kworker.0 Request processed in 73us (1225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201318.637749:0:15284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788201318.637774:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201318.639744:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c548f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458244224:0@lo:400:kworker.0 00000001:00080000:2.0:1788201319.198819:0:15196:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901907 is committed 00000004:00080000:2.0:1788201319.198860:0:15196:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:2.0:1788201319.198884:0:15196:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788201319.199282:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458244352:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201319.199505:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201319.199560:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458244352 00000100:00100000:2.0:1788201319.199568:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458244352 00000100:00100000:2.0:1788201319.199620:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4240 00000100:00100000:2.0:1788201319.199629:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458244352:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201319.199653:0:10484:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1054 count 1 00010000:00010000:2.0:1788201319.199679:0:10484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057aee966/0x9383f985bc4d473a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.199700:0:10484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002e0303fe/0x9383f985bc4d3fbc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f52 expref: 508 pid: 13450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.199709:0:10484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41e:0x0].0x0 since=47s v=(0 0) 00010000:00010000:2.0:1788201319.199714:0:10484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201319.199719:0:10484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057aee966/0x9383f985bc4d473a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.199747:0:10484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002e0303fe/0x9383f985bc4d3fbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f52 expref: 508 pid: 13450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.199762:0:10484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002e0303fe/0x9383f985bc4d3fbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f52 expref: 508 pid: 13450 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201319.199775:0:10484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c548ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10484:1875064458244608:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201319.199829:0:10484:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c11773c0 going to sleep for 11 seconds 00000100:00080000:3.0:1788201319.200000:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201319.200008:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201319.200018:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458244480:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201319.200047:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201319.200086:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458244480 00000100:00100000:3.0:1788201319.200090:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458244480 00000100:00100000:3.0:1788201319.200131:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4241 00000100:00100000:3.0:1788201319.200138:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458244480:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788201319.200150:0:13438:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1054 count 1 00010000:00010000:3.0:1788201319.200164:0:13438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c24951c2/0x9383f985bc4d4741 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.200177:0:13438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008bd623ea/0x9383f985bc4d3f99 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f28 expref: 7 pid: 13443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.200184:0:13438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41e:0x0].0x0 since=47s v=(0 0) 00010000:00010000:3.0:1788201319.200188:0:13438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201319.200192:0:13438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c24951c2/0x9383f985bc4d4741 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.200212:0:13438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008bd623ea/0x9383f985bc4d3f99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f28 expref: 7 pid: 13443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.200222:0:13438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008bd623ea/0x9383f985bc4d3f99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f28 expref: 7 pid: 13443 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201319.200233:0:13438:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13438:1875064458244736:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201319.200256:0:13438:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1c1d240 going to sleep for 11 seconds 00000100:00080000:3.0:1788201319.200266:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201319.205225:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201319.205261:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201319.205325:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442691456 00000100:00100000:3.0:1788201319.205334:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442691456 00010000:00010000:3.0:1788201319.205566:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002e0303fe/0x9383f985bc4d3fbc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f52 expref: 509 pid: 13450 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201319.205604:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442691584 00000100:00100000:3.0:1788201319.205608:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442691584 00010000:00010000:3.0:1788201319.205626:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008bd623ea/0x9383f985bc4d3f99 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f28 expref: 8 pid: 13443 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201319.205650:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1552 00000100:00100000:3.0:1788201319.205659:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2359:x1875064442691456:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201319.205674:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201319.205680:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002e0303fe/0x9383f985bc4d3fbc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f52 expref: 509 pid: 13450 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.205695:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002e0303fe/0x9383f985bc4d3fbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f52 expref: 509 pid: 13450 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.205723:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201319.205728:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201319.205735:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000057aee966/0x9383f985bc4d473a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.205746:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057aee966/0x9383f985bc4d473a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.205767:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201319.205819:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2359:x1875064442691456:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 160us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201319.205827:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1552 00000100:00100000:3.0:1788201319.205849:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1553 00000100:00100000:3.0:1788201319.205856:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2359:x1875064442691584:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201319.205864:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201319.205869:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008bd623ea/0x9383f985bc4d3f99 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f28 expref: 8 pid: 13443 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.205880:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008bd623ea/0x9383f985bc4d3f99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f28 expref: 8 pid: 13443 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.205899:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201319.205903:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201319.205907:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c24951c2/0x9383f985bc4d4741 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.205915:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c24951c2/0x9383f985bc4d4741 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201319.205926:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201319.205945:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2359:x1875064442691584:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 89us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201319.205951:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1553 00000100:00080000:3.0:1788201319.205971:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201319.205976:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788201319.206327:0:10484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e0303fe/0x9383f985bc4d3fbc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f52 expref: 508 pid: 13450 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201319.206344:0:10484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c548ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10484:1875064458244608:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201319.206385:0:10484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000057aee966/0x9383f985bc4d473a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.206394:0:10484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000057aee966/0x9383f985bc4d473a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.206401:0:10484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057aee966/0x9383f985bc4d473a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.206412:0:10484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057aee966/0x9383f985bc4d473a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.206419:0:10484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057aee966/0x9383f985bc4d473a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201319.206437:0:10484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201319.206969:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1875064458244352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7327us (7450us total) trans 4294968862 rc 0/0 00000100:00100000:2.0:1788201319.206979:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4240 00000004:00080000:2.0:1788201319.207021:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c12d1180/2, rc 0, transno 4294968862 00000100:00100000:2.0:1788201319.207031:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458244352:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788201319.207561:0:13438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008bd623ea/0x9383f985bc4d3f99 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f28 expref: 7 pid: 13443 timeout: 694 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201319.207578:0:13438:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13438:1875064458244736:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201319.207596:0:13438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c24951c2/0x9383f985bc4d4741 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.207605:0:13438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c24951c2/0x9383f985bc4d4741 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.207612:0:13438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c24951c2/0x9383f985bc4d4741 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.207620:0:13438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c24951c2/0x9383f985bc4d4741 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.207626:0:13438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c24951c2/0x9383f985bc4d4741 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201319.207650:0:13438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788201319.208542:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201319.208551:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057aee966/0x9383f985bc4d473a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.208562:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b28a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201319.208566:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057aee966/0x9383f985bc4d473a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.208576:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057aee966/0x9383f985bc4d473a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.208594:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057aee966/0x9383f985bc4d473a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.208603:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057aee966/0x9383f985bc4d473a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.208623:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201319.208627:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c24951c2/0x9383f985bc4d4741 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.208631:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201319.208633:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c24951c2/0x9383f985bc4d4741 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.208640:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c24951c2/0x9383f985bc4d4741 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.208647:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c24951c2/0x9383f985bc4d4741 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.208651:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c24951c2/0x9383f985bc4d4741 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201319.208659:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201319.208661:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201319.208662:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201319.208775:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201319.208860:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3311:x1875064458244480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8722us (8811us total) trans 4294968862 rc 0/0 00000100:00100000:0.0:1788201319.208868:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4241 00000004:00080000:2.0:1788201319.209648:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c12d3800/2, rc 0, transno 4294968862 00000100:00100000:2.0:1788201319.209661:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458244480:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788201319.270229:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201320.294616:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201320.337924:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201320.338395:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201320.338436:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201320.338477:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201320.338517:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442691968 00000100:00100000:0.0:1788201320.338530:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442691968 00000100:00100000:0.0:1788201320.338592:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442692096 00000100:00100000:0.0:1788201320.338595:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442692096 00000100:00100000:0.0:1788201320.338624:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 201 00000100:00100000:0.0:1788201320.338636:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2361:x1875064442691968:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201320.338733:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2361:x1875064442691968:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 99us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201320.338742:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 201 00000100:00100000:0.0:1788201320.338765:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 202 00000100:00100000:0.0:1788201320.338772:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2361:x1875064442692096:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201320.338799:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2361:x1875064442692096:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 28us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201320.338806:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 202 00000100:00100000:3.0:1788201320.339673:0:15284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442691840 00000100:00100000:3.0:1788201320.339684:0:15284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442691840 00000100:00100000:3.0:1788201320.339759:0:15284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:3.0:1788201320.339769:0:15284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2361:x1875064442691840:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201320.339834:0:15284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2361:x1875064442691840:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 67us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201320.339842:0:15284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00080000:2.0:1788201320.341898:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201320.346766:0:15173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442691712 00000100:00100000:1.0:1788201320.346783:0:15173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442691712 00000100:00100000:1.0:1788201320.346863:0:15173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:1.0:1788201320.346876:0:15173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2dc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2361:x1875064442691712:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201320.346986:0:15173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2dc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2361:x1875064442691712:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 112us (9076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201320.346995:0:15173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 63 00010000:00010000:1.0:1788201321.317630:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201322.347327:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788201322.725554:0:15202:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 597983255867ns, next at 598983252283ns, rc = 0 00000004:00080000:3.0:1788201322.725589:0:15204:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 597983294321ns, next at 598983292898ns, rc = 0 00000100:00100000:1.0:1788201322.725610:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458244992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201322.725651:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2202300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458244864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201322.730443:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201322.734224:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458244864 00000100:00100000:0.0:1788201322.734994:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458244864 00000100:00080000:2.0:1788201322.735385:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201322.735519:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788201322.735540:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875064458244864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201322.735597:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524877824 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1788201322.735818:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875064458244864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 287us (5387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201322.735827:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788201322.737186:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201322.737345:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458244992 00000100:00100000:2.0:1788201322.737358:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458244992 00000100:00100000:2.0:1788201322.737434:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788201322.737447:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2200000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875064458244992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201322.737493:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 13631488 granted 524877824 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201322.737567:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2200000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875064458244992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201322.737575:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788201322.737629:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458244992:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788201322.737649:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201322.739156:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2202300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458244864:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788201323.370934:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201323.750249:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201323.751318:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875064458245376:0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.751415:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201323.751520:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201323.751527:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458245248:0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.751554:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201323.751598:0:15180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458245376 00000100:00100000:2.0:1788201323.751608:0:15180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458245376 00000100:00100000:2.0:1788201323.751673:0:15180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458245248 00000100:00100000:2.0:1788201323.751677:0:15180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458245248 00000100:00100000:2.0:1788201323.751710:0:15180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788201323.751720:0:15180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875064458245376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.751788:0:15180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875064458245376:12345-0@lo:400:kworker.0 Request processed in 68us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201323.751795:0:15180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788201323.751816:0:15180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788201323.751824:0:15180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875064458245248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.751853:0:15180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875064458245248:12345-0@lo:400:kworker.0 Request processed in 31us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201323.751859:0:15180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788201323.751908:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458245248:0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.751919:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875064458245376:0@lo:400:kworker.0 00000100:00080000:0.0:1788201323.752157:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201323.757177:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458245504:0@lo:400:kworker.0 00000100:00100000:1.0:1788201323.757283:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201323.757377:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458245120:0@lo:400:kworker.0 00000100:00100000:1.0:1788201323.757408:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201323.757551:0:15194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458245120 00000100:00100000:0.0:1788201323.757562:0:15194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458245120 00000100:00100000:0.0:1788201323.757627:0:15194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788201323.757637:0:15194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04fae07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3312:x1875064458245120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201323.757715:0:15194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04fae07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3312:x1875064458245120:12345-0@lo:400:kworker.0 Request processed in 79us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201323.757724:0:15194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788201323.757877:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458245504 00000100:00100000:2.0:1788201323.757882:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458245504 00000100:00100000:2.0:1788201323.757929:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788201323.757937:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2200700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3312:x1875064458245504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201323.758030:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458245120:0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.758130:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2200700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3312:x1875064458245504:12345-0@lo:400:kworker.0 Request processed in 192us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201323.758139:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788201323.758289:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458245504:0@lo:400:kworker.0 00000100:00100000:0.0:1788201323.759069:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875064458245760:0@lo:400:kworker.0 00000100:00100000:0.0:1788201323.759128:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201323.759240:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458245632:0@lo:400:kworker.0 00000100:00100000:2.0:1788201323.759275:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201323.759438:0:13442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458245632 00000100:00100000:0.0:1788201323.759445:0:13442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458245632 00000100:00100000:0.0:1788201323.759508:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788201323.759517:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3313:x1875064458245632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201323.759571:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3313:x1875064458245632:12345-0@lo:400:kworker.0 Request processed in 56us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201323.759579:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788201323.759764:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458245632:0@lo:400:kworker.0 00000100:00100000:3.0:1788201323.759838:0:15180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458245760 00000100:00100000:3.0:1788201323.759843:0:15180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458245760 00000100:00100000:3.0:1788201323.759883:0:15180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788201323.759891:0:15180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875064458245760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201323.759946:0:15180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875064458245760:12345-0@lo:400:kworker.0 Request processed in 56us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201323.759953:0:15180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788201323.760073:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875064458245760:0@lo:400:kworker.0 00000004:00080000:3.0:1788201324.281972:0:15196:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:3.0:1788201324.282021:0:15196:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:1.0:1788201324.282497:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458246016:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201324.282842:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201324.282908:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201324.282916:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2202300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458246144:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201324.283034:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458246016 00000100:00100000:1.0:1788201324.283043:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458246016 00000100:00080000:0.0:1788201324.283098:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201324.283134:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4242 00000100:00100000:1.0:1788201324.283148:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d80f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3312:x1875064458246016:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788201324.283184:0:13450:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1055 count 1 00010000:00010000:1.0:1788201324.283233:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d4748 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201324.283261:0:13450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d3f8b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f1a expref: 6 pid: 13443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201324.283273:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41f:0x0].0x0 since=52s v=(0 0) 00010000:00010000:1.0:1788201324.283278:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201324.283285:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d4748 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201324.283904:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458245888:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201324.283965:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201324.284013:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d80f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458246400:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201324.284051:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201324.284089:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201324.284096:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458245888 00000100:00100000:3.0:1788201324.284103:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d80f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458246272:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201324.284105:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458245888 00000100:00100000:3.0:1788201324.284158:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201324.284161:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458246400 00000100:00100000:0.0:1788201324.284164:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458246400 00000100:00100000:0.0:1788201324.284196:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458246272 00000100:00100000:0.0:1788201324.284198:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458246272 00000100:00100000:0.0:1788201324.284225:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4243 00000100:00100000:0.0:1788201324.284233:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+7:3311:x1875064458245888:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201324.284257:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4244 00002000:00080000:0.0:1788201324.284265:0:13446:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1053 count 1 00000100:00100000:3.0:1788201324.284273:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+7:3311:x1875064458246400:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201324.284327:0:13449:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1053 count 1 00010000:00010000:0.0:1788201324.284413:0:13446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ffd6bfa/0x9383f985bc4d474f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201324.284434:0:13446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000700c6050/0x9383f985bc4d3f5a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ef7 expref: 6 pid: 13440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201324.284440:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41d:0x0].0x0 since=52s v=(0 0) 00010000:00010000:0.0:1788201324.284444:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201324.284447:0:13446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ffd6bfa/0x9383f985bc4d474f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201324.284477:0:13446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000700c6050/0x9383f985bc4d3f5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ef7 expref: 6 pid: 13440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201324.284489:0:13446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000700c6050/0x9383f985bc4d3f5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ef7 expref: 6 pid: 13440 timeout: 699 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201324.284499:0:13446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5487b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:13446:1875064458246528:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201324.284575:0:13446:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f577d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201324.284592:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4245 00000100:00100000:0.0:1788201324.284599:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3311:x1875064458246272:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201324.284613:0:12363:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1055 count 1 00010000:00010000:0.0:1788201324.284627:0:12363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080ffd43d/0x9383f985bc4d4756 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201324.284640:0:12363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d3f84 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x41f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f13 expref: 507 pid: 13443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201324.284645:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41f:0x0].0x0 since=52s v=(0 0) 00010000:00010000:0.0:1788201324.284647:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201324.284649:0:12363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080ffd43d/0x9383f985bc4d4756 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x41f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201324.284665:0:12363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d3f84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x41f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f13 expref: 507 pid: 13443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201324.284671:0:12363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d3f84 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x41f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f13 expref: 507 pid: 13443 timeout: 699 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201324.284680:0:12363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5485c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12363:1875064458246656:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201324.284698:0:12363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f577d9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788201324.284814:0:13450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d3f8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f1a expref: 6 pid: 13443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788201324.284823:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788201324.284838:0:13450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d3f8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f1a expref: 6 pid: 13443 timeout: 699 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201324.284854:0:13450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d80f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:13450:1875064458246784:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201324.284937:0:13450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2fabf00 going to sleep for 11 seconds 00010000:00010000:3.0:1788201324.285624:0:13449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d475d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201324.285646:0:13449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000232c8587/0x9383f985bc4d3f7d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f0c expref: 507 pid: 13443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201324.285656:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41d:0x0].0x0 since=52s v=(0 0) 00010000:00010000:3.0:1788201324.285663:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201324.285667:0:13449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d475d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201324.286442:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201324.286512:0:13449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000232c8587/0x9383f985bc4d3f7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f0c expref: 507 pid: 13443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201324.286522:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458246144 00010000:00010000:3.0:1788201324.286530:0:13449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000232c8587/0x9383f985bc4d3f7d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f0c expref: 507 pid: 13443 timeout: 699 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201324.286532:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458246144 00000100:00100000:3.0:1788201324.286553:0:13449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:13449:1875064458246912:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201324.286583:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4246 00000100:00100000:2.0:1788201324.286595:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3312:x1875064458246144:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201324.286618:0:13444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1056 count 1 00010000:00010000:2.0:1788201324.286641:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057aee966/0x9383f985bc4d4764 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201324.286646:0:13449:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1268900 going to sleep for 11 seconds 00010000:00010000:2.0:1788201324.286665:0:13444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9237659/0x9383f985bc4d3f92 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f21 expref: 507 pid: 13443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.286674:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x420:0x0].0x0 since=52s v=(0 0) 00010000:00010000:2.0:1788201324.286679:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x420:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201324.286684:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057aee966/0x9383f985bc4d4764 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.286712:0:13444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d9237659/0x9383f985bc4d3f92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f21 expref: 507 pid: 13443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.286722:0:13444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d9237659/0x9383f985bc4d3f92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f21 expref: 507 pid: 13443 timeout: 699 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201324.286734:0:13444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c548c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13444:1875064458247040:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201324.286786:0:13444:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c83f6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201324.297735:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201324.297786:0:13446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5487b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:13446:1875064458246528:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201324.297828:0:13446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005ffd6bfa/0x9383f985bc4d474f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201324.297848:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442692224 00000100:00100000:2.0:1788201324.297859:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442692224 00000100:00080000:1.0:1788201324.297901:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788201324.297921:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000700c6050/0x9383f985bc4d3f5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ef7 expref: 7 pid: 13440 timeout: 699 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201324.302490:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1554 00000100:00100000:0.0:1788201324.302523:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2361:x1875064442692224:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201324.302552:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201324.302566:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000700c6050/0x9383f985bc4d3f5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ef7 expref: 7 pid: 13440 timeout: 699 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201324.302591:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000700c6050/0x9383f985bc4d3f5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ef7 expref: 7 pid: 13440 timeout: 699 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201324.302628:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000700c6050/0x9383f985bc4d3f5a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4ef7 expref: 7 pid: 13440 timeout: 699 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201324.302647:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201324.302652:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201324.302660:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ffd6bfa/0x9383f985bc4d474f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201324.302671:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ffd6bfa/0x9383f985bc4d474f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201324.302849:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201324.302928:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2361:x1875064442692224:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 421us (5203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201324.302939:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1554 00010000:00010000:0.0:1788201324.303924:0:13446:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005ffd6bfa/0x9383f985bc4d474f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201324.303942:0:13446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ffd6bfa/0x9383f985bc4d474f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201324.303957:0:13446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ffd6bfa/0x9383f985bc4d474f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201324.303968:0:13446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ffd6bfa/0x9383f985bc4d474f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201324.304000:0:13446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201324.305925:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201324.305942:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ffd6bfa/0x9383f985bc4d474f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201324.305958:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201324.305965:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ffd6bfa/0x9383f985bc4d474f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201324.305977:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ffd6bfa/0x9383f985bc4d474f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201324.306017:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ffd6bfa/0x9383f985bc4d474f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201324.306026:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ffd6bfa/0x9383f985bc4d474f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201324.306059:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201324.306063:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201324.306068:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201324.308089:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+8:3311:x1875064458245888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23846us (24115us total) trans 4294968863 rc 0/0 00000100:00100000:2.0:1788201324.308119:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4243 00000004:00080000:1.0:1788201324.309127:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c12d0000/2, rc 0, transno 4294968863 00000100:00100000:1.0:1788201324.309136:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458245888:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201324.321970:0:13450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d80f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:13450:1875064458246784:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201324.322018:0:13450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d4748 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201324.322184:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201324.322225:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201324.322274:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201324.322319:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201324.323118:0:13444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c548c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13444:1875064458247040:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201324.323159:0:13444:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000057aee966/0x9383f985bc4d4764 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201324.323448:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442692352 00000100:00100000:2.0:1788201324.323458:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442692352 00000100:00100000:1.0:1788201324.323463:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442692480 00000100:00100000:1.0:1788201324.323473:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442692480 00010000:00010000:1.0:1788201324.323514:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d3f8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f1a expref: 6 pid: 13443 timeout: 699 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.323517:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d3f84 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x41f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f13 expref: 508 pid: 13443 timeout: 699 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201324.323620:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442692608 00000100:00100000:1.0:1788201324.323626:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442692608 00010000:00010000:1.0:1788201324.323645:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000232c8587/0x9383f985bc4d3f7d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f0c expref: 509 pid: 13443 timeout: 699 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201324.325431:0:13449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:13449:1875064458246912:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201324.325465:0:13449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d475d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201324.333106:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442692736 00000100:00100000:2.0:1788201324.333123:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442692736 00000100:00100000:1.0:1788201324.333256:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1555 00010000:00010000:2.0:1788201324.333258:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d9237659/0x9383f985bc4d3f92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f21 expref: 510 pid: 13443 timeout: 699 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201324.333309:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2359:x1875064442692480:12345-192.168.201.30@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788201324.333321:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1556 00000100:00100000:2.0:1788201324.333336:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c7e14050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+510:2359:x1875064442692352:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201324.333352:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201324.333358:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d3f84 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x41f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f13 expref: 510 pid: 13443 timeout: 699 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.333372:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d3f84 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x41f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f13 expref: 510 pid: 13443 timeout: 699 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.333399:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201324.333404:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201324.333410:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000080ffd43d/0x9383f985bc4d4756 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.333421:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080ffd43d/0x9383f985bc4d4756 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x41f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.333443:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201324.334010:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c7e14050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+510:2359:x1875064442692352:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 676us (11824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201324.334019:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1556 00000100:00100000:2.0:1788201324.334079:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1557 00000100:00100000:2.0:1788201324.334088:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2359:x1875064442692608:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201324.334098:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201324.334104:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000232c8587/0x9383f985bc4d3f7d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f0c expref: 509 pid: 13443 timeout: 699 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.334116:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000232c8587/0x9383f985bc4d3f7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f0c expref: 509 pid: 13443 timeout: 699 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.334597:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000232c8587/0x9383f985bc4d3f7d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x41d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f0c expref: 509 pid: 13443 timeout: 699 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.334622:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201324.334627:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201324.334631:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d475d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.334639:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d475d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.334669:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201324.334697:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2359:x1875064442692608:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 609us (12420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201324.334703:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1557 00000100:00100000:2.0:1788201324.334724:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1558 00000100:00100000:2.0:1788201324.334731:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+507:2359:x1875064442692736:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201324.334740:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201324.334745:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d9237659/0x9383f985bc4d3f92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f21 expref: 507 pid: 13443 timeout: 699 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.334754:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d9237659/0x9383f985bc4d3f92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f21 expref: 507 pid: 13443 timeout: 699 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.334768:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9237659/0x9383f985bc4d3f92 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x420:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f21 expref: 507 pid: 13443 timeout: 699 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.334783:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x420:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201324.334786:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x420:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201324.334790:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000057aee966/0x9383f985bc4d4764 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.334797:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057aee966/0x9383f985bc4d4764 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.334814:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201324.334834:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+506:2359:x1875064442692736:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 104us (12515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201324.334840:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1558 00010000:00010000:1.0:1788201324.335461:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201324.335481:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d3f8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x41f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f1a expref: 6 pid: 13443 timeout: 699 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201324.335504:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d3f8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x41f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f1a expref: 6 pid: 13443 timeout: 699 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201324.335529:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0a1d546/0x9383f985bc4d3f8b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x41f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f1a expref: 6 pid: 13443 timeout: 699 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201324.335546:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201324.335551:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201324.335557:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d4748 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201324.335568:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d4748 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201324.335612:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201324.335664:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2359:x1875064442692480:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 2390us (13437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201324.335675:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1555 00010000:00010000:1.0:1788201324.335795:0:13450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d4748 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201324.335806:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d4748 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201324.335819:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d4748 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201324.335828:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d4748 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788201324.335850:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788201324.335852:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201324.335872:0:13444:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000057aee966/0x9383f985bc4d4764 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.335897:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057aee966/0x9383f985bc4d4764 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.335909:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057aee966/0x9383f985bc4d4764 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.335916:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057aee966/0x9383f985bc4d4764 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.335947:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788201324.336654:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d80f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+8:3312:x1875064458246016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 53506us (53811us total) trans 4294968864 rc 0/0 00000100:00100000:1.0:1788201324.336666:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4242 00000100:00100000:2.0:1788201324.336797:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3312:x1875064458246144:12345-0@lo:6:osp-syn-0-0.0 Request processed in 50203us (50356us total) trans 4294968863 rc 0/0 00000100:00100000:2.0:1788201324.336805:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4246 00010000:00010000:2.0:1788201324.336836:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201324.336843:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d4748 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.336853:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201324.336858:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d4748 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.336868:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d4748 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.336885:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d4748 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.336893:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d4748 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.336914:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201324.336917:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057aee966/0x9383f985bc4d4764 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.336925:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b28a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201324.336928:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057aee966/0x9383f985bc4d4764 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.336932:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057aee966/0x9383f985bc4d4764 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.336939:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057aee966/0x9383f985bc4d4764 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.336943:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057aee966/0x9383f985bc4d4764 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x420:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.336952:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201324.336953:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201324.336954:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201324.338630:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201324.338654:0:13449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d475d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201324.338673:0:13449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d475d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201324.338699:0:13449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d475d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201324.338714:0:13449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d475d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201324.338746:0:13449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201324.339365:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201324.339376:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d475d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201324.339388:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201324.339395:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d475d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201324.339404:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d475d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201324.339428:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d475d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201324.339436:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013c1550e/0x9383f985bc4d475d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201324.339458:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201324.339459:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201324.339461:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201324.340169:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+9:3311:x1875064458246400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 55895us (56110us total) trans 4294968864 rc 0/0 00000100:00100000:3.0:1788201324.340182:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4244 00000004:00080000:1.0:1788201324.341446:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04d80f0e00/2, rc 0, transno 4294968864 00000100:00100000:1.0:1788201324.341462:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d80f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458246400:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788201324.342556:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c2202300/2, rc 0, transno 4294968863 00000100:00100000:0.0:1788201324.342566:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2202300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458246144:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788201324.342585:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c12d2a00/2, rc 0, transno 4294968864 00000100:00100000:0.0:1788201324.342590:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458246016:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788201324.342650:0:12363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a490acb/0x9383f985bc4d3f84 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x41f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4f13 expref: 505 pid: 13443 timeout: 699 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201324.343476:0:12363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5485c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12363:1875064458246656:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201324.343514:0:12363:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000080ffd43d/0x9383f985bc4d4756 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201324.343657:0:12363:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000080ffd43d/0x9383f985bc4d4756 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201324.343668:0:12363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080ffd43d/0x9383f985bc4d4756 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201324.344432:0:12363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080ffd43d/0x9383f985bc4d4756 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201324.344445:0:12363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080ffd43d/0x9383f985bc4d4756 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201324.344470:0:12363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201324.344565:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201324.344579:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080ffd43d/0x9383f985bc4d4756 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.344594:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a8800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201324.344600:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080ffd43d/0x9383f985bc4d4756 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.344613:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080ffd43d/0x9383f985bc4d4756 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.344637:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080ffd43d/0x9383f985bc4d4756 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.344646:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080ffd43d/0x9383f985bc4d4756 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201324.344678:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201324.344681:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201324.344684:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788201324.346214:0:6732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294968862 is committed 00000100:00100000:0.0:1788201324.346637:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3311:x1875064458246272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 62032us (62475us total) trans 4294968865 rc 0/0 00000100:00100000:0.0:1788201324.346649:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4245 00000100:00100000:1.0:1788201324.348892:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968862 gen 2 00000004:00080000:1.0:1788201324.348906:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c12d1180, transno 4294968862 00000100:00100000:1.0:1788201324.348928:0:3311:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9e03c2202300 x1875064458246144/t4294968863(4294968863) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201379 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788201324.348943:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04d80f3800/2, rc 0, transno 4294968865 00000100:00100000:1.0:1788201324.348949:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d80f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458246272:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788201324.392022:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788201324.414567:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968862 is committed 00000001:02000400:0.0:1788201324.882508:0:16014:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 102d: check replay 00000100:00100000:0.0:1788201325.046762:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201325.046897:0:15179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442692864 00000100:00100000:3.0:1788201325.046910:0:15179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442692864 00000100:00100000:3.0:1788201325.047016:0:15179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00100000:3.0:1788201325.047029:0:15179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:16387:x1875064442692864:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788201325.047064:0:15179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201325.047097:0:15179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d476b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c506a expref: -99 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.047187:0:15179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d4772 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.047203:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d4772 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.047219:0:15179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d4772 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201325.047517:0:15179:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788201325.047522:0:15179:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201325.047612:0:15179:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d4772 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.047647:0:15179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d476b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c506a expref: 8 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.047665:0:15179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d4772 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c506a expref: 7 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.047674:0:15179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c23c1300) 00010000:00010000:3.0:1788201325.047676:0:15179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201325.047680:0:15179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5065e00, rc 0) 00000100:00100000:3.0:1788201325.047772:0:15179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:16387:x1875064442692864:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 744us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201325.047780:0:15179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00080000:1.0:1788201325.048071:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201325.052757:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201325.052892:0:15284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442692992 00000100:00100000:3.0:1788201325.052906:0:15284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442692992 00000100:00100000:3.0:1788201325.052997:0:15284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00100000:3.0:1788201325.053011:0:15284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:16387:x1875064442692992:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788201325.053054:0:15284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201325.053083:0:15284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d4779 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5071 expref: -99 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.053178:0:15284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d4780 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.053196:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d4780 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.053209:0:15284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d4780 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.053229:0:15284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d4787 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.053237:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d4787 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.053244:0:15284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d4787 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.053604:0:15284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d4780 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.053614:0:15284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d4780 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.053622:0:15284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d4780 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.053630:0:15284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201325.053635:0:15284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d4780 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.053644:0:15284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d4780 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.053659:0:15284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c23c1300) 00010000:00010000:3.0:1788201325.053663:0:15284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201325.053669:0:15284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d4780 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.053676:0:15284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d4780 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.053689:0:15284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d4787 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.053695:0:15284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d4787 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.053701:0:15284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d4787 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.053720:0:15284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201325.053723:0:15284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d4787 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.053733:0:15284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d4787 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.053740:0:15284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x430dc47c (ffff9e03c23c1500) 00010000:00010000:3.0:1788201325.053742:0:15284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201325.053745:0:15284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d4787 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.053751:0:15284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d4787 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.053793:0:15284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d4779 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5071 expref: 8 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.053805:0:15284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c23c1300) 00010000:00010000:3.0:1788201325.053808:0:15284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201325.053812:0:15284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d4779 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5071 expref: 8 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.053823:0:15284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5064600, rc 0) 00000100:00100000:3.0:1788201325.053905:0:15284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:16387:x1875064442692992:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 896us (1159us total) trans 0 rc 301/301 00000100:00100000:3.0:1788201325.053914:0:15284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00100000:1.0:1788201325.073481:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201325.073533:0:15179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442693248 00000100:00100000:1.0:1788201325.073546:0:15179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442693248 00000100:00100000:1.0:1788201325.073614:0:15179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:1.0:1788201325.073625:0:15179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:16387:x1875064442693248:12345-192.168.201.30@tcp:36:lfs.0 00010000:00010000:1.0:1788201325.073718:0:15179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201325.073752:0:15179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d4772 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c506a expref: 7 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.073774:0:15179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c23c1300) 00010000:00010000:1.0:1788201325.073790:0:15179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201325.074269:0:15179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d478e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.074285:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d478e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.074324:0:15179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d478e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.074338:0:15179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4795 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x430dc47c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.074346:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4795 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.074353:0:15179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4795 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201325.080269:0:15179:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x402:0x0]: returning size 512 00010000:00010000:1.0:1788201325.080804:0:15179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d478e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.080824:0:15179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d478e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.080832:0:15179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d478e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.080839:0:15179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201325.080845:0:15179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d478e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.080853:0:15179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d478e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.080876:0:15179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c26be600) 00010000:00010000:1.0:1788201325.080880:0:15179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201325.080886:0:15179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d478e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.080892:0:15179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d478e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201325.080916:0:15179:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dbeb464e reply state 00000000e497b411 transno 12884901908 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4795 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201325.080927:0:15179:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201325.081657:0:15179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:16387:x1875064442693248:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 8023us (8180us total) trans 12884901908 rc 0/0 00000100:00100000:1.0:1788201325.081670:0:15179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 43 00010000:00010000:3.0:1788201325.099067:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4795 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.099093:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4795 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.099102:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4795 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.099109:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201325.099115:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4795 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.099125:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4795 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.099147:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x430dc47c (ffff9e03c26bed00) 00010000:00010000:3.0:1788201325.099150:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201325.099156:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4795 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.099163:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4795 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201325.150063:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201325.150216:0:15284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442693376 00000100:00100000:3.0:1788201325.150230:0:15284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442693376 00000100:00100000:3.0:1788201325.150322:0:15284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:3.0:1788201325.150334:0:15284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:16390:x1875064442693376:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788201325.150366:0:15284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201325.150394:0:15284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d479c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5078 expref: -99 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.150482:0:15284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d47a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.150499:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d47a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.150512:0:15284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d47a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201325.150593:0:15284:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788201325.150599:0:15284:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201325.150631:0:15284:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d47a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.150662:0:15284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d479c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5078 expref: 9 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.150684:0:15284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d47a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5078 expref: 8 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.150694:0:15284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c23c1500) 00010000:00010000:3.0:1788201325.150698:0:15284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201325.150714:0:15284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5064800, rc 0) 00000100:00100000:3.0:1788201325.150802:0:15284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:16390:x1875064442693376:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 470us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201325.150810:0:15284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:2.0:1788201325.153582:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201325.153754:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442693632 00000100:00100000:0.0:1788201325.153769:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442693632 00000100:00100000:0.0:1788201325.153839:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:0.0:1788201325.153851:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:16390:x1875064442693632:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1788201325.153878:0:15178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201325.153906:0:15178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d47aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c507f expref: -99 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.154017:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d47b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.154034:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d47b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.154798:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d47b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.154827:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d47b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.154837:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d47b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.154845:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d47b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201325.155039:0:15178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x402:0x0]: returning size 512 00010000:00010000:0.0:1788201325.155392:0:15178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d47b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.155401:0:15178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d47b1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.155408:0:15178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d47b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.155416:0:15178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201325.155421:0:15178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d47b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.155430:0:15178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d47b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.155445:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c23c1500) 00010000:00010000:0.0:1788201325.155448:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201325.155453:0:15178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d47b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.155460:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d47b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.155474:0:15178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d47b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.155480:0:15178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d47b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.155491:0:15178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d47b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.155496:0:15178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201325.155499:0:15178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d47b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.155505:0:15178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d47b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.155513:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x430dc47c (ffff9e03c2fc5600) 00010000:00010000:0.0:1788201325.155515:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201325.155518:0:15178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d47b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.155524:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d47b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.155586:0:15178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d47aa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c507f expref: 10 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.155599:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c23c1500) 00010000:00010000:0.0:1788201325.155601:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201325.155605:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d47aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c507f expref: 10 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.155616:0:15178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c19a9800, rc 0) 00000100:00100000:0.0:1788201325.157816:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:16390:x1875064442693632:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1855us (2146us total) trans 12884901909 rc 301/301 00000100:00100000:0.0:1788201325.157838:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:2.0:1788201325.159625:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201325.159878:0:15284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442693888 00000100:00100000:0.0:1788201325.159892:0:15284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442693888 00000100:00100000:0.0:1788201325.159979:0:15284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:0.0:1788201325.159991:0:15284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:16390:x1875064442693888:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1788201325.160024:0:15284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201325.160062:0:15284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d47c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5086 expref: -99 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.160160:0:15284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d47cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.160177:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d47cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.160190:0:15284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d47cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.160209:0:15284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d47d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.160217:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d47d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.160225:0:15284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d47d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.165150:0:15284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d47db lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.165181:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d47db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.165193:0:15284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d47db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201325.165213:0:15284:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x402:0x0]: returning size 512 00010000:00010000:0.0:1788201325.165385:0:15284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d47cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.165394:0:15284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d47cd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.165401:0:15284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d47cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.165408:0:15284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201325.165412:0:15284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d47cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.165419:0:15284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d47cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.165432:0:15284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c23c1500) 00010000:00010000:0.0:1788201325.165434:0:15284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201325.165438:0:15284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d47cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.165444:0:15284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d47cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.165459:0:15284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d47d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.165465:0:15284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d47d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.165470:0:15284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d47d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.165474:0:15284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a8200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201325.165477:0:15284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d47d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.165482:0:15284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d47d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.165488:0:15284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x430dc47c (ffff9e03c2fc5500) 00010000:00010000:0.0:1788201325.165490:0:15284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201325.165493:0:15284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d47d4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.165498:0:15284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d47d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.165794:0:15284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d47c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5086 expref: 12 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.165813:0:15284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d47db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5086 expref: 11 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.167245:0:15284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:0.0:1788201325.167249:0:15284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201325.167254:0:15284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c19a9400, rc 0) 00000100:00100000:0.0:1788201325.167352:0:15284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:16390:x1875064442693888:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 7360us (7736us total) trans 12884901910 rc 0/0 00000100:00100000:0.0:1788201325.167361:0:15284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:3.0:1788201325.169900:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201325.170345:0:15181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442694144 00000100:00100000:2.0:1788201325.170357:0:15181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442694144 00000100:00100000:2.0:1788201325.170408:0:15181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:2.0:1788201325.170418:0:15181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:16390:x1875064442694144:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:2.0:1788201325.170681:0:15181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:16390:x1875064442694144:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 263us (788us total) trans 12884901911 rc 0/0 00000100:00100000:2.0:1788201325.170689:0:15181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:2.0:1788201325.182703:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201325.182850:0:15181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442694272 00000100:00100000:1.0:1788201325.182863:0:15181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442694272 00000100:00100000:1.0:1788201325.182943:0:15181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:1.0:1788201325.183147:0:15181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2a18450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:16390:x1875064442694272:12345-192.168.201.30@tcp:33:lfs.0 00000004:00200000:1.0:1788201325.183286:0:15181:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x402:0x0]: returning size 512 00000004:00200000:1.0:1788201325.184178:0:15181:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:1.0:1788201325.184356:0:15181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2a18450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:16390:x1875064442694272:12345-192.168.201.30@tcp:33:lfs.0 Request processed in 1396us (1664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201325.184369:0:15181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:2.0:1788201325.197810:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201325.198764:0:15182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442694528 00000100:00100000:0.0:1788201325.198779:0:15182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442694528 00000100:00100000:0.0:1788201325.198874:0:15182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:0.0:1788201325.198886:0:15182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:16390:x1875064442694528:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:0.0:1788201325.199398:0:15182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:16390:x1875064442694528:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 510us (1599us total) trans 12884901912 rc 0/0 00000100:00100000:0.0:1788201325.199411:0:15182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:3.0:1788201325.312235:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201325.312439:0:15179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442694656 00000100:00100000:1.0:1788201325.312455:0:15179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442694656 00000100:00100000:1.0:1788201325.312593:0:15179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00100000:1.0:1788201325.312606:0:15179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:16393:x1875064442694656:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:1.0:1788201325.312644:0:15179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201325.312686:0:15179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d47e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c508d expref: -99 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.312777:0:15179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d47f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.312795:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d47f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.312809:0:15179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d47f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.312827:0:15179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d47f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.312834:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d47f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.312847:0:15179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d47f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.313001:0:15179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d47fe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.313012:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d47fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.313031:0:15179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d47fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201325.313068:0:15179:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x402:0x0]: returning size 512 00000004:00200000:1.0:1788201325.313072:0:15179:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201325.313120:0:15179:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d47fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.313136:0:15179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d47f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.313143:0:15179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d47f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.313150:0:15179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d47f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.313156:0:15179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201325.313161:0:15179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d47f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.313169:0:15179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d47f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.313184:0:15179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c23c1500) 00010000:00010000:1.0:1788201325.313187:0:15179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201325.313192:0:15179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d47f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.313199:0:15179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d47f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.313214:0:15179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d47f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.313221:0:15179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d47f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.313227:0:15179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d47f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.313233:0:15179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201325.313236:0:15179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d47f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.313243:0:15179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d47f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.313251:0:15179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x430dc47c (ffff9e03c26be600) 00010000:00010000:1.0:1788201325.313253:0:15179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201325.313256:0:15179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d47f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.313262:0:15179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d47f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.313384:0:15179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d47e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c508d expref: 15 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.313401:0:15179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d47fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c508d expref: 14 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.313410:0:15179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:1.0:1788201325.313412:0:15179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788201325.313416:0:15179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2ef2c00, rc 0) 00000100:00100000:1.0:1788201325.313507:0:15179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:16393:x1875064442694656:12345-192.168.201.30@tcp:101:touch.0 Request processed in 903us (1289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201325.313516:0:15179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00100000:1.0:1788201325.329738:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201325.329913:0:15180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442694912 00000100:00100000:2.0:1788201325.329927:0:15180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442694912 00000100:00100000:2.0:1788201325.330015:0:15180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:2.0:1788201325.330039:0:15180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d1f0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:16393:x1875064442694912:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:2.0:1788201325.330069:0:15180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201325.330074:0:15180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788201325.330108:0:15180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d47db lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5086 expref: 14 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.330132:0:15180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:2.0:1788201325.330139:0:15180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201325.330156:0:15180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d4805 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5094 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.330612:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28000/0x9383f985bc4d480c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.330631:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28000/0x9383f985bc4d480c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.330644:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28000/0x9383f985bc4d480c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.334908:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d4813 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.334934:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d4813 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.334947:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d4813 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201325.343185:0:15180:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x420:0x0], count =34 00000004:00080000:2.0:1788201325.343198:0:15180:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x420:0x0]+34 in llog 00000004:00080000:2.0:1788201325.343272:0:15180:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x442:0x0], index 1: 0 00010000:00010000:2.0:1788201325.343523:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28400/0x9383f985bc4d481a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x403:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.343541:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28400/0x9383f985bc4d481a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x403:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.343554:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28400/0x9383f985bc4d481a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x403:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.343593:0:15180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28000/0x9383f985bc4d480c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.343600:0:15180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28000/0x9383f985bc4d480c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.343607:0:15180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28000/0x9383f985bc4d480c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.343614:0:15180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b28000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201325.343618:0:15180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28000/0x9383f985bc4d480c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.343625:0:15180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28000/0x9383f985bc4d480c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.343638:0:15180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:2.0:1788201325.343641:0:15180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201325.343645:0:15180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28000/0x9383f985bc4d480c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.343651:0:15180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28000/0x9383f985bc4d480c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201325.343665:0:15180:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000086561e8 reply state 000000006423c587 transno 12884901913 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d4813 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201325.343675:0:15180:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201325.343715:0:15180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d4805 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5094 expref: 16 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.343730:0:15180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28400/0x9383f985bc4d481a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x403:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5094 expref: 15 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.343737:0:15180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x403:0x0].0x0 (ffff9e03c2ac6300) 00010000:00010000:2.0:1788201325.343739:0:15180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201325.343741:0:15180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0501b28400, rc 0) 00000100:00100000:2.0:1788201325.343823:0:15180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d1f0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:16393:x1875064442694912:12345-192.168.201.30@tcp:101:touch.0 Request processed in 13787us (14100us total) trans 12884901913 rc 0/0 00000100:00100000:2.0:1788201325.343832:0:15180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:3.0:1788201325.349897:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201325.350027:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442695168 00000100:00100000:0.0:1788201325.350041:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442695168 00000100:00100000:0.0:1788201325.350117:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:0.0:1788201325.350129:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:16393:x1875064442695168:12345-192.168.201.30@tcp:36:touch.0 00010000:00010000:0.0:1788201325.350203:0:15178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201325.350237:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28400/0x9383f985bc4d481a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x403:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5094 expref: 16 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.350263:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x403:0x0].0x0 (ffff9e03c2ac6300) 00010000:00010000:0.0:1788201325.350277:0:15178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201325.350374:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d4813 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.350390:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d4828 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.350394:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d4813 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.350418:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d4813 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.350422:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d4828 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.350426:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b29400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201325.350437:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d4813 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.350447:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d4813 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.350456:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d4828 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.350468:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0xcda302ea (ffff9e03c2ac6700) 00010000:00010000:2.0:1788201325.350473:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201325.350478:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d4813 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.350486:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29400/0x9383f985bc4d4813 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201325.350634:0:15178:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fcab9550 reply state 0000000044678403 transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d4828 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201325.350647:0:15178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201325.350771:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:16393:x1875064442695168:12345-192.168.201.30@tcp:36:touch.0 Request processed in 643us (889us total) trans 12884901914 rc 0/0 00000100:00100000:0.0:1788201325.350780:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 49 00010000:00010000:1.0:1788201325.357381:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d4828 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.357405:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d4828 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.357414:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d4828 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.357422:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a8e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201325.357429:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d4828 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.357439:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d4828 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.357468:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x403:0x0].0x0 (ffff9e03c2fc5500) 00010000:00010000:1.0:1788201325.357472:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201325.357478:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d4828 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.357486:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d4828 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201325.357510:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201325.357658:0:15284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442695296 00000100:00100000:0.0:1788201325.357682:0:15284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442695296 00000100:00100000:0.0:1788201325.357826:0:15284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:0.0:1788201325.357840:0:15284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:16393:x1875064442695296:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:0.0:1788201325.357874:0:15284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201325.357898:0:15284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d482f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x403:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c509b expref: -99 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.357987:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d482f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x403:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c509b expref: 16 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.358004:0:15284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d482f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x403:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c509b expref: 16 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.358038:0:15284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x403:0x0].0x0 (ffff9e03c2fc5600) 00010000:00010000:0.0:1788201325.358042:0:15284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788201325.358045:0:15284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c19a8200, rc 0) 00000100:00100000:0.0:1788201325.358127:0:15284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:16393:x1875064442695296:12345-192.168.201.30@tcp:101:touch.0 Request processed in 290us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201325.358140:0:15284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:2.0:1788201325.367006:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201325.367447:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442695424 00000100:00100000:0.0:1788201325.367461:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442695424 00000100:00100000:0.0:1788201325.367544:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4247 00000100:00100000:0.0:1788201325.367557:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2361:x1875064442695424:12345-192.168.201.30@tcp:2:touch.0 00000100:00100000:0.0:1788201325.368222:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2361:x1875064442695424:12345-192.168.201.30@tcp:2:touch.0 Request processed in 665us (1228us total) trans 4294968865 rc 0/0 00000100:00100000:0.0:1788201325.368232:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4247 00000100:00100000:3.0:1788201325.373801:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201325.374125:0:15181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442695680 00000100:00100000:1.0:1788201325.374136:0:15181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442695680 00000100:00100000:1.0:1788201325.374210:0:15181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:1.0:1788201325.374221:0:15181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:16393:x1875064442695680:12345-192.168.201.30@tcp:35:touch.0 00000100:00100000:1.0:1788201325.375183:0:15181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+17:16393:x1875064442695680:12345-192.168.201.30@tcp:35:touch.0 Request processed in 959us (1390us total) trans 12884901915 rc 0/0 00000100:00100000:1.0:1788201325.375192:0:15181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:3.0:1788201325.402415:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201325.402641:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442695936 00000100:00100000:0.0:1788201325.402652:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442695936 00000100:00100000:0.0:1788201325.402712:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00100000:0.0:1788201325.402723:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+17:16394:x1875064442695936:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:0.0:1788201325.402751:0:15178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201325.402774:0:15178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d4836 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c50a2 expref: -99 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.403115:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d483d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.403130:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d483d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.403141:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d483d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.403158:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d4844 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.403170:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d4844 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.403177:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d4844 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201325.404947:0:15178:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x421:0x0], count =33 00000004:00080000:1.0:1788201325.404958:0:15178:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x421:0x0]+33 in llog 00000004:00080000:1.0:1788201325.404986:0:15178:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x442:0x0], index 0: 0 00010000:00010000:1.0:1788201325.405326:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d484b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x404:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.405341:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d484b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x404:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.405352:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d484b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x404:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.405390:0:15178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d483d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.405398:0:15178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d483d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.405404:0:15178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d483d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.405410:0:15178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201325.405414:0:15178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d483d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.405422:0:15178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d483d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.405434:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:1.0:1788201325.405437:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201325.405442:0:15178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d483d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.405519:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d483d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201325.405535:0:15178:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fbfd25bf reply state 000000007e2a67c0 transno 12884901916 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d4844 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201325.405543:0:15178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201325.405581:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d4836 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50a2 expref: 20 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.405596:0:15178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d484b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x404:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50a2 expref: 19 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.405609:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x404:0x0].0x0 (ffff9e03c26be600) 00010000:00010000:1.0:1788201325.405612:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201325.405615:0:15178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2ef3e00, rc 0) 00000100:00100000:1.0:1788201325.405756:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:16394:x1875064442695936:12345-192.168.201.30@tcp:101:touch.0 Request processed in 3034us (3349us total) trans 12884901916 rc 0/0 00000100:00100000:1.0:1788201325.405766:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 51 00010000:00010000:3.0:1788201325.409669:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d4844 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.409685:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d4844 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.409693:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d4844 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.409699:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201325.409704:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d4844 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.409710:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d4844 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.409725:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x15fcbbea (ffff9e03c2fc5d00) 00010000:00010000:3.0:1788201325.409728:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201325.409732:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d4844 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.409738:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d4844 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201325.410554:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201325.411016:0:15180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442696192 00000100:00100000:2.0:1788201325.411026:0:15180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442696192 00000100:00100000:2.0:1788201325.411084:0:15180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:2.0:1788201325.411095:0:15180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:16394:x1875064442696192:12345-192.168.201.30@tcp:36:touch.0 00010000:00010000:2.0:1788201325.411154:0:15180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201325.411174:0:15180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d484b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x404:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50a2 expref: 19 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.411191:0:15180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x404:0x0].0x0 (ffff9e03c26be600) 00010000:00010000:2.0:1788201325.411199:0:15180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201325.411243:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d4859 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.411256:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d4859 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.411264:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d4859 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201325.411429:0:15180:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099120a9a reply state 00000000fd0ee284 transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d4859 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201325.411438:0:15180:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201325.411847:0:15180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:16394:x1875064442696192:12345-192.168.201.30@tcp:36:touch.0 Request processed in 751us (1294us total) trans 12884901917 rc 0/0 00000100:00100000:2.0:1788201325.412461:0:15180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 52 00010000:00010000:1.0:1788201325.413601:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201325.417088:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d4859 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.417107:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d4859 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.417116:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d4859 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.417123:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b28600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201325.417128:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d4859 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.417135:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d4859 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.417152:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x404:0x0].0x0 (ffff9e03c2ac6700) 00010000:00010000:1.0:1788201325.417155:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201325.417160:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d4859 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.417166:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d4859 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201325.417622:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201325.418055:0:15179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442696320 00000100:00100000:1.0:1788201325.418065:0:15179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442696320 00000100:00100000:1.0:1788201325.418141:0:15179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:1.0:1788201325.418152:0:15179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:16394:x1875064442696320:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:1.0:1788201325.418179:0:15179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201325.418199:0:15179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d4860 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x404:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c50a9 expref: -99 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.418258:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d4860 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x404:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50a9 expref: 20 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.418274:0:15179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d4860 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x404:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50a9 expref: 20 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.418317:0:15179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x404:0x0].0x0 (ffff9e03c26bea00) 00010000:00010000:1.0:1788201325.418320:0:15179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201325.418323:0:15179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2ef2600, rc 0) 00000100:00100000:1.0:1788201325.418374:0:15179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:16394:x1875064442696320:12345-192.168.201.30@tcp:101:touch.0 Request processed in 225us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201325.418381:0:15179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:2.0:1788201325.430486:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201325.430649:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442696448 00000100:00100000:0.0:1788201325.430661:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442696448 00000100:00100000:0.0:1788201325.430724:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4248 00000100:00100000:0.0:1788201325.430735:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c6632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2360:x1875064442696448:12345-192.168.201.30@tcp:2:touch.0 00000100:00100000:0.0:1788201325.431270:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c6632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+506:2360:x1875064442696448:12345-192.168.201.30@tcp:2:touch.0 Request processed in 536us (793us total) trans 4294968866 rc 0/0 00000100:00100000:0.0:1788201325.431278:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4248 00000100:00100000:3.0:1788201325.433376:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201325.433534:0:15182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442696704 00000100:00100000:0.0:1788201325.433544:0:15182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442696704 00000100:00100000:0.0:1788201325.433599:0:15182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:0.0:1788201325.433608:0:15182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:16394:x1875064442696704:12345-192.168.201.30@tcp:35:touch.0 00000100:00100000:0.0:1788201325.434347:0:15182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:16394:x1875064442696704:12345-192.168.201.30@tcp:35:touch.0 Request processed in 738us (975us total) trans 12884901918 rc 0/0 00000100:00100000:0.0:1788201325.434357:0:15182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:1.0:1788201325.454042:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201325.454185:0:15284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442696960 00000100:00100000:0.0:1788201325.454196:0:15284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442696960 00000100:00100000:0.0:1788201325.454257:0:15284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00100000:0.0:1788201325.454266:0:15284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d80f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:16395:x1875064442696960:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:0.0:1788201325.454288:0:15284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201325.454350:0:15284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8a00/0x9383f985bc4d4867 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c50b0 expref: -99 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.454486:0:15284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d486e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.454499:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d486e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.454510:0:15284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d486e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.454523:0:15284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d4875 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.454530:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d4875 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.454536:0:15284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d4875 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201325.455007:0:15284:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x443:0x0], index 1: 0 00010000:00010000:0.0:1788201325.455791:0:15284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d487c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x405:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.455804:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d487c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x405:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.455813:0:15284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d487c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x405:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.455848:0:15284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d486e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.455855:0:15284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d486e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.457141:0:15284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d486e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.457151:0:15284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a8000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201325.457156:0:15284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d486e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.457164:0:15284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d486e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.457178:0:15284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:0.0:1788201325.457182:0:15284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201325.457187:0:15284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d486e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.457192:0:15284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d486e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201325.457209:0:15284:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004d60ea16 reply state 00000000c64a362d transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d4875 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201325.457218:0:15284:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201325.457616:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201325.457674:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201325.457769:0:15173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442697088 00000100:00100000:2.0:1788201325.457778:0:15173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442697088 00000100:00100000:2.0:1788201325.457835:0:15173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00100000:2.0:1788201325.457846:0:15173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cfeffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2361:x1875064442697088:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201325.457924:0:15173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cfeffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2361:x1875064442697088:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 80us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201325.457931:0:15173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00100000:1.0:1788201325.458028:0:13451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442697216 00000100:00100000:1.0:1788201325.458033:0:13451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442697216 00000100:00100000:1.0:1788201325.458081:0:13451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 205 00000100:00100000:1.0:1788201325.458089:0:13451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2362:x1875064442697216:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201325.458122:0:13451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2362:x1875064442697216:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 34us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201325.458129:0:13451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 205 00010000:00010000:0.0:1788201325.460026:0:15284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8a00/0x9383f985bc4d4867 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50b0 expref: 24 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.460058:0:15284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d487c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x405:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50b0 expref: 23 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.460687:0:15284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x405:0x0].0x0 (ffff9e03c2fc5c00) 00010000:00010000:0.0:1788201325.460691:0:15284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201325.460694:0:15284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c19a8800, rc 0) 00000100:00100000:0.0:1788201325.460754:0:15284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d80f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:16395:x1875064442696960:12345-192.168.201.30@tcp:101:touch.0 Request processed in 6487us (6721us total) trans 12884901919 rc 0/0 00000100:00100000:0.0:1788201325.460762:0:15284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 54 00010000:00010000:2.0:1788201325.463527:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d4875 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.463545:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d4875 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.463553:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d4875 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.463560:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201325.463566:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d4875 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.463574:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d4875 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.463605:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x5e5674ea (ffff9e03c2fc5800) 00010000:00010000:2.0:1788201325.463609:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201325.463614:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d4875 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.463620:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d4875 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201325.475433:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201325.479655:0:15179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442697472 00000100:00100000:3.0:1788201325.479669:0:15179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442697472 00000100:00100000:3.0:1788201325.479740:0:15179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 55 00000100:00100000:3.0:1788201325.479750:0:15179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:16395:x1875064442697472:12345-192.168.201.30@tcp:36:touch.0 00010000:00010000:3.0:1788201325.479807:0:15179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201325.479835:0:15179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d487c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x405:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50b0 expref: 23 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.479866:0:15179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x405:0x0].0x0 (ffff9e03c2fc5c00) 00010000:00010000:3.0:1788201325.479880:0:15179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201325.479926:0:15179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d488a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.479938:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d488a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.479946:0:15179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d488a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201325.480107:0:15179:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000383e7b3c reply state 00000000b4d0fce6 transno 12884901920 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d488a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201325.480117:0:15179:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201325.480224:0:15179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:16395:x1875064442697472:12345-192.168.201.30@tcp:36:touch.0 Request processed in 475us (4800us total) trans 12884901920 rc 0/0 00000100:00100000:3.0:1788201325.480232:0:15179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 55 00000100:00100000:3.0:1788201325.482493:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201325.482621:0:15180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442697600 00000100:00100000:2.0:1788201325.482631:0:15180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442697600 00000100:00100000:2.0:1788201325.482689:0:15180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 56 00000100:00100000:2.0:1788201325.482699:0:15180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:16395:x1875064442697600:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:2.0:1788201325.482720:0:15180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201325.482741:0:15180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28000/0x9383f985bc4d4891 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x405:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c50b7 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.482796:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28000/0x9383f985bc4d4891 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x405:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50b7 expref: 25 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.482810:0:15180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28000/0x9383f985bc4d4891 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x405:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50b7 expref: 25 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.482828:0:15180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x405:0x0].0x0 (ffff9e03c23c1200) 00010000:00010000:2.0:1788201325.482832:0:15180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201325.482835:0:15180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0501b28000, rc 0) 00000100:00100000:2.0:1788201325.482893:0:15180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+25:16395:x1875064442697600:12345-192.168.201.30@tcp:101:touch.0 Request processed in 196us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201325.482903:0:15180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 56 00010000:00010000:1.0:1788201325.484424:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d488a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.484439:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d488a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.484455:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d488a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.484463:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201325.484467:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d488a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.484476:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d488a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.484491:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x405:0x0].0x0 (ffff9e03c23c1200) 00010000:00010000:1.0:1788201325.484494:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201325.484498:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d488a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.484504:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d488a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201325.486756:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201325.486857:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442697728 00000100:00100000:2.0:1788201325.486866:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442697728 00000100:00100000:2.0:1788201325.486917:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4249 00000100:00100000:2.0:1788201325.486925:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2360:x1875064442697728:12345-192.168.201.30@tcp:2:touch.0 00000100:00100000:2.0:1788201325.487232:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442697728:12345-192.168.201.30@tcp:2:touch.0 Request processed in 306us (480us total) trans 4294968866 rc 0/0 00000100:00100000:2.0:1788201325.487241:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4249 00000100:00100000:3.0:1788201325.490664:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201325.490786:0:15181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442697984 00000100:00100000:1.0:1788201325.490796:0:15181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442697984 00000100:00100000:1.0:1788201325.490859:0:15181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:1.0:1788201325.490870:0:15181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:16395:x1875064442697984:12345-192.168.201.30@tcp:35:touch.0 00000100:00100000:1.0:1788201325.491384:0:15181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+25:16395:x1875064442697984:12345-192.168.201.30@tcp:35:touch.0 Request processed in 515us (727us total) trans 12884901921 rc 0/0 00000100:00100000:1.0:1788201325.491393:0:15181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:0.0:1788201325.530749:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201325.530831:0:15179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442698240 00000100:00100000:3.0:1788201325.530842:0:15179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442698240 00000100:00100000:3.0:1788201325.530912:0:15179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:3.0:1788201325.530922:0:15179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+25:16396:x1875064442698240:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:3.0:1788201325.530959:0:15179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201325.530997:0:15179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d4898 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c50be expref: -99 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.531132:0:15179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d489f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.531147:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d489f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.531159:0:15179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d489f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.531176:0:15179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d48a6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.531183:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d48a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.531190:0:15179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d48a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201325.531735:0:15179:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x443:0x0], index 0: 0 00010000:00010000:3.0:1788201325.531902:0:15179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d48ad lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.531913:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d48ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.531920:0:15179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d48ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.531956:0:15179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d489f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.531977:0:15179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d489f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.531984:0:15179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d489f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.531990:0:15179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201325.531994:0:15179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d489f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.532002:0:15179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d489f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.532013:0:15179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:3.0:1788201325.532016:0:15179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201325.532022:0:15179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d489f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.532027:0:15179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d489f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201325.532040:0:15179:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081384b00 reply state 000000005a9712e8 transno 12884901922 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d48a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201325.532050:0:15179:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788201325.532079:0:15179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d4898 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50be expref: 28 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.532094:0:15179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d48ad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50be expref: 27 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.532101:0:15179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x406:0x0].0x0 (ffff9e03c23c1000) 00010000:00010000:3.0:1788201325.532104:0:15179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201325.532106:0:15179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5065800, rc 0) 00000100:00100000:3.0:1788201325.532175:0:15179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:16396:x1875064442698240:12345-192.168.201.30@tcp:101:touch.0 Request processed in 1253us (1435us total) trans 12884901922 rc 0/0 00000100:00100000:3.0:1788201325.532182:0:15179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 57 00010000:00010000:2.0:1788201325.534878:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d48a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.534901:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d48a6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.534910:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d48a6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.534917:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201325.534923:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d48a6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.534931:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d48a6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.534952:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0xa6b02dea (ffff9e03c23c1300) 00010000:00010000:2.0:1788201325.534956:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201325.534970:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d48a6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.534982:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065600/0x9383f985bc4d48a6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201325.545229:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201325.545568:0:15180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442698496 00000100:00100000:2.0:1788201325.545583:0:15180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442698496 00000100:00100000:2.0:1788201325.545659:0:15180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 58 00000100:00100000:2.0:1788201325.545671:0:15180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:16396:x1875064442698496:12345-192.168.201.30@tcp:36:touch.0 00010000:00010000:2.0:1788201325.545748:0:15180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201325.545781:0:15180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065800/0x9383f985bc4d48ad lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50be expref: 27 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.545806:0:15180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x406:0x0].0x0 (ffff9e03c23c1000) 00010000:00010000:2.0:1788201325.545818:0:15180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201325.545884:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d48bb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.545901:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d48bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.545912:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d48bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201325.546109:0:15180:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f9b338b8 reply state 00000000d0c92cb1 transno 12884901923 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d48bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201325.546120:0:15180:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201325.546244:0:15180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:16396:x1875064442698496:12345-192.168.201.30@tcp:36:touch.0 Request processed in 575us (1029us total) trans 12884901923 rc 0/0 00000100:00100000:2.0:1788201325.546257:0:15180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 58 00010000:00010000:2.0:1788201325.550115:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d48bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.550138:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d48bb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.550148:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d48bb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.550156:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b28a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201325.550162:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d48bb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.550172:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d48bb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.550193:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x406:0x0].0x0 (ffff9e03c2ac6b00) 00010000:00010000:2.0:1788201325.550196:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201325.550202:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d48bb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.550209:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d48bb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201325.560412:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201325.560815:0:15179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442698624 00000100:00100000:3.0:1788201325.560829:0:15179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442698624 00000100:00100000:3.0:1788201325.560904:0:15179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:3.0:1788201325.560916:0:15179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:16396:x1875064442698624:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:3.0:1788201325.560951:0:15179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201325.560993:0:15179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d48c2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x406:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c50c5 expref: -99 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.561092:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d48c2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x406:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50c5 expref: 28 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.561109:0:15179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d48c2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x406:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50c5 expref: 28 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.561132:0:15179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x406:0x0].0x0 (ffff9e03c23c1100) 00010000:00010000:3.0:1788201325.561135:0:15179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201325.561141:0:15179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5064200, rc 0) 00000100:00100000:3.0:1788201325.561215:0:15179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:16396:x1875064442698624:12345-192.168.201.30@tcp:101:touch.0 Request processed in 300us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201325.561223:0:15179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:3.0:1788201325.572690:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201325.572816:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442698752 00000100:00100000:2.0:1788201325.572828:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442698752 00000100:00100000:2.0:1788201325.572918:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4250 00000100:00100000:2.0:1788201325.572931:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5284000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35604eb4-baf9-45be-a20a-4883a2cd8cf9+506:2361:x1875064442698752:12345-192.168.201.30@tcp:2:touch.0 00000100:00100000:2.0:1788201325.573530:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5284000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35604eb4-baf9-45be-a20a-4883a2cd8cf9+507:2361:x1875064442698752:12345-192.168.201.30@tcp:2:touch.0 Request processed in 600us (854us total) trans 4294968867 rc 0/0 00000100:00100000:2.0:1788201325.573540:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4250 00000100:00100000:0.0:1788201325.595441:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201325.595563:0:15181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442699008 00000100:00100000:1.0:1788201325.595576:0:15181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442699008 00000100:00100000:1.0:1788201325.595644:0:15181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:1.0:1788201325.595655:0:15181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:16396:x1875064442699008:12345-192.168.201.30@tcp:35:touch.0 00000100:00100000:1.0:1788201325.596107:0:15181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+29:16396:x1875064442699008:12345-192.168.201.30@tcp:35:touch.0 Request processed in 452us (679us total) trans 12884901924 rc 0/0 00000100:00100000:1.0:1788201325.596115:0:15181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:3.0:1788201325.614085:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201325.616796:0:15180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442699264 00000100:00100000:2.0:1788201325.616829:0:15180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442699264 00000100:00100000:2.0:1788201325.616926:0:15180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:2.0:1788201325.616993:0:15180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+29:16397:x1875064442699264:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:2.0:1788201325.617042:0:15180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201325.617091:0:15180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d48c9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c50cc expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.617292:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d48d0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.617410:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d48d0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.617447:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d48d0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.617483:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d48d7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.617490:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d48d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.617505:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d48d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201325.618366:0:15180:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x444:0x0], index 1: 0 00010000:00010000:2.0:1788201325.618574:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29600/0x9383f985bc4d48de lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.618589:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29600/0x9383f985bc4d48de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.618598:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29600/0x9383f985bc4d48de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.618639:0:15180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d48d0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.618647:0:15180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d48d0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.618655:0:15180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d48d0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.618663:0:15180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b28800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201325.618667:0:15180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d48d0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.618676:0:15180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d48d0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.618689:0:15180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:2.0:1788201325.618692:0:15180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201325.618698:0:15180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d48d0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.618704:0:15180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d48d0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201325.618719:0:15180:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da51711f reply state 0000000022c1cdb7 transno 12884901925 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d48d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201325.618729:0:15180:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201325.618768:0:15180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d48c9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50cc expref: 32 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.618784:0:15180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29600/0x9383f985bc4d48de lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50cc expref: 31 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.618792:0:15180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x407:0x0].0x0 (ffff9e03c2ac6f00) 00010000:00010000:2.0:1788201325.618794:0:15180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201325.618797:0:15180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0501b29600, rc 0) 00000100:00100000:2.0:1788201325.618901:0:15180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+32:16397:x1875064442699264:12345-192.168.201.30@tcp:101:touch.0 Request processed in 1925us (4838us total) trans 12884901925 rc 0/0 00000100:00100000:2.0:1788201325.618910:0:15180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 60 00010000:00010000:0.0:1788201325.622866:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d48d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.622888:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d48d7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.622897:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d48d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.622904:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b29a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201325.622909:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d48d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.622919:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d48d7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.622939:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0xef09e6ea (ffff9e03c2ac6b00) 00010000:00010000:0.0:1788201325.622943:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201325.622950:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d48d7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.622956:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d48d7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201325.630866:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201325.630991:0:15179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442699520 00000100:00100000:1.0:1788201325.631004:0:15179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442699520 00000100:00100000:1.0:1788201325.631084:0:15179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00100000:1.0:1788201325.631095:0:15179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+31:16397:x1875064442699520:12345-192.168.201.30@tcp:36:touch.0 00010000:00010000:1.0:1788201325.631169:0:15179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201325.631201:0:15179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29600/0x9383f985bc4d48de lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50cc expref: 31 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.631226:0:15179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x407:0x0].0x0 (ffff9e03c2ac6f00) 00010000:00010000:1.0:1788201325.631240:0:15179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201325.631343:0:15179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d48ec lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.631359:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d48ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.631370:0:15179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d48ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201325.631772:0:15179:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc6d7594 reply state 000000004f0a5624 transno 12884901926 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d48ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201325.631783:0:15179:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201325.631898:0:15179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+32:16397:x1875064442699520:12345-192.168.201.30@tcp:36:touch.0 Request processed in 803us (1048us total) trans 12884901926 rc 0/0 00000100:00100000:1.0:1788201325.631906:0:15179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 61 00010000:00010000:2.0:1788201325.642017:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d48ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.642043:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d48ec lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.642053:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d48ec lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.642060:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201325.642076:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d48ec lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.642087:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d48ec lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.642112:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x407:0x0].0x0 (ffff9e03c26bee00) 00010000:00010000:2.0:1788201325.642116:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201325.642121:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d48ec lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.642129:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d48ec lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201325.643918:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201325.644463:0:15180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442699648 00000100:00100000:2.0:1788201325.644478:0:15180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442699648 00000100:00100000:2.0:1788201325.644549:0:15180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 62 00000100:00100000:2.0:1788201325.644561:0:15180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+31:16397:x1875064442699648:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:2.0:1788201325.644595:0:15180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201325.644625:0:15180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d48f3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x407:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c50d3 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.644705:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d48f3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x407:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50d3 expref: 32 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.644723:0:15180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d48f3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x407:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50d3 expref: 32 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.644743:0:15180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x407:0x0].0x0 (ffff9e03c2ac6900) 00010000:00010000:2.0:1788201325.644746:0:15180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201325.644750:0:15180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0501b28a00, rc 0) 00000100:00100000:2.0:1788201325.644836:0:15180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+32:16397:x1875064442699648:12345-192.168.201.30@tcp:101:touch.0 Request processed in 277us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201325.646111:0:15180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 62 00000100:00100000:3.0:1788201325.648380:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201325.648506:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442699776 00000100:00100000:1.0:1788201325.648519:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442699776 00000100:00100000:1.0:1788201325.648578:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4251 00000100:00100000:1.0:1788201325.648590:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442699776:12345-192.168.201.30@tcp:2:touch.0 00000100:00100000:1.0:1788201325.649049:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2360:x1875064442699776:12345-192.168.201.30@tcp:2:touch.0 Request processed in 460us (682us total) trans 4294968867 rc 0/0 00000100:00100000:1.0:1788201325.649058:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4251 00000100:00100000:3.0:1788201325.658258:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201325.658978:0:15181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442700032 00000100:00100000:1.0:1788201325.658994:0:15181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442700032 00000100:00100000:1.0:1788201325.659084:0:15181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:1.0:1788201325.659096:0:15181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2a19c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+32:16397:x1875064442700032:12345-192.168.201.30@tcp:35:touch.0 00000100:00100000:1.0:1788201325.661034:0:15181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2a19c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+33:16397:x1875064442700032:12345-192.168.201.30@tcp:35:touch.0 Request processed in 1924us (2773us total) trans 12884901927 rc 0/0 00000100:00100000:1.0:1788201325.661050:0:15181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:3.0:1788201325.697496:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201325.697655:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442700288 00000100:00100000:0.0:1788201325.697669:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442700288 00000100:00100000:0.0:1788201325.697738:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:0.0:1788201325.697750:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+33:16398:x1875064442700288:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:0.0:1788201325.697783:0:15178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201325.697809:0:15178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d48fa lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c50da expref: -99 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.698179:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d4901 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.698198:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d4901 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.698212:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d4901 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.698228:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4908 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.698234:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4908 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.698242:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4908 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201325.701687:0:15178:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x444:0x0], index 0: 0 00010000:00010000:0.0:1788201325.705922:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d490f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.705948:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d490f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.705974:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d490f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.706038:0:15178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d4901 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.706043:0:15178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d4901 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.706048:0:15178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d4901 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.706052:0:15178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201325.706055:0:15178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d4901 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.706060:0:15178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d4901 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.706069:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:0.0:1788201325.706071:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201325.706075:0:15178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d4901 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.706082:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d4901 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201325.706097:0:15178:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c31a7438 reply state 0000000010f04c02 transno 12884901928 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4908 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201325.706103:0:15178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201325.706141:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d48fa lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50da expref: 36 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.706150:0:15178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d490f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50da expref: 35 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.706166:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x408:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:0.0:1788201325.706168:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201325.706169:0:15178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c19a8e00, rc 0) 00000100:00100000:0.0:1788201325.706247:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+36:16398:x1875064442700288:12345-192.168.201.30@tcp:101:touch.0 Request processed in 8499us (8969us total) trans 12884901928 rc 0/0 00000100:00100000:0.0:1788201325.706256:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 63 00010000:00010000:0.0:1788201325.707566:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4908 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.707585:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4908 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.707593:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4908 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.707600:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201325.707606:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4908 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.707613:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4908 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.707630:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x37639fea (ffff9e03c2fc5e00) 00010000:00010000:0.0:1788201325.707633:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201325.707637:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4908 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.707643:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4908 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201325.719889:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201325.720044:0:15284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442700544 00000100:00100000:0.0:1788201325.720058:0:15284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442700544 00000100:00100000:0.0:1788201325.720151:0:15284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00100000:0.0:1788201325.720162:0:15284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+35:16398:x1875064442700544:12345-192.168.201.30@tcp:36:touch.0 00010000:00010000:0.0:1788201325.720241:0:15284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201325.720278:0:15284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d490f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50da expref: 35 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.720324:0:15284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x408:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:0.0:1788201325.720340:0:15284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201325.720404:0:15284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d491d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.720422:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d491d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.720434:0:15284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d491d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201325.720600:0:15284:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd6bc435 reply state 000000000a681b5c transno 12884901929 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d491d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201325.720612:0:15284:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201325.720725:0:15284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+36:16398:x1875064442700544:12345-192.168.201.30@tcp:36:touch.0 Request processed in 564us (851us total) trans 12884901929 rc 0/0 00000100:00100000:0.0:1788201325.720733:0:15284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00100000:3.0:1788201325.722736:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:2.0:1788201325.724707:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d491d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.724726:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d491d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201325.724826:0:15179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442700672 00000100:00100000:1.0:1788201325.724836:0:15179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442700672 00000100:00100000:1.0:1788201325.724895:0:15179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00100000:1.0:1788201325.724902:0:15179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+36:16398:x1875064442700672:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:1.0:1788201325.724926:0:15179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201325.724947:0:15179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2200/0x9383f985bc4d4924 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x408:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c50e1 expref: -99 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.725024:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d491d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.725177:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2200/0x9383f985bc4d4924 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x408:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50e1 expref: 37 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.725191:0:15179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2200/0x9383f985bc4d4924 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x408:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50e1 expref: 37 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.725208:0:15179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x408:0x0].0x0 (ffff9e03c2fc5e00) 00010000:00010000:1.0:1788201325.725210:0:15179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201325.725212:0:15179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2ef2200, rc 0) 00000100:00100000:1.0:1788201325.725283:0:15179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+37:16398:x1875064442700672:12345-192.168.201.30@tcp:101:touch.0 Request processed in 381us (2559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201325.725289:0:15179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 65 00010000:00010000:2.0:1788201325.725953:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201325.726430:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d491d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.726442:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d491d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.726458:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x408:0x0].0x0 (ffff9e03c2fc5e00) 00010000:00010000:2.0:1788201325.726461:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201325.726464:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d491d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201325.726471:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d491d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201325.731225:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201325.731352:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442700800 00000100:00100000:0.0:1788201325.731368:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442700800 00000100:00100000:0.0:1788201325.731445:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4252 00000100:00100000:0.0:1788201325.731457:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+507:2361:x1875064442700800:12345-192.168.201.30@tcp:2:touch.0 00000100:00100000:0.0:1788201325.731854:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2361:x1875064442700800:12345-192.168.201.30@tcp:2:touch.0 Request processed in 387us (631us total) trans 4294968868 rc 0/0 00000100:00100000:0.0:1788201325.731863:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4252 00000100:00100000:3.0:1788201325.733979:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201325.734132:0:15182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442701056 00000100:00100000:0.0:1788201325.734144:0:15182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442701056 00000100:00100000:0.0:1788201325.734209:0:15182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:0.0:1788201325.734219:0:15182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+36:16398:x1875064442701056:12345-192.168.201.30@tcp:35:touch.0 00000100:00100000:1.0:1788201325.734982:0:15182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+37:16398:x1875064442701056:12345-192.168.201.30@tcp:35:touch.0 Request processed in 744us (1003us total) trans 12884901930 rc 0/0 00000100:00100000:1.0:1788201325.734996:0:15182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:1.0:1788201325.749021:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201325.752897:0:15284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442701312 00000100:00100000:0.0:1788201325.752910:0:15284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442701312 00000100:00100000:1.0:1788201325.753977:0:15284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 66 00000100:00100000:1.0:1788201325.753989:0:15284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+37:16399:x1875064442701312:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:1.0:1788201325.754015:0:15284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201325.754034:0:15284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d492b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c50e8 expref: -99 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.754272:0:15284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d4932 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.754286:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d4932 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.754394:0:15284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d4932 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.754408:0:15284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4939 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.754413:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4939 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.754418:0:15284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4939 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201325.755802:0:15284:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x445:0x0], index 1: 0 00010000:00010000:1.0:1788201325.756613:0:15284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3000/0x9383f985bc4d4940 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.756637:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3000/0x9383f985bc4d4940 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.756650:0:15284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3000/0x9383f985bc4d4940 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.756694:0:15284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d4932 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.756707:0:15284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d4932 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.756714:0:15284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d4932 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.756721:0:15284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201325.756726:0:15284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d4932 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.756734:0:15284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d4932 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.756750:0:15284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:1.0:1788201325.756754:0:15284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201325.756759:0:15284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d4932 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.756767:0:15284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d4932 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201325.756786:0:15284:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000165fe63c reply state 000000003a92fc6a transno 12884901931 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4939 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201325.756796:0:15284:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201325.756838:0:15284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d492b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50e8 expref: 40 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.756914:0:15284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3000/0x9383f985bc4d4940 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50e8 expref: 39 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.757053:0:15284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x409:0x0].0x0 (ffff9e03c26be500) 00010000:00010000:1.0:1788201325.757056:0:15284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201325.757059:0:15284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2ef3000, rc 0) 00000100:00100000:1.0:1788201325.757220:0:15284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+40:16399:x1875064442701312:12345-192.168.201.30@tcp:101:touch.0 Request processed in 3232us (8207us total) trans 12884901931 rc 0/0 00000100:00100000:1.0:1788201325.757231:0:15284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 66 00010000:00010000:0.0:1788201325.760872:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4939 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.760895:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4939 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.760904:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4939 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.760913:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201325.760920:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4939 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.760940:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4939 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.760971:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x7fbd58ea (ffff9e03c26be900) 00010000:00010000:0.0:1788201325.760975:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201325.760981:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4939 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.760988:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d4939 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201325.764631:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201325.764841:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442701568 00000100:00100000:0.0:1788201325.764911:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442701568 00000100:00100000:1.0:1788201325.765242:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 67 00000100:00100000:1.0:1788201325.765256:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+39:16399:x1875064442701568:12345-192.168.201.30@tcp:36:touch.0 00010000:00010000:1.0:1788201325.765385:0:15178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201325.765419:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3000/0x9383f985bc4d4940 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50e8 expref: 39 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.765444:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x409:0x0].0x0 (ffff9e03c26be500) 00010000:00010000:1.0:1788201325.765594:0:15178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201325.765655:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d494e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.765672:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d494e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201325.765683:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d494e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201325.765856:0:15178:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044b45dd9 reply state 00000000a207502f transno 12884901932 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d494e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201325.765872:0:15178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201325.766056:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+40:16399:x1875064442701568:12345-192.168.201.30@tcp:36:touch.0 Request processed in 803us (1437us total) trans 12884901932 rc 0/0 00000100:00100000:1.0:1788201325.766191:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 67 00010000:00010000:0.0:1788201325.768659:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d494e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.768679:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d494e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.768686:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d494e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.768694:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201325.768699:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d494e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.768707:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d494e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.768727:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x409:0x0].0x0 (ffff9e03c26bee00) 00010000:00010000:0.0:1788201325.768730:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201325.768734:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d494e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201325.768742:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d494e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201325.771103:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201325.771430:0:15180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442701696 00000100:00100000:3.0:1788201325.771452:0:15180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442701696 00000100:00100000:3.0:1788201325.771518:0:15180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 68 00000100:00100000:3.0:1788201325.771528:0:15180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+39:16399:x1875064442701696:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:3.0:1788201325.771558:0:15180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201325.771585:0:15180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d4955 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x409:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c50ef expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.771656:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d4955 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x409:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50ef expref: 40 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.771673:0:15180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d4955 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x409:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50ef expref: 40 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201325.771693:0:15180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x409:0x0].0x0 (ffff9e03c23c1900) 00010000:00010000:3.0:1788201325.771697:0:15180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201325.771701:0:15180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5065a00, rc 0) 00000100:00100000:3.0:1788201325.772213:0:15180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+40:16399:x1875064442701696:12345-192.168.201.30@tcp:101:touch.0 Request processed in 683us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201325.772222:0:15180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 68 00000100:00100000:3.0:1788201325.775205:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201325.775912:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442701824 00000100:00100000:2.0:1788201325.776004:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442701824 00000100:00100000:2.0:1788201325.776217:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4253 00000100:00100000:2.0:1788201325.776230:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2362:x1875064442701824:12345-192.168.201.30@tcp:2:touch.0 00000100:00100000:2.0:1788201325.776742:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:2362:x1875064442701824:12345-192.168.201.30@tcp:2:touch.0 Request processed in 512us (1550us total) trans 4294968868 rc 0/0 00000100:00100000:2.0:1788201325.776753:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4253 00000100:00100000:0.0:1788201325.779251:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201325.779463:0:15181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442702080 00000100:00100000:1.0:1788201325.779477:0:15181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442702080 00000100:00100000:1.0:1788201325.779616:0:15181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:1.0:1788201325.779629:0:15181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+40:16399:x1875064442702080:12345-192.168.201.30@tcp:35:touch.0 00000100:00100000:1.0:1788201325.780170:0:15181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+41:16399:x1875064442702080:12345-192.168.201.30@tcp:35:touch.0 Request processed in 541us (928us total) trans 12884901933 rc 0/0 00000100:00100000:1.0:1788201325.780179:0:15181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00010000:00010000:0.0:1788201326.438407:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201326.465653:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201326.465923:0:15179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442702208 00000100:00100000:3.0:1788201326.465934:0:15179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442702208 00000100:00100000:3.0:1788201326.466010:0:15179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:3.0:1788201326.466021:0:15179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+41:16412:x1875064442702208:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1788201326.466047:0:15179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201326.466241:0:15179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d495c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c50f6 expref: -99 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.466350:0:15179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d4963 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.466367:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d4963 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.466379:0:15179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d4963 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.466394:0:15179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d496a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.466402:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d496a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.466407:0:15179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d496a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.469418:0:15179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d4971 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x404:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.469438:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d4971 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x404:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.469452:0:15179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d4971 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x404:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201326.469510:0:15179:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x404:0x0]: returning size 0 00000004:00200000:3.0:1788201326.469515:0:15179:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201326.469539:0:15179:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d4971 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x404:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.469551:0:15179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d4971 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x404:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.469564:0:15179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d4963 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.469569:0:15179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d4963 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.469575:0:15179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d4963 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.469581:0:15179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201326.469585:0:15179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d4963 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.469592:0:15179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d4963 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.469604:0:15179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:3.0:1788201326.469607:0:15179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201326.469611:0:15179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d4963 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.469617:0:15179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d4963 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.469628:0:15179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d496a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.469634:0:15179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d496a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.469638:0:15179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d496a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.469643:0:15179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201326.469646:0:15179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d496a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.469651:0:15179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d496a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.469657:0:15179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x15fcbbea (ffff9e03c23c1b00) 00010000:00010000:3.0:1788201326.469659:0:15179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201326.469661:0:15179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d496a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.469666:0:15179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d496a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15179 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.469707:0:15179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d495c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50f6 expref: 43 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.469719:0:15179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d4971 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x404:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50f6 expref: 42 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.469725:0:15179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x404:0x0].0x0 (ffff9e03c26bea00) 00010000:00010000:3.0:1788201326.469728:0:15179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201326.469730:0:15179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5064c00, rc 0) 00000100:00100000:0.0:1788201326.479176:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201326.479323:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201326.479359:0:15180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442702336 00000100:00100000:0.0:1788201326.479369:0:15180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442702336 00000100:00100000:0.0:1788201326.479415:0:15180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442702592 00000100:00100000:0.0:1788201326.479419:0:15180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442702592 00000100:00100000:0.0:1788201326.479432:0:15180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:0.0:1788201326.479441:0:15180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+44:16414:x1875064442702336:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1788201326.479777:0:15180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201326.479799:0:15180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d4978 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c50fd expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.479882:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d497f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.479895:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d497f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.479907:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d497f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.479924:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d4986 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.479932:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d4986 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.479938:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d4986 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480044:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d498d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480052:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d498d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480058:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d498d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201326.480094:0:15180:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x406:0x0]: returning size 0 00000004:00200000:0.0:1788201326.480098:0:15180:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201326.480116:0:15180:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d498d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480127:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d498d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480135:0:15180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d497f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480140:0:15180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d497f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480150:0:15180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d497f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480156:0:15180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201326.480160:0:15180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d497f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480167:0:15180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d497f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480177:0:15180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:0.0:1788201326.480180:0:15180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201326.480184:0:15180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d497f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480189:0:15180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d497f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480200:0:15180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d4986 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480205:0:15180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d4986 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480211:0:15180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d4986 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480215:0:15180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201326.480217:0:15180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d4986 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480225:0:15180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d4986 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480231:0:15180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0xa6b02dea (ffff9e03c2fc5f00) 00010000:00010000:0.0:1788201326.480233:0:15180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201326.480235:0:15180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d4986 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480240:0:15180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d4986 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480273:0:15180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d4978 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50fd expref: 46 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480285:0:15180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d498d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50fd expref: 45 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480325:0:15180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x406:0x0].0x0 (ffff9e03c23c1100) 00010000:00010000:0.0:1788201326.480328:0:15180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201326.480331:0:15180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c19a8e00, rc 0) 00000100:00100000:0.0:1788201326.480398:0:15180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+45:16414:x1875064442702336:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 957us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201326.480407:0:15180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:0.0:1788201326.480432:0:15180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 71 00000100:00100000:0.0:1788201326.480441:0:15180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+44:16413:x1875064442702592:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1788201326.480451:0:15180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201326.480617:0:15180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4994 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c510b expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480652:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d499b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480661:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d499b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480668:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d499b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480680:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8a00/0x9383f985bc4d49a2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480687:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8a00/0x9383f985bc4d49a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480693:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8a00/0x9383f985bc4d49a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480743:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d49a9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x405:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480751:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d49a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x405:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480757:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d49a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x405:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201326.480774:0:15180:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x405:0x0]: returning size 0 00000004:00200000:0.0:1788201326.480777:0:15180:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201326.480786:0:15180:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d49a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x405:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480799:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d49a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x405:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480804:0:15180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d499b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480810:0:15180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d499b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480815:0:15180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d499b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.480820:0:15180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a8000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201326.480822:0:15180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d499b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.485227:0:15180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d499b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.485250:0:15180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:0.0:1788201326.485253:0:15180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201326.485260:0:15180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d499b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.485268:0:15180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d499b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.485286:0:15180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8a00/0x9383f985bc4d49a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.485307:0:15180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8a00/0x9383f985bc4d49a2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.485316:0:15180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8a00/0x9383f985bc4d49a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.485322:0:15180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a8a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201326.485326:0:15180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8a00/0x9383f985bc4d49a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.485333:0:15180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8a00/0x9383f985bc4d49a2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.485341:0:15180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x5e5674ea (ffff9e03c2fc5400) 00010000:00010000:0.0:1788201326.485343:0:15180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201326.485347:0:15180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8a00/0x9383f985bc4d49a2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.485353:0:15180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8a00/0x9383f985bc4d49a2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.485419:0:15180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4994 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c510b expref: 46 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.485438:0:15180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d49a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x405:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c510b expref: 45 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.485445:0:15180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x405:0x0].0x0 (ffff9e03c23c1200) 00010000:00010000:0.0:1788201326.485448:0:15180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201326.485451:0:15180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c19a8800, rc 0) 00000100:00100000:0.0:1788201326.486428:0:15180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+45:16413:x1875064442702592:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 5983us (7099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201326.486441:0:15180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 71 00000100:00100000:3.0:1788201326.489188:0:15179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+44:16412:x1875064442702208:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 23159us (23532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201326.489200:0:15179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:1.0:1788201326.489444:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201326.489485:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201326.489507:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201326.489525:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201326.489546:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201326.489566:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442703104 00000100:00100000:1.0:1788201326.489574:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442703104 00000100:00100000:1.0:1788201326.489618:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4254 00000100:00100000:1.0:1788201326.489628:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2360:x1875064442703104:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1788201326.489645:0:13450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201326.489665:0:13450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2f6912d/0x9383f985bc4d49b0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x442:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5127 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201326.489699:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x442:0x0] initial LVB size: 0, mtime: 0x6a95c96d, atime: 0x6a95c96d, ctime: 0x6a95c96d, blocks: 0x1 00010000:00010000:1.0:1788201326.489717:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x442:0x0].0x0 since=601s v=(0 0) 00010000:00010000:1.0:1788201326.489721:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x442:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201326.489731:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2f6912d/0x9383f985bc4d49b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x442:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5127 expref: 509 pid: 13450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.489749:0:13450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c2f6912d/0x9383f985bc4d49b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x442:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5127 expref: 509 pid: 13450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.489763:0:13450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2ef3a00, rc 0) 00000100:00100000:1.0:1788201326.489811:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2360:x1875064442703104:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 184us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201326.489818:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4254 00000100:00080000:1.0:1788201326.489842:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201326.489866:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201326.489933:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201326.489963:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442702464 00000100:00100000:1.0:1788201326.489966:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442702464 00000100:00100000:1.0:1788201326.489983:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442702720 00000100:00100000:1.0:1788201326.489986:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442702720 00000100:00100000:1.0:1788201326.489995:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442702848 00000100:00100000:1.0:1788201326.489997:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442702848 00000100:00100000:1.0:1788201326.490006:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442702976 00000100:00100000:1.0:1788201326.490008:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442702976 00000100:00100000:1.0:1788201326.490020:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 72 00000100:00100000:1.0:1788201326.490026:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+47:16415:x1875064442702464:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1788201326.490036:0:15178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201326.490049:0:15178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d49b7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5104 expref: -99 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490105:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3000/0x9383f985bc4d49be lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490118:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3000/0x9383f985bc4d49be lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490128:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3000/0x9383f985bc4d49be lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490140:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d49c5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490147:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d49c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490154:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d49c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490251:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d49cc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490258:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d49cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490265:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d49cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201326.490318:0:15178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x407:0x0]: returning size 0 00000004:00200000:1.0:1788201326.490323:0:15178:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201326.490343:0:15178:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d49cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490354:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d49cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490361:0:15178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3000/0x9383f985bc4d49be lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490367:0:15178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3000/0x9383f985bc4d49be lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490374:0:15178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3000/0x9383f985bc4d49be lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490381:0:15178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201326.490385:0:15178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3000/0x9383f985bc4d49be lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490392:0:15178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3000/0x9383f985bc4d49be lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490402:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:1.0:1788201326.490405:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201326.490409:0:15178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3000/0x9383f985bc4d49be lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490415:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3000/0x9383f985bc4d49be lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490425:0:15178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d49c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490435:0:15178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d49c5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490441:0:15178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d49c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490446:0:15178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201326.490449:0:15178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d49c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490455:0:15178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d49c5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490462:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0xef09e6ea (ffff9e03c26bed00) 00010000:00010000:1.0:1788201326.490464:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201326.490467:0:15178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d49c5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490473:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d49c5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490503:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d49b7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5104 expref: 49 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490514:0:15178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d49cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5104 expref: 48 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490521:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x407:0x0].0x0 (ffff9e03c2ac6900) 00010000:00010000:1.0:1788201326.490523:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201326.490525:0:15178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2ef2000, rc 0) 00000100:00100000:1.0:1788201326.490557:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+48:16415:x1875064442702464:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 530us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201326.490564:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 72 00000100:00100000:1.0:1788201326.490579:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 73 00000100:00100000:1.0:1788201326.490586:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+47:16417:x1875064442702720:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1788201326.490595:0:15178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201326.490603:0:15178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d49d3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5112 expref: -99 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490630:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d49da lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490638:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d49da lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490646:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d49da lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490656:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d49e1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490663:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d49e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490670:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d49e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490713:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235fa00/0x9383f985bc4d49e8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490726:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235fa00/0x9383f985bc4d49e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490733:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235fa00/0x9383f985bc4d49e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201326.490750:0:15178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x409:0x0]: returning size 0 00000004:00200000:1.0:1788201326.490753:0:15178:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201326.490762:0:15178:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235fa00/0x9383f985bc4d49e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490769:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235fa00/0x9383f985bc4d49e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490775:0:15178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d49da lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490780:0:15178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d49da lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490786:0:15178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d49da lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490791:0:15178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201326.490795:0:15178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d49da lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490801:0:15178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d49da lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490809:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:1.0:1788201326.490812:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201326.490815:0:15178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d49da lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490821:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d49da lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490830:0:15178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d49e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490836:0:15178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d49e1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490842:0:15178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d49e1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490847:0:15178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201326.490850:0:15178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d49e1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490856:0:15178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d49e1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490864:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x7fbd58ea (ffff9e03c26be100) 00010000:00010000:1.0:1788201326.490866:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201326.490869:0:15178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d49e1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490874:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d49e1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490894:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d49d3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5112 expref: 49 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490906:0:15178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235fa00/0x9383f985bc4d49e8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5112 expref: 48 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.490912:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x409:0x0].0x0 (ffff9e03c23c1900) 00010000:00010000:1.0:1788201326.490914:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201326.490916:0:15178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c235fa00, rc 0) 00000100:00100000:1.0:1788201326.490939:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+48:16417:x1875064442702720:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 353us (1453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201326.490958:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 73 00000100:00100000:1.0:1788201326.490973:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 74 00000100:00100000:1.0:1788201326.490980:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+47:16411:x1875064442702848:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1788201326.490987:0:15178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201326.490996:0:15178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235fe00/0x9383f985bc4d49ef lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5119 expref: -99 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491036:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e600/0x9383f985bc4d49f6 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491045:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e600/0x9383f985bc4d49f6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491053:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e600/0x9383f985bc4d49f6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491065:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e200/0x9383f985bc4d49fd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491075:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e200/0x9383f985bc4d49fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491081:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e200/0x9383f985bc4d49fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491123:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235fc00/0x9383f985bc4d4a04 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x403:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491131:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235fc00/0x9383f985bc4d4a04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x403:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491137:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235fc00/0x9383f985bc4d4a04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x403:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201326.491155:0:15178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x403:0x0]: returning size 0 00000004:00200000:1.0:1788201326.491158:0:15178:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201326.491167:0:15178:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235fc00/0x9383f985bc4d4a04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x403:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491174:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235fc00/0x9383f985bc4d4a04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x403:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491180:0:15178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e600/0x9383f985bc4d49f6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491185:0:15178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e600/0x9383f985bc4d49f6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491190:0:15178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e600/0x9383f985bc4d49f6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491199:0:15178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c235e600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201326.491202:0:15178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e600/0x9383f985bc4d49f6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491208:0:15178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e600/0x9383f985bc4d49f6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491216:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:1.0:1788201326.491218:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201326.491221:0:15178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e600/0x9383f985bc4d49f6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491226:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e600/0x9383f985bc4d49f6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491235:0:15178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e200/0x9383f985bc4d49fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491241:0:15178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e200/0x9383f985bc4d49fd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491247:0:15178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e200/0x9383f985bc4d49fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491252:0:15178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c235e200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201326.491255:0:15178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e200/0x9383f985bc4d49fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491261:0:15178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e200/0x9383f985bc4d49fd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491271:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0xcda302ea (ffff9e03c26bec00) 00010000:00010000:1.0:1788201326.491273:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201326.491275:0:15178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e200/0x9383f985bc4d49fd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491281:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e200/0x9383f985bc4d49fd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491323:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235fe00/0x9383f985bc4d49ef lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5119 expref: 49 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491334:0:15178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235fc00/0x9383f985bc4d4a04 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x403:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5119 expref: 48 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491340:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x403:0x0].0x0 (ffff9e03c2fc5600) 00010000:00010000:1.0:1788201326.491342:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201326.491344:0:15178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c235fc00, rc 0) 00000100:00100000:1.0:1788201326.491364:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+48:16411:x1875064442702848:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 385us (1857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201326.491370:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 74 00000100:00100000:1.0:1788201326.491382:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 75 00000100:00100000:1.0:1788201326.491389:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+47:16416:x1875064442702976:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1788201326.491396:0:15178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201326.491404:0:15178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f200/0x9383f985bc4d4a0b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5120 expref: -99 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491427:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e000/0x9383f985bc4d4a12 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491435:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e000/0x9383f985bc4d4a12 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491442:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e000/0x9383f985bc4d4a12 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491452:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f600/0x9383f985bc4d4a19 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491459:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f600/0x9383f985bc4d4a19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491465:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f600/0x9383f985bc4d4a19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491510:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f800/0x9383f985bc4d4a20 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491518:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f800/0x9383f985bc4d4a20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491525:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f800/0x9383f985bc4d4a20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201326.491542:0:15178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x408:0x0]: returning size 0 00000004:00200000:1.0:1788201326.491544:0:15178:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201326.491552:0:15178:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f800/0x9383f985bc4d4a20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491559:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f800/0x9383f985bc4d4a20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491568:0:15178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e000/0x9383f985bc4d4a12 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491574:0:15178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e000/0x9383f985bc4d4a12 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491580:0:15178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e000/0x9383f985bc4d4a12 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491585:0:15178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c235e000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201326.491588:0:15178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e000/0x9383f985bc4d4a12 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491593:0:15178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e000/0x9383f985bc4d4a12 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491599:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:1.0:1788201326.491601:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201326.491603:0:15178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e000/0x9383f985bc4d4a12 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491608:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e000/0x9383f985bc4d4a12 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491615:0:15178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f600/0x9383f985bc4d4a19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491620:0:15178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f600/0x9383f985bc4d4a19 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491625:0:15178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f600/0x9383f985bc4d4a19 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491630:0:15178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c235f600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201326.491632:0:15178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f600/0x9383f985bc4d4a19 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491637:0:15178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f600/0x9383f985bc4d4a19 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491642:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x37639fea (ffff9e03c26bee00) 00010000:00010000:1.0:1788201326.491643:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201326.491645:0:15178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f600/0x9383f985bc4d4a19 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491650:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f600/0x9383f985bc4d4a19 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491666:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f200/0x9383f985bc4d4a0b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5120 expref: 49 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491674:0:15178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f800/0x9383f985bc4d4a20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5120 expref: 48 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.491680:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x408:0x0].0x0 (ffff9e03c2fc5e00) 00010000:00010000:1.0:1788201326.491682:0:15178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201326.491684:0:15178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c235f800, rc 0) 00000100:00100000:1.0:1788201326.491702:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+48:16416:x1875064442702976:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 314us (2177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201326.491707:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 75 00000100:00100000:3.0:1788201326.492840:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442703232 00000100:00100000:3.0:1788201326.492852:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442703232 00000100:00100000:3.0:1788201326.492963:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442703360 00000100:00100000:3.0:1788201326.492967:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442703360 00000100:00100000:3.0:1788201326.493004:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4255 00000100:00100000:3.0:1788201326.493014:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2362:x1875064442703232:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1788201326.493028:0:13449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201326.493046:0:13449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb412d5a/0x9383f985bc4d4a27 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x443:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c512e expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201326.493072:0:13449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x443:0x0] initial LVB size: 0, mtime: 0x6a95c96d, atime: 0x6a95c96d, ctime: 0x6a95c96d, blocks: 0x1 00010000:00010000:3.0:1788201326.493089:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x443:0x0].0x0 since=601s v=(0 0) 00010000:00010000:3.0:1788201326.493093:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x443:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201326.493100:0:13449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb412d5a/0x9383f985bc4d4a27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x443:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c512e expref: 510 pid: 13449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.493113:0:13449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bb412d5a/0x9383f985bc4d4a27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x443:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c512e expref: 510 pid: 13449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.493125:0:13449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5065c00, rc 0) 00000100:00100000:3.0:1788201326.493165:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+510:2362:x1875064442703232:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 153us (3298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201326.493171:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4255 00000100:00100000:3.0:1788201326.493188:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4256 00000100:00100000:3.0:1788201326.493196:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:2359:x1875064442703360:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1788201326.493203:0:13449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201326.493215:0:13449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d4a2e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x443:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5135 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201326.493230:0:13449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x443:0x0] initial LVB size: 0, mtime: 0x6a95c96d, atime: 0x6a95c96d, ctime: 0x6a95c96d, blocks: 0x1 00010000:00010000:3.0:1788201326.493239:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x443:0x0].0x0 since=601s v=(0 0) 00010000:00010000:3.0:1788201326.493242:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x443:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201326.493248:0:13449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d4a2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x443:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5135 expref: 10 pid: 13449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.493260:0:13449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d4a2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x443:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5135 expref: 10 pid: 13449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.493267:0:13449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5065800, rc 0) 00000100:00100000:3.0:1788201326.493285:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2359:x1875064442703360:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 91us (3352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201326.493290:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4256 00000100:00080000:3.0:1788201326.493328:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201326.499559:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201326.499636:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442703488 00000100:00100000:3.0:1788201326.499646:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442703488 00000100:00100000:3.0:1788201326.499745:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4257 00000100:00100000:3.0:1788201326.499757:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2361:x1875064442703488:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1788201326.499774:0:13441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201326.499794:0:13441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bf3c8de/0x9383f985bc4d4a35 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x445:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c513c expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201326.499821:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x445:0x0] initial LVB size: 0, mtime: 0x6a95c96d, atime: 0x6a95c96d, ctime: 0x6a95c96d, blocks: 0x1 00010000:00010000:3.0:1788201326.499850:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x445:0x0].0x0 since=601s v=(0 0) 00010000:00010000:3.0:1788201326.499856:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x445:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201326.499865:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bf3c8de/0x9383f985bc4d4a35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x445:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c513c expref: 11 pid: 13441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.499883:0:13441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003bf3c8de/0x9383f985bc4d4a35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x445:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c513c expref: 11 pid: 13441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.499897:0:13441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5065600, rc 0) 00000100:00100000:3.0:1788201326.499968:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:2361:x1875064442703488:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 213us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201326.499975:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4257 00000100:00100000:3.0:1788201326.506378:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201326.506953:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442704768 00000100:00100000:0.0:1788201326.506964:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442704768 00000100:00100000:0.0:1788201326.507021:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 881 00000100:00100000:0.0:1788201326.507031:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+48:2361:x1875064442704768:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:0.0:1788201326.507081:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201326.507102:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8a00/0x9383f985bc4d4a3c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5174 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.507162:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d4a43 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.507175:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d4a43 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.507186:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d4a43 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.507201:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d4a4a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.507207:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d4a4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.507214:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d4a4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.507276:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d4a43 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.507288:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d4a43 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.507336:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d4a43 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.507343:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a8000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201326.507347:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d4a43 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.507353:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d4a43 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.507364:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:0.0:1788201326.507367:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201326.507372:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d4a43 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.507377:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8000/0x9383f985bc4d4a43 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.507388:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d4a4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.507393:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d4a4a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.507397:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d4a4a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.507401:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201326.507404:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d4a4a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.507410:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d4a4a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.507416:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0xc81711ea (ffff9e03c2fc5400) 00010000:00010000:0.0:1788201326.507418:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201326.507421:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d4a4a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.507427:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9400/0x9383f985bc4d4a4a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.507458:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8a00/0x9383f985bc4d4a3c lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5174 expref: 49 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.507467:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:0.0:1788201326.507468:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201326.507472:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8a00/0x9383f985bc4d4a3c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5174 expref: 49 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.507481:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c19a8a00, rc -2) 00000100:00100000:0.0:1788201326.507558:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+48:2361:x1875064442704768:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 527us (1187us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201326.507566:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 881 00000100:00100000:1.0:1788201326.509074:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201326.509114:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201326.509141:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201326.509166:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201326.509188:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201326.509203:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201326.509222:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201326.509243:0:15284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442704000 00000100:00100000:1.0:1788201326.509252:0:15284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442704000 00000100:00100000:1.0:1788201326.509324:0:15284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442704256 00000100:00100000:1.0:1788201326.509328:0:15284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442704256 00000100:00100000:1.0:1788201326.509338:0:15284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442705152 00000100:00100000:1.0:1788201326.509341:0:15284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442705152 00000100:00100000:1.0:1788201326.509355:0:15284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 76 00000100:00100000:1.0:1788201326.509365:0:15284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+50:16412:x1875064442704000:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:1.0:1788201326.509417:0:15284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201326.509439:0:15284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064c00/0x9383f985bc4d4971 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x404:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50f6 expref: 50 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201326.509446:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442703616 00000100:00100000:2.0:1788201326.509450:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442703616 00010000:00010000:1.0:1788201326.509454:0:15284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x404:0x0].0x0 (ffff9e03c26bea00) 00010000:00010000:1.0:1788201326.509459:0:15284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201326.509486:0:15284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f200/0x9383f985bc4d4a51 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.509499:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f200/0x9383f985bc4d4a51 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.509520:0:15284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f200/0x9383f985bc4d4a51 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201326.509558:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442703744 00000100:00100000:2.0:1788201326.509561:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442703744 00000100:00100000:2.0:1788201326.509579:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442704640 00000100:00100000:2.0:1788201326.509582:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442704640 00000100:00100000:2.0:1788201326.509593:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442704512 00000100:00100000:2.0:1788201326.509595:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442704512 00000100:00100000:2.0:1788201326.509610:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4258 00000100:00100000:2.0:1788201326.509617:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35604eb4-baf9-45be-a20a-4883a2cd8cf9+510:2362:x1875064442703616:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1788201326.509627:0:13445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201326.509643:0:13445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d94893d/0x9383f985bc4d4a58 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x444:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5143 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201326.509667:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x444:0x0] initial LVB size: 0, mtime: 0x6a95c96d, atime: 0x6a95c96d, ctime: 0x6a95c96d, blocks: 0x1 00010000:00010000:2.0:1788201326.509685:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x444:0x0].0x0 since=601s v=(0 0) 00010000:00010000:2.0:1788201326.509690:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x444:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201326.509697:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d94893d/0x9383f985bc4d4a58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x444:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5143 expref: 511 pid: 13445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.509713:0:13445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d94893d/0x9383f985bc4d4a58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x444:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5143 expref: 511 pid: 13445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.509725:0:13445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0501b29c00, rc 0) 00000004:00010000:1.0:1788201326.509774:0:15284:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008eae0d85 reply state 000000006d4609ba transno 12884901934 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f200/0x9383f985bc4d4a51 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201326.509777:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2362:x1875064442703616:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 160us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201326.509783:0:15284:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201326.509784:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4258 00000100:00100000:2.0:1788201326.509800:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4259 00000100:00100000:2.0:1788201326.509806:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:2360:x1875064442703744:12345-192.168.201.30@tcp:101:chmod.0 00010000:02000000:1.0:1788201326.509812:0:15284:0:(ldlm_lib.c:3355:target_send_reply_msg()) *** cfs_fail_loc=15a, val=0*** 00010000:00010000:2.0:1788201326.509813:0:13445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201326.509825:0:13445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab0efb21/0x9383f985bc4d4a5f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x442:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c514a expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201326.509841:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x442:0x0] initial LVB size: 0, mtime: 0x6a95c96d, atime: 0x6a95c96d, ctime: 0x6a95c96d, blocks: 0x1 00010000:00010000:2.0:1788201326.509850:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x442:0x0].0x0 since=601s v=(0 0) 00010000:00010000:2.0:1788201326.509852:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x442:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201326.509857:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab0efb21/0x9383f985bc4d4a5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x442:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c514a expref: 14 pid: 13445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.509869:0:13445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ab0efb21/0x9383f985bc4d4a5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x442:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c514a expref: 14 pid: 13445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.509877:0:13445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0501b28200, rc 0) 00000100:00100000:2.0:1788201326.509896:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:2360:x1875064442703744:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 91us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201326.509903:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4259 00000100:00100000:2.0:1788201326.509915:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4260 00000100:00100000:2.0:1788201326.509922:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:2362:x1875064442704640:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1788201326.509928:0:13445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201326.510058:0:13445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8b36adf/0x9383f985bc4d4a66 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x444:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5197 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201326.510071:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x444:0x0] initial LVB size: 0, mtime: 0x6a95c96d, atime: 0x6a95c96d, ctime: 0x6a95c96d, blocks: 0x1 00010000:00010000:2.0:1788201326.510080:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x444:0x0].0x0 since=601s v=(0 0) 00010000:00010000:2.0:1788201326.510084:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x444:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201326.510090:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8b36adf/0x9383f985bc4d4a66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x444:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5197 expref: 14 pid: 13445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.510101:0:13445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b8b36adf/0x9383f985bc4d4a66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x444:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5197 expref: 14 pid: 13445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.510109:0:13445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0501b28800, rc 0) 00000100:00100000:2.0:1788201326.510129:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:2362:x1875064442704640:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 208us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201326.510136:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4260 00000100:00100000:2.0:1788201326.510149:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4261 00000100:00100000:2.0:1788201326.510156:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:2359:x1875064442704512:12345-192.168.201.30@tcp:101:ll_sa.0 00010000:00010000:2.0:1788201326.510163:0:13445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201326.510169:0:13445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e094923/0x9383f985bc4d4a6d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x444:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c516d expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.510182:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x444:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201326.510185:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x444:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201326.510191:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e094923/0x9383f985bc4d4a6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x444:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c516d expref: 14 pid: 13445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.510208:0:13445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e094923/0x9383f985bc4d4a6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x444:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c516d expref: 14 pid: 13445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.510216:0:13445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0501b29600, rc 0) 00000100:00100000:2.0:1788201326.510234:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:2359:x1875064442704512:12345-192.168.201.30@tcp:101:ll_sa.0 Request processed in 79us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201326.510240:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4261 00000100:00100000:0.0:1788201326.512338:0:15180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 77 00000100:00100000:0.0:1788201326.512357:0:15180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+51:16414:x1875064442704256:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:0.0:1788201326.512412:0:15180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201326.512436:0:15180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8e00/0x9383f985bc4d498d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50fd expref: 51 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.512453:0:15180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x406:0x0].0x0 (ffff9e03c23c1100) 00010000:00010000:0.0:1788201326.512458:0:15180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201326.512487:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d4a74 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.512498:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d4a74 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.512519:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d4a74 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201326.512712:0:15180:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e352b36 reply state 000000002683dc64 transno 12884901935 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d4a74 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201326.512721:0:15180:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:02000000:0.0:1788201326.512753:0:15180:0:(ldlm_lib.c:3355:target_send_reply_msg()) *** cfs_fail_loc=15a, val=0*** 00010000:00080000:0.0:1788201326.512757:0:15180:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788201326.512775:0:15180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+52:16414:x1875064442704256:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 426us (3608us total) trans 12884901935 rc 0/0 00000100:00100000:0.0:1788201326.512782:0:15180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 77 00000100:00100000:0.0:1788201326.512806:0:15180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 78 00000100:00100000:0.0:1788201326.512814:0:15180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+51:16413:x1875064442705152:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:0.0:1788201326.512831:0:15180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201326.512843:0:15180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8800/0x9383f985bc4d49a9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x405:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c510b expref: 51 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.512853:0:15180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x405:0x0].0x0 (ffff9e03c23c1200) 00010000:00010000:0.0:1788201326.512856:0:15180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201326.512867:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d4a7b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.512875:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d4a7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.512881:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d4a7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201326.512967:0:15180:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb9f81c9 reply state 00000000fca00e81 transno 12884901936 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d4a7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201326.512974:0:15180:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:02000000:0.0:1788201326.512989:0:15180:0:(ldlm_lib.c:3355:target_send_reply_msg()) *** cfs_fail_loc=15a, val=0*** 00010000:00080000:0.0:1788201326.512992:0:15180:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788201326.513003:0:15180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+52:16413:x1875064442705152:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 190us (3780us total) trans 12884901936 rc 0/0 00000100:00100000:0.0:1788201326.513009:0:15180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 78 00010000:00010000:0.0:1788201326.513043:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d4a74 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.513063:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d4a74 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.513071:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d4a74 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.513078:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201326.513082:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d4a74 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.513094:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d4a74 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.513103:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x406:0x0].0x0 (ffff9e03c23c1100) 00010000:00010000:0.0:1788201326.513106:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788201326.513109:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d4a74 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.513115:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9600/0x9383f985bc4d4a74 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.513134:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d4a7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.513140:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d4a7b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.513146:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d4a7b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.513151:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201326.513153:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d4a7b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.513159:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d4a7b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.513166:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x405:0x0].0x0 (ffff9e03c23c1200) 00010000:00010000:0.0:1788201326.513168:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788201326.513170:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d4a7b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.513179:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9000/0x9383f985bc4d4a7b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1788201326.515181:0:15284:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788201326.515208:0:15284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+49:16412:x1875064442704000:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 5837us (6086us total) trans 12884901934 rc 0/0 00000100:00100000:1.0:1788201326.515217:0:15284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 76 00010000:00010000:1.0:1788201326.515252:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f200/0x9383f985bc4d4a51 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.515262:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f200/0x9383f985bc4d4a51 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.515269:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f200/0x9383f985bc4d4a51 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.515275:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c235f200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201326.515279:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f200/0x9383f985bc4d4a51 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.515284:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f200/0x9383f985bc4d4a51 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201326.517449:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201326.517483:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201326.517918:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442705280 00000100:00100000:3.0:1788201326.517930:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442705280 00000100:00100000:3.0:1788201326.517988:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 882 00000100:00100000:3.0:1788201326.517998:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5287b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+49:2359:x1875064442705280:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:3.0:1788201326.518036:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201326.518056:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d4a82 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c51c8 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.518114:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d4a89 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.518127:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d4a89 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.518142:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d4a89 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.518156:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d4a90 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xfa0c02ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.518162:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d4a90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xfa0c02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.518167:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d4a90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xfa0c02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.518234:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d4a89 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.518241:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d4a89 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.518248:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d4a89 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.518254:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201326.518258:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d4a89 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.518265:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d4a89 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.518275:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:3.0:1788201326.518278:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201326.518282:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d4a89 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.518290:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064400/0x9383f985bc4d4a89 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.518322:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d4a90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xfa0c02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.518328:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d4a90 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xfa0c02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.518334:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d4a90 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xfa0c02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.518340:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201326.518342:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d4a90 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xfa0c02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.518348:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d4a90 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xfa0c02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.518356:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0xfa0c02ea (ffff9e03c1f72f00) 00010000:00010000:3.0:1788201326.518358:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201326.518361:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d4a90 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xfa0c02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.518367:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065200/0x9383f985bc4d4a90 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xfa0c02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.519270:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d4a82 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c51c8 expref: 50 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.519282:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:3.0:1788201326.519284:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201326.519287:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065400/0x9383f985bc4d4a82 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c51c8 expref: 50 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.519318:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5065400, rc -2) 00000100:00100000:3.0:1788201326.519403:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5287b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+49:2359:x1875064442705280:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 1406us (1919us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201326.519412:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 882 00000100:00100000:2.0:1788201326.519491:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201326.519525:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442705536 00000100:00100000:2.0:1788201326.519532:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442705536 00000100:00100000:2.0:1788201326.519571:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442705920 00000100:00100000:2.0:1788201326.519574:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442705920 00000100:00100000:2.0:1788201326.519596:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 79 00000100:00100000:2.0:1788201326.519604:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+50:16417:x1875064442705536:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:2.0:1788201326.519645:0:15178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201326.519660:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235fa00/0x9383f985bc4d49e8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5112 expref: 50 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.519672:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x409:0x0].0x0 (ffff9e03c23c1900) 00010000:00010000:2.0:1788201326.519675:0:15178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201326.519701:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d4a97 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.519712:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d4a97 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.519724:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d4a97 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201326.519923:0:15178:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000644b1a45 reply state 00000000b65357aa transno 12884901937 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d4a97 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201326.519943:0:15180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 80 00000100:00100000:2.0:1788201326.519957:0:15178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201326.519960:0:15180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c6630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+50:16415:x1875064442705920:12345-192.168.201.30@tcp:36:chmod.0 00010000:02000000:2.0:1788201326.519988:0:15178:0:(ldlm_lib.c:3355:target_send_reply_msg()) *** cfs_fail_loc=15a, val=0*** 00010000:00080000:2.0:1788201326.519991:0:15178:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00010000:00010000:3.0:1788201326.520003:0:15180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788201326.520005:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+51:16417:x1875064442705536:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 402us (2564us total) trans 12884901937 rc 0/0 00000100:00100000:2.0:1788201326.520011:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 79 00010000:00010000:3.0:1788201326.520014:0:15180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d49cc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5104 expref: 51 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.520025:0:15180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x407:0x0].0x0 (ffff9e03c2ac6900) 00010000:00010000:3.0:1788201326.520028:0:15180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201326.520034:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d4a97 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.520041:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d4a97 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.520042:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d4a9e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.520050:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d4a9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.520055:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d4a97 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.520058:0:15180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d4a9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.520062:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b29a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201326.520066:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d4a97 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.520072:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d4a97 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.520080:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x409:0x0].0x0 (ffff9e03c23c1900) 00010000:00010000:2.0:1788201326.520083:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788201326.520086:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d4a97 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.520093:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d4a97 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201326.520149:0:15180:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c870caf reply state 00000000bc471998 transno 12884901938 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d4a9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201326.520156:0:15180:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:02000000:3.0:1788201326.520173:0:15180:0:(ldlm_lib.c:3355:target_send_reply_msg()) *** cfs_fail_loc=15a, val=0*** 00010000:00080000:3.0:1788201326.520176:0:15180:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788201326.520181:0:15180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c6630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+50:16415:x1875064442705920:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 223us (690us total) trans 12884901938 rc 0/0 00000100:00100000:3.0:1788201326.520186:0:15180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 80 00010000:00010000:1.0:1788201326.520419:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x404:0x0].0x0 (ffff9e03c26bea00) 00010000:00010000:1.0:1788201326.520423:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788201326.520427:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f200/0x9383f985bc4d4a51 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.520438:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f200/0x9383f985bc4d4a51 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.520466:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d4a9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.520472:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d4a9e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.520478:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d4a9e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.520483:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201326.520486:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d4a9e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.520492:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d4a9e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.520500:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x407:0x0].0x0 (ffff9e03c2ac6900) 00010000:00010000:1.0:1788201326.520502:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788201326.520513:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d4a9e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.520519:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065e00/0x9383f985bc4d4a9e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201326.524073:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201326.524119:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201326.524156:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201326.524358:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442704384 00000100:00100000:0.0:1788201326.524370:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442704384 00000100:00100000:0.0:1788201326.524416:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442704896 00000100:00100000:0.0:1788201326.524419:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442704896 00000100:00100000:0.0:1788201326.524430:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442705664 00000100:00100000:0.0:1788201326.524432:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442705664 00000100:00100000:0.0:1788201326.524447:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 883 00000100:00100000:0.0:1788201326.524470:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+50:2359:x1875064442704384:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:0.0:1788201326.524592:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201326.524615:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d4aa5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5151 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.524672:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4aac lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.524684:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4aac lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.524695:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4aac lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.524709:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d4ab3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.524716:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d4ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.524726:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d4ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.524849:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d4aba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.524858:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d4aba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.524865:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d4aba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201326.524883:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x406:0x0]: returning size 0 00000004:00200000:0.0:1788201326.524887:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201326.524905:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d4aba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.524915:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d4aba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.524923:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4aac lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.524930:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4aac lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.524937:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4aac lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.524952:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201326.524957:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4aac lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.524964:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4aac lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.524976:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:0.0:1788201326.524979:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201326.524984:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4aac lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.524991:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9a00/0x9383f985bc4d4aac lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525007:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d4ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525012:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d4ab3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525017:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d4ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525022:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c19a9800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201326.525024:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d4ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525030:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d4ab3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525036:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0xa6b02dea (ffff9e03c2fc5f00) 00010000:00010000:0.0:1788201326.525039:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201326.525042:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d4ab3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525047:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9800/0x9383f985bc4d4ab3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525078:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a9200/0x9383f985bc4d4aa5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5151 expref: 52 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525091:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d4aba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5151 expref: 51 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525099:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x406:0x0].0x0 (ffff9e03c23c1100) 00010000:00010000:0.0:1788201326.525101:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201326.525104:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3e00, rc 0) 00010000:00010000:0.0:1788201326.525109:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201326.525117:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d4ac1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5158 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525138:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d4ac8 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525145:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d4ac8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525151:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d4ac8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525160:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d4acf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525167:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d4acf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525173:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d4acf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525197:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d4ac8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525203:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d4ac8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525207:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d4ac8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525212:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201326.525215:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d4ac8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525220:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d4ac8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525227:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:0.0:1788201326.525229:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201326.525232:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d4ac8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525236:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d4ac8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525244:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d4acf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525250:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d4acf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525256:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d4acf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525260:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201326.525262:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d4acf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525267:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d4acf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525272:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0xc81711ea (ffff9e03c2fc5100) 00010000:00010000:0.0:1788201326.525274:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201326.525277:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d4acf lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525284:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d4acf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525334:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d4ac1 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5158 expref: 52 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525343:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:0.0:1788201326.525345:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201326.525348:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d4ac1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5158 expref: 52 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.525356:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3000, rc -2) 00000100:00100000:0.0:1788201326.525426:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+51:2359:x1875064442704384:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 970us (1363us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201326.525437:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 883 00000100:00100000:0.0:1788201326.525464:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 884 00000100:00100000:0.0:1788201326.525473:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+50:2362:x1875064442704896:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:0.0:1788201326.525490:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201326.525499:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d4ad6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c519e expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.526391:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d4add lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.526405:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d4add lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.526413:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d4add lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.526426:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d4ae4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.526432:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d4ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.526438:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d4ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.526479:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d4add lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.526486:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d4add lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.526497:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d4add lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.526503:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201326.526589:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d4add lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.526597:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d4add lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.526606:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:0.0:1788201326.526609:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201326.526613:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d4add lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.526619:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d4add lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.526629:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d4ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.526636:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d4ae4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.526642:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d4ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.526647:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201326.526650:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d4ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.526660:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d4ae4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.526666:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0xc81711ea (ffff9e03c2fc5a00) 00010000:00010000:0.0:1788201326.526669:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201326.526672:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d4ae4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.526678:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d4ae4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.526705:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d4ad6 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c519e expref: 51 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.526714:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:0.0:1788201326.526717:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201326.526721:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d4ad6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c519e expref: 51 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.526730:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2200, rc -2) 00000100:00100000:0.0:1788201326.526777:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+50:2362:x1875064442704896:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 1305us (2657us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201326.526785:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 884 00000100:00100000:0.0:1788201326.526812:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 885 00000100:00100000:0.0:1788201326.526822:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+49:2359:x1875064442705664:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:0.0:1788201326.526870:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201326.526880:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d4aeb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c51cf expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.526907:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c200/0x9383f985bc4d4af2 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.526916:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c200/0x9383f985bc4d4af2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.526923:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c200/0x9383f985bc4d4af2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.526934:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d4af9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.526941:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d4af9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.526957:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d4af9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527031:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507dc00/0x9383f985bc4d4b00 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527040:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507dc00/0x9383f985bc4d4b00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527047:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507dc00/0x9383f985bc4d4b00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201326.527063:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x406:0x0]: returning size 0 00000004:00200000:0.0:1788201326.527067:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201326.527081:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507dc00/0x9383f985bc4d4b00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527093:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507dc00/0x9383f985bc4d4b00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527099:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c200/0x9383f985bc4d4af2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527104:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c200/0x9383f985bc4d4af2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527109:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c200/0x9383f985bc4d4af2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527114:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507c200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201326.527117:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c200/0x9383f985bc4d4af2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527122:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c200/0x9383f985bc4d4af2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527130:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:0.0:1788201326.527132:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201326.527135:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c200/0x9383f985bc4d4af2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527140:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c200/0x9383f985bc4d4af2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527149:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d4af9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527154:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d4af9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527159:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d4af9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527164:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507c800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201326.527166:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d4af9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527171:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d4af9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527178:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0xa6b02dea (ffff9e03c2fc5b00) 00010000:00010000:0.0:1788201326.527181:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201326.527183:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d4af9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527189:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d4af9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527209:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d4aeb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c51cf expref: 51 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527220:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507dc00/0x9383f985bc4d4b00 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c51cf expref: 50 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527227:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x406:0x0].0x0 (ffff9e03c23c1100) 00010000:00010000:0.0:1788201326.527230:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201326.527232:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c507dc00, rc 0) 00010000:00010000:0.0:1788201326.527237:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201326.527244:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c000/0x9383f985bc4d4b07 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c51d6 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527267:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d400/0x9383f985bc4d4b0e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527274:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d400/0x9383f985bc4d4b0e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527281:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d400/0x9383f985bc4d4b0e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527313:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d4b15 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527321:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d4b15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527329:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d4b15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527353:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d400/0x9383f985bc4d4b0e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527359:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d400/0x9383f985bc4d4b0e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527365:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d400/0x9383f985bc4d4b0e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527370:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201326.527372:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d400/0x9383f985bc4d4b0e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527382:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d400/0x9383f985bc4d4b0e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527390:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:0.0:1788201326.527392:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201326.527395:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d400/0x9383f985bc4d4b0e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527401:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d400/0x9383f985bc4d4b0e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527410:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d4b15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527415:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d4b15 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527420:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d4b15 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527425:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201326.527427:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d4b15 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527433:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d4b15 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527440:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0xc81711ea (ffff9e03c2fc5c00) 00010000:00010000:0.0:1788201326.527443:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201326.527446:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d4b15 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527452:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d4b15 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527473:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c000/0x9383f985bc4d4b07 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c51d6 expref: 51 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527481:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:0.0:1788201326.527483:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201326.527487:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c000/0x9383f985bc4d4b07 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c51d6 expref: 51 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201326.527495:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c507c000, rc -2) 00000100:00100000:1.0:1788201326.527959:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201326.528126:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442706176 00000100:00100000:3.0:1788201326.528133:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442706176 00000100:00100000:3.0:1788201326.528180:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 81 00000100:00100000:3.0:1788201326.528188:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+51:16416:x1875064442706176:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:3.0:1788201326.528225:0:15178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201326.528238:0:15178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f800/0x9383f985bc4d4a20 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5120 expref: 51 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.528250:0:15178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x408:0x0].0x0 (ffff9e03c2fc5e00) 00010000:00010000:3.0:1788201326.528253:0:15178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201326.528273:0:15178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d4b1c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.528281:0:15178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d4b1c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201326.528310:0:15178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d4b1c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201326.528487:0:15178:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000015e15ae5 reply state 000000002c4b6bf7 transno 12884901939 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d4b1c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201326.528496:0:15178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:02000000:3.0:1788201326.528529:0:15178:0:(ldlm_lib.c:3355:target_send_reply_msg()) *** cfs_fail_loc=15a, val=0*** 00010000:00080000:3.0:1788201326.528532:0:15178:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788201326.528545:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+52:16416:x1875064442706176:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 358us (588us total) trans 12884901939 rc 0/0 00000100:00100000:3.0:1788201326.528552:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 81 00010000:00010000:2.0:1788201326.528566:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d4b1c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.528575:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d4b1c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.528581:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d4b1c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.528586:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201326.528591:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d4b1c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.528596:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d4b1c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.528605:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x408:0x0].0x0 (ffff9e03c2fc5e00) 00010000:00010000:2.0:1788201326.528607:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788201326.528610:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d4b1c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.528616:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064600/0x9383f985bc4d4b1c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201326.529106:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+50:2359:x1875064442705664:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 2284us (4947us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201326.529115:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 885 00000100:00100000:3.0:1788201326.531707:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201326.531750:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201326.532123:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442706560 00000100:00100000:1.0:1788201326.532134:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442706560 00000100:00100000:1.0:1788201326.532186:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 886 00000100:00100000:1.0:1788201326.532196:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+50:2360:x1875064442706560:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:1.0:1788201326.532241:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201326.532260:0:6715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e000/0x9383f985bc4d4b23 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c51f2 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532330:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235fe00/0x9383f985bc4d4b2a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532342:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235fe00/0x9383f985bc4d4b2a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532352:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235fe00/0x9383f985bc4d4b2a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532365:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e200/0x9383f985bc4d4b31 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532371:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e200/0x9383f985bc4d4b31 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532377:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e200/0x9383f985bc4d4b31 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532484:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e600/0x9383f985bc4d4b38 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x404:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532492:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e600/0x9383f985bc4d4b38 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x404:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532498:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e600/0x9383f985bc4d4b38 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x404:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201326.532537:0:6715:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x404:0x0]: returning size 0 00000004:00200000:1.0:1788201326.532543:0:6715:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201326.532564:0:6715:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e600/0x9383f985bc4d4b38 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x404:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532577:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e600/0x9383f985bc4d4b38 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x404:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532585:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235fe00/0x9383f985bc4d4b2a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532591:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235fe00/0x9383f985bc4d4b2a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532599:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235fe00/0x9383f985bc4d4b2a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532604:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c235fe00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201326.532608:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235fe00/0x9383f985bc4d4b2a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532614:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235fe00/0x9383f985bc4d4b2a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532624:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:1.0:1788201326.532627:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201326.532630:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235fe00/0x9383f985bc4d4b2a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532636:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235fe00/0x9383f985bc4d4b2a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532651:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e200/0x9383f985bc4d4b31 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532657:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e200/0x9383f985bc4d4b31 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532662:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e200/0x9383f985bc4d4b31 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532666:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c235e200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201326.532668:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e200/0x9383f985bc4d4b31 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532673:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e200/0x9383f985bc4d4b31 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532678:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x15fcbbea (ffff9e03c26bee00) 00010000:00010000:1.0:1788201326.532679:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201326.532682:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e200/0x9383f985bc4d4b31 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532687:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e200/0x9383f985bc4d4b31 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532710:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e000/0x9383f985bc4d4b23 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c51f2 expref: 52 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532720:0:6715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e600/0x9383f985bc4d4b38 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x404:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c51f2 expref: 51 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532731:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x404:0x0].0x0 (ffff9e03c26bea00) 00010000:00010000:1.0:1788201326.532733:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201326.532735:0:6715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c235e600, rc 0) 00010000:00010000:1.0:1788201326.532739:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201326.532745:0:6715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235ec00/0x9383f985bc4d4b3f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c51f9 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532761:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f400/0x9383f985bc4d4b46 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532768:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f400/0x9383f985bc4d4b46 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532774:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f400/0x9383f985bc4d4b46 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532783:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f600/0x9383f985bc4d4b4d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532789:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f600/0x9383f985bc4d4b4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532795:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f600/0x9383f985bc4d4b4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532834:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235ee00/0x9383f985bc4d4b54 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x405:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532841:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235ee00/0x9383f985bc4d4b54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x405:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532851:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235ee00/0x9383f985bc4d4b54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x405:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201326.532861:0:6715:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x405:0x0]: returning size 0 00000004:00200000:1.0:1788201326.532863:0:6715:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201326.532870:0:6715:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235ee00/0x9383f985bc4d4b54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x405:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532876:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235ee00/0x9383f985bc4d4b54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x405:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532882:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f400/0x9383f985bc4d4b46 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532887:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f400/0x9383f985bc4d4b46 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532892:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f400/0x9383f985bc4d4b46 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532896:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c235f400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201326.532898:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f400/0x9383f985bc4d4b46 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532903:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f400/0x9383f985bc4d4b46 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532909:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:1.0:1788201326.532911:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201326.532913:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f400/0x9383f985bc4d4b46 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532922:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f400/0x9383f985bc4d4b46 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532929:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f600/0x9383f985bc4d4b4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532934:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f600/0x9383f985bc4d4b4d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532939:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f600/0x9383f985bc4d4b4d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532954:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c235f600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201326.532956:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f600/0x9383f985bc4d4b4d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532961:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f600/0x9383f985bc4d4b4d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532968:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x5e5674ea (ffff9e03c26bec00) 00010000:00010000:1.0:1788201326.532970:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201326.532973:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f600/0x9383f985bc4d4b4d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532978:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235f600/0x9383f985bc4d4b4d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.532998:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235ec00/0x9383f985bc4d4b3f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c51f9 expref: 53 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533024:0:6715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235ee00/0x9383f985bc4d4b54 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x405:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c51f9 expref: 52 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533030:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x405:0x0].0x0 (ffff9e03c23c1200) 00010000:00010000:1.0:1788201326.533032:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201326.533034:0:6715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c235ee00, rc 0) 00010000:00010000:1.0:1788201326.533038:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201326.533045:0:6715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231a800/0x9383f985bc4d4b5b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5200 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533065:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231b400/0x9383f985bc4d4b62 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533072:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231b400/0x9383f985bc4d4b62 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533078:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231b400/0x9383f985bc4d4b62 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533089:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231bc00/0x9383f985bc4d4b69 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533096:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231bc00/0x9383f985bc4d4b69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533102:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231bc00/0x9383f985bc4d4b69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533157:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231ae00/0x9383f985bc4d4b70 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533166:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231ae00/0x9383f985bc4d4b70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533175:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231ae00/0x9383f985bc4d4b70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201326.533187:0:6715:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x406:0x0]: returning size 0 00000004:00200000:1.0:1788201326.533189:0:6715:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201326.533196:0:6715:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231ae00/0x9383f985bc4d4b70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533203:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231ae00/0x9383f985bc4d4b70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533209:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231b400/0x9383f985bc4d4b62 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533214:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231b400/0x9383f985bc4d4b62 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533220:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231b400/0x9383f985bc4d4b62 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533227:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c231b400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201326.533229:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231b400/0x9383f985bc4d4b62 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533235:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231b400/0x9383f985bc4d4b62 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533242:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:1.0:1788201326.533245:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201326.533247:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231b400/0x9383f985bc4d4b62 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533252:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231b400/0x9383f985bc4d4b62 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533260:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231bc00/0x9383f985bc4d4b69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533264:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231bc00/0x9383f985bc4d4b69 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533269:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231bc00/0x9383f985bc4d4b69 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533274:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c231bc00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201326.533276:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231bc00/0x9383f985bc4d4b69 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533281:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231bc00/0x9383f985bc4d4b69 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533286:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0xa6b02dea (ffff9e03c26be100) 00010000:00010000:1.0:1788201326.533288:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201326.533290:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231bc00/0x9383f985bc4d4b69 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533318:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231bc00/0x9383f985bc4d4b69 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533334:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231a800/0x9383f985bc4d4b5b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5200 expref: 54 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533344:0:6715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231ae00/0x9383f985bc4d4b70 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5200 expref: 53 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533350:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x406:0x0].0x0 (ffff9e03c23c1100) 00010000:00010000:1.0:1788201326.533352:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201326.533354:0:6715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c231ae00, rc 0) 00010000:00010000:1.0:1788201326.533358:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201326.533364:0:6715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231b200/0x9383f985bc4d4b77 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5207 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533379:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231a600/0x9383f985bc4d4b7e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533387:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231a600/0x9383f985bc4d4b7e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533393:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231a600/0x9383f985bc4d4b7e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533401:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231b000/0x9383f985bc4d4b85 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533406:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231b000/0x9383f985bc4d4b85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533412:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231b000/0x9383f985bc4d4b85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533451:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231be00/0x9383f985bc4d4b8c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533459:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231be00/0x9383f985bc4d4b8c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533465:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231be00/0x9383f985bc4d4b8c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201326.533478:0:6715:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x407:0x0]: returning size 0 00000004:00200000:1.0:1788201326.533481:0:6715:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201326.533489:0:6715:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231be00/0x9383f985bc4d4b8c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533496:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231be00/0x9383f985bc4d4b8c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533502:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231a600/0x9383f985bc4d4b7e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533508:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231a600/0x9383f985bc4d4b7e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533513:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231a600/0x9383f985bc4d4b7e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533519:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c231a600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201326.533522:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231a600/0x9383f985bc4d4b7e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533602:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231a600/0x9383f985bc4d4b7e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533611:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:1.0:1788201326.533614:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201326.533617:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231a600/0x9383f985bc4d4b7e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533622:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231a600/0x9383f985bc4d4b7e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533631:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231b000/0x9383f985bc4d4b85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533636:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231b000/0x9383f985bc4d4b85 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533642:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231b000/0x9383f985bc4d4b85 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533646:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c231b000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201326.533648:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231b000/0x9383f985bc4d4b85 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533653:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231b000/0x9383f985bc4d4b85 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533658:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0xef09e6ea (ffff9e03c26bed00) 00010000:00010000:1.0:1788201326.533660:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201326.533662:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231b000/0x9383f985bc4d4b85 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533667:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231b000/0x9383f985bc4d4b85 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533686:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231b200/0x9383f985bc4d4b77 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5207 expref: 55 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533697:0:6715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231be00/0x9383f985bc4d4b8c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5207 expref: 54 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533703:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x407:0x0].0x0 (ffff9e03c2ac6900) 00010000:00010000:1.0:1788201326.533705:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201326.533707:0:6715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c231be00, rc 0) 00010000:00010000:1.0:1788201326.533710:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201326.533716:0:6715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231a400/0x9383f985bc4d4b93 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c520e expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533733:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231ba00/0x9383f985bc4d4b9a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533741:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231ba00/0x9383f985bc4d4b9a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533747:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231ba00/0x9383f985bc4d4b9a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533758:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4000/0x9383f985bc4d4ba1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533764:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4000/0x9383f985bc4d4ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533770:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4000/0x9383f985bc4d4ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533810:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4c00/0x9383f985bc4d4ba8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533818:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4c00/0x9383f985bc4d4ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533824:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4c00/0x9383f985bc4d4ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201326.533834:0:6715:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x408:0x0]: returning size 0 00000004:00200000:1.0:1788201326.533836:0:6715:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201326.533842:0:6715:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4c00/0x9383f985bc4d4ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533849:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4c00/0x9383f985bc4d4ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533855:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231ba00/0x9383f985bc4d4b9a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533860:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231ba00/0x9383f985bc4d4b9a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533865:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231ba00/0x9383f985bc4d4b9a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533870:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c231ba00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201326.533872:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231ba00/0x9383f985bc4d4b9a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533877:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231ba00/0x9383f985bc4d4b9a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533883:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:1.0:1788201326.533885:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201326.533888:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231ba00/0x9383f985bc4d4b9a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533893:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231ba00/0x9383f985bc4d4b9a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533900:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4000/0x9383f985bc4d4ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533904:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4000/0x9383f985bc4d4ba1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533909:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4000/0x9383f985bc4d4ba1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533914:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9ce4000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201326.533916:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4000/0x9383f985bc4d4ba1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533921:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4000/0x9383f985bc4d4ba1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533926:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x37639fea (ffff9e03c26be900) 00010000:00010000:1.0:1788201326.533928:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201326.533930:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4000/0x9383f985bc4d4ba1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533935:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4000/0x9383f985bc4d4ba1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533960:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231a400/0x9383f985bc4d4b93 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c520e expref: 56 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533972:0:6715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4c00/0x9383f985bc4d4ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c520e expref: 55 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.533978:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x408:0x0].0x0 (ffff9e03c2fc5e00) 00010000:00010000:1.0:1788201326.533981:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201326.533983:0:6715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9ce4c00, rc 0) 00010000:00010000:1.0:1788201326.533988:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201326.533994:0:6715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d4baf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5215 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535314:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5e00/0x9383f985bc4d4bb6 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535334:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5e00/0x9383f985bc4d4bb6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535344:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5e00/0x9383f985bc4d4bb6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535358:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d4bbd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535364:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d4bbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535370:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d4bbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535458:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4400/0x9383f985bc4d4bc4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535466:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4400/0x9383f985bc4d4bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535473:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4400/0x9383f985bc4d4bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201326.535493:0:6715:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x409:0x0]: returning size 0 00000004:00200000:1.0:1788201326.535497:0:6715:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201326.535585:0:6715:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4400/0x9383f985bc4d4bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535596:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4400/0x9383f985bc4d4bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535605:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5e00/0x9383f985bc4d4bb6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535611:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5e00/0x9383f985bc4d4bb6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535618:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5e00/0x9383f985bc4d4bb6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535622:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9ce5e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201326.535626:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5e00/0x9383f985bc4d4bb6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535632:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5e00/0x9383f985bc4d4bb6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535641:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:1.0:1788201326.535646:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201326.535650:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5e00/0x9383f985bc4d4bb6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535655:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5e00/0x9383f985bc4d4bb6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535666:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d4bbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535671:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d4bbd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535676:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d4bbd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535681:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9ce4800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201326.535683:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d4bbd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535688:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d4bbd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535693:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x7fbd58ea (ffff9e04c98a6200) 00010000:00010000:1.0:1788201326.535695:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201326.535697:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d4bbd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535701:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d4bbd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535728:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d4baf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5215 expref: 57 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535740:0:6715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4400/0x9383f985bc4d4bc4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5215 expref: 56 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535746:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x409:0x0].0x0 (ffff9e03c23c1900) 00010000:00010000:1.0:1788201326.535748:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201326.535750:0:6715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9ce4400, rc 0) 00010000:00010000:1.0:1788201326.535756:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201326.535764:0:6715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d4bcb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c521c expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535788:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5800/0x9383f985bc4d4bd2 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535795:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5800/0x9383f985bc4d4bd2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535801:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5800/0x9383f985bc4d4bd2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535810:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4600/0x9383f985bc4d4bd9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535816:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4600/0x9383f985bc4d4bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.535821:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4600/0x9383f985bc4d4bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.536114:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5800/0x9383f985bc4d4bd2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.536123:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5800/0x9383f985bc4d4bd2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.536862:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5800/0x9383f985bc4d4bd2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.536869:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9ce5800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201326.536873:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5800/0x9383f985bc4d4bd2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.536880:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5800/0x9383f985bc4d4bd2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.536893:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:1.0:1788201326.536896:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201326.536900:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5800/0x9383f985bc4d4bd2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.536905:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5800/0x9383f985bc4d4bd2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.537011:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4600/0x9383f985bc4d4bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.537019:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4600/0x9383f985bc4d4bd9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.538042:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4600/0x9383f985bc4d4bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.538049:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9ce4600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201326.538055:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4600/0x9383f985bc4d4bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.538062:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4600/0x9383f985bc4d4bd9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.538073:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0xc81711ea (ffff9e04c98a6800) 00010000:00010000:1.0:1788201326.538076:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201326.538079:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4600/0x9383f985bc4d4bd9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.538085:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4600/0x9383f985bc4d4bd9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.538141:0:6715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d4bcb lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c521c expref: 57 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.538153:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:1.0:1788201326.538155:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201326.538158:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d4bcb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c521c expref: 57 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201326.538167:0:6715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9ce4200, rc -2) 00000100:00100000:1.0:1788201326.538237:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+56:2360:x1875064442706560:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 6041us (6484us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201326.538245:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 886 00000100:00100000:2.0:1788201326.540032:0:15284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442706432 00000100:00100000:2.0:1788201326.540045:0:15284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442706432 00000100:00100000:2.0:1788201326.540174:0:15284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 82 00000100:00100000:2.0:1788201326.540185:0:15284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+56:16411:x1875064442706432:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:2.0:1788201326.540262:0:15284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201326.540284:0:15284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235fc00/0x9383f985bc4d4a04 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x403:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5119 expref: 56 pid: 15178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.540318:0:15284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x403:0x0].0x0 (ffff9e03c2fc5600) 00010000:00010000:2.0:1788201326.540324:0:15284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201326.540355:0:15284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d4be0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.540369:0:15284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d4be0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.540379:0:15284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d4be0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201326.540638:0:15284:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000763b8afe reply state 000000009bb80364 transno 12884901940 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d4be0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201326.540647:0:15284:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:02000000:2.0:1788201326.540678:0:15284:0:(ldlm_lib.c:3355:target_send_reply_msg()) *** cfs_fail_loc=15a, val=0*** 00010000:00080000:2.0:1788201326.540681:0:15284:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788201326.540698:0:15284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+57:16411:x1875064442706432:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 514us (9002us total) trans 12884901940 rc 0/0 00000100:00100000:2.0:1788201326.540704:0:15284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 82 00010000:00010000:2.0:1788201326.540730:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d4be0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.540736:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d4be0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.540746:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d4be0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.540753:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b28600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201326.540757:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d4be0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.540763:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d4be0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.540771:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x403:0x0].0x0 (ffff9e03c2fc5600) 00010000:00010000:2.0:1788201326.540774:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788201326.540777:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d4be0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201326.540783:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28600/0x9383f985bc4d4be0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201327.461672:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201327.850318:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5117800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458247168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201327.850397:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201327.850479:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458247168 00000100:00100000:0.0:1788201327.850487:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458247168 00000100:00100000:0.0:1788201327.850544:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788201327.850552:0:6708:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1788201327.850557:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3312:x1875064458247168:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201327.850564:0:6708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:0.0:1788201327.850599:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524877824 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1788201327.850651:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3312:x1875064458247168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201327.850659:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788201327.850732:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5117800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458247168:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788201327.853975:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201327.854006:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458247296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201327.854151:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201327.854452:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458247296 00000100:00100000:2.0:1788201327.854461:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458247296 00000100:00100000:2.0:1788201327.854522:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788201327.854532:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5114380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875064458247296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201327.854570:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 13631488 granted 524877824 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201327.854624:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5114380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875064458247296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201327.854631:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788201327.854670:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968862 gen 2 00000004:00080000:2.0:1788201327.854676:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c12d3800, transno 4294968862 00000100:00100000:2.0:1788201327.854690:0:3313:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9e03c12d0000 x1875064458245888/t4294968863(4294968863) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201379 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201327.854708:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458247296:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788201327.854759:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788201328.486561:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201328.870694:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458247680:0@lo:400:kworker.0 00000100:00100000:1.0:1788201328.870766:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201328.870896:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5116a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458247552:0@lo:400:kworker.0 00000100:00100000:2.0:1788201328.870939:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201328.870984:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5114700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875064458248064:0@lo:400:kworker.0 00000100:00100000:2.0:1788201328.871009:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201328.871034:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788201328.871040:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458247424:0@lo:400:kworker.0 00000100:00100000:2.0:1788201328.871069:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201328.871093:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458247936:0@lo:400:kworker.0 00000100:00100000:2.0:1788201328.871116:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201328.871149:0:15284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458247680 00000100:00100000:2.0:1788201328.871156:0:15284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458247680 00000100:00100000:2.0:1788201328.871207:0:15284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458247552 00000100:00100000:2.0:1788201328.871210:0:15284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458247552 00000100:00100000:2.0:1788201328.871225:0:15284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458248064 00000100:00100000:2.0:1788201328.871228:0:15284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458248064 00000100:00100000:2.0:1788201328.871242:0:15284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788201328.871250:0:15284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458247680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201328.871329:0:15284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458247680:12345-0@lo:400:kworker.0 Request processed in 78us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201328.871337:0:15284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788201328.871357:0:15284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788201328.871363:0:15284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875064458247552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201328.871395:0:15284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875064458247552:12345-0@lo:400:kworker.0 Request processed in 32us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201328.871405:0:15284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788201328.871415:0:15284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788201328.871421:0:15284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c23d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875064458248064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201328.871442:0:15284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c23d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875064458248064:12345-0@lo:400:kworker.0 Request processed in 22us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201328.871447:0:15284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788201328.871464:0:15194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458247424 00000100:00100000:2.0:1788201328.871467:0:15194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458247424 00000100:00100000:2.0:1788201328.871503:0:15194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788201328.871509:0:15194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cfeff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458247424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201328.871535:0:15194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cfeff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458247424:12345-0@lo:400:kworker.0 Request processed in 27us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201328.871540:0:15194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788201328.871565:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458247936 00000100:00100000:2.0:1788201328.871568:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458247936 00000100:00100000:2.0:1788201328.871591:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788201328.871597:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:3311:x1875064458247936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201328.871623:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:3311:x1875064458247936:12345-0@lo:400:kworker.0 Request processed in 26us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201328.871629:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788201328.871668:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458247424:0@lo:400:kworker.0 00000100:00100000:2.0:1788201328.871680:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458247936:0@lo:400:kworker.0 00000100:00100000:2.0:1788201328.871688:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5116a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458247552:0@lo:400:kworker.0 00000100:00100000:2.0:1788201328.871696:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5114700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875064458248064:0@lo:400:kworker.0 00000100:00100000:1.0:1788201328.871942:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458247680:0@lo:400:kworker.0 00000100:00100000:1.0:1788201328.871956:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201328.871961:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5114a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458247808:0@lo:400:kworker.0 00000100:00100000:1.0:1788201328.871986:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788201328.872031:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201328.872122:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458247808 00000100:00100000:2.0:1788201328.872126:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458247808 00000100:00100000:2.0:1788201328.872159:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788201328.872165:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f965a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+8:3312:x1875064458247808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201328.872356:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f965a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+8:3312:x1875064458247808:12345-0@lo:400:kworker.0 Request processed in 189us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201328.872363:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788201328.874506:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5114a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458247808:0@lo:400:kworker.0 00000001:00080000:1.0:1788201329.453093:0:6732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294968868 is committed 00000001:00080000:1.0:1788201329.453115:0:6732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294968865 is committed 00000001:00080000:3.0:1788201329.456725:0:15196:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901936 is committed 00000001:00080000:3.0:1788201329.456805:0:15196:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901940 is committed 00000001:00080000:2.0:1788201329.462230:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968865 is committed 00000001:00080000:2.0:1788201329.462250:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968863 is committed 00000001:00080000:2.0:1788201329.462258:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968867 is committed 00000001:00080000:2.0:1788201329.462264:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968864 is committed 00000001:00080000:2.0:1788201329.462268:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968868 is committed 00010000:00010000:0.0:1788201329.509447:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788201330.471743:0:16267:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788201330.471804:0:16267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97e00/0x9383f985bc4d4191 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4198 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.471821:0:16267:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97e00/0x9383f985bc4d4191 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d4198 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.471829:0:16267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97e00/0x9383f985bc4d4191 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d4198 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.471836:0:16267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97e00/0x9383f985bc4d4191 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d4198 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.471861:0:16267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788201330.471867:0:16267:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788201330.471899:0:16267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788201330.471904:0:16267:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788201330.471910:0:16267:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788201330.471935:0:16267:0:(import.c:65:import_set_state_nolock()) ffff9e04c8284000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788201330.471992:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875064458248192:0@lo:39:umount.0 00000100:00100000:2.0:1788201330.472056:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201330.472142:0:15284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458248192 00000100:00100000:0.0:1788201330.472149:0:15284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458248192 00000100:00100000:0.0:1788201330.472194:0:15284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788201330.472202:0:15284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875064458248192:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788201330.472225:0:15284:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d4232 00000100:00080000:0.0:1788201330.472238:0:15284:0:(import.c:65:import_set_state_nolock()) ffff9e04f48ce800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788201330.472321:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201330.472327:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97e00/0x9383f985bc4d4191 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d4198 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.472336:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97e00 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:1.0:1788201330.472341:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97e00/0x9383f985bc4d4191 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d4198 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.472350:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97e00/0x9383f985bc4d4191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x9383f985bc4d4198 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201330.472358:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97e00/0x9383f985bc4d4191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x9383f985bc4d4198 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201330.472363:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788201330.472365:0:5846:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788201330.472368:0:5846:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788201330.472388:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97e00/0x9383f985bc4d4191 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d4198 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.472394:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201330.472408:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97e00/0x9383f985bc4d4191 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d4198 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.472416:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97e00/0x9383f985bc4d4191 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d4198 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.472426:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201330.472428:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201330.472430:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201330.472436:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201330.472445:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458248320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201330.472473:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201330.472509:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458248320 00000100:00100000:1.0:1788201330.472512:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458248320 00000100:00100000:1.0:1788201330.472539:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788201330.472545:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5116680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3313:x1875064458248320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201330.472554:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201330.472567:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c1b96200/0x9383f985bc4d4198 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d4191 expref: 19 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.472578:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201330.472601:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5116680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b60c000b-7335-444d-a8dc-1a5956712fb2+18:3313:x1875064458248320:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201330.472607:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788201330.472636:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458248320:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201330.472700:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201330.472859:0:15284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3309:x1875064458248192:12345-0@lo:39:umount.0 Request processed in 657us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201330.472866:0:15284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000020:00000080:0.0:1788201330.472887:0:15284:0:(genops.c:906:class_export_put()) final put ffff9e04f48ca800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788201330.472960:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04f48ca800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788201330.473002:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04f48ce800 for lustre-MDT0000 00000100:00080000:2.0:1788201330.473062:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04c8284000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788201330.473110:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875064458248192:0@lo:39:umount.0 00000100:00080000:1.0:1788201330.473151:0:16267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788201330.473154:0:16267:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788201330.473157:0:16267:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788201330.474262:0:16267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2c00/0x9383f985bc4d40e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d40e9 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.474275:0:16267:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2c00/0x9383f985bc4d40e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d40e9 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.474282:0:16267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2c00/0x9383f985bc4d40e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d40e9 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.474820:0:16267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2c00/0x9383f985bc4d40e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d40e9 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.474924:0:16267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201330.474931:0:16267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7400/0x9383f985bc4d41b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d41bb expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.474938:0:16267:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7400/0x9383f985bc4d41b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d41bb expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.474943:0:16267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7400/0x9383f985bc4d41b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d41bb expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.474949:0:16267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7400/0x9383f985bc4d41b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d41bb expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.474981:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201330.474989:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2c00/0x9383f985bc4d40e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d40e9 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.474996:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2c00 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:2.0:1788201330.475000:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2c00/0x9383f985bc4d40e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d40e9 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.475007:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2c00/0x9383f985bc4d40e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x9383f985bc4d40e9 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201330.475019:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2c00/0x9383f985bc4d40e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x9383f985bc4d40e9 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201330.475025:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788201330.475027:0:5845:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788201330.475059:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2c00/0x9383f985bc4d40e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d40e9 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.475064:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788201330.475130:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c33f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458248448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201330.475191:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201330.475257:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2c00/0x9383f985bc4d40e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d40e9 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.475266:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2c00/0x9383f985bc4d40e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d40e9 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.475280:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201330.475283:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7400/0x9383f985bc4d41b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d41bb expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.475289:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7400 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:2.0:1788201330.475318:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7400/0x9383f985bc4d41b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d41bb expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.475325:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7400/0x9383f985bc4d41b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9383f985bc4d41bb expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201330.475331:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7400/0x9383f985bc4d41b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9383f985bc4d41bb expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201330.475336:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788201330.475339:0:5845:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1788201330.475352:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7400/0x9383f985bc4d41b4 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d41bb expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.475358:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201330.475373:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7400/0x9383f985bc4d41b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d41bb expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.475380:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201330.475381:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201330.475383:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201330.475390:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201330.475400:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c33f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458248576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201330.475428:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201330.475468:0:13526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458248448 00000100:00100000:2.0:1788201330.475473:0:13526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458248448 00000100:00100000:2.0:1788201330.475510:0:13526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458248576 00000100:00100000:2.0:1788201330.475514:0:13526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458248576 00000100:00100000:2.0:1788201330.475536:0:13526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788201330.475544:0:13526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3313:x1875064458248448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201330.475556:0:13526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201330.475569:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c20c2800/0x9383f985bc4d40e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d40e2 expref: 19 pid: 15194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.475580:0:13526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201330.475643:0:16267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788201330.475648:0:16267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7400/0x9383f985bc4d41b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d41bb expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201330.475662:0:16267:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788201330.475676:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201330.475686:0:16267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3200/0x9383f985bc4d4183 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d418a expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.475693:0:16267:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3200/0x9383f985bc4d4183 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d418a expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.475699:0:16267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3200/0x9383f985bc4d4183 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d418a expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.475707:0:16267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3200/0x9383f985bc4d4183 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d418a expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.475721:0:16267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201330.475727:0:16267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3400/0x9383f985bc4d40d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d40db expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.475733:0:16267:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3400/0x9383f985bc4d40d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d40db expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.475738:0:16267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3400/0x9383f985bc4d40d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d40db expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.475743:0:16267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3400/0x9383f985bc4d40d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d40db expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.475752:0:16267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788201330.475755:0:16267:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788201330.475758:0:16267:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000100:00100000:0.0:1788201330.475895:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788201330.475904:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b60c000b-7335-444d-a8dc-1a5956712fb2+18:3311:x1875064458248576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201330.475914:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201330.475923:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c20c2400/0x9383f985bc4d41bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d41b4 expref: 18 pid: 15194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.475932:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201330.475967:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b60c000b-7335-444d-a8dc-1a5956712fb2+17:3311:x1875064458248576:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201330.475974:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000020:01000004:1.0:1788201330.476048:0:16267:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788201330.476052:0:16267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:1.0:1788201330.476056:0:16267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1788201330.476061:0:16267:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00000100:00100000:2.0:1788201330.477449:0:13526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b60c000b-7335-444d-a8dc-1a5956712fb2+16:3313:x1875064458248448:12345-0@lo:103:ldlm_bl.0 Request processed in 1898us (2250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201330.477461:0:13526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788201330.477530:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c33f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458248576:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201330.477554:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201330.477562:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3200/0x9383f985bc4d4183 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d418a expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.477572:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3200 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:2.0:1788201330.477576:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3200/0x9383f985bc4d4183 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d418a expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.477584:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3200/0x9383f985bc4d4183 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9383f985bc4d418a expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201330.477592:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3200/0x9383f985bc4d4183 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9383f985bc4d418a expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201330.477597:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788201330.477599:0:5845:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788201330.477602:0:5845:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788201330.477630:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3200/0x9383f985bc4d4183 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d418a expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.477636:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201330.477663:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3200/0x9383f985bc4d4183 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d418a expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.477669:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3200/0x9383f985bc4d4183 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d418a expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.477679:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201330.477683:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3400/0x9383f985bc4d40d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d40db expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.477689:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3400 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:2.0:1788201330.477692:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3400/0x9383f985bc4d40d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d40db expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.477699:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3400/0x9383f985bc4d40d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9383f985bc4d40db expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201330.477706:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3400/0x9383f985bc4d40d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9383f985bc4d40db expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201330.477711:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788201330.477714:0:5845:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788201330.477716:0:5845:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788201330.477727:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3400/0x9383f985bc4d40d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d40db expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.477733:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201330.477740:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3400/0x9383f985bc4d40d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d40db expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.477747:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3400/0x9383f985bc4d40d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d40db expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000080:1.0:1788201330.478593:0:16267:0:(mdt_handler.c:8183:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000100:00100000:0.0:1788201330.478888:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458248704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201330.478951:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201330.479077:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201330.479081:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201330.479083:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201330.479146:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458248704 00000100:00100000:2.0:1788201330.479153:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458248704 00000100:00100000:2.0:1788201330.479202:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788201330.479210:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c7e15450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b60c000b-7335-444d-a8dc-1a5956712fb2+16:3311:x1875064458248704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201330.479222:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201330.479237:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c2cc7a00/0x9383f985bc4d418a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d4183 expref: 16 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.479251:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201330.479289:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c7e15450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b60c000b-7335-444d-a8dc-1a5956712fb2+15:3311:x1875064458248704:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201330.479318:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788201330.479377:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458248704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201330.479750:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c33f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458248448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201330.479776:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201330.479783:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458248832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201330.479812:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201330.479861:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201330.479972:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458248832 00000100:00100000:0.0:1788201330.479977:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458248832 00000100:00100000:0.0:1788201330.480014:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788201330.480021:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b60c000b-7335-444d-a8dc-1a5956712fb2+15:3313:x1875064458248832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201330.480031:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201330.480041:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c2cc7800/0x9383f985bc4d40db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d40d4 expref: 15 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.480056:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201330.480094:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b60c000b-7335-444d-a8dc-1a5956712fb2+14:3313:x1875064458248832:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201330.480101:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788201330.480163:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458248832:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1788201330.488903:0:16267:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 3/7 00000020:00080000:2.0:1788201330.488917:0:16267:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e04fae22800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788201330.488924:0:16267:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e04f976d000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788201330.488931:0:16267:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e04f48d2000 35604eb4-baf9-45be-a20a-4883a2cd8cf9 192.168.201.30@tcp 22 (0 0 17) 0 0 0 0: 0000000000000000 12884901940 stale:0 00000020:00080000:2.0:1788201330.488936:0:16267:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9e04d1c319c0) has exports, disconnecting them 00000020:00080000:2.0:1788201330.488940:0:16267:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e04fae22800), last request at 1788201328 00000020:00000080:2.0:1788201330.488948:0:16267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d447e 00000100:00080000:2.0:1788201330.488958:0:16267:0:(import.c:65:import_set_state_nolock()) ffff9e04fae20800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788201330.489022:0:16267:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e04fae22800): rc 0 00000020:00000080:2.0:1788201330.489025:0:16267:0:(genops.c:906:class_export_put()) final put ffff9e04fae22800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788201330.489043:0:16267:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e04f976d000), last request at 1788201328 00000020:00000080:2.0:1788201330.489052:0:16267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d4477 00000100:00080000:2.0:1788201330.489058:0:16267:0:(import.c:65:import_set_state_nolock()) ffff9e04f9768000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788201330.489102:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04fae22800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788201330.489153:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04fae20800 for lustre-MDT0000 00010000:00010000:1.0:1788201330.490898:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788201330.491139:0:16267:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e04f976d000): rc 0 00000020:00000080:2.0:1788201330.491143:0:16267:0:(genops.c:906:class_export_put()) final put ffff9e04f976d000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1788201330.491165:0:16267:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.201.30@tcp (ffff9e04f48d2000), last request at 1788201326 00000020:00000080:2.0:1788201330.491170:0:16267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d4121 00000020:00010000:2.0:1788201330.491185:0:16267:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e04f48d2000: total 1 00000100:00080000:2.0:1788201330.491188:0:16267:0:(import.c:65:import_set_state_nolock()) ffff9e04f9d82000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788201330.491228:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04f976d000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788201330.491271:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04f9768000 for lustre-MDT0000 00000020:00010000:0.0:1788201330.491510:0:5845:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e04f48d2000: total 0 00010000:00010000:0.0:1788201330.491561:0:5845:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e04f48d2000, canceled 0 locks, left on hash table 17. 00010000:00010000:0.0:1788201330.491599:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231be00/0x9383f985bc4d4b8c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5207 expref: 21 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.491620:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064200/0x9383f985bc4d48c2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x406:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50c5 expref: 20 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.491637:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d4860 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x404:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50a9 expref: 19 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.491652:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4400/0x9383f985bc4d4bc4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5215 expref: 18 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.491666:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5064800/0x9383f985bc4d47a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5078 expref: 17 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.491685:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28000/0x9383f985bc4d4891 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x405:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50b7 expref: 16 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.491715:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235e600/0x9383f985bc4d4b38 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x404:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c51f2 expref: 15 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.491733:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c231ae00/0x9383f985bc4d4b70 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5200 expref: 14 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.491745:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28a00/0x9383f985bc4d48f3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x407:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50d3 expref: 13 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.491870:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d4aba lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5151 expref: 12 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.491900:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2200/0x9383f985bc4d4924 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x408:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50e1 expref: 11 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.491913:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c5065a00/0x9383f985bc4d4955 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x409:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c50ef expref: 10 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.491929:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507dc00/0x9383f985bc4d4b00 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c51cf expref: 9 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.491945:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4c00/0x9383f985bc4d4ba8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c520e expref: 8 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.491963:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c19a8200/0x9383f985bc4d482f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x403:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c509b expref: 7 pid: 15284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.491986:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d47fe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c508d expref: 6 pid: 15179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.492002:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c235ee00/0x9383f985bc4d4b54 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x405:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c51f9 expref: 5 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.492016:0:5845:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e04f48d2000, canceled 17 locks, left on hash table 0. 00000020:00080000:1.0:1788201330.494032:0:16267:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.30@tcp (ffff9e04f48d2000): rc 0 00000004:00000080:1.0:1788201330.494044:0:16267:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffad6102cbfae0 00000100:00080000:1.0:1788201330.494085:0:16267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788201330.494090:0:16267:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968862 gen 3 00000100:00100000:1.0:1788201330.494100:0:16267:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e03c2202300 x1875064458246144/t4294968863(4294968863) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201379 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788201330.494109:0:16267:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c2202300, transno 4294968863 00000100:00100000:1.0:1788201330.494133:0:16267:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e04d80f0e00 x1875064458246400/t4294968864(4294968864) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201379 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788201330.494140:0:16267:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04d80f0e00, transno 4294968864 00000100:00100000:1.0:1788201330.494146:0:16267:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e04d80f3800 x1875064458246272/t4294968865(4294968865) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201379 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788201330.494152:0:16267:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04d80f3800, transno 4294968865 00000004:00080000:1.0:1788201330.494166:0:16267:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788201330.494242:0:16267:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788201330.494268:0:16267:0:(import.c:65:import_set_state_nolock()) ffff9e04cff4b000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788201330.494283:0:16267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788201330.494286:0:16267:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968862 gen 3 00000100:00100000:1.0:1788201330.494313:0:16267:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e03c12d0000 x1875064458245888/t4294968863(4294968863) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201379 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788201330.494319:0:16267:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c12d0000, transno 4294968863 00000100:00100000:1.0:1788201330.494330:0:16267:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e03c12d2a00 x1875064458246016/t4294968864(4294968864) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201379 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788201330.494335:0:16267:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c12d2a00, transno 4294968864 00000004:00080000:1.0:1788201330.494346:0:16267:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788201330.494451:0:16267:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788201330.494462:0:16267:0:(import.c:65:import_set_state_nolock()) ffff9e04c8363800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788201330.494495:0:16267:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9e04d1c319c0) has no exports 00000004:00080000:2.0:1788201330.494905:0:15201:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00000100:00100000:2.0:1788201330.494924:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458248960:0@lo:9:umount.0 00000100:00100000:2.0:1788201330.494994:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201330.495027:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5114e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458249088:0@lo:9:umount.0 00000100:00100000:2.0:1788201330.495049:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201330.495807:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458248960 00000100:00100000:1.0:1788201330.495817:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458248960 00000100:00100000:1.0:1788201330.495892:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458249088 00000100:00100000:1.0:1788201330.495896:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458249088 00000100:00100000:1.0:1788201330.495926:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4262 00000100:00100000:1.0:1788201330.495936:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3309:x1875064458248960:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788201330.495962:0:13449:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d4160 00000100:00080000:1.0:1788201330.495970:0:13449:0:(import.c:65:import_set_state_nolock()) ffff9e04c8354000 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1788201330.497290:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201330.497320:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788201330.497355:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201330.498393:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4263 00000100:00100000:2.0:1788201330.498414:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3309:x1875064458249088:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788201330.498444:0:13438:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d416e 00000100:00080000:2.0:1788201330.498455:0:13438:0:(import.c:65:import_set_state_nolock()) ffff9e04ff44d000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788201330.498494:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788201330.498504:0:13438:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968868 00000100:00100000:2.0:1788201330.498825:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+2:3309:x1875064458249088:12345-0@lo:9:umount.0 Request processed in 421us (3773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201330.498831:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4263 00000100:00100000:3.0:1788201330.498838:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968864 gen 3 00000100:00080000:3.0:1788201330.498846:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04c8363800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788201330.498859:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788201330.498862:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788201330.498868:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5114e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458249088:0@lo:9:umount.0 00000001:00000004:1.0:1788201330.500036:0:13449:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968868 00000100:00100000:1.0:1788201330.500363:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+2:3309:x1875064458248960:12345-0@lo:9:umount.0 Request processed in 4428us (5367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201330.500372:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4262 00010000:00010000:3.0:1788201330.501060:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201330.501160:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968865 gen 3 00000100:00080000:3.0:1788201330.501168:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04cff4b000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788201330.501310:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788201330.501583:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788201330.501590:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458248960:0@lo:9:umount.0 00000020:00080000:2.0:1788201330.502672:0:16267:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9e04d1c319c0) has no exports 00000020:00000080:0.0:1788201330.511679:0:5845:0:(genops.c:906:class_export_put()) final put ffff9e04f48d2000/35604eb4-baf9-45be-a20a-4883a2cd8cf9 00010000:00010000:0.0:1788201330.511714:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201330.511717:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201330.511720:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788201330.512178:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04f48d2000/35604eb4-baf9-45be-a20a-4883a2cd8cf9 for lustre-MDT0000 00000020:00000080:1.0:1788201330.512263:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04f9d82000 for lustre-MDT0000 00010000:00010000:3.0:1788201330.534850:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788201330.546436:0:16267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d4136 00000020:00000080:2.0:1788201330.546449:0:16267:0:(genops.c:906:class_export_put()) final put ffff9e04c8362000/lustre-QMT0000_UUID 00000020:01000000:2.0:1788201330.546464:0:16267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788201330.546537:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c8362000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788201330.546553:0:16267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201330.546564:0:16267:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788201330.546568:0:16267:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9e04ff1e3380) has no exports 00000020:00000080:1.0:1788201330.546822:0:16267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d412f 00000020:00000080:1.0:1788201330.546828:0:16267:0:(genops.c:906:class_export_put()) final put ffff9e04f5757800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788201330.546851:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04f5757800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788201330.546890:0:16267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201330.546897:0:16267:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788201330.546900:0:16267:0:(genops.c:906:class_export_put()) final put ffff9e04f0045000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788201330.546903:0:16267:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04f0045000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788201330.546910:0:16267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1788201330.547017:0:16267:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e03c2162180 - data ffff9e03c14295e8/ffff9e03c1f81400 00000020:01000000:1.0:1788201330.547111:0:16267:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e04c6b5a000 - data ffff9e04dd2b7798/ffff9e03c2452c00 00000100:00100000:3.0:1788201330.579169:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201330.579212:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201330.579243:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201330.579287:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201330.579337:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442706944 00000100:00100000:3.0:1788201330.579337:0:15178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442706816 00000100:00100000:0.0:1788201330.579346:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442706944 00000100:00100000:3.0:1788201330.579346:0:15178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442706816 00000100:00100000:0.0:1788201330.579385:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442707072 00000100:00100000:0.0:1788201330.579388:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442707072 00000100:00100000:3.0:1788201330.579391:0:15178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 84 00000100:00100000:3.0:1788201330.579399:0:15178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2362:x1875064442706816:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201330.579408:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 208 00000020:00080000:3.0:1788201330.579409:0:15178:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.30@tcp 00000100:00100000:0.0:1788201330.579414:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2362:x1875064442706944:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201330.579479:0:15178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2362:x1875064442706816:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 79us (234us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788201330.579487:0:15178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 84 00000100:00100000:3.0:1788201330.579512:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 209 00000100:00100000:3.0:1788201330.579519:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2362:x1875064442707072:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201330.579591:0:15173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442706688 00000100:00100000:2.0:1788201330.579596:0:15173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442706688 00000100:00100000:2.0:1788201330.579626:0:15173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 67 00000100:00100000:2.0:1788201330.579633:0:15173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04fae06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442706688:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201330.579679:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2362:x1875064442706944:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 264us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201330.579686:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 208 00000100:00080000:0.0:1788201330.579710:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201330.579713:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201330.579718:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2362:x1875064442707072:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 200us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201330.579725:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 209 00000100:00100000:2.0:1788201330.581003:0:15173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04fae06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442706688:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 1363us (1837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201330.581014:0:15173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 67 00000100:00080000:0.0:1788201330.581056:0:16267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788201330.581062:0:16267:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968865 gen 4 00000004:00080000:0.0:1788201330.581117:0:16267:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201330.581120:0:16267:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788201330.581713:0:15201:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788201330.581718:0:15201:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 5 count 4 00000040:00080000:2.0:1788201330.581728:0:15201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 3 count 2 00000100:00080000:0.0:1788201330.582031:0:16267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788201330.582034:0:16267:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968864 gen 4 00000004:00080000:0.0:1788201330.582045:0:16267:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201330.582047:0:16267:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788201330.582484:0:15203:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788201330.582488:0:15203:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 3 00000040:00080000:2.0:1788201330.582495:0:15203:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 3 count 2 00000020:00000080:2.0:1788201330.590866:0:16267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d40f7 00000020:00000080:2.0:1788201330.590888:0:16267:0:(genops.c:906:class_export_put()) final put ffff9e04c6b8d000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788201330.591923:0:16267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d410c 00000020:00000080:2.0:1788201330.591930:0:16267:0:(genops.c:906:class_export_put()) final put ffff9e04cff4e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201330.592043:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c6b8d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788201330.592099:0:16267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788201330.592104:0:16267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201330.592112:0:16267:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788201330.592116:0:16267:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9e04d1c30000) has no exports 00000004:01000000:2.0:1788201330.592326:0:16267:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788201330.592334:0:16267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d4167 00000020:00000080:2.0:1788201330.592338:0:16267:0:(genops.c:906:class_export_put()) final put ffff9e04c8365000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201330.592393:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04cff4e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788201330.592440:0:16267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788201330.592443:0:16267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201330.592449:0:16267:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788201330.592451:0:16267:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9e04eadc8000) has no exports 00000020:00000080:2.0:1788201330.592457:0:16267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d4159 00000020:00000080:2.0:1788201330.592461:0:16267:0:(genops.c:906:class_export_put()) final put ffff9e04c8364000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788201330.592482:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c8365000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:2.0:1788201330.592915:0:16267:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788201330.592919:0:16267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788201330.592923:0:16267:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968864 gen 5 00000004:00080000:2.0:1788201330.592928:0:16267:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788201330.592931:0:16267:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788201330.593002:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c8364000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788201330.593075:0:16267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201330.593082:0:16267:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201330.593087:0:16267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d414b 00000020:00000080:2.0:1788201330.593091:0:16267:0:(genops.c:906:class_export_put()) final put ffff9e04c6717000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201330.593110:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04c8363800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788201330.593114:0:38:0:(genops.c:906:class_export_put()) final put ffff9e04c6713800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201330.593116:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c6713800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788201330.593123:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788201330.593230:0:16267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788201330.593234:0:16267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201330.593239:0:16267:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788201330.593241:0:16267:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff9e04eadc99c0) has no exports 00000020:00000080:2.0:1788201330.593245:0:16267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d4144 00000020:00000080:2.0:1788201330.593248:0:16267:0:(genops.c:906:class_export_put()) final put ffff9e04cff4d000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788201330.597290:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c6717000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788201330.597329:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04cff4d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788201330.597529:0:16267:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788201330.597538:0:16267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788201330.597543:0:16267:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968865 gen 5 00000004:00080000:2.0:1788201330.597587:0:16267:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788201330.597589:0:16267:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788201330.597657:0:16267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201330.597666:0:16267:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201330.597697:0:16267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201330.597700:0:16267:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201330.597705:0:16267:0:(genops.c:906:class_export_put()) final put ffff9e04c6b8f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201330.597707:0:16267:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c6b8f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788201330.597713:0:16267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201330.597963:0:16267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d4113 00000020:00000080:2.0:1788201330.597974:0:16267:0:(genops.c:906:class_export_put()) final put ffff9e04cff4c000/lustre-MDD0000_UUID 00000020:00000080:0.0:1788201330.598225:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04cff4b000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788201330.598231:0:38:0:(genops.c:906:class_export_put()) final put ffff9e04c8361800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201330.598233:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c8361800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788201330.598237:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788201330.598419:0:16267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788201330.598424:0:16267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201330.598429:0:16267:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788201330.598433:0:16267:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9e04eadcb380) has no exports 00000020:00000080:2.0:1788201330.598451:0:16267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201330.598454:0:16267:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788201330.598459:0:16267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d411a 00000020:00000080:2.0:1788201330.598463:0:16267:0:(genops.c:906:class_export_put()) final put ffff9e04cff4f800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788201330.598499:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04cff4c000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788201330.598503:0:38:0:(genops.c:906:class_export_put()) final put ffff9e04cff48000/lustre-MDD0000_UUID 00000020:00000080:0.0:1788201330.598505:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04cff48000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788201330.598509:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:2.0:1788201330.598660:0:16267:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e03c371d800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788201330.598664:0:16267:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e03c371d800 3 00000020:01000004:2.0:1788201330.598667:0:16267:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e03c371d800 from lustre-MDT0000 00000020:00000080:2.0:1788201330.598715:0:16267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201330.598719:0:16267:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788201330.598721:0:16267:0:(genops.c:906:class_export_put()) final put ffff9e04c6b88800/lustre-MDT0000_UUID 00000020:00000080:2.0:1788201330.598724:0:16267:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c6b88800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788201330.598731:0:16267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788201330.598827:0:16267:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1788201330.598831:0:16267:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788201330.598834:0:16267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788201330.598837:0:16267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201330.598839:0:16267:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788201330.598847:0:16267:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9e03c5130000 7ad49433-54fa-4e21-b756-859420d95603 192.168.201.30@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788201330.598853:0:16267:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9e04ffc56800 b60c000b-7335-444d-a8dc-1a5956712fb2 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788201330.598857:0:16267:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9e04d1c33380) has exports, disconnecting them 00000020:00080000:2.0:1788201330.598862:0:16267:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.201.30@tcp (ffff9e03c5130000), last request at 1788201304 00000020:00000080:2.0:1788201330.598887:0:16267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d4485 00000020:00010000:2.0:1788201330.598891:0:16267:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e03c5130000: total 1 00000100:00080000:2.0:1788201330.598895:0:16267:0:(import.c:65:import_set_state_nolock()) ffff9e03c5132000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788201330.598935:0:16267:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.30@tcp (ffff9e03c5130000): rc 0 00000020:00080000:2.0:1788201330.598938:0:16267:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9e04ffc56800), last request at 1788201296 00000020:00000080:2.0:1788201330.598976:0:16267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d40b8 00000020:00010000:2.0:1788201330.598979:0:16267:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e04ffc56800: total 1 00000100:00080000:2.0:1788201330.598981:0:16267:0:(import.c:65:import_set_state_nolock()) ffff9e04ffc55000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788201330.599004:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04cff4f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:3.0:1788201330.599028:0:7645:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e03c5130000: total 0 00010000:00010000:3.0:1788201330.599060:0:7645:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e03c5130000, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1788201330.599085:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e04c0031c00/0x9383f985bc4d4493 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fc9 expref: 5 pid: 15194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.599099:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e04c0031400/0x9383f985bc4d44a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fd7 expref: 4 pid: 15194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.599110:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e04c0030a00/0x9383f985bc4d448c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fc2 expref: 3 pid: 15194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.599124:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c2ef2400/0x9383f985bc4d449a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c4fd0 expref: 2 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.599132:0:7645:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e03c5130000, canceled 4 locks, left on hash table 0. 00000020:00000080:3.0:1788201330.599144:0:7645:0:(genops.c:906:class_export_put()) final put ffff9e03c5130000/7ad49433-54fa-4e21-b756-859420d95603 00000020:00010000:3.0:1788201330.599157:0:7645:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e04ffc56800: total 1 00010000:00010000:3.0:1788201330.599160:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201330.599177:0:7645:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e04ffc56800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788201330.599191:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c5065000/0x9383f985bc4d421d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d4216 expref: 11 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.599202:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e04f9c0b200/0x9383f985bc4d420f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d4208 expref: 10 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.599212:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c2cc7c00/0x9383f985bc4d41c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d41c2 expref: 9 pid: 15194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.599220:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c1b96600/0x9383f985bc4d422b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d4224 expref: 8 pid: 15194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.599229:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c1b97000/0x9383f985bc4d41d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d41d0 expref: 7 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.599237:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c2cc6000/0x9383f985bc4d41e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d41de expref: 6 pid: 15172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.599247:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c20c3a00/0x9383f985bc4d41f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d41ec expref: 5 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.599255:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e04f9c0ac00/0x9383f985bc4d4201 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d41fa expref: 4 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.599263:0:7645:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e04ffc56800, canceled 8 locks, left on hash table 0. 00010000:00010000:3.0:1788201330.599270:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201330.599272:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201330.599274:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788201330.599321:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03c5130000/7ad49433-54fa-4e21-b756-859420d95603 for MGS 00000020:00000080:0.0:1788201330.599345:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e03c5132000 for MGS 00000020:00080000:2.0:1788201330.599442:0:16267:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e04ffc56800): rc 0 00000020:00000080:2.0:1788201330.599445:0:16267:0:(genops.c:906:class_export_put()) final put ffff9e04ffc56800/b60c000b-7335-444d-a8dc-1a5956712fb2 00000020:00080000:2.0:1788201330.599456:0:16267:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9e04d1c33380) has no exports 00000100:00100000:2.0:1788201330.599503:0:15194:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff9e04c56fe600:15194] 3 exiting: rc = 0 00000100:00100000:2.0:1788201330.599590:0:15172:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9e04c5725000:15172] 0 exiting: rc = 1 00000100:00100000:2.0:1788201330.599638:0:15173:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9e04c5724200:15173] 1 exiting: rc = 0 00000020:00000080:3.0:1788201330.599703:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04ffc56800/b60c000b-7335-444d-a8dc-1a5956712fb2 for MGS 00000020:00000080:3.0:1788201330.599731:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04ffc55000 for MGS 00000100:00100000:3.0:1788201330.599749:0:15174:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9e0501a64800:15174] 2 exiting: rc = 0 00000100:00100000:2.0:1788201330.599897:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.599905:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.599911:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.599918:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.599923:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.599929:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.599934:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.599940:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600086:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600095:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600101:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600106:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600111:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600116:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600122:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600127:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600132:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600140:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600145:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600149:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600154:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600159:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600165:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600170:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600176:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600181:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600186:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600191:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600196:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600200:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600205:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600209:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600214:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600371:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1788201330.600404:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201330.600453:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201330.600528:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600534:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600539:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600544:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600548:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600553:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600558:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600564:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600570:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600575:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600587:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600592:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600597:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600602:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600607:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600612:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600617:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600626:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600633:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600664:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600670:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600675:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600680:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600684:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600690:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600695:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600700:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600705:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600711:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.600716:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1788201330.601186:0:16267:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788201330.601190:0:16267:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1788201330.601753:0:16267:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e03c1b8f600 - data ffff9e04dd022bd0/ffff9e04e7847400 00000020:01000000:2.0:1788201330.601961:0:16267:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e03c2ec6f60 - data ffff9e04dd02a0d8/ffff9e03c2b87c00 00000020:00000080:2.0:1788201330.602528:0:16267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d40b1 00000020:00000080:2.0:1788201330.602537:0:16267:0:(genops.c:906:class_export_put()) final put ffff9e03c24d8800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788201330.602588:0:16267:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e03c371d800 from MGS, refs=2 00000020:01000004:2.0:1788201330.602592:0:16267:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e03c371d800 2 00000020:01000004:2.0:1788201330.602595:0:16267:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e03c371d800 from MGS 00000020:00000080:2.0:1788201330.602616:0:16267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201330.602623:0:16267:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788201330.602626:0:16267:0:(genops.c:906:class_export_put()) final put ffff9e03c24d9800/MGS 00000020:00000080:2.0:1788201330.602628:0:16267:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03c24d9800/MGS for MGS 00000020:01000000:2.0:1788201330.602635:0:16267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788201330.602696:0:16267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788201330.602700:0:16267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201330.602707:0:16267:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788201330.602714:0:16267:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9e04c6711000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788201330.602720:0:16267:0:(genops.c:1574:class_disconnect_exports()) OBD device 17 (ffff9e04eadccd40) has exports, disconnecting them 00000020:00080000:2.0:1788201330.602724:0:16267:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9e04c6711000), last request at 1788201297 00000020:00000080:2.0:1788201330.602729:0:16267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d41a6 00000020:00080000:2.0:1788201330.602738:0:16267:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e04c6711000): rc 0 00000020:00000080:2.0:1788201330.602743:0:16267:0:(genops.c:906:class_export_put()) final put ffff9e04c6711000/lustre-MDT0000-lwp-MDT0000 00000100:00100000:0.0:1788201330.602822:0:15284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442707200 00000100:00100000:0.0:1788201330.602832:0:15284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442707200 00000100:00100000:0.0:1788201330.602868:0:15284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 85 00000100:00100000:0.0:1788201330.602889:0:15284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2358:x1875064442707200:12345-192.168.201.30@tcp:38:ptlrpcd_01_01.0 00010000:00020000:0.0:1788201330.602906:0:15284:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201330.602971:0:15284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2358:x1875064442707200:12345-192.168.201.30@tcp:38:ptlrpcd_01_01.0 Request processed in 82us (2518us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201330.602979:0:15284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 85 00000020:00000080:3.0:1788201330.603349:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03c24d8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788201330.604206:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c6711000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788201330.604345:0:16267:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788201330.604350:0:16267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788201330.604354:0:16267:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788201330.604359:0:16267:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788201330.604466:0:16267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201330.604474:0:16267:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788201330.604482:0:16267:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e03c371d800 1 00000020:00000080:3.0:1788201330.604488:0:16267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d40a3 00000020:00000080:3.0:1788201330.604495:0:16267:0:(genops.c:906:class_export_put()) final put ffff9e03c24df800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788201330.604500:0:16267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788201330.604504:0:16267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201330.604508:0:16267:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788201330.604511:0:16267:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9e04ff1e4d40) has no exports 00000020:00000080:0.0:1788201330.604637:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04c8284000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788201330.604642:0:38:0:(genops.c:906:class_export_put()) final put ffff9e04c6716800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788201330.604644:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c6716800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788201330.604688:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788201330.604733:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03c24df800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788201330.614828:0:16267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201330.614843:0:16267:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788201330.614848:0:16267:0:(genops.c:906:class_export_put()) final put ffff9e03c371c000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788201330.614853:0:16267:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03c371c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788201330.614860:0:16267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788201330.614996:0:16267:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e03c3718800 00000020:01000000:0.0:1788201330.615021:0:16267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788201330.615024:0:16267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201330.615028:0:16267:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788201330.615031:0:16267:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9e04d1c34d40) has no exports 00000100:00100000:0.0:1788201330.615085:0:15284:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9e03c32c3400:15284] 3 exiting: rc = 0 00000100:00100000:0.0:1788201330.615172:0:15180:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9e03c376fe00:15180] 2 exiting: rc = 0 00000100:00100000:0.0:1788201330.617389:0:15179:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9e03c376fc00:15179] 1 exiting: rc = 0 00000100:00100000:0.0:1788201330.617485:0:15178:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9e03c31c4c00:15178] 0 exiting: rc = 1 00000100:00100000:0.0:1788201330.617542:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617550:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617555:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617560:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617565:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617570:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617575:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617580:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617586:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617591:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617597:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617602:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617608:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617613:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617618:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617623:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617630:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617635:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617639:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617644:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617649:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617654:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617659:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617665:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617670:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617675:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617680:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617685:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617690:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617695:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617700:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617705:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617710:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617715:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617719:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617724:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617730:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617735:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617742:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617747:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617752:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617757:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617942:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617949:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617954:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617959:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617965:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617969:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617974:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617980:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617986:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617992:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.617997:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.618003:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.618009:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.618013:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.618018:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.618023:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.618028:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.618034:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.618040:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.618050:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.618055:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.618061:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201330.622415:0:15181:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9e03c376e600:15181] 0 exiting: rc = 1 00000100:00100000:3.0:1788201330.622415:0:15182:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9e0501a64600:15182] 1 exiting: rc = 0 00000100:00100000:0.0:1788201330.622600:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622608:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622614:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622618:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622629:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622634:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622639:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622645:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622650:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622655:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622660:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622665:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622670:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622675:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622679:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622684:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622688:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622693:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622697:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622701:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622705:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622710:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622714:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622718:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622723:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622728:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622732:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622737:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622741:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622745:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622750:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622754:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622769:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622773:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622778:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622783:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622787:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622792:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622797:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622802:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622807:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622811:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622817:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622821:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622826:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622830:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622835:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622839:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622844:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622849:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622853:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622857:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622861:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622866:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622870:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622883:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622887:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622892:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622896:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622900:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622904:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622909:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622913:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.622918:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623241:0:15184:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9e0501a65e00:15184] 1 exiting: rc = 0 00000100:00100000:3.0:1788201330.623411:0:15183:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9e03c376e000:15183] 0 exiting: rc = 1 00000100:00100000:0.0:1788201330.623503:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623509:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623515:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623521:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623527:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623533:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623539:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623545:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623550:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623556:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623561:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623577:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623583:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623589:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623594:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623600:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623606:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623611:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623617:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623622:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623627:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623633:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623638:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623655:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623661:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623666:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623671:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623678:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623683:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623690:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623696:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623702:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623707:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623712:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623726:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623732:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623738:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623743:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623749:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623768:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623773:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623779:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623785:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623790:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623795:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623800:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623805:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623811:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623816:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623822:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623827:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623833:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623838:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623844:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623850:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623856:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623862:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623871:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623885:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623891:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623897:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623903:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623908:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.623914:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201330.632027:0:15185:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9e04d1193200:15185] 0 exiting: rc = 1 00000100:00100000:3.0:1788201330.633399:0:15186:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9e03c1892200:15186] 1 exiting: rc = 0 00000100:00100000:0.0:1788201330.633497:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633503:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633508:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633514:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633518:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633523:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633529:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633533:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633538:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633542:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633547:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633552:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633556:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633561:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633565:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633569:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633577:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633581:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633586:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633590:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633595:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633600:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633605:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633610:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633614:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633618:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633622:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633626:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633630:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633637:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633641:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633646:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633651:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633655:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633659:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633663:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633668:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633672:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633676:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633681:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633686:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633690:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633695:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633699:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633704:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633709:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633714:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633718:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633722:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633726:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633731:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633735:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633739:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633744:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633749:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633754:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633767:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633772:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633776:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633780:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633785:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633789:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633793:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.633798:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.634098:0:15188:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9e03c1892400:15188] 1 exiting: rc = 0 00000100:00100000:2.0:1788201330.636170:0:15187:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9e03c1892000:15187] 0 exiting: rc = 1 00000100:00100000:0.0:1788201330.636421:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636428:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636432:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636437:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636443:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636447:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636452:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636457:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636462:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636466:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636471:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636475:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636479:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636483:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636487:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636491:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636496:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636500:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636504:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636508:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636512:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636516:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636521:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636525:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636534:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636539:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636543:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636548:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636552:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636557:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636562:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636567:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636571:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636576:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636581:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636585:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636589:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636594:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636599:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636603:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636608:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636612:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636616:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636620:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636624:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636628:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636632:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636636:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636641:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636645:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636650:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636654:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636658:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636663:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636667:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636671:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636675:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636679:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636683:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636687:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636691:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636695:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636699:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.636704:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201330.637125:0:15190:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9e03c1892e00:15190] 1 exiting: rc = 0 00000100:00100000:2.0:1788201330.638951:0:15189:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9e04ff10ec00:15189] 0 exiting: rc = 1 00000100:00100000:2.0:1788201330.639043:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639048:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639052:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639057:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639062:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639066:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639071:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639076:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639081:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639086:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639096:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639102:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639107:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639111:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639116:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639121:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639126:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639131:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639135:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639140:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639145:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639149:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639153:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639157:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639161:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639165:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639169:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639174:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639178:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639182:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639186:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639190:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639194:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639199:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639203:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639207:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639211:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639215:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639219:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639224:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639228:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639233:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639237:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639241:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639245:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639249:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639253:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639257:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639261:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639265:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639269:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639274:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639279:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639283:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639287:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639291:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639316:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639320:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639324:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639328:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639333:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639337:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639341:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.639345:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201330.639944:0:15193:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9e04c5725400:15193] 2 exiting: rc = 0 00000100:00100000:2.0:1788201330.642052:0:15191:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9e03c32c4a00:15191] 0 exiting: rc = 1 00000100:00100000:2.0:1788201330.642461:0:15192:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9e04c56fe400:15192] 1 exiting: rc = 0 00000100:00100000:2.0:1788201330.642534:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642561:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642566:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642572:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642577:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642582:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642587:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642593:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642597:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642602:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642607:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642612:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642617:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642622:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642627:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642633:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642638:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642644:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642649:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642655:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642660:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642665:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642670:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642675:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642681:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642698:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642704:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642709:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642715:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642720:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642725:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642730:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642737:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642748:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.642999:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.643007:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.643013:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.643018:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.643027:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.643035:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.643044:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.643050:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.643055:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.643061:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.643066:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.643071:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.643076:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.643081:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.643087:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.643108:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.643114:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.643119:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.643124:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.643130:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.643135:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.643141:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.643148:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.643153:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.643158:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.643163:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.643168:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.643173:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.643178:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201330.643183:0:16267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788201330.649002:0:16267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201330.649016:0:16267:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788201330.649022:0:16267:0:(genops.c:906:class_export_put()) final put ffff9e03c24de000/MDS_uuid 00000020:00000080:3.0:1788201330.649027:0:16267:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03c24de000/MDS_uuid for MDS 00000020:01000000:3.0:1788201330.649038:0:16267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788201330.649231:0:16267:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788201331.560479:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201332.587196:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201333.605466:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201333.989886:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201333.989909:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458249344:0@lo:400:kworker.0 00000400:00000100:0.0:1788201333.989979:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458249344 offset 0 length 224: 4 00000100:00100000:0.0:1788201333.990149:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875064458249472:0@lo:400:kworker.0 00000400:00000100:0.0:1788201333.990169:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458249472 offset 0 length 224: 4 00000100:00100000:3.0:1788201333.990323:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458249216:0@lo:400:kworker.0 00000400:00000100:3.0:1788201333.990351:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875064458249216 offset 0 length 224: 4 00000001:00100000:2.0:1788201334.567751:0:7657:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201334.567762:0:7657:0:(genops.c:906:class_export_put()) final put ffff9e04f0044800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201334.567796:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04f0044800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788201334.567854:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04ff44d000 for lustre-OST0001 00000001:00100000:2.0:1788201334.578862:0:6732:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201334.578872:0:6732:0:(genops.c:906:class_export_put()) final put ffff9e04c6b8b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788201334.579001:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c6b8b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788201334.579069:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04c8354000 for lustre-OST0000 00010000:00010000:3.0:1788201334.632317:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201335.653566:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1788201335.697053:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.30@tcp portal 12 match 1875064442707456 offset 0 length 520: 4 00000400:00000100:3.0:1788201335.697081:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.30@tcp portal 26 match 1875064442707328 offset 0 length 224: 4 00000100:00100000:3.0:1788201335.698714:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201335.698825:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201335.705122:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442707712 00000100:00100000:2.0:1788201335.705138:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442707712 00000100:00100000:2.0:1788201335.705275:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442707584 00000100:00100000:2.0:1788201335.705279:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442707584 00000100:00080000:3.0:1788201335.705353:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201335.705358:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201335.708262:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 210 00000100:00100000:0.0:1788201335.708286:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2362:x1875064442707712:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201335.708406:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2362:x1875064442707712:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 130us (9699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201335.708413:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 210 00000100:00100000:0.0:1788201335.708434:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 211 00000100:00100000:0.0:1788201335.708442:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2362:x1875064442707584:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201335.708464:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2362:x1875064442707584:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (9640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201335.708470:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 211 00010000:00010000:0.0:1788201336.677459:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201337.701959:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201338.726032:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201339.112057:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875064458249856:0@lo:400:kworker.0 00000400:00000100:0.0:1788201339.112116:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458249856 offset 0 length 224: 4 00000100:00100000:1.0:1788201339.112130:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458249728:0@lo:400:kworker.0 00000400:00000100:1.0:1788201339.112163:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458249728 offset 0 length 224: 4 00000100:00100000:1.0:1788201339.112196:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201339.112203:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458249600:0@lo:400:kworker.0 00000400:00000100:1.0:1788201339.112225:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875064458249600 offset 0 length 224: 4 00010000:00010000:0.0:1788201339.749475:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201340.773735:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1788201340.824436:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.30@tcp portal 26 match 1875064442707840 offset 0 length 224: 4 00000100:00100000:1.0:1788201340.824480:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201340.824521:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201340.824626:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442708096 00000100:00100000:2.0:1788201340.824636:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442708096 00000100:00100000:2.0:1788201340.824716:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442707968 00000100:00100000:2.0:1788201340.824720:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442707968 00000100:00100000:2.0:1788201340.824748:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 212 00000100:00100000:2.0:1788201340.824762:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5115500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2361:x1875064442708096:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201340.824852:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5115500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2361:x1875064442708096:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 96us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201340.824863:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 212 00000100:00100000:2.0:1788201340.824879:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 213 00000100:00100000:2.0:1788201340.824886:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5117b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2361:x1875064442707968:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201340.825331:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5117b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2361:x1875064442707968:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 443us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201340.825340:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 213 00000100:00080000:3.0:1788201340.825405:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201340.825410:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788201341.798657:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201342.821784:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201343.848194:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201344.231846:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458250240:0@lo:400:kworker.0 00000400:00000100:1.0:1788201344.231903:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458250240 offset 0 length 224: 4 00000100:00100000:1.0:1788201344.231971:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201344.231977:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458250112:0@lo:400:kworker.0 00000400:00000100:1.0:1788201344.231995:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458250112 offset 0 length 224: 4 00000100:00100000:3.0:1788201344.232069:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201344.232080:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458249984:0@lo:400:kworker.0 00000400:00000100:3.0:1788201344.232104:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875064458249984 offset 0 length 224: 4 00010000:00010000:3.0:1788201344.872336:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201345.893860:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201345.942877:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000400:00000100:0.0:1788201345.942919:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.30@tcp portal 26 match 1875064442708224 offset 0 length 224: 4 00000100:00100000:0.0:1788201345.943233:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201345.943511:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442708352 00000100:00100000:2.0:1788201345.943520:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442708352 00000100:00100000:2.0:1788201345.943586:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442708480 00000100:00100000:2.0:1788201345.943590:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442708480 00000100:00100000:2.0:1788201345.943635:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 214 00000100:00100000:2.0:1788201345.943645:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5484000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2361:x1875064442708352:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201345.943719:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5484000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2361:x1875064442708352:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 76us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201345.943726:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 214 00000100:00100000:2.0:1788201345.943745:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 215 00000100:00100000:2.0:1788201345.943752:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2362:x1875064442708480:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201345.943778:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2362:x1875064442708480:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 27us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201345.943785:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 215 00000100:00080000:0.0:1788201345.943905:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201345.943910:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788201346.918640:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201347.944744:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201348.967744:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1788201349.094380:0:3311:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201333/real 1788201333] req@ffff9e03c5487800 x1875064458249472/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201349 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201349.140190:0:3311:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e03c5487800 x1875064458249472/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201349 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201349.140207:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788201349.140211:0:3311:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788201349.159566:0:3311:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00080000:0.0:1788201349.159933:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201349.159939:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201349.159943:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201349.159951:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 578 00000100:00080000:0.0:1788201349.159960:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e04f5751000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1788201349.159979:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e03c5484a80 x1875064458250624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000400:0.0:1788201349.160010:0:3311:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201333/real 1788201333] req@ffff9e03c5485f80 x1875064458249344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201349 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201349.160036:0:3311:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e03c5485f80 x1875064458249344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201349 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201349.160044:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788201349.160047:0:3311:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788201349.160050:0:3311:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00080000:0.0:1788201349.160062:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201349.160066:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201349.160068:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201349.160072:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 578 00000100:00080000:0.0:1788201349.160076:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e04ff4ba000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1788201349.160088:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e03c5486a00 x1875064458250752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201349.160116:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:0:1875064458250496:0@lo:400:kworker.0 00000100:00100000:0.0:1788201349.160124:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875064458249472:0@lo:400:kworker.0 00000100:00100000:0.0:1788201349.160128:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458249344:0@lo:400:kworker.0 00000100:00100000:0.0:1788201349.160153:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201349.160160:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458250368:0@lo:400:kworker.0 00000400:00000100:0.0:1788201349.160206:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875064458250368 offset 0 length 224: 4 00000100:00100000:3.0:1788201349.160328:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875064458250624:0@lo:38:kworker.0 00000400:00000100:3.0:1788201349.160355:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458250624 offset 0 length 520: 4 00000100:00100000:3.0:1788201349.160371:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875064458250752:0@lo:38:kworker.0 00000400:00000100:3.0:1788201349.160387:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458250752 offset 0 length 520: 4 00000100:00000400:2.0:1788201349.353639:0:3313:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201333/real 1788201333] req@ffff9e03c5484e00 x1875064458249216/t0(0) o400->MGC192.168.201.130@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788201349 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201349.353844:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e03c5484e00 x1875064458249216/t0(0) o400->MGC192.168.201.130@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788201349 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201349.353854:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9e04c6711800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788201349.353858:0:3313:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788201349.375413:0:3313:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.130@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788201349.375420:0:3313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788201349.375441:0:3313:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e03c5484e00 x1875064458249216/t0(0) o400->MGC192.168.201.130@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788201349 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201349.375459:0:3313:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e04f00dd180 x1875064458249600/t0(0) o400->MGC192.168.201.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201355 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201349.375469:0:3313:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e03c5117100 x1875064458249984/t0(0) o400->MGC192.168.201.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201360 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201349.375490:0:3313:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e03c5487b80 x1875064458250368/t0(0) o400->MGC192.168.201.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201365 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788201349.375511:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788201349.375515:0:3313:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788201349.375516:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788201349.375519:0:3313:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:2.0:1788201349.375577:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458249984:0@lo:400:kworker.0 00000100:00080000:2.0:1788201349.375612:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b60c000b-7335-444d-a8dc-1a5956712fb2->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201349.375616:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788201349.375619:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e04c6711800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201349.375625:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.130@tcp: connect to NID 0@lo last attempt 571 00000100:00080000:2.0:1788201349.375634:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.130@tcp: import ffff9e04c6711800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1788201349.375835:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e04f000e680 x1875064458250880/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201349.375884:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b60c000b-7335-444d-a8dc-1a5956712fb2:3309:1875064458250880:0@lo:250:kworker.0 00000400:00000100:2.0:1788201349.375936:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875064458250880 offset 0 length 520: 4 00000100:00100000:2.0:1788201349.375994:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458249600:0@lo:400:kworker.0 00000100:00100000:2.0:1788201349.376000:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458249216:0@lo:400:kworker.0 00000100:00100000:1.0:1788201349.376071:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458250368:0@lo:400:kworker.0 00000020:01000004:2.0:1788201349.595778:0:16708:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788201349.595784:0:16708:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788201349.595891:0:16708:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e03c37bf000 00000020:01000004:2.0:1788201349.595907:0:16708:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788201349.595919:0:16708:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788201349.595931:0:16708:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9e03c1fa99c0) 00000020:00000080:2.0:1788201349.595948:0:16708:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788201349.681118:0:16708:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788201349.699416:0:16708:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x37:0x0] (8/32) 00100000:10000000:2.0:1788201349.700844:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 436: rc = 0 00100000:10000000:2.0:1788201349.701796:0:16708:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788201349.701899:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 436: rc = 0 00100000:10000000:2.0:1788201349.702018:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 436: rc = 0 00100000:10000000:2.0:1788201349.702116:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 436: rc = 0 00100000:10000000:2.0:1788201349.702223:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 436: rc = 0 00100000:10000000:3.0:1788201349.703009:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 436: rc = 0 00100000:10000000:3.0:1788201349.710035:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 438: rc = 0 00100000:10000000:3.0:1788201349.734625:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 474: rc = 0 00100000:10000000:3.0:1788201349.734731:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 474: rc = 0 00100000:10000000:2.0:1788201349.738699:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 363: rc = 0 00100000:10000000:2.0:1788201349.739946:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 363: rc = 0 00100000:10000000:2.0:1788201349.741065:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 363: rc = 0 00100000:10000000:2.0:1788201349.742248:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 363: rc = 0 00100000:10000000:2.0:1788201349.747246:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 363: rc = 0 00100000:10000000:2.0:1788201349.750590:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 363: rc = 0 00100000:10000000:0.0:1788201349.762558:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 363: rc = 0 00100000:10000000:1.0:1788201349.764325:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 363: rc = 0 00100000:10000000:1.0:1788201349.769965:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 363: rc = 0 00100000:10000000:1.0:1788201349.771369:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 363: rc = 0 00100000:10000000:1.0:1788201349.783876:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 363: rc = 0 00100000:10000000:1.0:1788201349.786640:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 363: rc = 0 00100000:10000000:1.0:1788201349.797656:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 595: rc = 0 00100000:10000000:1.0:1788201349.810775:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 595: rc = 0 00100000:10000000:1.0:1788201349.815039:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 595: rc = 0 00100000:10000000:1.0:1788201349.828137:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 595: rc = 0 00100000:10000000:2.0:1788201349.836602:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 595: rc = 0 00100000:10000000:0.0:1788201349.852970:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 595: rc = 0 00100000:10000000:1.0:1788201349.854981:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 595: rc = 0 00100000:10000000:1.0:1788201349.856391:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 595: rc = 0 00100000:10000000:1.0:1788201349.857832:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 595: rc = 0 00100000:10000000:1.0:1788201349.858978:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 595: rc = 0 00100000:10000000:1.0:1788201349.860239:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 595: rc = 0 00100000:10000000:2.0:1788201349.878914:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 595: rc = 0 00100000:10000000:2.0:1788201349.886961:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 595: rc = 0 00100000:10000000:0.0:1788201349.888279:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 595: rc = 0 00100000:10000000:2.0:1788201349.892736:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 595: rc = 0 00100000:10000000:0.0:1788201349.895851:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 595: rc = 0 00100000:10000000:0.0:1788201349.904487:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 595: rc = 0 00100000:10000000:2.0:1788201349.914289:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 595: rc = 0 00100000:10000000:2.0:1788201349.918234:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 595: rc = 0 00100000:10000000:3.0:1788201349.919974:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 595: rc = 0 00100000:10000000:3.0:1788201349.924440:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 595: rc = 0 00100000:10000000:3.0:1788201349.925952:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 595: rc = 0 00100000:10000000:3.0:1788201349.927135:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 595: rc = 0 00100000:10000000:3.0:1788201349.928735:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 595: rc = 0 00100000:10000000:3.0:1788201349.929937:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 595: rc = 0 00100000:10000000:3.0:1788201349.930912:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 595: rc = 0 00100000:10000000:3.0:1788201349.932019:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 595: rc = 0 00100000:10000000:3.0:1788201349.933066:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 595: rc = 0 00100000:10000000:3.0:1788201349.934269:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 595: rc = 0 00100000:10000000:3.0:1788201349.935270:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 595: rc = 0 00100000:10000000:3.0:1788201349.936702:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 595: rc = 0 00100000:10000000:3.0:1788201349.937880:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 595: rc = 0 00100000:10000000:3.0:1788201349.939984:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 590: rc = 0 00100000:10000000:3.0:1788201349.941042:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000bd0:0x1:0x0] under 590: rc = 0 00100000:10000000:3.0:1788201349.944222:0:16708:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788201349.945181:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 359: rc = 0 00100000:10000000:3.0:1788201349.946317:0:16708:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788201349.946403:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 359: rc = 0 00100000:10000000:3.0:1788201349.947703:0:16708:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788201349.947790:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 359: rc = 0 00100000:10000000:2.0:1788201349.949684:0:16708:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788201349.949787:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 475: rc = 0 00100000:10000000:2.0:1788201349.951182:0:16708:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788201349.951280:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 475: rc = 0 00100000:10000000:2.0:1788201349.952648:0:16708:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788201349.952735:0:16708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 475: rc = 0 00000020:00000080:2.0:1788201349.953002:0:16708:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788201349.953010:0:16708:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788201349.953022:0:16708:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d4bee 00000020:01000004:2.0:1788201349.953031:0:16708:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788201349.953040:0:16708:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788201349.953045:0:16708:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e03c37bf000 from MGS 00000020:01000004:2.0:1788201349.953049:0:16708:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788201349.953060:0:16708:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9e03c1fab380) 00000020:00000080:2.0:1788201349.953070:0:16708:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788201349.953127:0:16708:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e03c37bf000 from MGS, refs=2 00080000:01000000:2.0:1788201349.953133:0:16708:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788201349.953138:0:16708:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d4bfc 00010000:00010000:2.0:1788201349.953243:0:16708:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-2 is initialized 00000040:01000000:2.0:1788201349.969883:0:16708:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788201349.969902:0:16708:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788201349.969904:0:16708:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788201349.975662:0:16709:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788201349.976197:0:16708:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788201349.976345:0:16708:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788201349.981832:0:16708:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788201349.982068:0:16708:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788201349.982230:0:16708:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788201349.982237:0:16708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788201349.983103:0:16708:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788201349.983111:0:16708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788201349.983698:0:16708:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788201349.983705:0:16708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788201349.984163:0:16708:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788201349.984184:0:16708:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1788201349.984186:0:16708:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.130@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1788201349.984190:0:16708:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.130@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:2.0:1788201349.984195:0:16708:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9e04c6711800 already not connected (conn 4, was 0): CONNECTING 00000100:00100000:2.0:1788201349.984200:0:16708:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00010000:00010000:3.0:1788201349.989464:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201350.044210:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201350.044357:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201350.044372:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201350.044430:0:16711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442708608 00000100:00100000:1.0:1788201350.044439:0:16711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442708608 00000100:00100000:1.0:1788201350.044507:0:16711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:1.0:1788201350.044515:0:16711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f950d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2362:x1875064442708608:12345-192.168.201.30@tcp:400:kworker.0 00000020:00080000:1.0:1788201350.044532:0:16711:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.30@tcp 00000100:00100000:1.0:1788201350.044615:0:16711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f950d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2362:x1875064442708608:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 99us (257us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788201350.044622:0:16711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00000400:00000100:0.0:1788201350.049749:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.30@tcp portal 12 match 1875064442708736 offset 0 length 520: 4 00000100:00100000:3.0:1788201350.051080:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442708864 00000100:00100000:3.0:1788201350.051092:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442708864 00000100:00080000:0.0:1788201350.051237:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201350.051288:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442708992 00000100:00100000:3.0:1788201350.051314:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442708992 00000100:00080000:0.0:1788201350.051369:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201350.052946:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 216 00000100:00100000:2.0:1788201350.052973:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2362:x1875064442708864:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201350.053075:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2362:x1875064442708864:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 112us (8874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201350.055338:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 217 00000100:00100000:0.0:1788201350.055365:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5487800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2362:x1875064442708992:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201350.055410:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 216 00000100:00100000:0.0:1788201350.055715:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5487800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2362:x1875064442708992:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 363us (11339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201350.055724:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 217 00000100:00100000:0.0:1788201350.067665:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201350.071858:0:16713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442709120 00000100:00100000:3.0:1788201350.071875:0:16713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442709120 00000100:00100000:3.0:1788201350.071935:0:16713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:3.0:1788201350.071944:0:16713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f950e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2358:x1875064442709120:12345-192.168.201.30@tcp:250:ptlrpcd_01_01.0 00010000:00080000:3.0:1788201350.071974:0:16713:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 7ad49433-54fa-4e21-b756-859420d95603@192.168.201.30@tcp t0 exp 0000000000000000 cur 625 last 0 00000020:00000080:3.0:1788201350.072005:0:16713:0:(genops.c:1406:class_connect()) connect: client 7ad49433-54fa-4e21-b756-859420d95603, cookie 0x9383f985bc4d4c03 00000100:00080000:3.0:1788201350.072141:0:16713:0:(import.c:65:import_set_state_nolock()) ffff9e04f48c8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201350.072276:0:16713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f950e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+5:2358:x1875064442709120:12345-192.168.201.30@tcp:250:ptlrpcd_01_01.0 Request processed in 331us (4621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201350.072284:0:16713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1 00010000:00010000:3.0:1788201351.014546:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201351.506912:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201351.507403:0:16712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442709248 00000100:00100000:3.0:1788201351.507418:0:16712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442709248 00000100:00100000:3.0:1788201351.507502:0:16712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:3.0:1788201351.507525:0:16712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+5:5601:x1875064442709248:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201351.507548:0:16712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201351.507583:0:16712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c5065000/0x9383f985bc4d4c0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c522a expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201351.507625:0:16712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c5065000/0x9383f985bc4d4c0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c522a expref: 6 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201351.507641:0:16712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c5065000/0x9383f985bc4d4c0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c522a expref: 6 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201351.507652:0:16712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5065000, rc 0) 00000100:00100000:3.0:1788201351.507735:0:16712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+6:5601:x1875064442709248:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 222us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201351.507742:0:16712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:0.0:1788201351.522793:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201351.524893:0:16713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442709376 00000100:00100000:3.0:1788201351.524917:0:16713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442709376 00000100:00100000:3.0:1788201351.525106:0:16713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:3.0:1788201351.525119:0:16713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+6:5601:x1875064442709376:12345-192.168.201.30@tcp:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788201351.525261:0:16713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+6:5601:x1875064442709376:12345-192.168.201.30@tcp:256:ll_cfg_requeue.0 Request processed in 144us (2486us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201351.525270:0:16713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:0.0:1788201351.548799:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201351.548926:0:16711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442709504 00000100:00100000:1.0:1788201351.548943:0:16711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442709504 00000100:00100000:1.0:1788201351.549023:0:16711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:1.0:1788201351.549036:0:16711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+6:5601:x1875064442709504:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201351.549062:0:16711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201351.549094:0:16711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e04f9ce5800/0x9383f985bc4d4c11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5231 expref: -99 pid: 16711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201351.549139:0:16711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e04f9ce5800/0x9383f985bc4d4c11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5231 expref: 7 pid: 16711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201351.549154:0:16711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e04f9ce5800/0x9383f985bc4d4c11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5231 expref: 7 pid: 16711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201351.549166:0:16711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9ce5800, rc 0) 00000100:00100000:1.0:1788201351.549389:0:16711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+7:5601:x1875064442709504:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 355us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201351.549409:0:16711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:1.0:1788201351.561532:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201351.561754:0:16713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442709632 00000100:00100000:3.0:1788201351.561768:0:16713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442709632 00000100:00100000:3.0:1788201351.561851:0:16713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:3.0:1788201351.561864:0:16713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+7:5601:x1875064442709632:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788201351.575832:0:16714:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788201351.577192:0:16713:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 11 20000000:01000000:3.0:1788201351.630402:0:16715:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788201351.630417:0:16715:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788201351.630421:0:16715:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788201351.630506:0:16715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788201351.631058:0:16713:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788201351.631173:0:16713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+8:5601:x1875064442709632:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 69304us (69659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201351.631194:0:16713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:2.0:1788201351.634761:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201351.635580:0:16712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442709760 00000100:00100000:0.0:1788201351.635595:0:16712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442709760 00000100:00100000:0.0:1788201351.635695:0:16712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:0.0:1788201351.635710:0:16712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+8:5601:x1875064442709760:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201351.636623:0:16712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+8:5601:x1875064442709760:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 Request processed in 909us (1871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201351.636637:0:16712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:2.0:1788201351.649167:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201351.649289:0:16713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442709888 00000100:00100000:0.0:1788201351.649332:0:16713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442709888 00000100:00100000:0.0:1788201351.649406:0:16713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:0.0:1788201351.649418:0:16713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+8:5601:x1875064442709888:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201351.649441:0:16713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201351.649474:0:16713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c507c000/0x9383f985bc4d4c18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5238 expref: -99 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201351.649528:0:16713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c507c000/0x9383f985bc4d4c18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5238 expref: 9 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201351.649541:0:16713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c507c000/0x9383f985bc4d4c18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5238 expref: 9 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201351.649552:0:16713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c507c000, rc 0) 00000100:00100000:0.0:1788201351.649632:0:16713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442709888:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 216us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201351.649640:0:16713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:1.0:1788201351.651416:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201351.655436:0:16712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442710016 00000100:00100000:0.0:1788201351.655469:0:16712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442710016 00000100:00100000:0.0:1788201351.655554:0:16712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:0.0:1788201351.655568:0:16712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442710016:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201351.656173:0:16712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442710016:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 605us (4775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201351.656183:0:16712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:2.0:1788201351.661952:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201351.662099:0:16713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442710144 00000100:00100000:0.0:1788201351.662115:0:16713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442710144 00000100:00100000:0.0:1788201351.662244:0:16713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:0.0:1788201351.662258:0:16713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442710144:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201351.663076:0:16713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442710144:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 Request processed in 815us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201351.663088:0:16713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:3.0:1788201351.670928:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201351.671150:0:16712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442710272 00000100:00100000:0.0:1788201351.671164:0:16712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442710272 00000100:00100000:0.0:1788201351.671237:0:16712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:0.0:1788201351.671249:0:16712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442710272:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201351.671272:0:16712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201351.671320:0:16712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c507dc00/0x9383f985bc4d4c1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c523f expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201351.671359:0:16712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c507dc00/0x9383f985bc4d4c1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c523f expref: 10 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201351.671373:0:16712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c507dc00/0x9383f985bc4d4c1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c523f expref: 10 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201351.671384:0:16712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c507dc00, rc 0) 00000100:00100000:0.0:1788201351.671812:0:16712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:5601:x1875064442710272:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 564us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201351.671821:0:16712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:2.0:1788201351.674112:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201351.674212:0:16713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442710400 00000100:00100000:0.0:1788201351.674223:0:16713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442710400 00000100:00100000:0.0:1788201351.674285:0:16713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:0.0:1788201351.674589:0:16713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:5601:x1875064442710400:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201351.675093:0:16713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:5601:x1875064442710400:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 795us (992us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201351.675103:0:16713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00010000:00010000:0.0:1788201352.037637:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201353.061646:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201354.086462:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788201354.469568:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b60c000b-7335-444d-a8dc-1a5956712fb2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201354.469582:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) b60c000b-7335-444d-a8dc-1a5956712fb2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201354.469586:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201354.469589:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201354.469593:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201354.469596:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788201355.109530:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201355.155441:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201355.155506:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201355.155592:0:13451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442710656 00000100:00100000:3.0:1788201355.155661:0:16712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442710528 00000100:00100000:1.0:1788201355.155667:0:13451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442710656 00000100:00100000:3.0:1788201355.155669:0:16712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442710528 00000100:00100000:3.0:1788201355.155740:0:16712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:1.0:1788201355.155741:0:13451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 218 00000100:00100000:3.0:1788201355.155755:0:16712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442710528:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201355.155757:0:13451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2362:x1875064442710656:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201355.155853:0:13451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2362:x1875064442710656:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 102us (346us total) trans 0 rc 0/0 00000100:00080000:2.0:1788201355.155855:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201355.155866:0:13451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 218 00000100:00100000:3.0:1788201355.161697:0:16712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442710528:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 5927us (6250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201355.161718:0:16712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:0.0:1788201355.162258:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201355.162866:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442710784 00000100:00100000:3.0:1788201355.162881:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442710784 00000100:00100000:3.0:1788201355.162965:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 219 00000100:00100000:3.0:1788201355.162977:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2361:x1875064442710784:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201355.163072:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2361:x1875064442710784:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 97us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201355.163080:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 219 00000100:00080000:2.0:1788201355.163526:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00000400:2.0:1788201355.430360:0:3310:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201339/real 1788201339] req@ffff9e04f00dc000 x1875064458249856/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201355 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201355.430406:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e04f00dc000 x1875064458249856/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201355 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201355.430415:0:3310:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff9e04f5751000 already not connected (conn 7, was 6): CONNECTING 00000100:00100000:2.0:1788201355.430435:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875064458249856:0@lo:400:kworker.0 00000100:00000400:2.0:1788201355.558577:0:3313:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201339/real 1788201339] req@ffff9e04f00df480 x1875064458249728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201355 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201355.558630:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e04f00df480 x1875064458249728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201355 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201355.558639:0:3313:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff9e04ff4ba000 already not connected (conn 7, was 6): CONNECTING 00000100:00100000:2.0:1788201355.558664:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458249728:0@lo:400:kworker.0 00010000:00010000:3.0:1788201356.136582:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201357.157916:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201358.183956:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201359.210247:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201359.589685:0:3309:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201349/real 1788201349] req@ffff9e04f000e680 x1875064458250880/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788201359 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201359.589735:0:3309:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e04f000e680 x1875064458250880/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788201359 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201359.589750:0:3309:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201349/real 1788201349] req@ffff9e03c5484a80 x1875064458250624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201359 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201359.589765:0:3309:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e03c5484a80 x1875064458250624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201359 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201359.589776:0:3309:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201349/real 1788201349] req@ffff9e03c5486a00 x1875064458250752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201359 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201359.589788:0:3309:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e03c5486a00 x1875064458250752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201359 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201359.589810:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04c6711800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201359.589842:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788201359.589859:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b60c000b-7335-444d-a8dc-1a5956712fb2:3309:1875064458250880:0@lo:250:kworker.0 00000100:00080000:2.0:1788201359.589867:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201359.589873:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788201359.589877:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875064458250624:0@lo:38:kworker.0 00000100:00080000:2.0:1788201359.589883:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201359.589887:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788201359.589890:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875064458250752:0@lo:38:kworker.0 10000000:01000000:3.0:1788201359.590117:0:16708:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:3.0:1788201359.590140:0:16708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3c00/0x9383f985bc4d4208 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4d420f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201359.590153:0:16708:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3c00/0x9383f985bc4d4208 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4d420f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201359.590161:0:16708:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788201359.590184:0:16708:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201359.590196:0:16708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3c00/0x9383f985bc4d4208 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4d420f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201359.590223:0:16708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3800/0x9383f985bc4d41c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4d41c9 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201359.590230:0:16708:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3800/0x9383f985bc4d41c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4d41c9 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201359.590236:0:16708:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201359.590239:0:16708:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201359.590243:0:16708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3800/0x9383f985bc4d41c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4d41c9 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201359.590263:0:16708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7600/0x9383f985bc4d41d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4d41d7 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201359.590271:0:16708:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7600/0x9383f985bc4d41d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4d41d7 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201359.590276:0:16708:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201359.590280:0:16708:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201359.590283:0:16708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7600/0x9383f985bc4d41d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4d41d7 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201359.590338:0:16708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2a00/0x9383f985bc4d41ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4d41f3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201359.590357:0:16708:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2a00/0x9383f985bc4d41ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4d41f3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201359.590363:0:16708:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201359.590368:0:16708:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201359.590397:0:16708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2a00/0x9383f985bc4d41ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4d41f3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201359.590412:0:16708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2600/0x9383f985bc4d41fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4d4201 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201359.590418:0:16708:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2600/0x9383f985bc4d41fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4d4201 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201359.590423:0:16708:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201359.590426:0:16708:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201359.590429:0:16708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c20c2600/0x9383f985bc4d41fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4d4201 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201359.590437:0:16708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c5064a00/0x9383f985bc4d4224 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4d422b expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201359.590443:0:16708:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c5064a00/0x9383f985bc4d4224 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4d422b expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201359.590448:0:16708:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201359.590451:0:16708:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201359.590454:0:16708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c5064a00/0x9383f985bc4d4224 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4d422b expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201359.590466:0:16708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d41de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4d41e5 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201359.590473:0:16708:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d41de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4d41e5 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201359.590483:0:16708:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788201359.590486:0:16708:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201359.590490:0:16708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d41de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4d41e5 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201359.590499:0:16708:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3600/0x9383f985bc4d4216 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4d421d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201359.590505:0:16708:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3600/0x9383f985bc4d4216 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4d421d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201359.590509:0:16708:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788201359.590512:0:16708:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201359.590515:0:16708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c20c3600/0x9383f985bc4d4216 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4d421d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788201359.590532:0:16708:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9e04c6711800 already not connected (conn 4, was 0): DISCONN 00000100:00080000:3.0:1788201359.590538:0:16708:0:(import.c:65:import_set_state_nolock()) ffff9e04c6711800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201359.590545:0:16708:0:(import.c:510:import_select_connection()) MGC192.168.201.130@tcp: connect to NID 0@lo last attempt 624 00000100:00080000:3.0:1788201359.590552:0:16708:0:(import.c:589:import_select_connection()) MGC192.168.201.130@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788201359.590558:0:16708:0:(import.c:624:import_select_connection()) MGC192.168.201.130@tcp: import ffff9e04c6711800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1788201359.590601:0:16708:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e04f00ddc00 x1875064458251008/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201359.590621:0:16708:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:0.0:1788201359.591703:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) b60c000b-7335-444d-a8dc-1a5956712fb2->MGS: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201359.591712:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) b60c000b-7335-444d-a8dc-1a5956712fb2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201359.591715:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201359.591720:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201359.591724:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201359.591732:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 624 00000100:00080000:0.0:1788201359.591736:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788201359.591743:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e04ff4ba000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1788201359.591780:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e03c5486680 x1875064458251136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201359.591796:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201359.591799:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201359.591801:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201359.591805:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 624 00000100:00080000:0.0:1788201359.591807:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788201359.591810:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e04f5751000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1788201359.591820:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e03c5485180 x1875064458251264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201359.594730:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b60c000b-7335-444d-a8dc-1a5956712fb2:3309:1875064458251008:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788201359.594855:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201359.594933:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875064458251136:0@lo:38:kworker.0 00000400:00000100:2.0:1788201359.594956:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458251136 offset 0 length 520: 4 00000100:00100000:2.0:1788201359.594973:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875064458251264:0@lo:38:kworker.0 00000400:00000100:2.0:1788201359.594989:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458251264 offset 0 length 520: 4 00000100:00100000:0.0:1788201359.595551:0:16713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458251008 00000100:00100000:0.0:1788201359.595566:0:16713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458251008 00000100:00100000:0.0:1788201359.595626:0:16713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201359.595635:0:16713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3309:x1875064458251008:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788201359.595686:0:16713:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from b60c000b-7335-444d-a8dc-1a5956712fb2@0@lo t0 exp 0000000000000000 cur 634 last 0 00000020:00000080:0.0:1788201359.595828:0:16713:0:(genops.c:1406:class_connect()) connect: client b60c000b-7335-444d-a8dc-1a5956712fb2, cookie 0x9383f985bc4d4c26 00000100:00080000:0.0:1788201359.597126:0:16713:0:(import.c:65:import_set_state_nolock()) ffff9e04fae42000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201359.598738:0:16713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+5:3309:x1875064458251008:12345-0@lo:250:mount.lustre.0 Request processed in 3093us (3873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201359.598755:0:16713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788201359.601037:0:3309:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.130@tcp: committing for last_committed 0 gen 4 00000100:00080000:2.0:1788201359.601060:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.130@tcp: connect to target with instance 0 00000100:00080000:2.0:1788201359.601073:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.130@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788201359.601081:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788201359.601088:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04c6711800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788201359.601091:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788201359.601139:0:3309:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788201359.601159:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b60c000b-7335-444d-a8dc-1a5956712fb2:3309:1875064458251008:0@lo:250:mount.lustre.0 00000020:01000000:1.0:1788201359.601440:0:36:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.201.130@tcp 10000000:01000000:1.0:1788201359.601468:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1788201359.601471:0:36:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1788201359.601474:0:36:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201359.601476:0:36:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201359.601477:0:36:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201359.601478:0:36:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201359.601480:0:36:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201359.601482:0:36:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201359.601484:0:36:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201359.601486:0:36:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1788201359.601550:0:36:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1788201359.601557:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1788201359.601560:0:36:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1788201359.601561:0:36:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788201359.601562:0:36:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201359.601563:0:36:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201359.601564:0:36:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201359.601566:0:36:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201359.601567:0:36:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201359.601568:0:36:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201359.601569:0:36:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1788201359.601586:0:36:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1788201359.601799:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458251392:0@lo:253:kworker.0 00000100:00100000:2.0:1788201359.601888:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201359.601946:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201359.601952:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5116d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458251520:0@lo:253:kworker.0 00000100:00100000:2.0:1788201359.601987:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201359.602031:0:16711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458251392 00000100:00100000:2.0:1788201359.602039:0:16711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458251392 00000100:00100000:2.0:1788201359.602080:0:16711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458251520 00000100:00100000:2.0:1788201359.602084:0:16711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458251520 00000100:00100000:2.0:1788201359.602102:0:16711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788201359.602111:0:16711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+6:3312:x1875064458251392:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1788201359.602148:0:16711:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788201359.602164:0:16711:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788201359.602433:0:16712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788201359.602445:0:16712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+6:3312:x1875064458251520:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1788201359.602462:0:16712:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00080000:3.0:1788201359.602572:0:16708:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:3.0:1788201359.602588:0:16708:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788201359.602596:0:16708:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788201359.602617:0:16708:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9e04eadccd40) 00000020:00000080:3.0:1788201359.602637:0:16708:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788201359.628525:0:16708:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788201359.628712:0:16708:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788201359.628719:0:16708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788201359.629854:0:16708:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788201359.629970:0:16708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788201359.630537:0:16708:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788201359.630544:0:16708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788201359.631682:0:16708:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788201359.631824:0:16708:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788201359.631829:0:16708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788201359.633003:0:16708:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788201359.633011:0:16708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 20000000:01000000:0.0:1788201359.667656:0:16711:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788201359.667669:0:16711:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788201359.667689:0:16714:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788201359.667693:0:16714:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788201359.667716:0:16714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e03c507d400/0x9383f985bc4d4c34 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201359.667737:0:16714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e03c5065000/0x9383f985bc4d4c0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c522a expref: 9 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201359.667746:0:16714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e03c507d400/0x9383f985bc4d4c34 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201359.667782:0:16714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e03c5065000/0x9383f985bc4d4c0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c522a expref: 9 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201359.667797:0:16714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e03c5065000/0x9383f985bc4d4c0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c522a expref: 9 pid: 16712 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201359.667812:0:16714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5485500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16714:1875064458251648:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201359.667924:0:16714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c83f6480 going to sleep for 11 seconds 20000000:01000000:1.0:1788201359.671332:0:16712:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788201359.676922:0:16708:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788201359.677110:0:16708:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788201359.677117:0:16708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788201359.678202:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201359.679169:0:16708:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788201359.679179:0:16708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788201359.679582:0:16708:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788201359.679737:0:16708:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788201359.679742:0:16708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788201359.679812:0:16714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5485500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16714:1875064458251648:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201359.679848:0:16714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e03c507d400/0x9383f985bc4d4c34 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201359.680221:0:16708:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788201359.680228:0:16708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788201359.680409:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442711424 00000100:00100000:2.0:1788201359.680417:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442711424 00010000:00010000:2.0:1788201359.680447:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e03c5065000/0x9383f985bc4d4c0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c522a expref: 10 pid: 16712 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201359.680476:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1559 00000100:00100000:2.0:1788201359.680485:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5114000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442711424:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201359.680499:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201359.680505:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e03c5065000/0x9383f985bc4d4c0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c522a expref: 10 pid: 16712 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201359.680518:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e03c5065000/0x9383f985bc4d4c0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c522a expref: 10 pid: 16712 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201359.680536:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c5065000/0x9383f985bc4d4c0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c522a expref: 10 pid: 16712 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201359.680553:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e03c507d400/0x9383f985bc4d4c34 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201359.680562:0:13458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c507d400/0x9383f985bc4d4c34 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788201359.680576:0:13458:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012883254s 00010000:00010000:2.0:1788201359.680581:0:13458:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03c507d400/0x9383f985bc4d4c34 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201359.680588:0:13458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03c507d400/0x9383f985bc4d4c34 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201359.680595:0:13458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e03c507d400/0x9383f985bc4d4c34 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201359.680602:0:13458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e03c507d400/0x9383f985bc4d4c34 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201359.680608:0:13458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201359.680613:0:13458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e03c507d400/0x9383f985bc4d4c34 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201359.680621:0:13458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e03c507d400/0x9383f985bc4d4c34 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201359.680633:0:13458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e03c507d400/0x9383f985bc4d4c34 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201359.680641:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201359.680692:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5114000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7ad49433-54fa-4e21-b756-859420d95603+9:2360:x1875064442711424:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 207us (2496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201359.680699:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1559 00010000:00010000:0.0:1788201359.681154:0:16714:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e03c507d400/0x9383f985bc4d4c34 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201359.681167:0:16714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e03c507d400/0x9383f985bc4d4c34 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201359.681174:0:16714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c507d400/0x9383f985bc4d4c34 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201359.681788:0:16708:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788201359.682047:0:16708:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788201359.682053:0:16708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788201359.682505:0:16708:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788201359.682512:0:16708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788201359.686244:0:16708:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788201359.686962:0:16708:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788201359.686969:0:16708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788201359.688983:0:16708:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788201359.688994:0:16708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788201359.704850:0:16708:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201359.705001:0:16708:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788201359.705006:0:16708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788201359.710696:0:16708:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788201359.710709:0:16708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788201359.712507:0:16708:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788201359.712519:0:16708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788201359.715144:0:16708:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788201359.715474:0:16708:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788201359.715481:0:16708:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788201359.715758:0:16708:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.130@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788201359.715797:0:16708:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.130@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788201359.715802:0:16708:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788201359.715803:0:16708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788201359.715805:0:16708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201359.715806:0:16708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201359.715807:0:16708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201359.715809:0:16708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201359.715810:0:16708:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201359.715813:0:16708:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788201359.715815:0:16708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201359.715816:0:16708:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788201359.715818:0:16708:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788201359.715821:0:16708:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788201359.715822:0:16708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788201359.715823:0:16708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201359.715824:0:16708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201359.715826:0:16708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201359.715827:0:16708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201359.715828:0:16708:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201359.715829:0:16708:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788201359.715831:0:16708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201359.715832:0:16708:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788201359.715858:0:16708:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788201359.715879:0:16708:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5485500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:16708:1875064458251776:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788201359.717153:0:16708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201359.717190:0:16708:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7fd2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201359.717212:0:16713:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:0.0:1788201359.717220:0:16713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:0.0:1788201359.717652:0:16713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458251776 00000100:00100000:0.0:1788201359.717660:0:16713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458251776 00000100:00100000:3.0:1788201359.717902:0:16738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788201359.717913:0:16738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+7:16708:x1875064458251776:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788201359.718079:0:16738:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788201359.718082:0:16738:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788201359.718086:0:16738:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:3.0:1788201359.718092:0:16738:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788201359.727364:0:16712:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788201359.727389:0:16712:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788201359.727432:0:16714:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788201359.727440:0:16714:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788201359.727470:0:16714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e03c507d400/0x9383f985bc4d4c3b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201359.727488:0:16714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c507d400/0x9383f985bc4d4c3b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788201359.727497:0:16714:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012883254s 00010000:00010000:0.0:1788201359.727503:0:16714:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03c507d400/0x9383f985bc4d4c3b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201359.727509:0:16714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03c507d400/0x9383f985bc4d4c3b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201359.727518:0:16714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e03c507d400/0x9383f985bc4d4c3b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201359.727525:0:16714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e03c507d400/0x9383f985bc4d4c3b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201359.727532:0:16714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201359.727536:0:16714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e03c507d400/0x9383f985bc4d4c3b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201359.727544:0:16714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e03c507d400/0x9383f985bc4d4c3b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201359.727557:0:16714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e03c507d400/0x9383f985bc4d4c3b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201359.727565:0:16714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e03c507d400/0x9383f985bc4d4c3b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201359.727571:0:16714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c507d400/0x9383f985bc4d4c3b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201359.731286:0:16711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+7:3312:x1875064458251392:12345-0@lo:253:kworker.0 Request processed in 129167us (129389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201359.731329:0:16711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000020:01000004:2.0:1788201359.731650:0:3312:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788201359.731653:0:3312:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788201359.731655:0:3312:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201359.731657:0:3312:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201359.731658:0:3312:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201359.731660:0:3312:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201359.731661:0:3312:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201359.731663:0:3312:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201359.731665:0:3312:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788201359.731668:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458251392:0@lo:253:kworker.0 00000100:00100000:3.0:1788201359.739085:0:16738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+6:16708:x1875064458251776:12345-0@lo:253:mount.lustre.0 Request processed in 21163us (21924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201359.739101:0:16738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788201359.739244:0:16708:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5485500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:16708:1875064458251776:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788201359.739269:0:16708:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788201359.739273:0:16708:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788201359.739275:0:16708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788201359.739276:0:16708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201359.739277:0:16708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201359.739279:0:16708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201359.739280:0:16708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201359.739282:0:16708:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201359.739283:0:16708:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788201359.739286:0:16708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201359.739288:0:16708:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788201359.739332:0:16708:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e03c37bf000 from lustre-MDT0000 10000000:01000000:1.0:1788201359.739382:0:16708:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788201359.739386:0:16708:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788201359.739394:0:16708:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e03c37bf000 10000000:01000000:1.0:1788201359.739398:0:16708:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788201359.739404:0:16708:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e03c37bf000 10000000:01000000:1.0:1788201359.739406:0:16708:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788201359.739410:0:16708:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9e03c37bf000 from 1 10000000:01000000:1.0:1788201359.739413:0:16708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788201359.739885:0:16708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce5e00/0x9383f985bc4d4c42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201359.739898:0:16708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce5e00/0x9383f985bc4d4c42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201359.739908:0:16708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce5e00/0x9383f985bc4d4c42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201359.739930:0:16708:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5115180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:16708:1875064458251904:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201359.739974:0:16708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201359.740061:0:16708:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201359.740166:0:16713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458251904 00000100:00100000:2.0:1788201359.740173:0:16713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458251904 00000100:00100000:2.0:1788201359.740210:0:16713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788201359.740220:0:16713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04e7857050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+6:16708:x1875064458251904:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201359.740234:0:16713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201359.740248:0:16713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0501b29200/0x9383f985bc4d4c49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d4c42 expref: -99 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201359.740281:0:16713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0501b29200/0x9383f985bc4d4c49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d4c42 expref: 7 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201359.740310:0:16713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0501b29200/0x9383f985bc4d4c49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d4c42 expref: 7 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201359.740321:0:16713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0501b29200, rc 0) 00000100:00100000:2.0:1788201359.740675:0:16713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04e7857050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+7:16708:x1875064458251904:12345-0@lo:101:mount.lustre.0 Request processed in 457us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201359.740683:0:16713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788201359.740748:0:16708:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5115180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:16708:1875064458251904:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201359.740762:0:16708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce5e00/0x9383f985bc4d4c42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4c49 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201359.740772:0:16708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce5e00/0x9383f985bc4d4c42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d4c49 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201359.740791:0:16708:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00000100:00100000:2.0:1788201359.740885:0:16712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+6:3312:x1875064458251520:12345-0@lo:253:kworker.0 Request processed in 138444us (138897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201359.740894:0:16712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000020:01000004:3.0:1788201359.740946:0:3312:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1788201359.740949:0:3312:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788201359.740951:0:3312:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201359.740952:0:3312:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201359.740954:0:3312:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201359.740955:0:3312:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201359.740956:0:3312:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201359.740958:0:3312:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201359.740959:0:3312:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788201359.740962:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5116d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458251520:0@lo:253:kworker.0 00010000:00010000:1.0:1788201359.740996:0:16708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce5e00/0x9383f985bc4d4c42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4c49 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201359.741005:0:16708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce5e00/0x9383f985bc4d4c42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4c49 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201359.741012:0:16708:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788201359.741016:0:16708:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788201359.741021:0:16708:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e03c37bf000 10000000:01000000:1.0:1788201359.741024:0:16708:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788201359.741027:0:16708:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788201359.741030:0:16708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788201359.741050:0:16708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4000/0x9383f985bc4d4c50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201359.741056:0:16708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4000/0x9383f985bc4d4c50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201359.741064:0:16708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4000/0x9383f985bc4d4c50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201359.741078:0:16708:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5115180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:16708:1875064458252032:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201359.741106:0:16708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201359.741135:0:16708:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201359.741147:0:16738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458252032 00000100:00100000:3.0:1788201359.741152:0:16738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458252032 00000100:00100000:3.0:1788201359.741185:0:16738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788201359.741192:0:16738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04e7854850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+6:16708:x1875064458252032:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201359.741202:0:16738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201359.741211:0:16738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c5064a00/0x9383f985bc4d4c57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d4c50 expref: -99 pid: 16738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201359.741226:0:16738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c5064a00/0x9383f985bc4d4c57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d4c50 expref: 7 pid: 16738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201359.741232:0:16738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c5064a00/0x9383f985bc4d4c57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d4c50 expref: 7 pid: 16738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201359.741236:0:16738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5064a00, rc 0) 00000100:00100000:3.0:1788201359.741265:0:16738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04e7854850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+7:16708:x1875064458252032:12345-0@lo:101:mount.lustre.0 Request processed in 74us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201359.741271:0:16738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788201359.741451:0:16708:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5115180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:16708:1875064458252032:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201359.741462:0:16708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4000/0x9383f985bc4d4c50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4c57 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201359.741573:0:16708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4000/0x9383f985bc4d4c50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d4c57 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201359.741627:0:16708:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5115180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:16708:1875064458252160:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201359.741654:0:16708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201359.741679:0:16708:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201359.741732:0:16713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458252160 00000100:00100000:2.0:1788201359.741737:0:16713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458252160 00000100:00100000:2.0:1788201359.741766:0:16713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788201359.741773:0:16713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04e7856850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+7:16708:x1875064458252160:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201359.743045:0:16713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04e7856850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+8:16708:x1875064458252160:12345-0@lo:501:mount.lustre.0 Request processed in 1270us (1387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201359.743053:0:16713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788201359.743114:0:16708:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5115180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:16708:1875064458252160:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201359.743151:0:16708:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5115180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:16708:1875064458252288:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201359.743183:0:16708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201359.743234:0:16708:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201359.743328:0:16711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458252288 00000100:00100000:2.0:1788201359.743335:0:16711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458252288 00000100:00100000:2.0:1788201359.743384:0:16711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788201359.743392:0:16711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04e7857850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+8:16708:x1875064458252288:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201359.750157:0:16711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04e7857850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+8:16708:x1875064458252288:12345-0@lo:503:mount.lustre.0 Request processed in 6758us (6964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201359.750171:0:16711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788201359.750243:0:16708:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5115180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:16708:1875064458252288:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201359.750922:0:16739:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:16739:1875064458252416:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201359.750975:0:16739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201359.751015:0:16739:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7ca9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201359.751043:0:16712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458252416 00000100:00100000:1.0:1788201359.751050:0:16712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458252416 00000100:00100000:1.0:1788201359.751092:0:16712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788201359.751101:0:16712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04e7855c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+8:16739:x1875064458252416:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201359.753934:0:16739:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:16739:1875064458252416:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788201359.753985:0:16739:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:1.0:1788201359.753989:0:16712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04e7855c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+8:16739:x1875064458252416:12345-0@lo:502:llog_process_th.0 Request processed in 2888us (3013us total) trans 0 rc 0/0 00000020:00000080:2.0:1788201359.753997:0:16739:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000100:00100000:1.0:1788201359.753999:0:16712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000020:00000080:2.0:1788201359.753999:0:16739:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788201359.754005:0:16739:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788201359.754009:0:16739:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201359.754024:0:16739:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9e03c1fa8000) 00000020:00000080:2.0:1788201359.754045:0:16739:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788201359.754051:0:16739:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788201359.754127:0:16739:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788201359.754133:0:16739:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d4c65 00000020:00000080:2.0:1788201359.754353:0:16739:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788201359.754356:0:16739:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201359.754360:0:16739:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201359.754361:0:16739:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788201359.754363:0:16739:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201359.754373:0:16739:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201359.754375:0:16739:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788201359.754379:0:16739:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201359.754387:0:16739:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9e03c1facd40) 00000020:00000080:2.0:1788201359.754397:0:16739:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788201359.754401:0:16739:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788201359.754402:0:16739:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788201359.754405:0:16739:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788201359.754411:0:16739:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788201359.754469:0:16739:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e03c37bf000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788201359.754765:0:16739:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9e04d1c34d40) 00000020:00000080:2.0:1788201359.754776:0:16739:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788201359.754847:0:16739:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788201359.754853:0:16739:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9383f985bc4d4c7a 00000020:00000080:2.0:1788201359.754948:0:16739:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788201359.754955:0:16739:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788201359.754961:0:16739:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9383f985bc4d4c81 00080000:01000000:2.0:1788201359.754966:0:16739:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788201359.754970:0:16739:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d4c88 00010000:00010000:2.0:1788201359.835260:0:16739:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-3 is initialized 00000001:00080000:1.0:1788201359.840532:0:16739:0:(tgt_lastrcvd.c:1749:tgt_clients_data_init()) RCVRNG CLIENT uuid: 35604eb4-baf9-45be-a20a-4883a2cd8cf9 idx: 0 lr: 8589938724 srv lr: 12884901888 lx: 0 gen 2 00000001:00000004:1.0:1788201359.840585:0:16739:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 4, last_transno is 12884901888 00000001:00080000:1.0:1788201359.846044:0:16739:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:1.0:1788201359.846145:0:16739:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04c7f91d80: xid 1875064442704000, transno 12884901934, client gen 2, slot idx 0 00000001:00080000:1.0:1788201359.846166:0:16739:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04c7f919c0: xid 1875064442702080, transno 12884901933, client gen 2, slot idx 1 00000001:00080000:1.0:1788201359.846177:0:16739:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04c7f916c0: xid 1875064442704256, transno 12884901935, client gen 2, slot idx 2 00000001:00080000:1.0:1788201359.846186:0:16739:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04c7f91180: xid 1875064442705152, transno 12884901936, client gen 2, slot idx 3 00000001:00080000:1.0:1788201359.846198:0:16739:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04c7f91480: xid 1875064442705536, transno 12884901937, client gen 2, slot idx 4 00000001:00080000:1.0:1788201359.846207:0:16739:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04c7f91a80: xid 1875064442705920, transno 12884901938, client gen 2, slot idx 5 00000001:00080000:1.0:1788201359.846217:0:16739:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04c7f91300: xid 1875064442706176, transno 12884901939, client gen 2, slot idx 6 00000001:00080000:1.0:1788201359.846227:0:16739:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04c7f91540: xid 1875064442706432, transno 12884901940, client gen 2, slot idx 7 00000020:00000080:1.0:1788201359.846724:0:16739:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9e04f9653380) 00000020:00000080:1.0:1788201359.846745:0:16739:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788201359.846806:0:16739:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788201359.846813:0:16739:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d4c9d 00000020:00000080:2.0:1788201359.850745:0:16739:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788201359.855788:0:16739:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9383f985bc4d4ca4 00000020:00000080:2.0:1788201359.857226:0:16739:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788201359.857240:0:16739:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201359.857245:0:16739:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201359.857247:0:16739:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788201359.857251:0:16739:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201359.857257:0:16739:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201359.857259:0:16739:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788201359.857263:0:16739:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788201359.857316:0:16739:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788201359.857334:0:16739:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201359.857337:0:16739:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201359.857339:0:16739:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788201359.857342:0:16739:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788201359.857344:0:16739:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #10 00000020:01000000:2.0:1788201359.857346:0:16739:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201359.857348:0:16739:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201359.857350:0:16739:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788201359.857352:0:16739:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201359.857353:0:16739:0:(obd_config.c:1561:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788201359.857356:0:16739:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788201359.857359:0:16739:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788201359.857362:0:16739:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201359.857374:0:16739:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788201359.857377:0:16739:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788201359.857382:0:16739:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.130@tcp to nid 0x20000c0a8c982 (192.168.201.130@tcp) 00000020:01000000:2.0:1788201359.857409:0:16739:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788201359.857412:0:16739:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201359.857427:0:16739:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9e04d1c33380) 00000020:00000080:2.0:1788201359.857445:0:16739:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788201359.857451:0:16739:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788201359.857506:0:16739:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788201359.857511:0:16739:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788201359.857517:0:16739:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d4cb2 00010000:00080000:2.0:1788201359.857547:0:16739:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e04c8365000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.130@tcp at head 00010000:00010000:2.0:1788201359.857767:0:16739:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788201359.858530:0:16739:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788201359.858577:0:16739:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788201359.869232:0:16739:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 2, last_idx 3 00000040:00080000:1.0:1788201359.870676:0:16739:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201359.871491:0:16739:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].4, 64 off8448 00000040:00080000:1.0:1788201359.871572:0:16739:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:2.0:1788201359.872144:0:16743:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 4 synced_idx: 0 lgh_last_idx: 4 00000040:00080000:2.0:1788201359.872149:0:16743:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788201359.890435:0:16739:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201359.890453:0:16739:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788201359.890494:0:16739:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788201359.890515:0:16739:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9383f985bc4d4cb9 00000100:00080000:1.0:1788201359.890526:0:16739:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788201359.890533:0:16739:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e04c8365000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:1.0:1788201359.890575:0:16739:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e03c5115180 x1875064458252544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201359.890599:0:16739:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788201359.890643:0:16739:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201359.890647:0:16739:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201359.890649:0:16739:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788201359.890653:0:16739:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788201359.890655:0:16739:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1788201359.890657:0:16739:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201359.890658:0:16739:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201359.890661:0:16739:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788201359.890663:0:16739:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201359.890665:0:16739:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788201359.890667:0:16739:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788201359.890672:0:16739:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788201359.890675:0:16739:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201359.890676:0:16739:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788201359.890679:0:16739:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788201359.890682:0:16739:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.130@tcp to nid 0x20000c0a8c982 (192.168.201.130@tcp) 00000020:01000000:1.0:1788201359.890705:0:16739:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788201359.890708:0:16739:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201359.890718:0:16739:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9e04f9654d40) 00000020:00000080:1.0:1788201359.890732:0:16739:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1788201359.890738:0:16739:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788201359.890782:0:16739:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788201359.890786:0:16739:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788201359.890790:0:16739:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d4cc7 00010000:00080000:1.0:1788201359.890812:0:16739:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e03c371f800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.130@tcp at head 00000100:00100000:2.0:1788201359.891017:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458252544:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788201359.891076:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201359.891126:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458252544 00000100:00100000:2.0:1788201359.891131:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458252544 00000100:00100000:2.0:1788201359.891155:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4264 00000100:00100000:2.0:1788201359.891161:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3309:x1875064458252544:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1788201359.891181:0:13447:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 635 last 0 00000020:00000080:2.0:1788201359.891202:0:13447:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9383f985bc4d4cce 00002000:00100000:2.0:1788201359.891212:0:13447:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9e04ff1c1000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788201359.891216:0:13447:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788201359.891218:0:13447:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788201359.891473:0:13447:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788201359.891496:0:13447:0:(import.c:65:import_set_state_nolock()) ffff9e04ff1c7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201359.891547:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3309:x1875064458252544:12345-0@lo:8:llog_process_th.0 Request processed in 384us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201359.891554:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4264 00000100:00100000:2.0:1788201359.891595:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788201359.891603:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788201359.891608:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788201359.891612:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788201359.891614:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04c8365000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788201359.891620:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788201359.891623:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458252544:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788201359.891756:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201359.891763:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458252672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201359.891788:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201359.891813:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458252672 00000100:00100000:3.0:1788201359.891816:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458252672 00000100:00100000:3.0:1788201359.891843:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788201359.891848:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875064458252672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201359.891865:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524877824 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1788201359.891890:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875064458252672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201359.891894:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:3.0:1788201359.891909:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201359.891940:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458252672:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788201359.892033:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201359.892037:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201359.892039:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201359.892041:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788201359.892103:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458252928:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201359.892129:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201359.892160:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458252928 00000100:00100000:0.0:1788201359.892163:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458252928 00000100:00100000:0.0:1788201359.892182:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4265 00000100:00100000:0.0:1788201359.892186:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3312:x1875064458252928:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201359.892199:0:13440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1055 count 1 00000100:00100000:0.0:1788201359.892543:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3312:x1875064458252928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 353us (409us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201359.892550:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4265 00000004:00080000:0.0:1788201359.892587:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5486a00, transno 0 00000004:00080000:0.0:1788201359.892591:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c5486a00/1, rc -2, transno 0 00000100:00100000:0.0:1788201359.892596:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458252928:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201359.892763:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458253056:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201359.892782:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201359.892807:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458253056 00000100:00100000:0.0:1788201359.892810:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458253056 00000100:00100000:0.0:1788201359.892827:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4266 00000100:00100000:0.0:1788201359.892831:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3313:x1875064458253056:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201359.892840:0:13443:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1053 count 1 00010000:00010000:1.0:1788201359.893162:0:16739:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-4 is initialized 00000040:01000000:1.0:1788201359.893318:0:16739:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788201359.893339:0:16739:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1788201359.896073:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458252800:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201359.896152:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201359.901819:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3313:x1875064458253056:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8975us (9024us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201359.901833:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4266 00000100:00100000:0.0:1788201359.901869:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458252800 00000100:00100000:0.0:1788201359.901877:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458252800 00000100:00100000:0.0:1788201359.901916:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4267 00000100:00100000:0.0:1788201359.901922:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3311:x1875064458252800:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201359.901950:0:13443:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1056 count 1 00000100:00100000:0.0:1788201359.902137:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3311:x1875064458252800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 214us (5985us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201359.902141:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4267 00000004:00080000:0.0:1788201359.902188:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5485500, transno 0 00000004:00080000:0.0:1788201359.902196:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c5485500/1, rc -2, transno 0 00000100:00100000:0.0:1788201359.902202:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458252800:0@lo:6:osp-syn-0-0.0 00000040:00080000:0.0:1788201359.902381:0:16743:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 6 count 2 00000040:00080000:0.0:1788201359.902415:0:16743:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1788201359.902419:0:16743:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0x1:0x2:0x0] 00000004:00080000:0.0:1788201359.902450:0:16743:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788201359.902495:0:16743:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 635160200600ns, next at 0ns, rc = 0 00000004:00080000:3.0:1788201359.904450:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c5486a00, transno 0 00000004:00080000:3.0:1788201359.904461:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c5486a00/1, rc -2, transno 0 00000100:00100000:3.0:1788201359.904469:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458253056:0@lo:6:osp-syn-0-0.0 00000040:00080000:1.0:1788201359.908717:0:16739:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 2, last_idx 3 00000040:00080000:1.0:1788201359.909663:0:16739:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201359.912759:0:16743:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 3, last_idx 4 00000040:00080000:0.0:1788201359.912814:0:16743:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1788201359.913679:0:16739:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].4, 64 off8448 00000040:00080000:1.0:1788201359.913768:0:16739:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1788201359.916460:0:16745:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 4 synced_idx: 0 lgh_last_idx: 4 00000040:00080000:3.0:1788201359.916468:0:16745:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788201359.927435:0:16739:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201359.927452:0:16739:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788201359.927498:0:16739:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788201359.927524:0:16739:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9383f985bc4d4cd5 00000100:00080000:2.0:1788201359.927538:0:16739:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788201359.927546:0:16739:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e03c371f800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1788201359.927583:0:16739:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e04f000dc00 x1875064458253184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201359.927605:0:16739:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788201359.927653:0:16739:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201359.927658:0:16739:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201359.927660:0:16739:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000100:00080000:1.0:1788201359.928045:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201359.928051:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201359.928054:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201359.928057:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788201359.928448:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458253184:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788201359.928530:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1788201359.928641:0:16739:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:2.0:1788201359.928728:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458253184 00000100:00100000:2.0:1788201359.928734:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458253184 00000100:00100000:2.0:1788201359.928766:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4268 00000100:00100000:2.0:1788201359.928773:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3309:x1875064458253184:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1788201359.928801:0:13446:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 635 last 0 00000020:00000080:2.0:1788201359.928828:0:13446:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9383f985bc4d4cdc 00002000:00100000:2.0:1788201359.928842:0:13446:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9e04c6a3b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788201359.928846:0:13446:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788201359.928849:0:13446:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788201359.929242:0:13446:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788201359.929359:0:13446:0:(import.c:65:import_set_state_nolock()) ffff9e04c6a38000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201359.929468:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3309:x1875064458253184:12345-0@lo:8:llog_process_th.0 Request processed in 693us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201359.929476:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4268 00000020:00000080:2.0:1788201359.929502:0:16739:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201359.929505:0:16739:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788201359.929512:0:16739:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788201359.929515:0:16739:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788201359.929519:0:16739:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201359.929522:0:16739:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201359.929524:0:16739:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788201359.929527:0:16739:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201359.929530:0:16739:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201359.929531:0:16739:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788201359.929535:0:16739:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788201359.929571:0:16739:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:16739:1875064458253312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201359.929625:0:16739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201359.929667:0:16739:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d0b27d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201359.929682:0:16738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458253312 00000100:00100000:1.0:1788201359.929687:0:16738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458253312 00000100:00100000:1.0:1788201359.929729:0:16738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788201359.929737:0:16738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04e7854c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+8:16739:x1875064458253312:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201359.929976:0:16738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04e7854c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+8:16739:x1875064458253312:12345-0@lo:502:llog_process_th.0 Request processed in 240us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201359.929984:0:16738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788201359.931031:0:16739:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:16739:1875064458253312:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788201359.931070:0:16739:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201359.931078:0:16739:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201359.931079:0:16739:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788201359.931084:0:16739:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788201359.931223:0:16708:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1788201359.931245:0:16708:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788201359.931262:0:16708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4000/0x9383f985bc4d4c50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4c57 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201359.931272:0:16708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4000/0x9383f985bc4d4c50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4c57 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201359.931279:0:16708:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e03c37bf000 from 1 10000000:01000000:1.0:1788201359.931281:0:16708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788201359.931334:0:16708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4a00/0x9383f985bc4d4ce3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201359.931353:0:16708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4a00/0x9383f985bc4d4ce3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201359.931372:0:16708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4a00/0x9383f985bc4d4ce3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201359.931931:0:16708:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5114e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:16708:1875064458253440:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201359.932002:0:16708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201359.932041:0:16708:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91000 going to sleep for 11 seconds 00000100:00100000:2.0:1788201359.932130:0:16713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458253440 00000100:00100000:2.0:1788201359.932137:0:16713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458253440 00000100:00100000:2.0:1788201359.932182:0:16713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788201359.932190:0:16713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04e7855850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+8:16708:x1875064458253440:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201359.932204:0:16713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201359.932219:0:16713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0501b29a00/0x9383f985bc4d4cea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d4ce3 expref: -99 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201359.932241:0:16713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0501b29a00/0x9383f985bc4d4cea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d4ce3 expref: 9 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201359.932389:0:16713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0501b29a00/0x9383f985bc4d4cea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d4ce3 expref: 9 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201359.932399:0:16713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0501b29a00, rc 0) 00000100:00100000:2.0:1788201359.932447:0:16713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04e7855850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+9:16708:x1875064458253440:12345-0@lo:101:mount.lustre.0 Request processed in 258us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201359.932457:0:16713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788201359.932536:0:16708:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5114e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:16708:1875064458253440:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201359.932551:0:16708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4a00/0x9383f985bc4d4ce3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4cea expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201359.932560:0:16708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4a00/0x9383f985bc4d4ce3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d4cea expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201359.933189:0:16708:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5486a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:16708:1875064458253568:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788201359.933233:0:16708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201359.933430:0:16708:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7fd2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201359.933505:0:16738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458253568 00000100:00100000:2.0:1788201359.933511:0:16738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458253568 00000100:00100000:2.0:1788201359.933552:0:16738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788201359.933559:0:16738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04e7856450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+9:16708:x1875064458253568:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788201359.933576:0:16738:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788201359.933595:0:16738:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788201359.933600:0:16738:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788201359.933602:0:16738:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 13 00000100:00100000:2.0:1788201359.933686:0:16738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04e7856450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+9:16708:x1875064458253568:12345-0@lo:256:mount.lustre.0 Request processed in 127us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201359.933695:0:16738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788201359.933782:0:16708:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5486a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:16708:1875064458253568:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788201359.934522:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201359.934531:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788201359.934539:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788201359.934545:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788201359.934549:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e03c371f800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788201359.934570:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788201359.934576:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458253184:0@lo:8:llog_process_th.0 00000040:00080000:3.0:1788201359.934681:0:16745:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 5 count 3 00000040:00080000:3.0:1788201359.934714:0:16745:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1788201359.934718:0:16745:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 4 of catalog [0x1:0x5:0x0] 00000004:00080000:3.0:1788201359.934744:0:16745:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788201359.935348:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458253696:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201359.935411:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201359.935442:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201359.935448:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458253824:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201359.935469:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201359.935502:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458253696 00000100:00100000:2.0:1788201359.935508:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458253696 00000100:00100000:2.0:1788201359.935549:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458253824 00000100:00100000:2.0:1788201359.935553:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458253824 00000100:00100000:2.0:1788201359.935579:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4269 00000100:00100000:2.0:1788201359.935586:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3310:x1875064458253696:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201359.935612:0:13439:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1053 count 1 00000100:00100000:1.0:1788201359.936792:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4270 00000100:00100000:1.0:1788201359.936803:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+7:3310:x1875064458253824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788201359.936823:0:13450:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1055 count 1 00000004:00080000:3.0:1788201359.937348:0:16745:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 635195052529ns, next at 0ns, rc = 0 00000100:00080000:2.0:1788201359.937757:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:0.0:1788201359.940469:0:16708:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788201359.940512:0:16708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4a00/0x9383f985bc4d4ce3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4cea expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201359.940527:0:16708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4a00/0x9383f985bc4d4ce3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4cea expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201359.941168:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201359.941191:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458253952:0@lo:13:osp-pre-1-0.0 10000000:01000000:0.0:1788201359.941274:0:16708:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e03c37bf000 from 1 10000000:01000000:0.0:1788201359.941279:0:16708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201359.941339:0:16708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c507d400/0x9383f985bc4d4cf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201359.941348:0:16708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c507d400/0x9383f985bc4d4cf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201359.941360:0:16708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c507d400/0x9383f985bc4d4cf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201359.941386:0:16708:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5486a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:16708:1875064458254080:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201359.941540:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3310:x1875064458253696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5952us (6126us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201359.941555:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4269 00000004:00080000:2.0:1788201359.941606:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00dc000, transno 0 00000004:00080000:2.0:1788201359.941613:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00dc000/1, rc -2, transno 0 00000100:00100000:2.0:1788201359.941624:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458253696:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201359.944108:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201359.944744:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3310:x1875064458253824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7940us (9269us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201359.944755:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4270 00000100:00100000:1.0:1788201359.944793:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458253952 00000100:00100000:1.0:1788201359.944800:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458253952 00000100:00100000:1.0:1788201359.944839:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788201359.944846:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875064458253952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201359.944955:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 13631488 granted 524877824 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201359.945008:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875064458253952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 161us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201359.945015:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788201359.945067:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458253952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201359.945453:0:16708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201359.945484:0:16708:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7fd2b40 going to sleep for 11 seconds 00000004:00080000:2.0:1788201359.945965:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00dd180, transno 0 00000004:00080000:2.0:1788201359.945971:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00dd180/1, rc -2, transno 0 00000100:00100000:2.0:1788201359.945981:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458253824:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201359.946121:0:16712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458254080 00000100:00100000:0.0:1788201359.946127:0:16712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458254080 00000100:00100000:0.0:1788201359.946159:0:16712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788201359.946168:0:16712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04e7855050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+9:16708:x1875064458254080:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201359.946179:0:16712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201359.946197:0:16712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c507cc00/0x9383f985bc4d4cf8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d4cf1 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201359.946221:0:16712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c507cc00/0x9383f985bc4d4cf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d4cf1 expref: 10 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201359.946233:0:16712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c507cc00/0x9383f985bc4d4cf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d4cf1 expref: 10 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201359.946243:0:16712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c507cc00, rc 0) 00000100:00100000:0.0:1788201359.946286:0:16712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04e7855050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+10:16708:x1875064458254080:12345-0@lo:101:mount.lustre.0 Request processed in 120us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201359.946310:0:16712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000040:00080000:3.0:1788201359.950552:0:16745:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 3, last_idx 4 00000040:00080000:3.0:1788201359.950598:0:16745:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000100:00100000:1.0:1788201359.951154:0:16708:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5486a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:16708:1875064458254080:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201359.951180:0:16708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c507d400/0x9383f985bc4d4cf1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4cf8 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201359.951191:0:16708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c507d400/0x9383f985bc4d4cf1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d4cf8 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201359.951267:0:16708:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5116680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:16708:1875064458254208:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201359.951352:0:16708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201359.951398:0:16708:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91000 going to sleep for 11 seconds 00000100:00100000:2.0:1788201359.951412:0:16738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458254208 00000100:00100000:2.0:1788201359.951419:0:16738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458254208 00000100:00100000:2.0:1788201359.951749:0:16738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788201359.951759:0:16738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04e7857c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+10:16708:x1875064458254208:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201359.952052:0:16738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04e7857c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+10:16708:x1875064458254208:12345-0@lo:501:mount.lustre.0 Request processed in 294us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201359.952060:0:16738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788201359.952421:0:16708:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5116680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:16708:1875064458254208:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201359.952462:0:16708:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5116680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:16708:1875064458254336:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201359.952506:0:16708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201359.952537:0:16708:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201359.952593:0:16712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458254336 00000100:00100000:0.0:1788201359.952598:0:16712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458254336 00000100:00100000:0.0:1788201359.952630:0:16712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788201359.952638:0:16712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04e7854450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+10:16708:x1875064458254336:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201359.952995:0:16712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04e7854450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+10:16708:x1875064458254336:12345-0@lo:503:mount.lustre.0 Request processed in 356us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201359.953003:0:16712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788201359.953383:0:16708:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5116680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:16708:1875064458254336:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201359.954737:0:16747:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:16747:1875064458254464:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201359.954843:0:16747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201359.954881:0:16711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458254464 00000100:00100000:3.0:1788201359.954888:0:16711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458254464 00000100:00100000:3.0:1788201359.954946:0:16711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788201359.954955:0:16711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04e7856050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+10:16747:x1875064458254464:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201359.955311:0:16747:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c1370780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201359.960118:0:16711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04e7856050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+10:16747:x1875064458254464:12345-0@lo:502:llog_process_th.0 Request processed in 5153us (5263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201359.960132:0:16711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788201359.960215:0:16747:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:16747:1875064458254464:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201359.960257:0:16747:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201359.960266:0:16747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201359.960268:0:16747:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788201359.960275:0:16747:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e03c37bf000 00000020:00000080:3.0:1788201359.960277:0:16747:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788201359.960283:0:16747:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201359.960286:0:16747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201359.960287:0:16747:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788201359.960290:0:16747:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201359.960321:0:16747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201359.960323:0:16747:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788201359.960326:0:16747:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e03c37bf000 00000020:00000080:3.0:1788201359.960328:0:16747:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788201359.960450:0:16747:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:16747:1875064458254592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201359.960664:0:16747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201359.960698:0:16747:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8073180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201359.961120:0:16713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458254592 00000100:00100000:2.0:1788201359.961128:0:16713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458254592 00000100:00100000:2.0:1788201359.961166:0:16713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788201359.961174:0:16713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+10:16747:x1875064458254592:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201359.961962:0:16713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+10:16747:x1875064458254592:12345-0@lo:502:llog_process_th.0 Request processed in 786us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201359.961971:0:16713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788201359.962262:0:16747:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:16747:1875064458254592:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201359.962316:0:16747:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201359.962323:0:16747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201359.962325:0:16747:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788201359.962329:0:16747:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788201359.963492:0:16708:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1788201359.963532:0:16708:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788201359.963588:0:16708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c507d400/0x9383f985bc4d4cf1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4cf8 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201359.963601:0:16708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c507d400/0x9383f985bc4d4cf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4cf8 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201359.963650:0:16708:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788201359.963654:0:16708:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e03c37bf000 10000000:01000000:0.0:1788201359.963657:0:16708:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e03c37bf000 10000000:01000000:0.0:1788201359.963661:0:16708:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788201359.963666:0:16708:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e03c37bf000 from 1 10000000:01000000:0.0:1788201359.963669:0:16708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788201359.963705:0:16708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c507da00/0x9383f985bc4d4cff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201359.963719:0:16708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c507da00/0x9383f985bc4d4cff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201359.963729:0:16708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c507da00/0x9383f985bc4d4cff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201359.963752:0:16708:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5485500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:16708:1875064458254720:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788201359.963806:0:16708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201359.963844:0:16708:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7fd2780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201359.964624:0:16738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458254720 00000100:00100000:3.0:1788201359.964633:0:16738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458254720 00000100:00100000:3.0:1788201359.964675:0:16738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788201359.964684:0:16738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1f82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+10:16708:x1875064458254720:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201359.964699:0:16738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201359.964713:0:16738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c5065200/0x9383f985bc4d4d06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d4cff expref: -99 pid: 16738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201359.964735:0:16738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c5065200/0x9383f985bc4d4d06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d4cff expref: 11 pid: 16738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201359.964747:0:16738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c5065200/0x9383f985bc4d4d06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d4cff expref: 11 pid: 16738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201359.964756:0:16738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5065200, rc 0) 00000100:00100000:3.0:1788201359.964807:0:16738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1f82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+11:16708:x1875064458254720:12345-0@lo:101:mount.lustre.0 Request processed in 124us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201359.964815:0:16738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788201359.965188:0:16708:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5485500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:16708:1875064458254720:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201359.965204:0:16708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c507da00/0x9383f985bc4d4cff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4d06 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201359.965212:0:16708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c507da00/0x9383f985bc4d4cff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d4d06 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201359.965282:0:16708:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5485500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:16708:1875064458254848:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201359.965332:0:16708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201359.965355:0:16708:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7fd2780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201359.965783:0:16713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458254848 00000100:00100000:2.0:1788201359.965789:0:16713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458254848 00000100:00100000:2.0:1788201359.965827:0:16713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788201359.965835:0:16713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+11:16708:x1875064458254848:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201359.966769:0:16713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+11:16708:x1875064458254848:12345-0@lo:501:mount.lustre.0 Request processed in 933us (1434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201359.966779:0:16713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788201359.966828:0:16708:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5485500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:16708:1875064458254848:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201359.966870:0:16708:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5485500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:16708:1875064458254976:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201359.966913:0:16708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201359.967216:0:16708:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7fd2780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201359.967324:0:16711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458254976 00000100:00100000:1.0:1788201359.967331:0:16711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458254976 00000100:00100000:1.0:1788201359.967373:0:16711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788201359.967381:0:16711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1f83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+11:16708:x1875064458254976:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201359.967635:0:16711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1f83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+11:16708:x1875064458254976:12345-0@lo:503:mount.lustre.0 Request processed in 254us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201359.967643:0:16711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788201359.967742:0:16708:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5485500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:16708:1875064458254976:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201359.968360:0:16749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5485500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:16749:1875064458255104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201359.968426:0:16749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201359.968509:0:16749:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7fd2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201359.968554:0:16712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458255104 00000100:00100000:2.0:1788201359.968560:0:16712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458255104 00000100:00100000:2.0:1788201359.968631:0:16712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788201359.968641:0:16712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+11:16749:x1875064458255104:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201359.968968:0:16712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+11:16749:x1875064458255104:12345-0@lo:502:llog_process_th.0 Request processed in 328us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201359.968976:0:16712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788201359.969114:0:16749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5485500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:16749:1875064458255104:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788201359.969172:0:16749:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788201359.969187:0:16749:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9e04f9650000) 00000020:00000080:1.0:1788201359.969208:0:16749:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1788201359.969511:0:16749:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e03c37bf000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788201359.969516:0:16749:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e03c37bf000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788201359.969519:0:16749:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e03c37bf000 4 00010000:00080000:1.0:1788201359.969553:0:16749:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e03c371d800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.130@tcp at head 00010000:00010000:1.0:1788201359.971406:0:16749:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-5 is initialized 00000020:00000080:1.0:1788201359.971504:0:16749:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788201359.971541:0:16749:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788201359.971555:0:16749:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9383f985bc4d4d14 00000100:00080000:1.0:1788201359.971567:0:16749:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788201359.971572:0:16749:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e03c371d800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:1.0:1788201359.971609:0:16749:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e03c5115c00 x1875064458255232/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201359.971642:0:16749:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788201359.971657:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875064458255232:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788201359.971662:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201359.971666:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201359.971670:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201359.971673:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788201359.971730:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201359.971798:0:16720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458255232 00000100:00100000:3.0:1788201359.971805:0:16720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458255232 00000100:00100000:3.0:1788201359.971842:0:16720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201359.971849:0:16720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875064458255232:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788201359.972152:0:16749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5114a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:16749:1875064458255360:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201359.972198:0:16749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201359.972214:0:16749:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1c24480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201359.972233:0:16711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458255360 00000100:00100000:1.0:1788201359.972237:0:16711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458255360 00000100:00100000:3.0:1788201359.972681:0:16720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875064458255232:12345-0@lo:38:llog_process_th.0 Request processed in 831us (950us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788201359.972691:0:16720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201359.972731:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201359.972738:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e03c371d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201359.972742:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788201359.972745:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875064458255232:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788201359.974146:0:16711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788201359.974158:0:16711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+11:16749:x1875064458255360:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201359.974564:0:16711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+11:16749:x1875064458255360:12345-0@lo:502:llog_process_th.0 Request processed in 408us (2365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201359.974573:0:16711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788201359.974629:0:16749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5114a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:16749:1875064458255360:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788201359.974661:0:16749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788201359.974775:0:16708:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788201359.974799:0:16708:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788201359.974816:0:16708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c507da00/0x9383f985bc4d4cff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4d06 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201359.974825:0:16708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c507da00/0x9383f985bc4d4cff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4d06 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788201359.975124:0:16708:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788201359.975126:0:16708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788201359.975127:0:16708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201359.975128:0:16708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201359.975129:0:16708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201359.975131:0:16708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201359.975132:0:16708:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201359.975134:0:16708:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788201359.975136:0:16708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201359.975137:0:16708:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788201359.975141:0:16708:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788201359.975144:0:16708:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788201359.975145:0:16708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788201359.975146:0:16708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201359.975147:0:16708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201359.975149:0:16708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201359.975150:0:16708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201359.975151:0:16708:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201359.975152:0:16708:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788201359.975153:0:16708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201359.975154:0:16708:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788201359.975174:0:16708:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788201359.975189:0:16708:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5114a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:16708:1875064458255488:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788201359.975235:0:16708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201359.975355:0:16708:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1c24480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201359.975471:0:16713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458255488 00000100:00100000:0.0:1788201359.975478:0:16713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458255488 00000100:00100000:0.0:1788201359.975515:0:16713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788201359.975523:0:16713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+11:16708:x1875064458255488:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788201359.975545:0:16713:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788201359.975562:0:16713:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000004:00080000:2.0:1788201359.987119:0:16726:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788201360.007039:0:16726:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 20000000:01000000:1.0:1788201360.031035:0:16713:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788201360.031056:0:16713:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788201360.031107:0:16714:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788201360.031113:0:16714:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788201360.031138:0:16714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e03c507c400/0x9383f985bc4d4d1b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201360.031158:0:16714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0501b29a00/0x9383f985bc4d4cea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d4ce3 expref: 11 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201360.031168:0:16714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e03c507c400/0x9383f985bc4d4d1b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201360.031213:0:16714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0501b29a00/0x9383f985bc4d4cea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9383f985bc4d4ce3 expref: 11 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201360.031226:0:16714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0501b29a00/0x9383f985bc4d4cea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9383f985bc4d4ce3 expref: 11 pid: 16713 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201360.031242:0:16714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5484e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16714:1875064458255616:0@lo:104: 00000100:00100000:0.0:1788201360.031345:0:16714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201360.031398:0:16714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f967e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201360.031664:0:8463:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788201360.031691:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458255616 00000100:00100000:1.0:1788201360.031698:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458255616 00000100:00100000:1.0:1788201360.031749:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788201360.031759:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c9003450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b60c000b-7335-444d-a8dc-1a5956712fb2+3:16714:x1875064458255616:12345-0@lo:104: 00010000:00010000:1.0:1788201360.031772:0:8463:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4a00/0x9383f985bc4d4ce3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9383f985bc4d4cea expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201360.031829:0:8463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201360.031836:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c9003450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b60c000b-7335-444d-a8dc-1a5956712fb2+3:16714:x1875064458255616:12345-0@lo:104: Request processed in 79us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201360.031844:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788201360.031939:0:16714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5484e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:16714:1875064458255616:0@lo:104: 00010000:00010000:0.0:1788201360.031959:0:16714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e03c507c400/0x9383f985bc4d4d1b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201360.034063:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201360.034075:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4a00/0x9383f985bc4d4ce3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9383f985bc4d4cea expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201360.034087:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9ce4a00 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1788201360.034092:0:7645:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4a00/0x9383f985bc4d4ce3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9383f985bc4d4cea expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201360.034103:0:7645:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4a00/0x9383f985bc4d4ce3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9383f985bc4d4cea expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201360.034109:0:7645:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4a00/0x9383f985bc4d4ce3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9383f985bc4d4cea expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201360.034120:0:7645:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201360.034204:0:7645:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4a00/0x9383f985bc4d4ce3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9383f985bc4d4cea expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201360.034211:0:7645:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201360.034238:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4a00/0x9383f985bc4d4ce3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9383f985bc4d4cea expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201360.034251:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4a00/0x9383f985bc4d4ce3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9383f985bc4d4cea expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201360.034270:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201360.034272:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201360.034274:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201360.034529:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458255744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201360.034600:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201360.034943:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458255744 00000100:00100000:3.0:1788201360.034951:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458255744 00010000:00010000:3.0:1788201360.034980:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0501b29a00/0x9383f985bc4d4cea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9383f985bc4d4ce3 expref: 12 pid: 16713 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201360.035013:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1560 00000100:00100000:3.0:1788201360.035022:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5484e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b60c000b-7335-444d-a8dc-1a5956712fb2+12:3313:x1875064458255744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201360.035035:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201360.035040:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0501b29a00/0x9383f985bc4d4cea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9383f985bc4d4ce3 expref: 12 pid: 16713 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201360.035052:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0501b29a00/0x9383f985bc4d4cea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9383f985bc4d4ce3 expref: 12 pid: 16713 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201360.035067:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0501b29a00/0x9383f985bc4d4cea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9383f985bc4d4ce3 expref: 12 pid: 16713 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201360.035083:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e03c507c400/0x9383f985bc4d4d1b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201360.035093:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c507c400/0x9383f985bc4d4d1b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788201360.035109:0:5843:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012883254s 00010000:00010000:3.0:1788201360.035114:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03c507c400/0x9383f985bc4d4d1b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201360.035122:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03c507c400/0x9383f985bc4d4d1b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201360.035129:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e03c507c400/0x9383f985bc4d4d1b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201360.035136:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e03c507c400/0x9383f985bc4d4d1b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201360.035142:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507c400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201360.035146:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e03c507c400/0x9383f985bc4d4d1b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201360.035153:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e03c507c400/0x9383f985bc4d4d1b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201360.035168:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e03c507c400/0x9383f985bc4d4d1b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201360.035178:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201360.035216:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5484e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b60c000b-7335-444d-a8dc-1a5956712fb2+11:3313:x1875064458255744:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201360.035224:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1560 00000100:00100000:0.0:1788201360.035428:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458255744:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201360.035452:0:16714:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e03c507c400/0x9383f985bc4d4d1b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201360.035461:0:16714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e03c507c400/0x9383f985bc4d4d1b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201360.035468:0:16714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c507c400/0x9383f985bc4d4d1b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201360.039264:0:16713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+10:16708:x1875064458255488:12345-0@lo:253:mount.lustre.0 Request processed in 63732us (64019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201360.039278:0:16713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788201360.039508:0:16708:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5114a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:16708:1875064458255488:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788201360.039525:0:16708:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788201360.039528:0:16708:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788201360.039530:0:16708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788201360.039531:0:16708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201360.039532:0:16708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201360.039533:0:16708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201360.039535:0:16708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201360.039536:0:16708:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201360.039537:0:16708:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788201360.039539:0:16708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201360.039540:0:16708:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788201360.039569:0:16708:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788201360.044075:0:16708:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788201360.044495:0:16708:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788201360.044782:0:16708:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788201360.044938:0:16708:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788201360.045212:0:16708:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788201360.046173:0:16708:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788201360.047779:0:16708:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788201360.047969:0:16708:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788201360.048478:0:16708:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788201360.048665:0:16708:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788201360.048926:0:16708:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788201360.049098:0:16708:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000040:01000000:2.0:1788201360.078673:0:16708:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1788201360.078919:0:16756:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1788201360.079475:0:16756:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1788201360.082992:0:16755:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788201360.083002:0:16755:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:2.0:1788201360.084866:0:16756:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000bd0:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788201360.084978:0:16756:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788201360.084983:0:16756:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1788201360.088278:0:16708:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788201360.088469:0:16708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788201360.088916:0:16708:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788201360.088925:0:16708:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788201360.089065:0:16708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201360.090110:0:16708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788201360.090699:0:16708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788201360.090735:0:16708:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788201360.090994:0:16708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788201360.096757:0:16708:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x38:0x0] (8/8/4) registered 00010000:00080000:3.0:1788201360.105139:0:16708:0:(ldlm_lib.c:3054:target_recovery_init()) RECOVERY: service lustre-MDT0000, 1 recoverable clients, last_transno 12884901940 00010000:00080000:1.0:1788201360.108813:0:16757:0:(ldlm_lib.c:2854:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 16757 00010000:02000000:1.0:1788201360.108829:0:16757:0:(ldlm_lib.c:2336:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00000020:01000004:0.0:1788201360.114669:0:16708:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788201360.114689:0:16708:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.130@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788201360.114706:0:16708:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788201360.114729:0:16708:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00080000:1.0:1788201360.118724:0:16757:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 1 abort 0 expired 0 00010000:00080000:1.0:1788201360.118730:0:16757:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 1 abort 0 expired 0 00000001:00100000:2.0:1788201360.161804:0:6732:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788201360.166838:0:7657:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788201360.229430:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201360.277010:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201360.277058:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201360.277194:0:13451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442711552 00000100:00100000:3.0:1788201360.277207:0:13451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442711552 00000100:00100000:3.0:1788201360.277280:0:13451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442711680 00000100:00100000:3.0:1788201360.277284:0:13451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442711680 00000100:00100000:3.0:1788201360.277352:0:13451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 220 00000100:00100000:3.0:1788201360.277373:0:13451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2359:x1875064442711552:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201360.277450:0:13451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2359:x1875064442711552:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 90us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201360.277458:0:13451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 220 00000100:00100000:3.0:1788201360.277476:0:13451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 221 00000100:00100000:3.0:1788201360.277483:0:13451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2359:x1875064442711680:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201360.277511:0:13451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2359:x1875064442711680:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 29us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201360.277518:0:13451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 221 00000100:00080000:0.0:1788201360.279440:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201360.279449:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201360.848934:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201360.849023:0:16711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442711808 00000100:00100000:3.0:1788201360.849033:0:16711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442711808 00000100:00100000:3.0:1788201360.849092:0:16711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 36 00000100:00100000:3.0:1788201360.849102:0:16711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442711808:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201360.849129:0:16711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201360.849151:0:16711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c5065400/0x9383f985bc4d4d22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5262 expref: -99 pid: 16711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201360.849178:0:16711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c5065400/0x9383f985bc4d4d22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5262 expref: 10 pid: 16711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201360.849190:0:16711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c5065400/0x9383f985bc4d4d22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5262 expref: 10 pid: 16711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201360.849199:0:16711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5065400, rc 0) 00000100:00100000:3.0:1788201360.849264:0:16711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:5601:x1875064442711808:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 163us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201360.849271:0:16711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 36 00000100:00100000:3.0:1788201360.853597:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201360.853726:0:16712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442711936 00000100:00100000:2.0:1788201360.853735:0:16712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442711936 00000100:00100000:2.0:1788201360.853796:0:16712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 37 00000100:00100000:2.0:1788201360.853807:0:16712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:5601:x1875064442711936:12345-192.168.201.30@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788201360.853833:0:16712:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1788201360.853864:0:16712:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788201360.853868:0:16712:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1788201360.853872:0:16712:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1788201360.853874:0:16712:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 14 00000100:00100000:3.0:1788201360.872500:0:16712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:5601:x1875064442711936:12345-192.168.201.30@tcp:256:ll_cfg_requeue.0 Request processed in 18683us (18900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201360.872518:0:16712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 37 00000100:00000400:0.0:1788201361.062468:0:3313:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201344/real 1788201344] req@ffff9e03c5115880 x1875064458250112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201360 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201361.125421:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e03c5115880 x1875064458250112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201360 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201361.125435:0:3313:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff9e04ff4ba000 already not connected (conn 8, was 6): CONNECTING 00000100:00000400:3.0:1788201361.127999:0:3313:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201344/real 1788201344] req@ffff9e03c5116300 x1875064458250240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201360 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201361.128028:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e03c5116300 x1875064458250240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201360 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201361.128037:0:3313:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff9e04f5751000 already not connected (conn 8, was 6): CONNECTING 00000100:00100000:3.0:1788201361.128056:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458250112:0@lo:400:kworker.0 00000100:00100000:3.0:1788201361.128063:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458250240:0@lo:400:kworker.0 00010000:00010000:3.0:1788201361.254836:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788201361.258640:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788201361.258648:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e03c37bf000 from 14 10000000:01000000:2.0:1788201361.258654:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788201361.258701:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e0501b28000/0x9383f985bc4d4d29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201361.258713:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e0501b28000/0x9383f985bc4d4d29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201361.258726:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e0501b28000/0x9383f985bc4d4d29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201361.258753:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458255872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201361.258825:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201361.259404:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d85d30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201361.263355:0:16711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458255872 00000100:00100000:3.0:1788201361.263369:0:16711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458255872 00000100:00100000:3.0:1788201361.263432:0:16711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788201361.263442:0:16711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1f81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+10:5855:x1875064458255872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201361.263460:0:16711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201361.263495:0:16711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c5064000/0x9383f985bc4d4d30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d4d29 expref: -99 pid: 16711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201361.263526:0:16711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c5064000/0x9383f985bc4d4d30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d4d29 expref: 11 pid: 16711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201361.263539:0:16711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c5064000/0x9383f985bc4d4d30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d4d29 expref: 11 pid: 16711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201361.263548:0:16711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5064000, rc 0) 00000100:00100000:3.0:1788201361.263634:0:16711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1f81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+11:5855:x1875064458255872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (4808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201361.263641:0:16711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788201361.263701:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458255872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201361.263719:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e0501b28000/0x9383f985bc4d4d29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4d30 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201361.263729:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e0501b28000/0x9383f985bc4d4d29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d4d30 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201361.263797:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458256000:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788201361.263834:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201361.263866:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8073c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201361.263881:0:16713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458256000 00000100:00100000:3.0:1788201361.263885:0:16713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458256000 00000100:00100000:3.0:1788201361.264130:0:16713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201361.264138:0:16713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+11:5855:x1875064458256000:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788201361.264154:0:16713:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788201361.264172:0:16713:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788201361.264176:0:16713:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1788201361.264270:0:16713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+11:5855:x1875064458256000:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 133us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201361.264277:0:16713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201361.264333:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458256000:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788201361.264385:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788201361.264392:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e0501b28000/0x9383f985bc4d4d29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4d30 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201361.264401:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e0501b28000/0x9383f985bc4d4d29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4d30 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201361.264410:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788201361.264413:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e04c6b8b800 from 42 10000000:01000000:3.0:1788201361.264416:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201361.264436:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c5064400/0x9383f985bc4d4d37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201361.264443:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c5064400/0x9383f985bc4d4d37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201361.264452:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c5064400/0x9383f985bc4d4d37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201361.264466:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458256128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201361.264995:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201361.265029:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8073c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201361.265094:0:16711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458256128 00000100:00100000:0.0:1788201361.265099:0:16711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458256128 00000100:00100000:0.0:1788201361.265140:0:16711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788201361.265148:0:16711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1f83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+11:5855:x1875064458256128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201361.265158:0:16711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201361.265170:0:16711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c507ca00/0x9383f985bc4d4d3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d4d37 expref: -99 pid: 16711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201361.265188:0:16711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c507ca00/0x9383f985bc4d4d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d4d37 expref: 12 pid: 16711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201361.265196:0:16711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c507ca00/0x9383f985bc4d4d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d4d37 expref: 12 pid: 16711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201361.265203:0:16711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c507ca00, rc 0) 00000100:00100000:0.0:1788201361.265248:0:16711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1f83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+12:5855:x1875064458256128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201361.265255:0:16711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788201361.266628:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458256128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201361.266651:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c5064400/0x9383f985bc4d4d37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4d3e expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201361.266661:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c5064400/0x9383f985bc4d4d37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d4d3e expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201361.266737:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458256256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201361.266782:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201361.266827:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8073c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201361.266886:0:16713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458256256 00000100:00100000:0.0:1788201361.266902:0:16713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458256256 00000100:00100000:0.0:1788201361.266942:0:16713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788201361.266950:0:16713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+12:5855:x1875064458256256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201361.267290:0:16713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+12:5855:x1875064458256256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 339us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201361.267325:0:16713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788201361.267638:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458256256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201361.267674:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458256384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201361.267719:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201361.267750:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8073c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201361.268498:0:16711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458256384 00000100:00100000:0.0:1788201361.268507:0:16711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458256384 00000100:00100000:0.0:1788201361.268546:0:16711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788201361.268554:0:16711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+12:5855:x1875064458256384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201361.268905:0:16711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+12:5855:x1875064458256384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 336us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201361.268914:0:16711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788201361.269159:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458256384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788201361.272636:0:16813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 42 00000020:01000000:0.0:1788201361.272839:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 42-41 (rc=0) 10000000:01000000:0.0:1788201361.272863:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788201361.272875:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c5064400/0x9383f985bc4d4d37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4d3e expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201361.272886:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c5064400/0x9383f985bc4d4d37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4d3e expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201361.273002:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788201361.273005:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1788201361.273008:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788201361.273052:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c507c600/0x9383f985bc4d4d45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201361.273060:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c507c600/0x9383f985bc4d4d45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201361.273071:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c507c600/0x9383f985bc4d4d45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201361.273096:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5484380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458256512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201361.273167:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201361.273212:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2fd9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201361.273337:0:16713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458256512 00000100:00100000:3.0:1788201361.273354:0:16713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458256512 00000100:00100000:3.0:1788201361.273408:0:16713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788201361.273418:0:16713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d1c0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+12:5855:x1875064458256512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201361.273435:0:16713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201361.273449:0:16713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c5064e00/0x9383f985bc4d4d4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d4d45 expref: -99 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201361.273478:0:16713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c5064e00/0x9383f985bc4d4d4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d4d45 expref: 13 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201361.273489:0:16713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c5064e00/0x9383f985bc4d4d4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d4d45 expref: 13 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201361.273500:0:16713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c5064e00, rc 0) 00000100:00100000:3.0:1788201361.273545:0:16713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d1c0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+13:5855:x1875064458256512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201361.273551:0:16713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788201361.273660:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5484380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458256512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201361.273674:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c507c600/0x9383f985bc4d4d45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4d4c expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201361.273682:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c507c600/0x9383f985bc4d4d45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d4d4c expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201361.273740:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5484380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458256640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201361.273767:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201361.273785:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2fd9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201361.273827:0:16711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458256640 00000100:00100000:3.0:1788201361.273831:0:16711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458256640 00000100:00100000:3.0:1788201361.273860:0:16711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788201361.273867:0:16711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d1c0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+13:5855:x1875064458256640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201361.275575:0:16711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d1c0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+13:5855:x1875064458256640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1702us (1801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201361.275586:0:16711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788201361.276245:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5484380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458256640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201361.276332:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5484380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458256768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201361.276400:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201361.276426:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2fd9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201361.278029:0:16713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458256768 00000100:00100000:3.0:1788201361.278042:0:16713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458256768 00000100:00100000:3.0:1788201361.278106:0:16713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788201361.278116:0:16713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+13:5855:x1875064458256768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201361.287438:0:16713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+13:5855:x1875064458256768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 9313us (11027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201361.287457:0:16713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788201361.287535:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5484380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458256768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201361.289379:0:16816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 11 00000020:01000000:0.0:1788201361.289597:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1788201361.289624:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788201361.289638:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c507c600/0x9383f985bc4d4d45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4d4c expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201361.289651:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c507c600/0x9383f985bc4d4d45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4d4c expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201361.289661:0:5855:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788201361.289664:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e04c6b8b800 from 7 10000000:01000000:0.0:1788201361.289667:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201361.289713:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c507ce00/0x9383f985bc4d4d53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201361.289722:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c507ce00/0x9383f985bc4d4d53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201361.289735:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c507ce00/0x9383f985bc4d4d53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201361.289778:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5485880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458256896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201361.289850:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201361.290011:0:16712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458256896 00000100:00100000:2.0:1788201361.290019:0:16712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458256896 00000100:00100000:2.0:1788201361.290068:0:16712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788201361.290078:0:16712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+13:5855:x1875064458256896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201361.290092:0:16712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201361.290107:0:16712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0501b28400/0x9383f985bc4d4d5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d4d53 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201361.290130:0:16712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0501b28400/0x9383f985bc4d4d5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d4d53 expref: 14 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201361.290141:0:16712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0501b28400/0x9383f985bc4d4d5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d4d53 expref: 14 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201361.290151:0:16712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0501b28400, rc 0) 00000100:00100000:2.0:1788201361.290183:0:16712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+14:5855:x1875064458256896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201361.290190:0:16712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788201361.290441:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2fd99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201361.290468:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5485880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458256896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201361.290484:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c507ce00/0x9383f985bc4d4d53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4d5a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201361.290493:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c507ce00/0x9383f985bc4d4d53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d4d5a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201361.290574:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5485880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458257024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201361.290604:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201361.290664:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2fd99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201361.294926:0:16738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458257024 00000100:00100000:2.0:1788201361.294943:0:16738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458257024 00000100:00100000:2.0:1788201361.295012:0:16738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788201361.295022:0:16738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+14:5855:x1875064458257024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201361.295356:0:16738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+14:5855:x1875064458257024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 335us (4749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201361.295365:0:16738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788201361.295585:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5485880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458257024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201361.295640:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5485880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458257152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201361.295687:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201361.295725:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2fd99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201361.296432:0:16712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458257152 00000100:00100000:2.0:1788201361.296440:0:16712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458257152 00000100:00100000:2.0:1788201361.296492:0:16712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788201361.296501:0:16712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+14:5855:x1875064458257152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201361.296886:0:16712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+14:5855:x1875064458257152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 385us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201361.296998:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5485880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458257152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788201361.297693:0:16818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000100:00100000:2.0:1788201361.297844:0:16712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000020:01000000:2.0:1788201361.299290:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788201361.299441:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788201361.299454:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c507ce00/0x9383f985bc4d4d53 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4d5a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201361.299468:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c507ce00/0x9383f985bc4d4d53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4d5a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201361.299478:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788201361.299480:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e04f9036000 from 42 10000000:01000000:2.0:1788201361.299483:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788201361.299524:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e0501b28a00/0x9383f985bc4d4d61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201361.299533:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e0501b28a00/0x9383f985bc4d4d61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201361.299544:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e0501b28a00/0x9383f985bc4d4d61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201361.299570:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458257280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201361.299635:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201361.299679:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2ff0540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201361.300125:0:16738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458257280 00000100:00100000:0.0:1788201361.300134:0:16738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458257280 00000100:00100000:0.0:1788201361.300188:0:16738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788201361.300199:0:16738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+14:5855:x1875064458257280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201361.300214:0:16738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201361.300229:0:16738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c507d200/0x9383f985bc4d4d68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d4d61 expref: -99 pid: 16738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201361.300253:0:16738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c507d200/0x9383f985bc4d4d68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d4d61 expref: 15 pid: 16738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201361.300262:0:16738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c507d200/0x9383f985bc4d4d68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d4d61 expref: 15 pid: 16738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201361.300272:0:16738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c507d200, rc 0) 00000100:00100000:0.0:1788201361.300357:0:16738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+15:5855:x1875064458257280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201361.300363:0:16738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788201361.300497:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458257280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201361.300514:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e0501b28a00/0x9383f985bc4d4d61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4d68 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201361.300523:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e0501b28a00/0x9383f985bc4d4d61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d4d68 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201361.300582:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458257408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201361.300610:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201361.300636:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2ff0540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201361.300678:0:16711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458257408 00000100:00100000:0.0:1788201361.300683:0:16711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458257408 00000100:00100000:0.0:1788201361.300713:0:16711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788201361.300720:0:16711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+15:5855:x1875064458257408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201361.302327:0:16711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+15:5855:x1875064458257408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1602us (1710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201361.302352:0:16711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788201361.302538:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458257408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201361.302593:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458257536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201361.302641:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201361.302676:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2ff0540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201361.302720:0:16738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458257536 00000100:00100000:0.0:1788201361.302725:0:16738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458257536 00000100:00100000:0.0:1788201361.304649:0:16738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788201361.304670:0:16738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+15:5855:x1875064458257536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201361.304932:0:16738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+15:5855:x1875064458257536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 269us (2289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201361.304941:0:16738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788201361.306252:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458257536:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201361.314458:0:16820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 42 00000020:01000000:3.0:1788201361.314664:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 42-41 (rc=0) 10000000:01000000:3.0:1788201361.314691:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788201361.314703:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e0501b28a00/0x9383f985bc4d4d61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4d68 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201361.314716:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e0501b28a00/0x9383f985bc4d4d61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4d68 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201361.314728:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788201361.314731:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1788201361.314734:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788201361.314784:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c5065000/0x9383f985bc4d4d6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201361.314793:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c5065000/0x9383f985bc4d4d6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201361.314804:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c5065000/0x9383f985bc4d4d6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201361.314828:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458257664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201361.315012:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201361.315053:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8073cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201361.315162:0:16712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458257664 00000100:00100000:1.0:1788201361.315168:0:16712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458257664 00000100:00100000:1.0:1788201361.315213:0:16712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788201361.315220:0:16712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+15:5855:x1875064458257664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201361.315233:0:16712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201361.315246:0:16712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e04f9ce5a00/0x9383f985bc4d4d76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d4d6f expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201361.315269:0:16712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e04f9ce5a00/0x9383f985bc4d4d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d4d6f expref: 16 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201361.315279:0:16712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e04f9ce5a00/0x9383f985bc4d4d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d4d6f expref: 16 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201361.315287:0:16712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9ce5a00, rc 0) 00000100:00100000:3.0:1788201361.315980:0:16712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+16:5855:x1875064458257664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 756us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201361.315989:0:16712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788201361.316066:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458257664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201361.316085:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c5065000/0x9383f985bc4d4d6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4d76 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201361.316096:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c5065000/0x9383f985bc4d4d6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d4d76 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201361.316157:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5485880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458257792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201361.316183:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201361.316214:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2fd99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201361.316254:0:16713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458257792 00000100:00100000:1.0:1788201361.316259:0:16713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458257792 00000100:00100000:1.0:1788201361.316290:0:16713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788201361.316398:0:16713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+16:5855:x1875064458257792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201361.316808:0:16713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+16:5855:x1875064458257792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 410us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201361.318163:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5485880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458257792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201361.318226:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458257920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201361.318289:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201361.318348:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8073600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201361.323075:0:16711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458257920 00000100:00100000:0.0:1788201361.323088:0:16711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458257920 00000100:00100000:0.0:1788201361.323150:0:16711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788201361.323160:0:16711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9558c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+17:5855:x1875064458257920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201361.324587:0:16713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788201361.339120:0:16711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9558c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+16:5855:x1875064458257920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 15952us (20822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201361.339134:0:16711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788201361.339222:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458257920:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788201361.343269:0:16822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 14 00000020:01000000:0.0:1788201361.343651:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1788201361.343679:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788201361.343690:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c5065000/0x9383f985bc4d4d6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4d76 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201361.343702:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c5065000/0x9383f985bc4d4d6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4d76 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201361.343712:0:5855:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788201361.343714:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9e04c6718000 from 1 10000000:01000000:0.0:1788201361.343717:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788201361.343772:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c507d800/0x9383f985bc4d4d7d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201361.343781:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c507d800/0x9383f985bc4d4d7d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201361.343793:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c507d800/0x9383f985bc4d4d7d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201361.343820:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5487100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458258048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201361.343891:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201361.343937:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2fd93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201361.344037:0:16738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458258048 00000100:00100000:2.0:1788201361.344045:0:16738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458258048 00000100:00100000:2.0:1788201361.344094:0:16738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788201361.344104:0:16738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f955b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+16:5855:x1875064458258048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201361.344119:0:16738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201361.344134:0:16738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0501b29800/0x9383f985bc4d4d84 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d4d7d expref: -99 pid: 16738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201361.344155:0:16738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0501b29800/0x9383f985bc4d4d84 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d4d7d expref: 17 pid: 16738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201361.344165:0:16738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0501b29800/0x9383f985bc4d4d84 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d4d7d expref: 17 pid: 16738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201361.344173:0:16738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0501b29800, rc 0) 00000100:00100000:2.0:1788201361.344212:0:16738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f955b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+17:5855:x1875064458258048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201361.344219:0:16738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788201361.344397:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5487100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458258048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201361.344413:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c507d800/0x9383f985bc4d4d7d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4d84 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201361.344421:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c507d800/0x9383f985bc4d4d7d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d4d84 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201361.344440:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788201361.344444:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c507d800/0x9383f985bc4d4d7d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4d84 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201361.344450:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c507d800/0x9383f985bc4d4d7d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4d84 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201361.344456:0:5855:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788201361.344458:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e04f9036000 from 7 10000000:01000000:0.0:1788201361.344460:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201361.344474:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c507d600/0x9383f985bc4d4d8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201361.344481:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c507d600/0x9383f985bc4d4d8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201361.344488:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c507d600/0x9383f985bc4d4d8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201361.344501:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5487100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458258176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201361.344528:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201361.344550:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2fd93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201361.344564:0:16713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458258176 00000100:00100000:0.0:1788201361.344568:0:16713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458258176 00000100:00100000:0.0:1788201361.344594:0:16713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788201361.344601:0:16713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9559450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+17:5855:x1875064458258176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201361.344608:0:16713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201361.344617:0:16713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c507de00/0x9383f985bc4d4d92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d4d8b expref: -99 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201361.344631:0:16713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c507de00/0x9383f985bc4d4d92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d4d8b expref: 18 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201361.344638:0:16713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c507de00/0x9383f985bc4d4d92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d4d8b expref: 18 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201361.344644:0:16713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c507de00, rc 0) 00000100:00100000:0.0:1788201361.344674:0:16713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9559450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+18:5855:x1875064458258176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201361.344680:0:16713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788201361.344710:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5487100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458258176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201361.344719:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c507d600/0x9383f985bc4d4d8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4d92 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201361.344726:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c507d600/0x9383f985bc4d4d8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d4d92 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201361.344786:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5487100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458258304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201361.344809:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201361.344819:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2fd93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201361.344831:0:16711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458258304 00000100:00100000:0.0:1788201361.344834:0:16711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458258304 00000100:00100000:0.0:1788201361.344854:0:16711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788201361.344860:0:16711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f955ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+18:5855:x1875064458258304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201361.345100:0:16711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f955ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+18:5855:x1875064458258304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201361.345107:0:16711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788201361.345135:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5487100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458258304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201361.345160:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5487100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458258432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201361.345196:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201361.345209:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2fd93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201361.345220:0:16713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458258432 00000100:00100000:0.0:1788201361.345406:0:16713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458258432 00000100:00100000:0.0:1788201361.345425:0:16713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788201361.345431:0:16713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9559c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+18:5855:x1875064458258432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201361.345575:0:16713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9559c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+18:5855:x1875064458258432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201361.345582:0:16713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788201361.345623:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5487100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458258432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788201361.354245:0:16823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788201361.354334:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788201361.354372:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788201361.354385:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c507d600/0x9383f985bc4d4d8b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4d92 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201361.354397:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c507d600/0x9383f985bc4d4d8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4d92 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201361.354406:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788201361.354408:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9e04c6718000 from 1 10000000:01000000:2.0:1788201361.354411:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788201361.354451:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e0501b29400/0x9383f985bc4d4d99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201361.354458:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e0501b29400/0x9383f985bc4d4d99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201361.354468:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e0501b29400/0x9383f985bc4d4d99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201361.354500:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458258560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201361.354571:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201361.354610:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e050159c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201361.355069:0:16713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458258560 00000100:00100000:0.0:1788201361.355077:0:16713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458258560 00000100:00100000:0.0:1788201361.355117:0:16713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788201361.355126:0:16713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f955a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+18:5855:x1875064458258560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201361.355140:0:16713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201361.355153:0:16713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c507c400/0x9383f985bc4d4da0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d4d99 expref: -99 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201361.355177:0:16713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c507c400/0x9383f985bc4d4da0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d4d99 expref: 19 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201361.355187:0:16713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c507c400/0x9383f985bc4d4da0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d4d99 expref: 19 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201361.355196:0:16713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c507c400, rc 0) 00000100:00100000:0.0:1788201361.355242:0:16713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f955a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+19:5855:x1875064458258560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201361.355249:0:16713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788201361.355314:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458258560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201361.355329:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e0501b29400/0x9383f985bc4d4d99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4da0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201361.355349:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e0501b29400/0x9383f985bc4d4d99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d4da0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201361.355407:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5487100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458258688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201361.355436:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201361.355454:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2fd9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201361.355750:0:16738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458258688 00000100:00100000:2.0:1788201361.355756:0:16738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458258688 00000100:00100000:2.0:1788201361.355786:0:16738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788201361.355794:0:16738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f955bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:5855:x1875064458258688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201361.356136:0:16738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f955bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:5855:x1875064458258688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 341us (696us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201361.356144:0:16738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788201361.356869:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5487100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458258688:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788201361.356922:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788201361.356932:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e0501b29400/0x9383f985bc4d4d99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4da0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201361.356943:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e0501b29400/0x9383f985bc4d4d99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4da0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201362.290596:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201363.302199:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201364.016970:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458258816:0@lo:400:kworker.0 00000100:00100000:0.0:1788201364.017079:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788201364.018702:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201364.018714:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201364.018718:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201364.018721:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201364.018814:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788201364.018820:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201364.018824:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e03c371d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201364.018839:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e03c371d800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1788201364.018869:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e04f000c700 x1875064458259200/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201364.018922:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458259072:0@lo:400:kworker.0 00000100:00100000:0.0:1788201364.018923:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458258944:0@lo:400:kworker.0 00000100:00100000:1.0:1788201364.019010:0:16713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458258816 00000100:00100000:1.0:1788201364.019020:0:16713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458258816 00000100:00100000:1.0:1788201364.019095:0:16713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788201364.019107:0:16713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f955b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458258816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201364.022647:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201364.022841:0:13442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458258944 00000100:00100000:3.0:1788201364.022854:0:13442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458258944 00000100:00100000:3.0:1788201364.022944:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788201364.022958:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458258944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201364.023231:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458258944:12345-0@lo:400:kworker.0 Request processed in 276us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201364.023244:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00080000:3.0:1788201364.023280:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201364.023361:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458258944:0@lo:400:kworker.0 00000100:00100000:1.0:1788201364.025519:0:16713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f955b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458258816:12345-0@lo:400:kworker.0 Request processed in 6400us (8426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201364.025538:0:16713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788201364.028048:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458258816:0@lo:400:kworker.0 00000100:00100000:3.0:1788201364.029985:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875064458259200:0@lo:38:kworker.0 00000100:00100000:3.0:1788201364.030103:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201364.030199:0:16722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458259200 00000100:00100000:0.0:1788201364.030211:0:16722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458259200 00000100:00100000:0.0:1788201364.030268:0:16722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788201364.030277:0:16722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1875064458259200:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788201364.030334:0:16722:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 639 last 0 00000020:00000080:0.0:1788201364.030383:0:16722:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9383f985bc4d4da7 00000004:00100000:0.0:1788201364.030404:0:16722:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788201364.030563:0:16722:0:(import.c:65:import_set_state_nolock()) ffff9e04c6b1f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201364.030641:0:16722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875064458259200:12345-0@lo:38:kworker.0 Request processed in 363us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201364.030649:0:16722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788201364.032321:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e04f000c700 x1875064458259200/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201364.032350:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 4 00000100:00080000:3.0:1788201364.032362:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788201364.032369:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788201364.032374:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e03c371d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788201364.032383:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875064458259200:0@lo:38:kworker.0 00000100:00100000:2.0:1788201364.036000:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201364.037533:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458259072 00000100:00100000:2.0:1788201364.037971:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458259072 00000100:00100000:2.0:1788201364.038215:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788201364.038230:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458259072:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788201364.039370:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201364.039714:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458259072:12345-0@lo:400:kworker.0 Request processed in 1484us (3723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201364.039727:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788201364.040147:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458259072:0@lo:400:kworker.0 00010000:00010000:3.0:1788201364.327553:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201365.356658:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201365.410059:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201365.411676:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201365.411720:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201365.415076:0:16738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442712064 00000100:00100000:2.0:1788201365.415102:0:16738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442712064 00000100:00100000:2.0:1788201365.415367:0:16738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 62 00000100:00100000:2.0:1788201365.415383:0:16738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f955a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442712064:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201365.415690:0:16738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f955a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442712064:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 310us (5639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201365.415700:0:16738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 62 00000100:00100000:3.0:1788201365.416519:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442712320 00000100:00100000:3.0:1788201365.416530:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442712320 00000100:00100000:3.0:1788201365.416612:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442712192 00000100:00100000:3.0:1788201365.416617:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442712192 00000100:00100000:3.0:1788201365.416648:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 224 00000100:00100000:3.0:1788201365.416659:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5114700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2359:x1875064442712320:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201365.417363:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 225 00000100:00100000:3.0:1788201365.417671:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5114700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2359:x1875064442712320:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 1009us (5995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201365.417685:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 224 00000100:00080000:3.0:1788201365.417719:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201365.417726:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201365.418194:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5116a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2359:x1875064442712192:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201365.418598:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5116a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2359:x1875064442712192:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 1218us (6874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201365.418613:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 225 00000001:02000400:0.0:1788201365.455259:0:17010:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788201366.376234:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201367.397615:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201368.422317:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788201369.317767:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201369.317777:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201369.317781:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201369.317784:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788201369.317870:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458259456:0@lo:400:kworker.0 00000100:00100000:3.0:1788201369.317973:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201369.318062:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201369.318069:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458259584:0@lo:400:kworker.0 00000100:00100000:3.0:1788201369.318095:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201369.318236:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458259456 00000100:00100000:1.0:1788201369.318246:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458259456 00000100:00100000:1.0:1788201369.318362:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458259584 00000100:00100000:1.0:1788201369.318366:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458259584 00000100:00100000:1.0:1788201369.318394:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788201369.318406:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458259456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201369.318617:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458259456:12345-0@lo:400:kworker.0 Request processed in 213us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201369.318627:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788201369.318648:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788201369.318655:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458259584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201369.318687:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458259584:12345-0@lo:400:kworker.0 Request processed in 33us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201369.318694:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788201369.318738:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458259584:0@lo:400:kworker.0 00000100:00100000:1.0:1788201369.318758:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458259456:0@lo:400:kworker.0 00000100:00100000:2.0:1788201369.318954:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458259712:0@lo:400:kworker.0 00000100:00100000:2.0:1788201369.318998:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201369.319031:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201369.319038:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458259328:0@lo:400:kworker.0 00000100:00100000:2.0:1788201369.319068:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788201369.320841:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201369.320854:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201369.320955:0:16720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458259712 00000100:00100000:1.0:1788201369.320968:0:16720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458259712 00000100:00100000:1.0:1788201369.321043:0:16720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788201369.321055:0:16720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458259712:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788201369.321078:0:16720:0:(ldlm_lib.c:3212:target_queue_recovery_request()) @@@ not queueing req@ffff9e04f000d500 x1875064458259712/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:490/0 lens 224/0 e 0 to 0 dl 1788201380 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201369.321190:0:16720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458259712:12345-0@lo:400:kworker.0 Request processed in 137us (2191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201369.321198:0:16720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788201369.321235:0:16713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458259328 00000100:00100000:1.0:1788201369.321240:0:16713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458259328 00000100:00100000:1.0:1788201369.323669:0:16713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788201369.323702:0:16713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9559850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3312:x1875064458259328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201369.323825:0:16713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9559850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3312:x1875064458259328:12345-0@lo:400:kworker.0 Request processed in 140us (4755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201369.323834:0:16713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788201369.323972:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458259328:0@lo:400:kworker.0 00010000:00080000:2.0:1788201369.323994:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e04f00dc000 x1875064458259712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201369.324009:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458259712:0@lo:400:kworker.0 00010000:00010000:2.0:1788201369.447046:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201370.470348:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201370.513643:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201370.513746:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201370.513852:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201370.513999:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442712832 00000100:00100000:3.0:1788201370.514009:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442712832 00000100:00100000:3.0:1788201370.514085:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442712960 00000100:00100000:3.0:1788201370.514600:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442712960 00000100:00100000:3.0:1788201370.514639:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 228 00000100:00100000:3.0:1788201370.514649:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2361:x1875064442712832:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201370.514725:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2361:x1875064442712832:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 77us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201370.514732:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 228 00000100:00100000:3.0:1788201370.514750:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 229 00000100:00100000:3.0:1788201370.514757:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2362:x1875064442712960:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201370.514795:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2362:x1875064442712960:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 39us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201370.514801:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 229 00000100:00080000:3.0:1788201370.514822:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201370.514827:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201370.515247:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201370.515325:0:16722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442712704 00000100:00100000:3.0:1788201370.515331:0:16722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442712704 00000100:00100000:3.0:1788201370.515359:0:16722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:3.0:1788201370.515365:0:16722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2358:x1875064442712704:12345-192.168.201.30@tcp:38:kworker.0 00010000:00080000:3.0:1788201370.515389:0:16722:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '35604eb4-baf9-45be-a20a-4883a2cd8cf9' at ffff9e04f9029800, cookie 0x9383f985bc4d4c8f 00010000:00080000:3.0:1788201370.515395:0:16722:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp recovering/t12884901908 exp ffff9e04f9029800 cur 645 last 1788201359 00010000:02000400:3.0:1788201370.515403:0:16722:0:(ldlm_lib.c:2037:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 1 client reconnects 00000100:00100000:2.0:1788201370.516517:0:16738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442712576 00000100:00100000:2.0:1788201370.516526:0:16738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442712576 00000100:00100000:2.0:1788201370.516718:0:16738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00100000:2.0:1788201370.516729:0:16738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f950d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7ad49433-54fa-4e21-b756-859420d95603+10:2361:x1875064442712576:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201370.516799:0:16738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f950d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7ad49433-54fa-4e21-b756-859420d95603+10:2361:x1875064442712576:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 72us (3165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201370.516806:0:16738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 64 00010000:00080000:3.0:1788201370.528197:0:16722:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:3.0:1788201370.528250:0:16722:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type 77, return 77 00000100:00080000:3.0:1788201370.529554:0:16722:0:(import.c:65:import_set_state_nolock()) ffff9e03c55b0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201370.529740:0:16722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2358:x1875064442712704:12345-192.168.201.30@tcp:38:kworker.0 Request processed in 14371us (14492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201370.529753:0:16722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2 00010000:00080000:1.0:1788201370.529884:0:16757:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 1 abort 0 expired 0 00010000:00080000:1.0:1788201370.529891:0:16757:0:(ldlm_lib.c:2684:replay_request_or_update()) Waiting for transno 12884901941 00000020:00080000:1.0:1788201370.529896:0:16757:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788201370.529900:0:16757:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 0, req_transno: 0, next_transno: 12884901941 00000020:00080000:1.0:1788201370.529904:0:16757:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788201370.529906:0:16757:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 0, req_transno: 0, next_transno: 12884901941 00000100:00100000:0.0:1788201370.542710:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201370.542836:0:16721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442713088 00000100:00100000:3.0:1788201370.542846:0:16721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442713088 00000100:00100000:3.0:1788201370.542906:0:16721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:3.0:1788201370.542916:0:16721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2358:x1875064442713088:12345-192.168.201.30@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1788201370.542942:0:16721:0:(ldlm_lib.c:3188:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9e03c5486a00 x1875064442713088/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:491/0 lens 328/0 e 0 to 0 dl 1788201381 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201370.542972:0:16721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2358:x1875064442713088:12345-192.168.201.30@tcp:101:ldlm_lock_repla.0 Request processed in 59us (273us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201370.542978:0:16721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3 00000020:00080000:2.0:1788201370.543426:0:16757:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788201370.543432:0:16757:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 1, connected: 1, completed: 1, queue_len: 0, req_transno: 0, next_transno: 12884901941 00010000:00080000:2.0:1788201370.543436:0:16757:0:(ldlm_lib.c:2263:check_for_next_transno()) waking for completed recovery 00000020:00080000:2.0:1788201370.543439:0:16757:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788201370.543446:0:16757:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788201370.543449:0:16757:0:(ldlm_lib.c:2283:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788201370.543457:0:16757:0:(ldlm_lib.c:2889:target_recovery_thread()) @@@ processing lock from 192.168.201.30@tcp: req@ffff9e03c5486a00 x1875064442713088/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:491/0 lens 328/0 e 0 to 0 dl 1788201381 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788201370.543477:0:16757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201370.543524:0:16757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28c00/0x9383f985bc4d4dae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5078 expref: -99 pid: 16757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.543561:0:16757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28c00/0x9383f985bc4d4dae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5078 expref: 7 pid: 16757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.543579:0:16757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28c00/0x9383f985bc4d4dae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5078 expref: 7 pid: 16757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.543588:0:16757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0501b28c00, rc 0) 00010000:00080000:2.0:1788201370.543656:0:16757:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00010000:00080000:2.0:1788201370.543668:0:16757:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00000100:00100000:0.0:1788201370.546897:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201370.547036:0:16722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442713216 00000100:00100000:3.0:1788201370.547046:0:16722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442713216 00000100:00100000:3.0:1788201370.547112:0:16722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:3.0:1788201370.547130:0:16722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2358:x1875064442713216:12345-192.168.201.30@tcp:400:ptlrpcd_rcv.0 00010000:00080000:3.0:1788201370.547159:0:16722:0:(ldlm_lib.c:3138:target_queue_recovery_request()) @@@ queue final req req@ffff9e04f4f21500 x1875064442713216/t0(0) o400->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:491/0 lens 224/0 e 0 to 0 dl 1788201381 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201370.547191:0:16722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2358:x1875064442713216:12345-192.168.201.30@tcp:400:ptlrpcd_rcv.0 Request processed in 62us (308us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201370.547198:0:16722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1 00010000:00080000:2.0:1788201370.547521:0:16757:0:(ldlm_lib.c:2286:check_for_next_lock()) waking for completed lock replay 00000001:00000004:2.0:1788201370.547790:0:16757:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 4, last_transno is 17179869184 00000001:00100000:0.0:1788201370.612967:0:16726:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 35604eb4-baf9-45be-a20a-4883a2cd8cf9 00000001:00080000:2.0:1788201370.613157:0:16757:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:2.0:1788201370.613230:0:16757:0:(ldlm_lib.c:1997:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:2.0:1788201370.613265:0:16757:0:(ldlm_lib.c:2941:target_recovery_thread()) @@@ processing final ping from 192.168.201.30@tcp: req@ffff9e04f4f21500 x1875064442713216/t0(0) o400->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:491/0 lens 224/0 e 0 to 0 dl 1788201381 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788201370.613655:0:16757:0:(ldlm_lib.c:1869:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:01, of 1 clients 1 recovered and 0 were evicted. 00000100:00100000:0.0:1788201370.650650:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201370.650703:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201370.650742:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201370.650780:0:16721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442712448 00000100:00100000:0.0:1788201370.650793:0:16721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442712448 00000100:00100000:0.0:1788201370.650859:0:16721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442704256 00000100:00100000:0.0:1788201370.650863:0:16721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442704256 00000100:00100000:0.0:1788201370.650875:0:16721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442704000 00000100:00100000:0.0:1788201370.650877:0:16721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442704000 00000100:00100000:0.0:1788201370.650900:0:16721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:0.0:1788201370.650912:0:16721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:16741:x1875064442712448:12345-192.168.201.30@tcp:41:lfs.0 00000004:00000024:0.0:1788201370.651237:0:16721:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788201370.655034:0:16721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:16741:x1875064442712448:12345-192.168.201.30@tcp:41:lfs.0 Request processed in 4107us (4383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201370.655053:0:16721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:0.0:1788201370.655196:0:16721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:0.0:1788201370.655213:0:16721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1a73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:16414:x1875064442704256:12345-192.168.201.30@tcp:36:chmod.0 00000100:00100000:0.0:1788201370.656401:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201370.656587:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201370.656620:0:16720:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788201370.656632:0:16720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788201370.656753:0:16722:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788201370.656763:0:16722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442705152 00000100:00100000:0.0:1788201370.656774:0:16722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442705152 00000100:00100000:0.0:1788201370.656819:0:16722:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788201370.656826:0:16722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442705920 00000100:00100000:0.0:1788201370.656829:0:16722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442705920 00000100:00100000:0.0:1788201370.656867:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201370.656905:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442711296 00000100:00100000:0.0:1788201370.656910:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442711296 00000100:00100000:0.0:1788201370.661562:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 887 00000100:00100000:0.0:1788201370.661596:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c6bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:0:x1875064442711296:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:0.0:1788201370.661658:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201370.661690:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c200/0x9383f985bc4d4db5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c525b expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201370.664582:0:16721:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 8377us 00000100:00100000:0.0:1788201370.666795:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201370.667131:0:6715:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 2 min 2 max 16 00000100:00100000:2.0:1788201370.667144:0:6715:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_002' 00000100:00100000:0.0:1788201370.667870:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201370.667900:0:16722:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788201370.667912:0:16722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442706176 00000100:00100000:0.0:1788201370.667925:0:16722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442706176 00000100:00100000:2.0:1788201370.668072:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442710912 00000100:00100000:2.0:1788201370.668086:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442710912 00000100:00100000:2.0:1788201370.668244:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 888 00000100:00100000:2.0:1788201370.668257:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4dec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:0:x1875064442710912:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:2.0:1788201370.668466:0:17128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201370.668497:0:17128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d4dbc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5246 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201370.668678:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201370.668716:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201370.668734:0:6715:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 3 min 2 max 16 00000100:00100000:0.0:1788201370.668741:0:6715:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_003' 00000100:00100000:0.0:1788201370.668856:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201370.668894:0:16720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442705536 00000100:00100000:0.0:1788201370.668899:0:16720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442705536 00000100:00100000:0.0:1788201370.676316:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442711168 00000100:00100000:0.0:1788201370.676340:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442711168 00000100:00100000:0.0:1788201370.676409:0:6715:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 3 min 2 max 16 00000100:00100000:0.0:1788201370.676421:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442711040 00000100:00100000:0.0:1788201370.676424:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442711040 00000100:00100000:0.0:1788201370.676796:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:0.0:1788201370.676812:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+18:16412:x1875064442704000:12345-192.168.201.30@tcp:36:chmod.0 00000100:00100000:0.0:1788201370.681811:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201370.681977:0:16720:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788201370.681991:0:16720:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1788201370.684754:0:16720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442706432 00000100:00100000:0.0:1788201370.684771:0:16720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442706432 00000100:00100000:2.0:1788201370.685720:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 889 00000100:00100000:2.0:1788201370.685738:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4def800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:0:x1875064442711168:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:2.0:1788201370.685800:0:17129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201370.685828:0:17129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97000/0x9383f985bc4d4dc3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5254 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201370.687049:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:0.0:1788201370.687069:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0501b34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:16413:x1875064442705152:12345-192.168.201.30@tcp:36:chmod.0 00000100:00100000:2.0:1788201370.687885:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201370.688030:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442714240 00000100:00100000:0.0:1788201370.688042:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442714240 00000100:00100000:0.0:1788201370.688190:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 166 00000100:00100000:0.0:1788201370.688202:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:16741:x1875064442714240:12345-192.168.201.30@tcp:13:lfs.0 00002000:00000024:0.0:1788201370.688243:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524877824 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1788201370.689523:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:16741:x1875064442714240:12345-192.168.201.30@tcp:13:lfs.0 Request processed in 1315us (1635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201370.689536:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 166 00000100:00100000:2.0:1788201370.693482:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201370.695278:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442714368 00000100:00100000:1.0:1788201370.695379:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442714368 00000100:00100000:1.0:1788201370.695469:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 167 00000100:00100000:1.0:1788201370.695482:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:16741:x1875064442714368:12345-192.168.201.30@tcp:13:lfs.0 00002000:00000024:1.0:1788201370.695540:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 13631488 granted 524877824 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201370.695646:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:16741:x1875064442714368:12345-192.168.201.30@tcp:13:lfs.0 Request processed in 166us (2192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201370.695655:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 167 00010000:00010000:0.0:1788201370.712986:0:17128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d4dca lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.713015:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d4dca lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.713032:0:17128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d4dca lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.713050:0:17128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d4dd1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xad7e02ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.713058:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d4dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.713065:0:17128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d4dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201370.713827:0:17130:0:(mdt_recovery.c:90:mdt_req_from_lrd()) @@@ restoring transno req@ffff9e0501b34a80 x1875064442705152/t0(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:491/0 lens 488/3152 e 0 to 0 dl 1788201381 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00000004:00000400:1.0:1788201370.713845:0:17130:0:(mdt_recovery.c:102:mdt_req_from_lrd()) @@@ restoring transno req@ffff9e0501b34a80 x1875064442705152/t12884901936(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:491/0 lens 488/3152 e 0 to 0 dl 1788201381 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788201370.715001:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97e00/0x9383f985bc4d4dd8 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.715026:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97e00/0x9383f985bc4d4dd8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.715045:0:17129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97e00/0x9383f985bc4d4dd8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.715072:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d4ddf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x73702ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.715080:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d4ddf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x73702ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.715088:0:17129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d4ddf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x73702ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.720136:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d4de6 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.720167:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d4de6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.720192:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d4de6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.720209:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d4ded lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xa05302ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.720217:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d4ded lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.720224:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d4ded lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201370.722725:0:17126:0:(mdt_recovery.c:90:mdt_req_from_lrd()) @@@ restoring transno req@ffff9e03c1a70380 x1875064442704000/t0(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:491/0 lens 488/3152 e 0 to 0 dl 1788201381 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00000004:00000400:2.0:1788201370.722747:0:17126:0:(mdt_recovery.c:102:mdt_req_from_lrd()) @@@ restoring transno req@ffff9e03c1a70380 x1875064442704000/t12884901934(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:491/0 lens 488/3152 e 0 to 0 dl 1788201381 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00000004:00000080:3.0:1788201370.724713:0:16757:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffad6102c97e10 00100000:10000000:3.0:1788201370.724730:0:16757:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:2.0:1788201370.730218:0:16744:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x444:0x0] 00000100:00100000:2.0:1788201370.730326:0:16744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:16744:1875064458259840:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788201370.730424:0:16744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201370.730582:0:16744:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1c0b480 going to sleep for 50 seconds 00000004:00080000:2.0:1788201370.730605:0:16746:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x445:0x0] 00000100:00100000:2.0:1788201370.730630:0:16746:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:16746:1875064458259968:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788201370.730661:0:16746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201370.730679:0:16746:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d0405780 going to sleep for 50 seconds 00000100:00100000:2.0:1788201370.730704:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458259840 00000100:00100000:2.0:1788201370.730713:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458259840 00000100:00100000:2.0:1788201370.730765:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458259968 00000100:00100000:2.0:1788201370.730769:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458259968 00000100:00100000:2.0:1788201370.730792:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4271 00000100:00100000:2.0:1788201370.730802:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:16744:x1875064458259840:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788201370.730839:0:13445:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1121 -> diff = -29 00002000:02000040:2.0:1788201370.730845:0:13445:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:1093 to 0x240000400:1121) 00000100:00100000:3.0:1788201370.731065:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4272 00000100:00100000:3.0:1788201370.731076:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:16746:x1875064458259968:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788201370.731093:0:13441:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1121 -> diff = -28 00002000:02000040:3.0:1788201370.731097:0:13441:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:1094 to 0x280000400:1121) 00010000:00010000:0.0:1788201370.731116:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d4de6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.731126:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d4de6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.731135:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d4de6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.731142:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201370.731147:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d4de6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201370.731149:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x461:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.731155:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b34dacfa/0x9383f985bc4d4df4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x461:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.731157:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d4de6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.731174:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x461:0x0].0x0 since=645s v=(0 0) 00010000:00010000:0.0:1788201370.731186:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5800) 00010000:00010000:3.0:1788201370.731189:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x461:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201370.731190:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201370.731197:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d4de6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.731198:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b34dacfa/0x9383f985bc4d4df4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x461:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.731204:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d4de6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.731214:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b34dacfa/0x9383f985bc4d4df4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x461:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.731216:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d4ded lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.731223:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d4ded lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.731224:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b34dacfa/0x9383f985bc4d4df4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x461:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.731230:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d4ded lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.731232:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b34dacfa/0x9383f985bc4d4df4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x461:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.731235:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201370.731238:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d4ded lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.731242:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d4ded lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.731253:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201370.731259:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0xa05302ea (ffff9e03c2fc5a00) 00010000:00010000:0.0:1788201370.731261:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201370.731264:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d4ded lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.731269:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d4ded lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xa05302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201370.732150:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x460:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.732160:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d4dfb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x460:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.732172:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x460:0x0].0x0 since=645s v=(0 0) 00010000:00010000:3.0:1788201370.732185:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x460:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.732190:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d4dfb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x460:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.732201:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d4dfb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x460:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.732210:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d4dfb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x460:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.732222:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d4dfb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x460:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.732240:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788201370.732256:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c200/0x9383f985bc4d4db5 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c525b expref: 20 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.732271:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5800) 00010000:00010000:0.0:1788201370.732275:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201370.732280:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c200/0x9383f985bc4d4db5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c525b expref: 20 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.733131:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c507c200, rc -2) 00000100:00100000:0.0:1788201370.733723:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c6bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:0:x1875064442711296:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 72135us (76847us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201370.733738:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 887 00000100:00100000:0.0:1788201370.733789:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 890 00000100:00100000:0.0:1788201370.733804:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d1f0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+18:0:x1875064442711040:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:0.0:1788201370.733850:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201370.733872:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d4e02 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c524d expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.733955:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d4e09 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.733971:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d4e09 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.733984:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d4e09 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.734003:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d4e10 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x53c502ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.734017:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d4e10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.734024:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d4e10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201370.736831:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x45f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.736849:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecaefa8a/0x9383f985bc4d4e17 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x45f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.736871:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x45f:0x0].0x0 since=645s v=(0 0) 00010000:00010000:3.0:1788201370.736878:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x45f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.736886:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecaefa8a/0x9383f985bc4d4e17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x45f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.736902:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecaefa8a/0x9383f985bc4d4e17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x45f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.736914:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecaefa8a/0x9383f985bc4d4e17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x45f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.736922:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecaefa8a/0x9383f985bc4d4e17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.736957:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788201370.737270:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d4e09 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.737280:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d4e09 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.737288:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d4e09 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.737309:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201370.737314:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d4e09 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.737323:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d4e09 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.737342:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5800) 00010000:00010000:0.0:1788201370.737345:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201370.737351:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d4e09 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.737357:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d4e09 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.737373:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d4e10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.737379:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d4e10 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.737384:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d4e10 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.737389:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201370.737392:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d4e10 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.737397:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d4e10 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.737405:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x53c502ea (ffff9e03c2fc5100) 00010000:00010000:0.0:1788201370.737407:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201370.737410:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d4e10 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.737415:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d4e10 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.737469:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d4e02 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c524d expref: 19 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.737481:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5800) 00010000:00010000:0.0:1788201370.737483:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201370.737487:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d4e02 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c524d expref: 19 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.737503:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc6000, rc -2) 00000100:00100000:0.0:1788201370.737593:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d1f0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+18:0:x1875064442711040:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 3792us (68734us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201370.737603:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 890 00002000:00010000:3.0:1788201370.737843:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x45e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00000100:00100000:0.0:1788201370.737845:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+17:16412:x1875064442704000:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 61037us (87101us total) trans 12884901934 rc 0/0 00010000:00010000:3.0:1788201370.737850:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d4e1e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x45e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201370.737853:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00010000:00010000:3.0:1788201370.737861:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x45e:0x0].0x0 since=645s v=(0 0) 00010000:00010000:3.0:1788201370.737865:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x45e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.737869:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d4e1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x45e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.737878:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d4e1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x45e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201370.737880:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00010000:00010000:3.0:1788201370.737886:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d4e1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x45e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.737892:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d4e1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201370.737894:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0501b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:16415:x1875064442705920:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:3.0:1788201370.737902:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000004:00080000:0.0:1788201370.737960:0:17126:0:(mdt_recovery.c:90:mdt_req_from_lrd()) @@@ restoring transno req@ffff9e0501b36a00 x1875064442705920/t0(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:491/0 lens 488/3152 e 0 to 0 dl 1788201381 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00000004:00000400:0.0:1788201370.737971:0:17126:0:(mdt_recovery.c:102:mdt_req_from_lrd()) @@@ restoring transno req@ffff9e0501b36a00 x1875064442705920/t12884901938(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:491/0 lens 488/3152 e 0 to 0 dl 1788201381 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00002000:00010000:3.0:1788201370.738236:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x45d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.738241:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d4e25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x45d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.738249:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x45d:0x0].0x0 since=645s v=(0 0) 00010000:00010000:3.0:1788201370.738252:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x45d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.738256:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d4e25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x45d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.738265:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d4e25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x45d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.738289:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d4e25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x45d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.738314:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d4e25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.738324:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788201370.738850:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x45c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.738857:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fe5b943/0x9383f985bc4d4e2c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x45c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.738865:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x45c:0x0].0x0 since=645s v=(0 0) 00010000:00010000:3.0:1788201370.738868:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x45c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.738872:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fe5b943/0x9383f985bc4d4e2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x45c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.738881:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fe5b943/0x9383f985bc4d4e2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x45c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.738889:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fe5b943/0x9383f985bc4d4e2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x45c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.738896:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fe5b943/0x9383f985bc4d4e2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.738910:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1788201370.739231:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x45b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.739238:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007f5270e/0x9383f985bc4d4e33 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x45b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.739246:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x45b:0x0].0x0 since=645s v=(0 0) 00010000:00010000:3.0:1788201370.739249:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x45b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.739253:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007f5270e/0x9383f985bc4d4e33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x45b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.739262:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007f5270e/0x9383f985bc4d4e33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x45b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.739270:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007f5270e/0x9383f985bc4d4e33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x45b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.739276:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007f5270e/0x9383f985bc4d4e33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.739333:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:0.0:1788201370.745902:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0501b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:16415:x1875064442705920:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 7994us (89296us total) trans 12884901938 rc 0/0 00000100:00100000:0.0:1788201370.745919:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:0.0:1788201370.745975:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:0.0:1788201370.745991:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:16416:x1875064442706176:12345-192.168.201.30@tcp:36:chmod.0 00000004:00080000:0.0:1788201370.746062:0:17126:0:(mdt_recovery.c:90:mdt_req_from_lrd()) @@@ restoring transno req@ffff9e04f4ded180 x1875064442706176/t0(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:491/0 lens 488/3152 e 0 to 0 dl 1788201381 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00000004:00000400:0.0:1788201370.746074:0:17126:0:(mdt_recovery.c:102:mdt_req_from_lrd()) @@@ restoring transno req@ffff9e04f4ded180 x1875064442706176/t12884901939(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:491/0 lens 488/3152 e 0 to 0 dl 1788201381 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201370.753428:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:16416:x1875064442706176:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 7425us (85546us total) trans 12884901939 rc 0/0 00000100:00100000:0.0:1788201370.753444:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:0.0:1788201370.755233:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:0.0:1788201370.755282:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:16417:x1875064442705536:12345-192.168.201.30@tcp:36:chmod.0 00000004:00080000:0.0:1788201370.758052:0:17126:0:(mdt_recovery.c:90:mdt_req_from_lrd()) @@@ restoring transno req@ffff9e04f4dece00 x1875064442705536/t0(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:491/0 lens 488/3152 e 0 to 0 dl 1788201381 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00000004:00000400:0.0:1788201370.758073:0:17126:0:(mdt_recovery.c:102:mdt_req_from_lrd()) @@@ restoring transno req@ffff9e04f4dece00 x1875064442705536/t12884901937(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:491/0 lens 488/3152 e 0 to 0 dl 1788201381 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201370.758650:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:16417:x1875064442705536:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 3396us (89969us total) trans 12884901937 rc 0/0 00000100:00100000:0.0:1788201370.758662:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:0.0:1788201370.758709:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:0.0:1788201370.758723:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d1f0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:16411:x1875064442706432:12345-192.168.201.30@tcp:36:chmod.0 00000004:00080000:0.0:1788201370.758751:0:17126:0:(mdt_recovery.c:90:mdt_req_from_lrd()) @@@ restoring transno req@ffff9e04d1f0df80 x1875064442706432/t0(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:491/0 lens 488/3152 e 0 to 0 dl 1788201381 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00000004:00000400:0.0:1788201370.758760:0:17126:0:(mdt_recovery.c:102:mdt_req_from_lrd()) @@@ restoring transno req@ffff9e04d1f0df80 x1875064442706432/t12884901940(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:491/0 lens 488/3152 e 0 to 0 dl 1788201381 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201370.758935:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d1f0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:16411:x1875064442706432:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 216us (77138us total) trans 12884901940 rc 0/0 00000100:00100000:0.0:1788201370.758942:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00010000:00010000:0.0:1788201370.759167:0:17128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d4dca lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.759195:0:17128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d4dca lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.759204:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d4dca lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.759211:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201370.759217:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d4dca lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.759226:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d4dca lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.759248:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5800) 00010000:00010000:0.0:1788201370.759251:0:17128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201370.759255:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d4dca lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.759261:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d4dca lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.759273:0:17128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d4dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.759278:0:17128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d4dd1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.759283:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d4dd1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.759289:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507c800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201370.759320:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d4dd1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.759327:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d4dd1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.759334:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0xad7e02ea (ffff9e03c2fc5b00) 00010000:00010000:0.0:1788201370.759337:0:17128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201370.759341:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d4dd1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.759345:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d4dd1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xad7e02ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.759386:0:17128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d4dbc lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5246 expref: 12 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.759398:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5800) 00010000:00010000:0.0:1788201370.759400:0:17128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201370.759404:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d4dbc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5246 expref: 12 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.759414:0:17128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0501b29a00, rc -2) 00000100:00100000:0.0:1788201370.759455:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4dec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:0:x1875064442710912:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 91201us (92675us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201370.759465:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 888 00000004:00080000:0.0:1788201370.759504:0:16721:0:(mdt_recovery.c:90:mdt_req_from_lrd()) @@@ restoring transno req@ffff9e03c1a73800 x1875064442704256/t0(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:491/0 lens 488/3152 e 0 to 0 dl 1788201381 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00000004:00000400:0.0:1788201370.759514:0:16721:0:(mdt_recovery.c:102:mdt_req_from_lrd()) @@@ restoring transno req@ffff9e03c1a73800 x1875064442704256/t12884901935(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:491/0 lens 488/3152 e 0 to 0 dl 1788201381 ref 1 fl Interpret:/202/0 rc 0/0 job:'chmod.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201370.759728:0:16721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1a73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:16414:x1875064442704256:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 104522us (109023us total) trans 12884901935 rc 0/0 00000100:00100000:0.0:1788201370.759736:0:16721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00010000:00010000:0.0:1788201370.759792:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97e00/0x9383f985bc4d4dd8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.759801:0:17129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97e00/0x9383f985bc4d4dd8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.759808:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97e00/0x9383f985bc4d4dd8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.759814:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201370.759818:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97e00/0x9383f985bc4d4dd8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.759824:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97e00/0x9383f985bc4d4dd8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.759832:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5800) 00010000:00010000:0.0:1788201370.759835:0:17129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201370.759838:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97e00/0x9383f985bc4d4dd8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.759844:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97e00/0x9383f985bc4d4dd8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.759854:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d4ddf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x73702ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.759860:0:17129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d4ddf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x73702ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.759867:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d4ddf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x73702ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.759873:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201370.759875:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d4ddf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x73702ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.759882:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d4ddf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x73702ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.759891:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x73702ea (ffff9e03c33e8f00) 00010000:00010000:0.0:1788201370.759893:0:17129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201370.759896:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d4ddf lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x73702ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.759902:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d4ddf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x73702ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.759929:0:17129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97000/0x9383f985bc4d4dc3 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5254 expref: 9 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.759939:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5800) 00010000:00010000:0.0:1788201370.759941:0:17129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201370.759944:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97000/0x9383f985bc4d4dc3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5254 expref: 9 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.759956:0:17129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c1b97000, rc -2) 00000100:00100000:0.0:1788201370.759982:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4def800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:0:x1875064442711168:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 74251us (91266us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201370.759993:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 889 00002000:00010000:3.0:1788201370.762872:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x45a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.762889:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075aceb8e/0x9383f985bc4d4e3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x45a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.762910:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x45a:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.762917:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x45a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.762925:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075aceb8e/0x9383f985bc4d4e3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x45a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.762943:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075aceb8e/0x9383f985bc4d4e3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x45a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.762955:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075aceb8e/0x9383f985bc4d4e3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x45a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.762965:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075aceb8e/0x9383f985bc4d4e3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.762979:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:3.0:1788201370.763385:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x459:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.763391:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c30a815/0x9383f985bc4d4e41 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x459:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.763401:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x459:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.763404:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x459:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.763408:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c30a815/0x9383f985bc4d4e41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x459:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.763417:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c30a815/0x9383f985bc4d4e41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x459:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.763425:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c30a815/0x9383f985bc4d4e41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x459:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.763433:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c30a815/0x9383f985bc4d4e41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x459:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.763443:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:3.0:1788201370.763730:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x458:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.763737:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b6707ed/0x9383f985bc4d4e48 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.763746:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x458:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.763749:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x458:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.763753:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b6707ed/0x9383f985bc4d4e48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.763763:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b6707ed/0x9383f985bc4d4e48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.763772:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b6707ed/0x9383f985bc4d4e48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.763780:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b6707ed/0x9383f985bc4d4e48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.763789:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:3.0:1788201370.764100:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x457:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.764106:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f025b68e/0x9383f985bc4d4e4f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.764116:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x457:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.764119:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x457:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.764124:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f025b68e/0x9383f985bc4d4e4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.764133:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f025b68e/0x9383f985bc4d4e4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.764142:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f025b68e/0x9383f985bc4d4e4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.764151:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f025b68e/0x9383f985bc4d4e4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.764160:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:3.0:1788201370.764580:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x456:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.764586:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6d23568/0x9383f985bc4d4e56 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.764596:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x456:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.764599:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x456:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.764603:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6d23568/0x9383f985bc4d4e56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.764613:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6d23568/0x9383f985bc4d4e56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.764628:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6d23568/0x9383f985bc4d4e56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.764636:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6d23568/0x9383f985bc4d4e56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.764645:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:3.0:1788201370.764954:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x455:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.764960:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040097fff/0x9383f985bc4d4e5d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.764968:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x455:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.764971:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x455:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.764975:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040097fff/0x9383f985bc4d4e5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.764984:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040097fff/0x9383f985bc4d4e5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.764993:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040097fff/0x9383f985bc4d4e5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.765001:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040097fff/0x9383f985bc4d4e5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.765014:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:3.0:1788201370.766634:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x454:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.766650:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d4e64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.766667:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x454:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.766671:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x454:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.766677:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d4e64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.766689:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d4e64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.766699:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d4e64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.766706:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d4e64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.766718:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:3.0:1788201370.767207:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x453:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.767214:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bcb7128/0x9383f985bc4d4e6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x453:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.767224:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x453:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.767228:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x453:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.767232:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bcb7128/0x9383f985bc4d4e6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x453:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.767243:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bcb7128/0x9383f985bc4d4e6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x453:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.767252:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bcb7128/0x9383f985bc4d4e6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x453:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.767260:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005bcb7128/0x9383f985bc4d4e6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x453:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.767269:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:3.0:1788201370.767950:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x452:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.767958:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d4e72 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x452:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.767969:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x452:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.767973:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x452:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.767977:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d4e72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x452:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.767988:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d4e72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x452:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.768008:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d4e72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x452:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.768017:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d4e72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x452:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.768027:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:3.0:1788201370.768679:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x451:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.768687:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d4e79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x451:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.768696:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x451:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.768699:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x451:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.768703:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d4e79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x451:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.768711:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d4e79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x451:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.768719:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d4e79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x451:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.768725:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d4e79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x451:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.768734:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:3.0:1788201370.769052:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x450:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.769255:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d65ba541/0x9383f985bc4d4e80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x450:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.769266:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x450:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.769269:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x450:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.769273:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d65ba541/0x9383f985bc4d4e80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x450:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.769375:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d65ba541/0x9383f985bc4d4e80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x450:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.769385:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d65ba541/0x9383f985bc4d4e80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x450:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.769393:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d65ba541/0x9383f985bc4d4e80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x450:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.769404:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00002000:00010000:3.0:1788201370.769841:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x44f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.769848:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e4d980a/0x9383f985bc4d4e87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x44f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.769856:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x44f:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.769859:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x44f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.769863:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e4d980a/0x9383f985bc4d4e87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x44f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.769872:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e4d980a/0x9383f985bc4d4e87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x44f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.769885:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e4d980a/0x9383f985bc4d4e87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x44f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.769892:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e4d980a/0x9383f985bc4d4e87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x44f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.769901:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00010000:00010000:1.0:1788201370.771690:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:1.0:1788201370.771706:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b34dacfa/0x9383f985bc4d4df4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x461:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.771722:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201370.771727:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b34dacfa/0x9383f985bc4d4df4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x461:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.771740:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b34dacfa/0x9383f985bc4d4df4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x461:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.771766:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b34dacfa/0x9383f985bc4d4df4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x461:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.771775:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b34dacfa/0x9383f985bc4d4df4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x461:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.771809:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:1.0:1788201370.771814:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d4dfb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x460:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.771821:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201370.771824:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d4dfb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x460:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.771833:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d4dfb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x460:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.771844:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d4dfb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x460:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.771852:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001710cf90/0x9383f985bc4d4dfb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x460:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.771864:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:1.0:1788201370.771868:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecaefa8a/0x9383f985bc4d4e17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.771874:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201370.771877:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecaefa8a/0x9383f985bc4d4e17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.771885:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecaefa8a/0x9383f985bc4d4e17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x45f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.771894:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecaefa8a/0x9383f985bc4d4e17 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x45f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.771901:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecaefa8a/0x9383f985bc4d4e17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x45f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.771918:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:1.0:1788201370.771921:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d4e1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.771927:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201370.773420:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:3.0:1788201370.773438:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d4e25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.773453:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5065e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201370.774134:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d4e25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774148:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d4e25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x45d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774183:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d4e25 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x45d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774191:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000332f1758/0x9383f985bc4d4e25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x45d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.774208:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d4e1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774214:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:3.0:1788201370.774220:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fe5b943/0x9383f985bc4d4e2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.774221:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d4e1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x45e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774228:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c5064c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201370.774231:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fe5b943/0x9383f985bc4d4e2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.774234:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d4e1e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x45e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774239:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fe5b943/0x9383f985bc4d4e2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x45c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.774242:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a966d82/0x9383f985bc4d4e1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x45e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774249:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fe5b943/0x9383f985bc4d4e2c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x45c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774255:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fe5b943/0x9383f985bc4d4e2c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x45c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774268:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:3.0:1788201370.774272:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007f5270e/0x9383f985bc4d4e33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774362:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201370.774366:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007f5270e/0x9383f985bc4d4e33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774374:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007f5270e/0x9383f985bc4d4e33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x45b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774390:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007f5270e/0x9383f985bc4d4e33 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x45b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774398:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007f5270e/0x9383f985bc4d4e33 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x45b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774413:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:3.0:1788201370.774418:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075aceb8e/0x9383f985bc4d4e3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774424:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201370.774426:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075aceb8e/0x9383f985bc4d4e3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774433:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075aceb8e/0x9383f985bc4d4e3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x45a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774442:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075aceb8e/0x9383f985bc4d4e3a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x45a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774448:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075aceb8e/0x9383f985bc4d4e3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x45a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774528:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:3.0:1788201370.774533:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c30a815/0x9383f985bc4d4e41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x459:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774541:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201370.774544:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c30a815/0x9383f985bc4d4e41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x459:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774551:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c30a815/0x9383f985bc4d4e41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x459:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774561:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c30a815/0x9383f985bc4d4e41 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x459:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774568:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c30a815/0x9383f985bc4d4e41 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x459:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774580:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1788201370.774584:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b6707ed/0x9383f985bc4d4e48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774590:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201370.774593:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b6707ed/0x9383f985bc4d4e48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774599:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b6707ed/0x9383f985bc4d4e48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774608:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b6707ed/0x9383f985bc4d4e48 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774615:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b6707ed/0x9383f985bc4d4e48 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774625:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1788201370.774629:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f025b68e/0x9383f985bc4d4e4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774634:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201370.774637:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f025b68e/0x9383f985bc4d4e4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774645:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f025b68e/0x9383f985bc4d4e4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774653:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f025b68e/0x9383f985bc4d4e4f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774661:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f025b68e/0x9383f985bc4d4e4f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774673:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1788201370.774678:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6d23568/0x9383f985bc4d4e56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774684:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201370.774689:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6d23568/0x9383f985bc4d4e56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774697:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6d23568/0x9383f985bc4d4e56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774706:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6d23568/0x9383f985bc4d4e56 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774713:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6d23568/0x9383f985bc4d4e56 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774725:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788201370.774731:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040097fff/0x9383f985bc4d4e5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774737:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201370.774741:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040097fff/0x9383f985bc4d4e5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774748:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040097fff/0x9383f985bc4d4e5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774757:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040097fff/0x9383f985bc4d4e5d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774765:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040097fff/0x9383f985bc4d4e5d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774777:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788201370.774781:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d4e64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774788:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201370.774791:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d4e64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774798:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d4e64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774807:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d4e64 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774814:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d4e64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774825:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788201370.774829:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005bcb7128/0x9383f985bc4d4e6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x453:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774835:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201370.774838:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005bcb7128/0x9383f985bc4d4e6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x453:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774851:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005bcb7128/0x9383f985bc4d4e6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x453:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774859:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005bcb7128/0x9383f985bc4d4e6b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x453:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774866:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bcb7128/0x9383f985bc4d4e6b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x453:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774875:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788201370.774879:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d4e72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x452:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774886:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201370.774889:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d4e72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x452:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774896:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d4e72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x452:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774904:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d4e72 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x452:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774911:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d4e72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x452:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774925:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788201370.774928:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d4e79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x451:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774935:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201370.774938:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d4e79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x451:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774945:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d4e79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x451:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774953:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d4e79 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x451:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774960:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d4e79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x451:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774972:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201370.774976:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d65ba541/0x9383f985bc4d4e80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x450:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.774984:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201370.774987:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d65ba541/0x9383f985bc4d4e80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x450:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.775000:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d65ba541/0x9383f985bc4d4e80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x450:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.775010:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d65ba541/0x9383f985bc4d4e80 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x450:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.775018:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d65ba541/0x9383f985bc4d4e80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x450:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.775027:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201370.775029:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201370.775030:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201370.775032:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e4d980a/0x9383f985bc4d4e87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x44f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.775033:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201370.775038:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff128200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201370.775041:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e4d980a/0x9383f985bc4d4e87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x44f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.775054:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e4d980a/0x9383f985bc4d4e87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x44f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.775064:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e4d980a/0x9383f985bc4d4e87 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x44f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.775072:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e4d980a/0x9383f985bc4d4e87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x44f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.775146:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201370.775148:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201370.775150:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201370.780577:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x44e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.780593:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d4e8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x44e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.780615:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x44e:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.780621:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x44e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.780627:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d4e8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x44e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.780645:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d4e8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x44e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.780657:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d4e8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x44e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.780667:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d4e8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x44e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.780700:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201370.780719:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201370.780726:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d4e8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x44e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.780734:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201370.780739:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d4e8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x44e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.780750:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d4e8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x44e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.780769:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d4e8e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x44e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.780777:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d4e8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x44e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.780800:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201370.780802:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201370.780803:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201370.781363:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x44d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.781370:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e9d4bc7/0x9383f985bc4d4e95 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x44d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.781380:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x44d:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.781384:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x44d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.781389:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e9d4bc7/0x9383f985bc4d4e95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x44d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.781399:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e9d4bc7/0x9383f985bc4d4e95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x44d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.781407:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e9d4bc7/0x9383f985bc4d4e95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x44d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.781414:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e9d4bc7/0x9383f985bc4d4e95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x44d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.781436:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201370.781446:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201370.781451:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e9d4bc7/0x9383f985bc4d4e95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x44d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.781459:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201370.781463:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e9d4bc7/0x9383f985bc4d4e95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x44d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.781471:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e9d4bc7/0x9383f985bc4d4e95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x44d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.781484:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e9d4bc7/0x9383f985bc4d4e95 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x44d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.781491:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e9d4bc7/0x9383f985bc4d4e95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x44d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.781503:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201370.781504:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201370.781506:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201370.781663:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0501b34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:16413:x1875064442705152:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 94593us (125267us total) trans 12884901936 rc 0/0 00000100:00100000:1.0:1788201370.781674:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00002000:00010000:3.0:1788201370.781807:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x44c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.781814:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001687b5b9/0x9383f985bc4d4e9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x44c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.781822:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x44c:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.781826:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x44c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.781830:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001687b5b9/0x9383f985bc4d4e9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x44c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.781839:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001687b5b9/0x9383f985bc4d4e9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x44c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.781846:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001687b5b9/0x9383f985bc4d4e9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x44c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.781854:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001687b5b9/0x9383f985bc4d4e9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x44c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.781888:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201370.782019:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201370.782024:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001687b5b9/0x9383f985bc4d4e9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x44c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.782032:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff128400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201370.782036:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001687b5b9/0x9383f985bc4d4e9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x44c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.782045:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001687b5b9/0x9383f985bc4d4e9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x44c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.782062:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001687b5b9/0x9383f985bc4d4e9c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x44c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.782070:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001687b5b9/0x9383f985bc4d4e9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x44c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.782886:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201370.782889:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201370.782892:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201370.784148:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201370.786560:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x44b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.786581:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d4ea3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x44b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.786603:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x44b:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.786609:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x44b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.786616:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d4ea3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x44b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.786634:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d4ea3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x44b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.786647:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d4ea3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x44b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.786656:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d4ea3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x44b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.786728:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201370.788251:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x44a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.788265:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d4eaa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x44a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.788363:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x44a:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.788370:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x44a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.788377:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d4eaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x44a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.788393:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d4eaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x44a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.788404:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d4eaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x44a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.788412:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d4eaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x44a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.795734:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201370.795756:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d4ea3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x44b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.795774:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff128600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201370.795780:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d4ea3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x44b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.795794:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d4ea3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x44b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.795824:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d4ea3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x44b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.795831:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d4ea3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x44b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.795874:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201370.795878:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d4eaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x44a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.795885:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201370.795888:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d4eaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x44a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.795896:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d4eaa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x44a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.795903:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d4eaa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x44a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.795910:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201370.795912:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201370.795914:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201370.796074:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788201370.796083:0:13441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d4eaa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x44a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.796374:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201370.797017:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x449:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.797028:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7f7118e/0x9383f985bc4d4eb1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x449:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.797044:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x449:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.797051:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x449:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.797058:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7f7118e/0x9383f985bc4d4eb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x449:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.797073:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7f7118e/0x9383f985bc4d4eb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x449:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.797085:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7f7118e/0x9383f985bc4d4eb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x449:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.797093:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7f7118e/0x9383f985bc4d4eb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x449:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.797116:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201370.800960:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x448:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.800981:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066520edc/0x9383f985bc4d4eb8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x448:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.801004:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x448:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.801009:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x448:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.801016:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066520edc/0x9383f985bc4d4eb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x448:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.801035:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066520edc/0x9383f985bc4d4eb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x448:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.801046:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066520edc/0x9383f985bc4d4eb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x448:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.801054:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066520edc/0x9383f985bc4d4eb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x448:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.802529:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788201370.803076:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x447:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.803086:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9ed0269/0x9383f985bc4d4ebf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x447:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.803102:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x447:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.803106:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x447:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.803113:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9ed0269/0x9383f985bc4d4ebf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x447:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.803125:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9ed0269/0x9383f985bc4d4ebf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x447:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.803134:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9ed0269/0x9383f985bc4d4ebf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x447:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.803141:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9ed0269/0x9383f985bc4d4ebf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x447:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.803222:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201370.803233:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7f7118e/0x9383f985bc4d4eb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x449:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.803242:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201370.803248:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7f7118e/0x9383f985bc4d4eb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x449:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.803264:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7f7118e/0x9383f985bc4d4eb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x449:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.804515:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7f7118e/0x9383f985bc4d4eb1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x449:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.804535:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7f7118e/0x9383f985bc4d4eb1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x449:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.804573:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201370.804579:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066520edc/0x9383f985bc4d4eb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x448:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.804587:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201370.804591:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066520edc/0x9383f985bc4d4eb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x448:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.804601:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066520edc/0x9383f985bc4d4eb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x448:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.804614:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066520edc/0x9383f985bc4d4eb8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x448:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.804622:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066520edc/0x9383f985bc4d4eb8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x448:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.804643:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201370.804647:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9ed0269/0x9383f985bc4d4ebf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x447:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.804654:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff128a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201370.804658:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9ed0269/0x9383f985bc4d4ebf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x447:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.804666:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9ed0269/0x9383f985bc4d4ebf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x447:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.804675:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9ed0269/0x9383f985bc4d4ebf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x447:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.804683:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201370.804685:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201370.804688:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201370.806414:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201370.807487:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788201370.807505:0:13441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9ed0269/0x9383f985bc4d4ebf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x447:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201370.808135:0:13441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x446:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.808145:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4d4ec6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x446:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.808162:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x446:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.808169:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x446:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.808189:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4d4ec6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x446:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.808207:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4d4ec6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x446:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.808220:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4d4ec6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x446:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.808229:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4d4ec6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x446:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.808262:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201370.808394:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201370.808394:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201370.808403:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4d4ec6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x446:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.808413:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201370.808419:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4d4ec6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x446:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.808435:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4d4ec6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x446:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.808458:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4d4ec6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x446:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.808466:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4d4ec6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x446:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.808489:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201370.808491:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201370.808494:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788201370.810914:0:13441:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:1093 00000100:00100000:3.0:1788201370.811065:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:16746:x1875064458259968:12345-0@lo:5:osp-pre-1-0.0 Request processed in 79984us (80396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201370.811078:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4272 00000100:00100000:0.0:1788201370.812137:0:16746:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:16746:1875064458259968:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788201370.812162:0:16746:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x461:0x0] from OST, last_created [0x280000400:0x461:0x0]last_used is [0x280000400:0x445:0x0] 00000100:00100000:0.0:1788201370.812285:0:16746:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:16746:1875064458260224:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788201370.812381:0:16746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201370.812418:0:16746:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7fd23c0 going to sleep for 50 seconds 00000100:00100000:0.0:1788201370.812449:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458260224 00000100:00100000:0.0:1788201370.812457:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458260224 00000100:00100000:0.0:1788201370.812507:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4273 00000100:00100000:0.0:1788201370.812518:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:16746:x1875064458260224:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788201370.812576:0:6703:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1122 00000100:00100000:1.0:1788201370.814354:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201370.814387:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458260096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201370.814467:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201370.816334:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458260096 00000100:00100000:1.0:1788201370.816351:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458260096 00000100:00100000:1.0:1788201370.816434:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788201370.816448:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5117480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875064458260096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201370.816485:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 13631488 granted 524877824 pending 131072 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201370.816582:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5117480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875064458260096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (2114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201370.816589:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788201370.816660:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d1f0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458260096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201370.820740:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201370.820797:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201370.820826:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201370.820846:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201370.820866:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201370.820892:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201370.820966:0:16720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442714624 00000100:00100000:1.0:1788201370.820981:0:16720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442714624 00000100:00100000:1.0:1788201370.821040:0:16720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442714752 00000100:00100000:1.0:1788201370.821043:0:16720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442714752 00000100:00100000:1.0:1788201370.821054:0:16720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442714880 00000100:00100000:1.0:1788201370.821067:0:16720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442714880 00000100:00100000:1.0:1788201370.821083:0:16720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442715008 00000100:00100000:1.0:1788201370.821085:0:16720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442715008 00000100:00100000:1.0:1788201370.821094:0:16720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442715136 00000100:00100000:1.0:1788201370.821096:0:16720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442715136 00000100:00100000:1.0:1788201370.821104:0:16720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442715264 00000100:00100000:1.0:1788201370.821106:0:16720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442715264 00000100:00100000:1.0:1788201370.821121:0:16720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:1.0:1788201370.821131:0:16720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:16416:x1875064442714624:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1788201370.821165:0:16720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201370.821210:0:16720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4600/0x9383f985bc4d4ecd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x408:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5270 expref: -99 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.821337:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4600/0x9383f985bc4d4ecd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x408:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5270 expref: 13 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.821358:0:16720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4600/0x9383f985bc4d4ecd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x408:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5270 expref: 13 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.821383:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x408:0x0].0x0 (ffff9e03c316f600) 00010000:00010000:1.0:1788201370.821387:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201370.821392:0:16720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9ce4600, rc 0) 00000100:00100000:1.0:1788201370.821476:0:16720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:16416:x1875064442714624:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 345us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201370.821485:0:16720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:1.0:1788201370.821509:0:16720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:1.0:1788201370.821519:0:16720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:16417:x1875064442714752:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1788201370.821527:0:16720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201370.821537:0:16720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d4ed4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x409:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5277 expref: -99 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.821565:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d4ed4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x409:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5277 expref: 13 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.821574:0:16720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d4ed4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x409:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5277 expref: 13 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.821586:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x409:0x0].0x0 (ffff9e03c316fb00) 00010000:00010000:1.0:1788201370.821589:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201370.821591:0:16720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9ce5c00, rc 0) 00000100:00100000:1.0:1788201370.821612:0:16720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:16417:x1875064442714752:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 96us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201370.821619:0:16720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:1.0:1788201370.821632:0:16720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:1.0:1788201370.821639:0:16720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3449f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:16411:x1875064442714880:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1788201370.821646:0:16720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201370.821657:0:16720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d4edb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x403:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c527e expref: -99 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.821681:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d4edb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x403:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c527e expref: 13 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.821690:0:16720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d4edb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x403:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c527e expref: 13 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.821700:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x403:0x0].0x0 (ffff9e03c316f100) 00010000:00010000:1.0:1788201370.821703:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201370.821705:0:16720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9ce4800, rc 0) 00000100:00100000:1.0:1788201370.821722:0:16720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3449f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:16411:x1875064442714880:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 84us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201370.821727:0:16720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:1.0:1788201370.821738:0:16720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:1.0:1788201370.821743:0:16720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:16415:x1875064442715008:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1788201370.821752:0:16720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201370.821761:0:16720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4a00/0x9383f985bc4d4ee2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x407:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5285 expref: -99 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.821781:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4a00/0x9383f985bc4d4ee2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x407:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5285 expref: 13 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.821789:0:16720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4a00/0x9383f985bc4d4ee2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x407:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5285 expref: 13 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.821800:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x407:0x0].0x0 (ffff9e03c316f300) 00010000:00010000:1.0:1788201370.821802:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201370.821804:0:16720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9ce4a00, rc 0) 00000100:00100000:1.0:1788201370.821820:0:16720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:16415:x1875064442715008:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 77us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201370.821825:0:16720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:1.0:1788201370.821837:0:16720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:1.0:1788201370.821843:0:16720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:16414:x1875064442715136:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1788201370.821850:0:16720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201370.821861:0:16720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5000/0x9383f985bc4d4ee9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x406:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c528c expref: -99 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.821882:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5000/0x9383f985bc4d4ee9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x406:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c528c expref: 13 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.821891:0:16720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5000/0x9383f985bc4d4ee9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x406:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c528c expref: 13 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.821901:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x406:0x0].0x0 (ffff9e03c316fe00) 00010000:00010000:1.0:1788201370.821904:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201370.821906:0:16720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9ce5000, rc 0) 00000100:00100000:1.0:1788201370.821921:0:16720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:16414:x1875064442715136:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 79us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201370.821927:0:16720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:1.0:1788201370.821939:0:16720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:1.0:1788201370.821946:0:16720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:16413:x1875064442715264:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1788201370.821956:0:16720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201370.821965:0:16720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4c00/0x9383f985bc4d4ef0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x405:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5293 expref: -99 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.821990:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4c00/0x9383f985bc4d4ef0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x405:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5293 expref: 13 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.822000:0:16720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4c00/0x9383f985bc4d4ef0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x405:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5293 expref: 13 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.822013:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x405:0x0].0x0 (ffff9e03c316f200) 00010000:00010000:1.0:1788201370.822016:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201370.822018:0:16720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9ce4c00, rc 0) 00000100:00100000:1.0:1788201370.822037:0:16720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:16413:x1875064442715264:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 92us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201370.822043:0:16720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:1.0:1788201370.833815:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:16746:x1875064458260224:12345-0@lo:5:osp-pre-1-0.0 Request processed in 21287us (21423us total) trans 4294968869 rc 0/0 00000100:00100000:1.0:1788201370.833833:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4273 00000100:00100000:3.0:1788201370.834012:0:16746:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:16746:1875064458260224:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788201370.834034:0:16746:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x461:0x0]-[0x280000400:0x481:0x0] 00002000:00010000:3.0:1788201370.838172:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x461:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.838207:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000232c8587/0x9383f985bc4d4ef7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x461:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.838232:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x461:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.838238:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x461:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.838246:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000232c8587/0x9383f985bc4d4ef7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x461:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.838267:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000232c8587/0x9383f985bc4d4ef7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x461:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.838281:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000232c8587/0x9383f985bc4d4ef7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x461:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.838289:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000232c8587/0x9383f985bc4d4ef7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x461:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.838338:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201370.838942:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x460:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.838949:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d4efe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x460:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.838960:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x460:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.838964:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x460:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.838968:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d4efe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x460:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.838980:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d4efe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x460:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.838990:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d4efe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x460:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.838998:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d4efe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x460:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.839015:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788201370.839027:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201370.839034:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000232c8587/0x9383f985bc4d4ef7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x461:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.839042:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bd800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201370.839047:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000232c8587/0x9383f985bc4d4ef7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x461:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.839057:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000232c8587/0x9383f985bc4d4ef7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x461:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.839076:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000232c8587/0x9383f985bc4d4ef7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x461:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.839086:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000232c8587/0x9383f985bc4d4ef7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x461:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.839108:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201370.839111:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d4efe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x460:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.839118:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201370.839122:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d4efe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x460:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.839128:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d4efe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x460:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.839136:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d4efe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x460:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.839142:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d4efe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x460:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.839151:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201370.839153:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201370.839154:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201370.839439:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x45f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.839445:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de2b048b/0x9383f985bc4d4f05 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x45f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.839453:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x45f:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.839457:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x45f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.839461:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de2b048b/0x9383f985bc4d4f05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x45f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.839471:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de2b048b/0x9383f985bc4d4f05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x45f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.839480:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de2b048b/0x9383f985bc4d4f05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x45f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.839488:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de2b048b/0x9383f985bc4d4f05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x45f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.839503:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201370.839800:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x45e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.839806:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8637c64/0x9383f985bc4d4f0c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x45e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.839815:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x45e:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.839818:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x45e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.839822:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8637c64/0x9383f985bc4d4f0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x45e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.839831:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8637c64/0x9383f985bc4d4f0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x45e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.839839:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8637c64/0x9383f985bc4d4f0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x45e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.839846:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8637c64/0x9383f985bc4d4f0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x45e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.839868:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788201370.839909:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201370.839916:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de2b048b/0x9383f985bc4d4f05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x45f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.839924:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bd600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201370.840063:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de2b048b/0x9383f985bc4d4f05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x45f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.840075:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de2b048b/0x9383f985bc4d4f05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x45f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.840094:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de2b048b/0x9383f985bc4d4f05 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x45f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.840101:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de2b048b/0x9383f985bc4d4f05 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x45f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.840121:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201370.840125:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8637c64/0x9383f985bc4d4f0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x45e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.840132:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201370.840136:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8637c64/0x9383f985bc4d4f0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x45e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.840144:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8637c64/0x9383f985bc4d4f0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x45e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.840155:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8637c64/0x9383f985bc4d4f0c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x45e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.840162:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8637c64/0x9383f985bc4d4f0c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x45e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.840184:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201370.840184:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x45d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201370.840186:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201370.840189:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201370.840190:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd191276/0x9383f985bc4d4f13 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x45d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.840199:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x45d:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.840202:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x45d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.840206:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd191276/0x9383f985bc4d4f13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x45d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.840215:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd191276/0x9383f985bc4d4f13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x45d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.840223:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd191276/0x9383f985bc4d4f13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x45d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.840229:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd191276/0x9383f985bc4d4f13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x45d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.840246:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201370.840596:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x45c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.840603:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010ae58ae/0x9383f985bc4d4f1a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x45c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.840613:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x45c:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.840617:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x45c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.840622:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010ae58ae/0x9383f985bc4d4f1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x45c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.840631:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010ae58ae/0x9383f985bc4d4f1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x45c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.840639:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010ae58ae/0x9383f985bc4d4f1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x45c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.840646:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010ae58ae/0x9383f985bc4d4f1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x45c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.840654:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788201370.841044:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x45b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.841049:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a3bf8dd/0x9383f985bc4d4f21 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x45b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.841058:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x45b:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.841060:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x45b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.841064:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a3bf8dd/0x9383f985bc4d4f21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x45b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.841072:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a3bf8dd/0x9383f985bc4d4f21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x45b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.841085:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a3bf8dd/0x9383f985bc4d4f21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x45b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.841091:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a3bf8dd/0x9383f985bc4d4f21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x45b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.841100:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788201370.841103:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201370.841109:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd191276/0x9383f985bc4d4f13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x45d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.841117:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bcc00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201370.841122:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd191276/0x9383f985bc4d4f13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x45d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.841130:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd191276/0x9383f985bc4d4f13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x45d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.841144:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd191276/0x9383f985bc4d4f13 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x45d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.841152:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd191276/0x9383f985bc4d4f13 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x45d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.841167:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201370.841170:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010ae58ae/0x9383f985bc4d4f1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x45c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.841188:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bca00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201370.841191:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010ae58ae/0x9383f985bc4d4f1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x45c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.841198:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010ae58ae/0x9383f985bc4d4f1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x45c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.841208:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010ae58ae/0x9383f985bc4d4f1a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x45c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.841215:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010ae58ae/0x9383f985bc4d4f1a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x45c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.841226:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201370.841229:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a3bf8dd/0x9383f985bc4d4f21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x45b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.841235:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bda00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201370.841239:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a3bf8dd/0x9383f985bc4d4f21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x45b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.841895:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a3bf8dd/0x9383f985bc4d4f21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x45b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.841918:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a3bf8dd/0x9383f985bc4d4f21 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x45b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.841926:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a3bf8dd/0x9383f985bc4d4f21 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x45b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.842009:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201370.842011:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201370.842013:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201370.842250:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201370.842259:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201370.842904:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201370.842949:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201370.842968:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201370.842993:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201370.843014:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201370.843031:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201370.843142:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201370.843369:0:16720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442714496 00000100:00100000:1.0:1788201370.843382:0:16720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442714496 00000100:00100000:1.0:1788201370.843450:0:16720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:1.0:1788201370.843462:0:16720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:16412:x1875064442714496:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1788201370.843489:0:16720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201370.843517:0:16720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4400/0x9383f985bc4d4f28 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x404:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5269 expref: -99 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.843597:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4400/0x9383f985bc4d4f28 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x404:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5269 expref: 14 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.843616:0:16720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4400/0x9383f985bc4d4f28 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x404:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5269 expref: 14 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201370.843626:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442715520 00000100:00100000:0.0:1788201370.843630:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442715520 00010000:00010000:1.0:1788201370.843640:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x404:0x0].0x0 (ffff9e03c316fd00) 00010000:00010000:1.0:1788201370.843644:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201370.843649:0:16720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9ce4400, rc 0) 00000100:00100000:0.0:1788201370.843660:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442715392 00000100:00100000:0.0:1788201370.843662:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442715392 00000100:00100000:0.0:1788201370.843678:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442715776 00000100:00100000:0.0:1788201370.843680:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442715776 00000100:00100000:0.0:1788201370.843696:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442715648 00000100:00100000:0.0:1788201370.843700:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442715648 00000100:00100000:0.0:1788201370.843716:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442715904 00000100:00100000:0.0:1788201370.843718:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442715904 00000100:00100000:1.0:1788201370.843720:0:16720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:16412:x1875064442714496:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 260us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201370.843729:0:16720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:0.0:1788201370.843734:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442716032 00000100:00100000:0.0:1788201370.843736:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442716032 00000100:00100000:0.0:1788201370.843754:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4274 00000100:00100000:1.0:1788201370.843759:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4275 00000100:00100000:0.0:1788201370.843761:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2360:x1875064442715520:12345-192.168.201.30@tcp:2:chmod.0 00000100:00100000:1.0:1788201370.843765:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:2362:x1875064442715392:12345-192.168.201.30@tcp:2:chmod.0 00002000:00010000:1.0:1788201370.843994:0:13443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x445:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788201370.843998:0:13443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x445:0x0] updating lvb mtime from disk: 1788201325 -> 1788201325 00002000:00010000:1.0:1788201370.844000:0:13443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x445:0x0] updating lvb atime from disk: 1788201325 -> 1788201325 00002000:00010000:1.0:1788201370.844003:0:13443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x445:0x0] updating lvb ctime from disk: 1788201325 -> 1788201326 00002000:00010000:1.0:1788201370.844005:0:13443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x445:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788201370.844030:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:2362:x1875064442715392:12345-192.168.201.30@tcp:2:chmod.0 Request processed in 265us (1060us total) trans 4294968870 rc 0/0 00000100:00100000:1.0:1788201370.844038:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4275 00000100:00100000:1.0:1788201370.844075:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4276 00000100:00100000:1.0:1788201370.844083:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:2362:x1875064442715776:12345-192.168.201.30@tcp:2:chmod.0 00002000:00010000:1.0:1788201370.844165:0:13443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x444:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788201370.844168:0:13443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x444:0x0] updating lvb mtime from disk: 1788201325 -> 1788201325 00002000:00010000:1.0:1788201370.844171:0:13443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x444:0x0] updating lvb atime from disk: 1788201325 -> 1788201325 00002000:00010000:1.0:1788201370.844183:0:13443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x444:0x0] updating lvb ctime from disk: 1788201325 -> 1788201326 00002000:00010000:1.0:1788201370.844186:0:13443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x444:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788201370.844210:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:2362:x1875064442715776:12345-192.168.201.30@tcp:2:chmod.0 Request processed in 127us (1215us total) trans 4294968871 rc 0/0 00000100:00100000:1.0:1788201370.844216:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4276 00000100:00100000:1.0:1788201370.844230:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4277 00000100:00100000:1.0:1788201370.844236:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:2362:x1875064442715648:12345-192.168.201.30@tcp:2:chmod.0 00002000:00010000:1.0:1788201370.844337:0:13443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x442:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788201370.844340:0:13443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x442:0x0] updating lvb mtime from disk: 1788201325 -> 1788201325 00002000:00010000:1.0:1788201370.844343:0:13443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x442:0x0] updating lvb atime from disk: 1788201325 -> 1788201325 00002000:00010000:1.0:1788201370.844345:0:13443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x442:0x0] updating lvb ctime from disk: 1788201325 -> 1788201326 00002000:00010000:1.0:1788201370.844347:0:13443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x442:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788201370.844369:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:2362:x1875064442715648:12345-192.168.201.30@tcp:2:chmod.0 Request processed in 133us (1354us total) trans 4294968872 rc 0/0 00000100:00100000:1.0:1788201370.844376:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4277 00000100:00100000:1.0:1788201370.844389:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4278 00000100:00100000:1.0:1788201370.844394:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2362:x1875064442715904:12345-192.168.201.30@tcp:2:chmod.0 00000100:00100000:1.0:1788201370.844442:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4279 00000100:00100000:1.0:1788201370.844449:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:2361:x1875064442716032:12345-192.168.201.30@tcp:2:chmod.0 00002000:00010000:1.0:1788201370.844529:0:10484:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x443:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788201370.844532:0:10484:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x443:0x0] updating lvb mtime from disk: 1788201325 -> 1788201325 00002000:00010000:1.0:1788201370.844535:0:10484:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x443:0x0] updating lvb atime from disk: 1788201325 -> 1788201325 00002000:00010000:1.0:1788201370.844537:0:10484:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x443:0x0] updating lvb ctime from disk: 1788201325 -> 1788201326 00002000:00010000:1.0:1788201370.844539:0:10484:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x443:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788201370.844563:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:2361:x1875064442716032:12345-192.168.201.30@tcp:2:chmod.0 Request processed in 113us (1419us total) trans 4294968873 rc 0/0 00000100:00100000:1.0:1788201370.844570:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4279 00002000:00010000:0.0:1788201370.845158:0:13440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x444:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788201370.845162:0:13440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x444:0x0] updating lvb mtime from disk: 1788201325 -> 1788201325 00002000:00010000:0.0:1788201370.845165:0:13440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x444:0x0] updating lvb atime from disk: 1788201325 -> 1788201325 00002000:00010000:0.0:1788201370.845167:0:13440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x444:0x0] updating lvb ctime from disk: 1788201325 -> 1788201326 00002000:00010000:0.0:1788201370.845169:0:13440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x444:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788201370.845226:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35604eb4-baf9-45be-a20a-4883a2cd8cf9+510:2360:x1875064442715520:12345-192.168.201.30@tcp:2:chmod.0 Request processed in 1463us (2328us total) trans 4294968869 rc 0/0 00000100:00100000:0.0:1788201370.845234:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4274 00002000:00010000:1.0:1788201370.848567:0:13443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x443:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788201370.848580:0:13443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x443:0x0] updating lvb mtime from disk: 1788201325 -> 1788201325 00002000:00010000:1.0:1788201370.848585:0:13443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x443:0x0] updating lvb atime from disk: 1788201325 -> 1788201325 00002000:00010000:1.0:1788201370.848587:0:13443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x443:0x0] updating lvb ctime from disk: 1788201325 -> 1788201326 00002000:00010000:1.0:1788201370.848589:0:13443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x443:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788201370.848674:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+510:2362:x1875064442715904:12345-192.168.201.30@tcp:2:chmod.0 Request processed in 4271us (5634us total) trans 4294968870 rc 0/0 00000100:00100000:1.0:1788201370.848688:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4278 00000100:00100000:0.0:1788201370.853672:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00002000:00010000:3.0:1788201370.853726:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x45a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.853738:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d4f2f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x45a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.853759:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x45a:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.853765:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x45a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.853774:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d4f2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x45a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.853791:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d4f2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x45a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.853803:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d4f2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x45a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.853811:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d4f2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x45a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.853847:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201370.854009:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788201370.854012:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442716160 00010000:00010000:0.0:1788201370.854018:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d4f2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x45a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201370.854025:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442716160 00010000:00010000:0.0:1788201370.854028:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bdc00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201370.854034:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d4f2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x45a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.854044:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d4f2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x45a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.854063:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d4f2f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x45a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.854072:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201370.854073:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201370.854075:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201370.854098:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4280 00000100:00100000:1.0:1788201370.854110:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35604eb4-baf9-45be-a20a-4883a2cd8cf9+510:2362:x1875064442716160:12345-192.168.201.30@tcp:2:chmod.0 00002000:00010000:1.0:1788201370.854344:0:13450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x442:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788201370.854347:0:13450:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x442:0x0] updating lvb mtime from disk: 1788201325 -> 1788201325 00002000:00010000:1.0:1788201370.854350:0:13450:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x442:0x0] updating lvb atime from disk: 1788201325 -> 1788201325 00002000:00010000:1.0:1788201370.854353:0:13450:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x442:0x0] updating lvb ctime from disk: 1788201325 -> 1788201326 00002000:00010000:1.0:1788201370.854355:0:13450:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x442:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788201370.854430:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2362:x1875064442716160:12345-192.168.201.30@tcp:2:chmod.0 Request processed in 320us (768us total) trans 4294968871 rc 0/0 00000100:00100000:1.0:1788201370.854438:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4280 00010000:00010000:3.0:1788201370.856390:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d4f2f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x45a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201370.858799:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x459:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.858817:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d4f36 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x459:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.858838:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x459:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.858843:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x459:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.858850:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d4f36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x459:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.858866:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d4f36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x459:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.858877:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d4f36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x459:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.858885:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d4f36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x459:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.858906:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201370.858920:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201370.858927:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d4f36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x459:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.858937:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201370.858943:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d4f36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x459:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.858992:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d4f36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x459:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.859014:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d4f36 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x459:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.859021:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074f6abf6/0x9383f985bc4d4f36 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x459:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.859040:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201370.859042:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201370.859044:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201370.859585:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x458:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.859592:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d4f3d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.859602:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x458:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.859605:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x458:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.859609:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d4f3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.859620:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d4f3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.859630:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d4f3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.859636:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d4f3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.859657:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201370.859668:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201370.859674:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d4f3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.859681:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201370.859686:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d4f3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.859694:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d4f3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.859704:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d4f3d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.859712:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d4f3d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x458:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.859727:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201370.859730:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201370.859732:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201370.860060:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x457:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.860066:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d4f44 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.860075:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x457:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.860079:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x457:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.860084:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d4f44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.860093:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d4f44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.860102:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d4f44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.860109:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d4f44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.860127:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201370.860136:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201370.860142:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d4f44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.860149:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bce00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201370.860152:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d4f44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.860165:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d4f44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201370.861942:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x456:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201370.861957:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008e3c192/0x9383f985bc4d4f4b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.861976:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x456:0x0].0x0 since=646s v=(0 0) 00010000:00010000:2.0:1788201370.861981:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x456:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201370.861987:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008e3c192/0x9383f985bc4d4f4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.862003:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008e3c192/0x9383f985bc4d4f4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.862014:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008e3c192/0x9383f985bc4d4f4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.862028:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008e3c192/0x9383f985bc4d4f4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.862059:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201370.862420:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x455:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201370.862425:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdbe346a/0x9383f985bc4d4f52 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.862434:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x455:0x0].0x0 since=646s v=(0 0) 00010000:00010000:2.0:1788201370.862437:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x455:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201370.862441:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdbe346a/0x9383f985bc4d4f52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.862450:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdbe346a/0x9383f985bc4d4f52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.862459:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdbe346a/0x9383f985bc4d4f52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.862467:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdbe346a/0x9383f985bc4d4f52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.862488:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788201370.862792:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x454:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201370.862797:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bb6ca01/0x9383f985bc4d4f59 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.862806:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x454:0x0].0x0 since=646s v=(0 0) 00010000:00010000:2.0:1788201370.862809:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x454:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201370.862813:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bb6ca01/0x9383f985bc4d4f59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.862822:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bb6ca01/0x9383f985bc4d4f59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.862830:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bb6ca01/0x9383f985bc4d4f59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.862837:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bb6ca01/0x9383f985bc4d4f59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.862845:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788201370.863139:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x453:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201370.863145:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002790950b/0x9383f985bc4d4f60 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x453:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.863153:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x453:0x0].0x0 since=646s v=(0 0) 00010000:00010000:2.0:1788201370.863156:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x453:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201370.863161:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002790950b/0x9383f985bc4d4f60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x453:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.863169:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002790950b/0x9383f985bc4d4f60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x453:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.863196:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002790950b/0x9383f985bc4d4f60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x453:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.863203:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002790950b/0x9383f985bc4d4f60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x453:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.863212:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788201370.863544:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x452:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201370.863550:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000407d1bb5/0x9383f985bc4d4f67 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x452:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.863559:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x452:0x0].0x0 since=646s v=(0 0) 00010000:00010000:2.0:1788201370.863563:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x452:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201370.863567:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000407d1bb5/0x9383f985bc4d4f67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x452:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.863576:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000407d1bb5/0x9383f985bc4d4f67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x452:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.863584:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000407d1bb5/0x9383f985bc4d4f67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x452:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.863591:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000407d1bb5/0x9383f985bc4d4f67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x452:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.863605:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788201370.863905:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x451:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201370.863911:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b61b04/0x9383f985bc4d4f6e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x451:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.863920:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x451:0x0].0x0 since=646s v=(0 0) 00010000:00010000:2.0:1788201370.863923:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x451:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201370.863926:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004b61b04/0x9383f985bc4d4f6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x451:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.863936:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004b61b04/0x9383f985bc4d4f6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x451:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.863944:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b61b04/0x9383f985bc4d4f6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x451:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.863951:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004b61b04/0x9383f985bc4d4f6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x451:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.863959:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1788201370.864122:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788201370.864134:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008e3c192/0x9383f985bc4d4f4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864144:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b96000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201370.864150:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008e3c192/0x9383f985bc4d4f4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864160:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008e3c192/0x9383f985bc4d4f4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864194:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008e3c192/0x9383f985bc4d4f4b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864203:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008e3c192/0x9383f985bc4d4f4b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x456:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864227:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788201370.864231:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdbe346a/0x9383f985bc4d4f52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864239:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201370.864242:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdbe346a/0x9383f985bc4d4f52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864249:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdbe346a/0x9383f985bc4d4f52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201370.864255:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x450:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201370.864258:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdbe346a/0x9383f985bc4d4f52 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.864260:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5713b5a/0x9383f985bc4d4f75 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x450:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864267:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdbe346a/0x9383f985bc4d4f52 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x455:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.864268:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x450:0x0].0x0 since=646s v=(0 0) 00010000:00010000:2.0:1788201370.864273:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x450:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201370.864277:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5713b5a/0x9383f985bc4d4f75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x450:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864280:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788201370.864283:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bb6ca01/0x9383f985bc4d4f59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.864286:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5713b5a/0x9383f985bc4d4f75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x450:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864291:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201370.864315:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5713b5a/0x9383f985bc4d4f75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x450:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864316:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bb6ca01/0x9383f985bc4d4f59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.864324:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5713b5a/0x9383f985bc4d4f75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x450:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864332:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bb6ca01/0x9383f985bc4d4f59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.864334:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788201370.864341:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bb6ca01/0x9383f985bc4d4f59 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864349:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bb6ca01/0x9383f985bc4d4f59 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x454:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864361:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788201370.864364:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002790950b/0x9383f985bc4d4f60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x453:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864371:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b96a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201370.864374:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002790950b/0x9383f985bc4d4f60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x453:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864381:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002790950b/0x9383f985bc4d4f60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x453:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864389:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002790950b/0x9383f985bc4d4f60 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x453:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864395:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002790950b/0x9383f985bc4d4f60 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x453:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864410:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201370.864414:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000407d1bb5/0x9383f985bc4d4f67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x452:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864419:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201370.864422:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000407d1bb5/0x9383f985bc4d4f67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x452:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864429:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000407d1bb5/0x9383f985bc4d4f67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x452:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864439:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000407d1bb5/0x9383f985bc4d4f67 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x452:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864447:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000407d1bb5/0x9383f985bc4d4f67 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x452:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864458:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201370.864478:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004b61b04/0x9383f985bc4d4f6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x451:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864485:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b96c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201370.864488:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b61b04/0x9383f985bc4d4f6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x451:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864501:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b61b04/0x9383f985bc4d4f6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x451:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864511:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004b61b04/0x9383f985bc4d4f6e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x451:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864519:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004b61b04/0x9383f985bc4d4f6e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x451:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864531:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201370.864534:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5713b5a/0x9383f985bc4d4f75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x450:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864540:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201370.864543:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5713b5a/0x9383f985bc4d4f75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x450:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864552:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5713b5a/0x9383f985bc4d4f75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x450:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864561:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5713b5a/0x9383f985bc4d4f75 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x450:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864569:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5713b5a/0x9383f985bc4d4f75 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x450:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864586:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201370.864587:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201370.864590:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201370.864614:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x44f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201370.864620:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cb2fb41/0x9383f985bc4d4f7c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x44f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.864627:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x44f:0x0].0x0 since=646s v=(0 0) 00010000:00010000:2.0:1788201370.864630:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x44f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201370.864634:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cb2fb41/0x9383f985bc4d4f7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x44f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.864643:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cb2fb41/0x9383f985bc4d4f7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x44f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.864651:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cb2fb41/0x9383f985bc4d4f7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x44f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.864659:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006cb2fb41/0x9383f985bc4d4f7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x44f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.864682:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201370.864775:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201370.864780:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006cb2fb41/0x9383f985bc4d4f7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x44f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864788:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201370.864792:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006cb2fb41/0x9383f985bc4d4f7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x44f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864800:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006cb2fb41/0x9383f985bc4d4f7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x44f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864812:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006cb2fb41/0x9383f985bc4d4f7c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x44f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864819:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cb2fb41/0x9383f985bc4d4f7c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x44f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.864831:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201370.864832:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201370.864834:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201370.864966:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x44e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201370.864971:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d4f83 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x44e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.864980:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x44e:0x0].0x0 since=646s v=(0 0) 00010000:00010000:2.0:1788201370.864983:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x44e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201370.864986:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d4f83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x44e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.864994:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d4f83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x44e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.865001:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d4f83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x44e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.865007:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d4f83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x44e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201370.865028:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201370.865470:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d4f44 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.865482:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d4f44 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x457:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.865497:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201370.865501:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d4f83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x44e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.865508:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201370.865512:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d4f83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x44e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.865522:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d4f83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x44e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.865532:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d4f83 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x44e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.865539:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d4f83 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x44e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.865557:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201370.865559:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201370.865561:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201370.865650:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201370.866624:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201370.869535:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x44d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.869553:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d4f8a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x44d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.869574:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x44d:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.869579:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x44d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.869587:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d4f8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x44d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.869603:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d4f8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x44d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.869614:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d4f8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x44d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.869623:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d4f8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x44d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.869650:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201370.870014:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x44c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.870020:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000232c8587/0x9383f985bc4d4f91 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x44c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.870034:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x44c:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.870036:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x44c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.870040:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000232c8587/0x9383f985bc4d4f91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x44c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.870049:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000232c8587/0x9383f985bc4d4f91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x44c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.870057:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000232c8587/0x9383f985bc4d4f91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x44c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.870065:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000232c8587/0x9383f985bc4d4f91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x44c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.870085:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788201370.870446:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x44b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.870452:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a3bf8dd/0x9383f985bc4d4f98 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x44b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.870461:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x44b:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.870464:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x44b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.870469:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a3bf8dd/0x9383f985bc4d4f98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x44b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.870479:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a3bf8dd/0x9383f985bc4d4f98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x44b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.870493:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a3bf8dd/0x9383f985bc4d4f98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x44b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.870500:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a3bf8dd/0x9383f985bc4d4f98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x44b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.870513:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788201370.870796:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x44a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.870801:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010ae58ae/0x9383f985bc4d4f9f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x44a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.870809:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x44a:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.870812:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x44a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.870817:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010ae58ae/0x9383f985bc4d4f9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x44a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.870825:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010ae58ae/0x9383f985bc4d4f9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x44a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.870833:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010ae58ae/0x9383f985bc4d4f9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x44a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.870840:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010ae58ae/0x9383f985bc4d4f9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x44a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.870855:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788201370.871061:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788201370.871072:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d4f8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x44d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.871084:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201370.871089:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d4f8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x44d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.871101:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d4f8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x44d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.871123:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d4f8a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x44d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.871131:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000700c6050/0x9383f985bc4d4f8a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x44d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201370.871140:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x449:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.871146:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd191276/0x9383f985bc4d4fa6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x449:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.871151:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788201370.871154:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x449:0x0].0x0 since=646s v=(0 0) 00010000:00010000:0.0:1788201370.871155:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000232c8587/0x9383f985bc4d4f91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x44c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.871157:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x449:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.871161:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd191276/0x9383f985bc4d4fa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x449:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.871162:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bd800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201370.871166:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000232c8587/0x9383f985bc4d4f91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x44c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.871171:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd191276/0x9383f985bc4d4fa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x449:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.871186:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000232c8587/0x9383f985bc4d4f91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x44c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.871191:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd191276/0x9383f985bc4d4fa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x449:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.871196:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000232c8587/0x9383f985bc4d4f91 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x44c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.871199:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd191276/0x9383f985bc4d4fa6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x449:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.871205:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000232c8587/0x9383f985bc4d4f91 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x44c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.871209:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788201370.871219:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201370.871223:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a3bf8dd/0x9383f985bc4d4f98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x44b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.871229:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bda00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201370.871232:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a3bf8dd/0x9383f985bc4d4f98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x44b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.871240:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a3bf8dd/0x9383f985bc4d4f98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x44b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.871249:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a3bf8dd/0x9383f985bc4d4f98 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x44b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.871256:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a3bf8dd/0x9383f985bc4d4f98 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x44b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.871265:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201370.871268:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010ae58ae/0x9383f985bc4d4f9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x44a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.871273:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bca00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201370.871277:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010ae58ae/0x9383f985bc4d4f9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x44a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.871284:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010ae58ae/0x9383f985bc4d4f9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x44a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.871291:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010ae58ae/0x9383f985bc4d4f9f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x44a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.871332:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010ae58ae/0x9383f985bc4d4f9f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x44a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.871341:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201370.871345:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd191276/0x9383f985bc4d4fa6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x449:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.871351:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bcc00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201370.871354:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd191276/0x9383f985bc4d4fa6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x449:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.871363:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd191276/0x9383f985bc4d4fa6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x449:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.871372:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd191276/0x9383f985bc4d4fa6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x449:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.871380:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd191276/0x9383f985bc4d4fa6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x449:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.871390:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201370.871392:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201370.871394:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201370.871526:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x448:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.871531:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8637c64/0x9383f985bc4d4fad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x448:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.871539:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x448:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.871543:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x448:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.871548:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8637c64/0x9383f985bc4d4fad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x448:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.871557:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8637c64/0x9383f985bc4d4fad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x448:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.871565:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8637c64/0x9383f985bc4d4fad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x448:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.871572:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8637c64/0x9383f985bc4d4fad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x448:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.871595:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201370.871887:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x447:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.871892:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de2b048b/0x9383f985bc4d4fb4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x447:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.871900:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x447:0x0].0x0 since=646s v=(0 0) 00010000:00010000:0.0:1788201370.871903:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201370.871903:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x447:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201370.871908:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8637c64/0x9383f985bc4d4fad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x448:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.871908:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de2b048b/0x9383f985bc4d4fb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x447:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.871916:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201370.871918:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de2b048b/0x9383f985bc4d4fb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x447:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.871920:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8637c64/0x9383f985bc4d4fad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x448:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.871927:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de2b048b/0x9383f985bc4d4fb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x447:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.871936:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de2b048b/0x9383f985bc4d4fb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x447:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.871940:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8637c64/0x9383f985bc4d4fad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x448:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.871945:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201370.871951:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8637c64/0x9383f985bc4d4fad lrc: 1/0,0 mode: --/PW res: [0x240000400:0x448:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.871960:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8637c64/0x9383f985bc4d4fad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x448:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.871974:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201370.871977:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de2b048b/0x9383f985bc4d4fb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x447:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.871983:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bd600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201370.871987:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de2b048b/0x9383f985bc4d4fb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x447:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.871994:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de2b048b/0x9383f985bc4d4fb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x447:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.872002:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de2b048b/0x9383f985bc4d4fb4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x447:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.872007:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de2b048b/0x9383f985bc4d4fb4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x447:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.872017:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201370.872019:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201370.872020:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201370.872242:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201370.872433:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201370.874087:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x446:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.874104:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d4fbb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x446:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.874122:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x446:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.874126:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x446:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.874133:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d4fbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x446:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.874147:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d4fbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x446:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.874158:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d4fbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x446:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.874167:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d4fbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x446:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.874209:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201370.874420:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201370.874429:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d4fbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x446:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.874438:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bdc00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201370.874443:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d4fbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x446:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.874453:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d4fbb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x446:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.874494:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d4fbb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x446:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.874503:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d4fbb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x446:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.874522:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201370.874523:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201370.874525:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201370.874855:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x445:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201370.874863:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d4fc2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x445:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.874872:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x445:0x0].0x0 since=646s v=(0 0) 00010000:00010000:3.0:1788201370.874876:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x445:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201370.874880:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d4fc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x445:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.874891:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d4fc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x445:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.874899:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d4fc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x445:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.874906:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d4fc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x445:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201370.874973:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788201370.875592:0:13445:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:1092 00000100:00100000:3.0:1788201370.875777:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:16744:x1875064458259840:12345-0@lo:5:osp-pre-0-0.0 Request processed in 144969us (145346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201370.875791:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4271 00010000:00010000:1.0:1788201370.879897:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201370.879918:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d4fc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x445:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.879938:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201370.879945:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d4fc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x445:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.879960:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d4fc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x445:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.879988:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d4fc2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x445:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201370.879996:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d4fc2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x445:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201370.880065:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201370.880069:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201370.880071:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201370.880225:0:16744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:16744:1875064458259840:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788201370.880247:0:16744:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x461:0x0] from OST, last_created [0x240000400:0x461:0x0]last_used is [0x240000400:0x444:0x0] 00000100:00100000:1.0:1788201370.880713:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458260352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201370.880798:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201370.880894:0:16744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:16744:1875064458260480:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788201370.880927:0:16744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201370.880945:0:16744:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c5e3f9c0 going to sleep for 50 seconds 00000100:00100000:0.0:1788201370.885794:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458260352 00000100:00100000:0.0:1788201370.885816:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458260352 00000100:00100000:0.0:1788201370.885948:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788201370.885961:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5115f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458260352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201370.886000:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524877824 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1788201370.886128:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5115f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458260352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 169us (5329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201370.886137:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788201370.886170:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458260480 00000100:00100000:0.0:1788201370.886185:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458260480 00000100:00100000:1.0:1788201370.886191:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458260352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201370.886226:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4281 00000100:00100000:0.0:1788201370.886234:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:16744:x1875064458260480:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788201370.887161:0:6706:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1122 00000100:00100000:2.0:1788201370.905427:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:16744:x1875064458260480:12345-0@lo:5:osp-pre-0-0.0 Request processed in 19184us (24489us total) trans 4294968872 rc 0/0 00000100:00100000:2.0:1788201370.905444:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4281 00000100:00100000:3.0:1788201370.905570:0:16744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:16744:1875064458260480:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788201370.905587:0:16744:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x461:0x0]-[0x240000400:0x481:0x0] 00010000:00010000:2.0:1788201371.493761:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201372.523427:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201373.550911:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201374.309447:0:3309:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201359/real 1788201359] req@ffff9e03c5486680 x1875064458251136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201374 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201374.309504:0:3309:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e03c5486680 x1875064458251136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201374 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201374.309516:0:3309:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201359/real 1788201359] req@ffff9e03c5485180 x1875064458251264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201374 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201374.309529:0:3309:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e03c5485180 x1875064458251264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201374 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201374.309553:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201374.309577:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788201374.309582:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875064458251136:0@lo:38:kworker.0 00000100:00080000:3.0:1788201374.309588:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201374.309594:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788201374.309597:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875064458251264:0@lo:38:kworker.0 00000100:00080000:0.0:1788201374.309792:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201374.309797:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201374.309801:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201374.309806:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 634 00000100:00080000:0.0:1788201374.309814:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788201374.309822:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e04ff4ba000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1788201374.309848:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e03c23d8a80 x1875064458260736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201374.309863:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201374.309866:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201374.309867:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201374.309870:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 634 00000100:00080000:0.0:1788201374.309873:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788201374.309876:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e04f5751000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1788201374.309887:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e03c23d9180 x1875064458260864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201374.310937:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875064458261248:0@lo:400:kworker.0 00000100:00100000:1.0:1788201374.311138:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201374.311358:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201374.311367:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c23d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458260608:0@lo:400:kworker.0 00000100:00100000:1.0:1788201374.311688:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201374.311773:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458260992:0@lo:400:kworker.0 00000100:00100000:1.0:1788201374.311809:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201374.311836:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201374.311842:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458261120:0@lo:400:kworker.0 00000100:00100000:1.0:1788201374.311865:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201374.311901:0:16712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458260608 00000100:00100000:1.0:1788201374.311910:0:16712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458260608 00000100:00100000:1.0:1788201374.311970:0:16712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788201374.311981:0:16712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f950e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458260608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201374.312124:0:16712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f950e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458260608:12345-0@lo:400:kworker.0 Request processed in 110us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201374.312149:0:16712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788201374.312228:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458260992 00000100:00100000:1.0:1788201374.312242:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458260992 00000100:00100000:1.0:1788201374.312372:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458261120 00000100:00100000:1.0:1788201374.312375:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458261120 00000100:00100000:0.0:1788201374.312758:0:16722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458261248 00000100:00100000:0.0:1788201374.312764:0:16722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458261248 00000100:00100000:0.0:1788201374.312804:0:16722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788201374.312812:0:16722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875064458261248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201374.312868:0:16722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875064458261248:12345-0@lo:400:kworker.0 Request processed in 58us (1731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201374.312875:0:16722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788201374.313045:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201374.313051:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201374.313070:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c23d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875064458260736:0@lo:38:kworker.0 00000100:00100000:3.0:1788201374.313126:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201374.313219:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c23d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875064458260864:0@lo:38:kworker.0 00000100:00100000:3.0:1788201374.313247:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201374.313286:0:16720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458260736 00000100:00100000:3.0:1788201374.313290:0:16720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458260736 00000100:00100000:3.0:1788201374.313337:0:16720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458260864 00000100:00100000:3.0:1788201374.313340:0:16720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458260864 00000100:00100000:3.0:1788201374.313358:0:16720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788201374.313363:0:16720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875064458260736:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788201374.313394:0:16720:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 649 last 0 00000020:00000080:3.0:1788201374.313457:0:16720:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9383f985bc4d4fc9 00000004:00100000:3.0:1788201374.313544:0:16720:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788201374.313614:0:16720:0:(import.c:65:import_set_state_nolock()) ffff9e03c5318000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201374.313703:0:16720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875064458260736:12345-0@lo:38:kworker.0 Request processed in 337us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201374.313710:0:16720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788201374.313742:0:16720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788201374.313763:0:16720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875064458260864:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788201374.313788:0:16720:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 649 last 0 00000020:00000080:3.0:1788201374.313836:0:16720:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9383f985bc4d4fd0 00000004:00100000:3.0:1788201374.313844:0:16720:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788201374.313894:0:16720:0:(import.c:65:import_set_state_nolock()) ffff9e03c531c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201374.313923:0:16720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875064458260864:12345-0@lo:38:kworker.0 Request processed in 159us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201374.313930:0:16720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1788201374.313978:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 4 00000100:00100000:1.0:1788201374.315024:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788201374.315042:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3312:x1875064458260992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201374.315132:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3312:x1875064458260992:12345-0@lo:400:kworker.0 Request processed in 99us (3322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201374.315139:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788201374.315158:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788201374.315165:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5115880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3312:x1875064458261120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201374.315196:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5115880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3312:x1875064458261120:12345-0@lo:400:kworker.0 Request processed in 32us (3329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201374.315201:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788201374.315263:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458261120:0@lo:400:kworker.0 00000100:00100000:1.0:1788201374.315277:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458260992:0@lo:400:kworker.0 00000100:00100000:1.0:1788201374.315341:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c23d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458260608:0@lo:400:kworker.0 00000100:00100000:1.0:1788201374.315356:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875064458261248:0@lo:400:kworker.0 00000100:00080000:3.0:1788201374.320544:0:3309:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9e03c23d8a80 x1875064458260736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201394 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201374.320563:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788201374.320571:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788201374.320577:0:3309:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788201374.336098:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c23d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875064458260736:0@lo:38:kworker.0 00000100:00080000:3.0:1788201374.336181:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 4 00000100:00080000:3.0:1788201374.342183:0:3309:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9e03c23d9180 x1875064458260864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201394 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201374.342203:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788201374.342211:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788201374.342216:0:3309:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788201374.342225:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c23d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875064458260864:0@lo:38:kworker.0 00010000:00010000:1.0:1788201374.567558:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201375.589602:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788201375.606291:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968869 is committed 00000001:00080000:3.0:1788201375.606335:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968873 is committed 00000001:00080000:2.0:1788201375.619983:0:6732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294968872 is committed 00000001:00080000:2.0:1788201375.620009:0:6732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294968869 is committed 00000001:00080000:2.0:1788201375.620019:0:6732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294968871 is committed 00000100:00100000:0.0:1788201375.637951:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201375.638009:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201375.638053:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201375.638086:0:16711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442716288 00000100:00100000:0.0:1788201375.638105:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201375.638137:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442716544 00000100:00100000:1.0:1788201375.638138:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442716672 00000100:00100000:0.0:1788201375.638148:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442716544 00000100:00100000:1.0:1788201375.638148:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442716672 00000100:00100000:1.0:1788201375.638245:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 232 00000100:00100000:3.0:1788201375.638248:0:16721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442716416 00000100:00100000:3.0:1788201375.638251:0:16721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442716416 00000100:00100000:1.0:1788201375.638259:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2360:x1875064442716672:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201375.638521:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2360:x1875064442716672:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 265us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201375.638530:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 232 00000100:00100000:2.0:1788201375.638597:0:16711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442716288 00000100:00100000:2.0:1788201375.638632:0:16711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 66 00000100:00100000:2.0:1788201375.638640:0:16711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442716288:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201375.638670:0:16711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442716288:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 31us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201375.638678:0:16711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 66 00000100:00100000:0.0:1788201375.641133:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 233 00000100:00100000:0.0:1788201375.641158:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2359:x1875064442716544:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201375.641258:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2359:x1875064442716544:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 110us (3202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201375.641266:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 233 00000100:00100000:3.0:1788201375.643822:0:16721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00080000:1.0:1788201375.643955:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201375.643963:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201375.643967:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201375.643997:0:16721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:2360:x1875064442716416:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201375.645706:0:16721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:2360:x1875064442716416:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 1707us (7755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201375.645723:0:16721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:2.0:1788201375.974758:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201375.974782:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458261376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201375.974871:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201375.974921:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458261376 00000100:00100000:2.0:1788201375.974929:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458261376 00000100:00100000:2.0:1788201375.974978:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788201375.974987:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458261376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201375.975024:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 13631488 granted 524746752 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201375.975069:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458261376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201375.975076:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788201375.975128:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968869 gen 2 00000100:00100000:2.0:1788201375.975150:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458261376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201375.975355:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201375.975367:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458261504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201375.975398:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201375.975718:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458261504 00000100:00100000:1.0:1788201375.975724:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458261504 00000100:00100000:1.0:1788201375.975766:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788201375.975773:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458261504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201375.975795:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524746752 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1788201375.976383:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458261504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 608us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201375.976391:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788201375.976599:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968872 gen 2 00000100:00100000:3.0:1788201375.976619:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458261504:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788201376.616946:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201376.830160:0:17316:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:1.0:1788201377.638323:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201378.663132:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201378.744841:0:17365:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:0.0:1788201379.557791:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875064458261760:0@lo:400:kworker.0 00000100:00100000:0.0:1788201379.557892:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201379.557980:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875064458262272:0@lo:400:kworker.0 00000100:00100000:0.0:1788201379.558031:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201379.558064:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201379.558071:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875064458261888:0@lo:400:kworker.0 00000100:00100000:0.0:1788201379.558096:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201379.558131:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458261760 00000100:00100000:0.0:1788201379.558139:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458261760 00000100:00100000:0.0:1788201379.558224:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458262272 00000100:00100000:0.0:1788201379.558228:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458262272 00000100:00100000:0.0:1788201379.558253:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458261888 00000100:00100000:0.0:1788201379.558256:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458261888 00000100:00100000:0.0:1788201379.558275:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788201379.558284:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875064458261760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201379.558372:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875064458261760:12345-0@lo:400:kworker.0 Request processed in 88us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201379.558380:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788201379.558400:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788201379.558407:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875064458262272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201379.558436:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875064458262272:12345-0@lo:400:kworker.0 Request processed in 31us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201379.558443:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788201379.558455:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788201379.558462:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875064458261888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201379.558490:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875064458261888:12345-0@lo:400:kworker.0 Request processed in 29us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201379.558495:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788201379.558545:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875064458261888:0@lo:400:kworker.0 00000100:00100000:0.0:1788201379.558557:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875064458261760:0@lo:400:kworker.0 00000100:00100000:0.0:1788201379.558565:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875064458262272:0@lo:400:kworker.0 00000100:00100000:1.0:1788201379.558910:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458262016:0@lo:400:kworker.0 00000100:00100000:1.0:1788201379.558955:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201379.559012:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788201379.559020:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0005880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458261632:0@lo:400:kworker.0 00000100:00100000:1.0:1788201379.559062:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201379.559087:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0007b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458262144:0@lo:400:kworker.0 00000100:00100000:1.0:1788201379.559108:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788201379.559142:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201379.559158:0:16712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458261632 00000100:00100000:1.0:1788201379.559164:0:16712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458261632 00000100:00100000:1.0:1788201379.559397:0:16712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788201379.559406:0:16712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3312:x1875064458261632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201379.559454:0:16712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3312:x1875064458261632:12345-0@lo:400:kworker.0 Request processed in 49us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201379.559461:0:16712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788201379.559523:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0005880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458261632:0@lo:400:kworker.0 00000100:00100000:0.0:1788201379.559710:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458262016 00000100:00100000:0.0:1788201379.559715:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458262016 00000100:00100000:0.0:1788201379.559769:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458262144 00000100:00100000:0.0:1788201379.559773:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458262144 00000100:00100000:0.0:1788201379.559807:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788201379.559815:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5114a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458262016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201379.559859:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5114a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458262016:12345-0@lo:400:kworker.0 Request processed in 45us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201379.559866:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788201379.559879:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788201379.559886:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5115c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458262144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201379.559914:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5115c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458262144:12345-0@lo:400:kworker.0 Request processed in 29us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201379.559920:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00080000:1.0:1788201379.560128:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201379.560133:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201379.560156:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0007b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458262144:0@lo:400:kworker.0 00000100:00100000:1.0:1788201379.560167:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458262016:0@lo:400:kworker.0 00010000:00010000:0.0:1788201379.685677:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201380.529844:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201380.530124:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442716800 00000100:00100000:0.0:1788201380.530149:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442716800 00000100:00080000:1.0:1788201380.530193:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201380.530247:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:0.0:1788201380.530263:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:17208:x1875064442716800:12345-192.168.201.30@tcp:41:lfs.0 00000004:00000024:0.0:1788201380.530368:0:17126:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788201380.530465:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:17208:x1875064442716800:12345-192.168.201.30@tcp:41:lfs.0 Request processed in 208us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201380.530474:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:2.0:1788201380.537549:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201380.537826:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442716928 00000100:00100000:0.0:1788201380.537841:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442716928 00000100:00100000:0.0:1788201380.537999:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 172 00000100:00100000:0.0:1788201380.538023:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:17208:x1875064442716928:12345-192.168.201.30@tcp:13:lfs.0 00002000:00000024:0.0:1788201380.538079:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524746752 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1788201380.538185:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:17208:x1875064442716928:12345-192.168.201.30@tcp:13:lfs.0 Request processed in 166us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201380.538194:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 172 00000100:00100000:3.0:1788201380.541213:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00080000:1.0:1788201380.541991:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201380.545196:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442717056 00000100:00100000:2.0:1788201380.545220:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442717056 00000100:00100000:2.0:1788201380.545355:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 173 00000100:00100000:2.0:1788201380.545369:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:17208:x1875064442717056:12345-192.168.201.30@tcp:13:lfs.0 00002000:00000024:2.0:1788201380.545436:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 13631488 granted 524746752 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788201380.545445:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201380.545581:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:17208:x1875064442717056:12345-192.168.201.30@tcp:13:lfs.0 Request processed in 213us (4382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201380.545589:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 173 00000100:00100000:3.0:1788201380.643406:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201380.643584:0:16721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442717184 00000100:00100000:0.0:1788201380.643606:0:16721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442717184 00000100:00100000:0.0:1788201380.643689:0:16721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:0.0:1788201380.643701:0:16721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:17229:x1875064442717184:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:0.0:1788201380.643731:0:16721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201380.643758:0:16721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d4fd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c529a expref: -99 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.643845:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d4fde lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.643865:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d4fde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.643880:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d4fde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.644127:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d4fe5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.644138:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d4fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.644145:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d4fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.644701:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d4fec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.644710:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d4fec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.644718:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d4fec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201380.644793:0:16721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x402:0x0]: returning size 7680 00000004:00200000:0.0:1788201380.644797:0:16721:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 7 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201380.644884:0:16721:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d4fec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.646084:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d4fde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.646096:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d4fde lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.646102:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d4fde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.646118:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201380.646122:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d4fde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.646131:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d4fde lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.646152:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33e8100) 00010000:00010000:0.0:1788201380.646155:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201380.646161:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d4fde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.646168:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d4fde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.646187:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d4fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.646193:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d4fe5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.646199:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d4fe5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.646204:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201380.646208:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d4fe5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.646214:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d4fe5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.646222:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x430dc47c (ffff9e03c2fc5800) 00010000:00010000:0.0:1788201380.646224:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201380.646228:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d4fe5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.646233:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d4fe5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.646340:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d4fd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c529a expref: 16 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.646358:0:16721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d4fec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c529a expref: 15 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.646364:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:0.0:1788201380.646367:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201380.646369:0:16721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc6000, rc 0) 00000100:00100000:0.0:1788201380.646470:0:16721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:17229:x1875064442717184:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 2769us (3078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201380.646479:0:16721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:3.0:1788201380.649994:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201380.650242:0:16722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442717312 00000100:00100000:2.0:1788201380.650257:0:16722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442717312 00000100:00100000:2.0:1788201380.650374:0:16722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:2.0:1788201380.650385:0:16722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:17229:x1875064442717312:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:2.0:1788201380.650413:0:16722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201380.650439:0:16722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97000/0x9383f985bc4d4ff3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c52a1 expref: -99 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.650524:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d4ffa lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.650539:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d4ffa lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.650556:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d4ffa lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.650572:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96200/0x9383f985bc4d5001 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.650580:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96200/0x9383f985bc4d5001 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.650587:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96200/0x9383f985bc4d5001 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.651027:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96600/0x9383f985bc4d5008 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x403:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.651036:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96600/0x9383f985bc4d5008 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x403:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.651043:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96600/0x9383f985bc4d5008 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x403:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201380.651430:0:16722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x403:0x0]: returning size 0 00000004:00200000:2.0:1788201380.651437:0:16722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201380.651470:0:16722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96600/0x9383f985bc4d5008 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x403:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.651483:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96600/0x9383f985bc4d5008 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x403:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.651491:0:16722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d4ffa lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.651501:0:16722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d4ffa lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.651509:0:16722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d4ffa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.651516:0:16722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201380.651521:0:16722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d4ffa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.651529:0:16722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d4ffa lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.651545:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:2.0:1788201380.651548:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201380.651554:0:16722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d4ffa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.651561:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d4ffa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.651578:0:16722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96200/0x9383f985bc4d5001 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.651583:0:16722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96200/0x9383f985bc4d5001 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.652108:0:16722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96200/0x9383f985bc4d5001 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.652114:0:16722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b96200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201380.652118:0:16722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96200/0x9383f985bc4d5001 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.652124:0:16722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96200/0x9383f985bc4d5001 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.652135:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0xcda302ea (ffff9e03c2ac6100) 00010000:00010000:2.0:1788201380.652138:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201380.652141:0:16722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96200/0x9383f985bc4d5001 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.652147:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96200/0x9383f985bc4d5001 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.652196:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97000/0x9383f985bc4d4ff3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c52a1 expref: 17 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.652212:0:16722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96600/0x9383f985bc4d5008 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x403:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c52a1 expref: 16 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.652219:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x403:0x0].0x0 (ffff9e03c316f100) 00010000:00010000:2.0:1788201380.652221:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201380.652224:0:16722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c1b96600, rc 0) 00000100:00100000:2.0:1788201380.652392:0:16722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:17229:x1875064442717312:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 2007us (2410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201380.652401:0:16722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:3.0:1788201380.673133:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201380.673237:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442717440 00000100:00100000:0.0:1788201380.673252:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442717440 00000100:00100000:0.0:1788201380.673384:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:0.0:1788201380.673398:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:17232:x1875064442717440:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:0.0:1788201380.673427:0:17126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201380.673455:0:17126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d500f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c52a8 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.673555:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5016 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.673575:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5016 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.673588:0:17126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5016 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.673607:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d501d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.673614:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d501d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.673621:0:17126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d501d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.674379:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d5024 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x404:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.674392:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d5024 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x404:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.674401:0:17126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d5024 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x404:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201380.674448:0:17126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x404:0x0]: returning size 0 00000004:00200000:0.0:1788201380.674454:0:17126:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201380.674479:0:17126:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d5024 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x404:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.674494:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d5024 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x404:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.675355:0:17126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5016 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.675364:0:17126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5016 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.675372:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5016 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.675380:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201380.675384:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5016 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.675393:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5016 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.675410:0:17126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:0.0:1788201380.675413:0:17126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201380.675419:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5016 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.675425:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5016 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.675442:0:17126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d501d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.675453:0:17126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d501d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.675459:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d501d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.675464:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201380.675467:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d501d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.675472:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d501d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.675479:0:17126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x15fcbbea (ffff9e03c2fc5800) 00010000:00010000:0.0:1788201380.675481:0:17126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201380.675483:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d501d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.675488:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d501d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.676440:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d500f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c52a8 expref: 18 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.676464:0:17126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d5024 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x404:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c52a8 expref: 17 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.676473:0:17126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x404:0x0].0x0 (ffff9e03c316fd00) 00010000:00010000:0.0:1788201380.676476:0:17126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201380.676480:0:17126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc7000, rc 0) 00000100:00100000:0.0:1788201380.677226:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+17:17232:x1875064442717440:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 3826us (4114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201380.677239:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:1.0:1788201380.696750:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201380.696954:0:16721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442717568 00000100:00100000:0.0:1788201380.696969:0:16721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442717568 00000100:00100000:0.0:1788201380.697094:0:16721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:0.0:1788201380.697106:0:16721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+17:17235:x1875064442717568:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:0.0:1788201380.697143:0:16721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201380.697173:0:16721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d502b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c52af expref: -99 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.697263:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d5032 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.697291:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d5032 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.697348:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d5032 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.697367:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5039 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.697375:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5039 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.697382:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5039 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.697802:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d5040 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x405:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.697814:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d5040 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x405:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.697821:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d5040 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x405:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201380.697863:0:16721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x405:0x0]: returning size 0 00000004:00200000:0.0:1788201380.697868:0:16721:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201380.697892:0:16721:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d5040 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x405:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.697905:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d5040 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x405:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.697915:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d5032 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.697921:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d5032 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.697929:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d5032 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.697937:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201380.697942:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d5032 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.697950:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d5032 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.697964:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:0.0:1788201380.697968:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201380.697974:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d5032 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.697980:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d5032 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.697994:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5039 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.698000:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5039 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.698017:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5039 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.698023:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201380.698026:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5039 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.698033:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5039 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.698041:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x5e5674ea (ffff9e03c2fc5800) 00010000:00010000:0.0:1788201380.698043:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201380.698047:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5039 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.698052:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5039 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.698090:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d502b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c52af expref: 19 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.698106:0:16721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d5040 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x405:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c52af expref: 18 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.698114:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x405:0x0].0x0 (ffff9e03c316f200) 00010000:00010000:0.0:1788201380.698116:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201380.698119:0:16721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc7c00, rc 0) 00000100:00100000:0.0:1788201380.698208:0:16721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+18:17235:x1875064442717568:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 1103us (1474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201380.698217:0:16721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:3.0:1788201380.712205:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201380.713354:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442717696 00000100:00100000:2.0:1788201380.713371:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442717696 00000100:00100000:2.0:1788201380.713454:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 891 00000100:00100000:2.0:1788201380.713468:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+18:2362:x1875064442717696:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:2.0:1788201380.713551:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201380.713577:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96200/0x9383f985bc4d5047 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c52b6 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.713649:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d504e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.713666:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d504e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.713679:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d504e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.713695:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97000/0x9383f985bc4d5055 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.713702:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97000/0x9383f985bc4d5055 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.713709:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97000/0x9383f985bc4d5055 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.714143:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d505c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.714153:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d505c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.714160:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d505c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201380.714185:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x406:0x0]: returning size 0 00000004:00200000:2.0:1788201380.714192:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201380.714234:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d505c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.714248:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d505c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.714256:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d504e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.714263:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d504e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.714271:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d504e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.714278:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201380.714283:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d504e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.714291:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d504e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.714582:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:2.0:1788201380.714586:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201380.714591:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d504e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.714597:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d504e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.714612:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97000/0x9383f985bc4d5055 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.714623:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97000/0x9383f985bc4d5055 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.714629:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97000/0x9383f985bc4d5055 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.714633:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201380.714636:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97000/0x9383f985bc4d5055 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.714641:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97000/0x9383f985bc4d5055 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.714647:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0xa6b02dea (ffff9e03c2ac6100) 00010000:00010000:2.0:1788201380.714649:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201380.714651:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97000/0x9383f985bc4d5055 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.714656:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97000/0x9383f985bc4d5055 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.714691:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96200/0x9383f985bc4d5047 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c52b6 expref: 20 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.714703:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d505c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c52b6 expref: 19 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.714711:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x406:0x0].0x0 (ffff9e03c316fe00) 00010000:00010000:2.0:1788201380.714713:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201380.714716:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c1b96c00, rc 0) 00010000:00010000:2.0:1788201380.714723:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201380.714732:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97400/0x9383f985bc4d5063 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c52bd expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.714761:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96a00/0x9383f985bc4d506a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.714769:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96a00/0x9383f985bc4d506a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.714776:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96a00/0x9383f985bc4d506a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.714786:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d5071 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.714792:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d5071 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.714797:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d5071 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715040:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97200/0x9383f985bc4d5078 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715050:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97200/0x9383f985bc4d5078 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715057:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97200/0x9383f985bc4d5078 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201380.715073:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x407:0x0]: returning size 0 00000004:00200000:2.0:1788201380.715077:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201380.715088:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97200/0x9383f985bc4d5078 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715096:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97200/0x9383f985bc4d5078 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715102:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96a00/0x9383f985bc4d506a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715109:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96a00/0x9383f985bc4d506a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715115:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96a00/0x9383f985bc4d506a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715120:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b96a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201380.715136:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96a00/0x9383f985bc4d506a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715143:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96a00/0x9383f985bc4d506a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715151:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:2.0:1788201380.715155:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201380.715158:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96a00/0x9383f985bc4d506a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715164:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96a00/0x9383f985bc4d506a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715175:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d5071 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715186:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d5071 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715192:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d5071 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715197:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201380.715199:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d5071 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715206:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d5071 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715212:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0xef09e6ea (ffff9e03c2ac6f00) 00010000:00010000:2.0:1788201380.715215:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201380.715217:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d5071 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715222:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d5071 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715246:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97400/0x9383f985bc4d5063 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c52bd expref: 21 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715256:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97200/0x9383f985bc4d5078 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c52bd expref: 20 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715263:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x407:0x0].0x0 (ffff9e03c316f300) 00010000:00010000:2.0:1788201380.715265:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201380.715268:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c1b97200, rc 0) 00010000:00010000:2.0:1788201380.715273:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201380.715280:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96000/0x9383f985bc4d507f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c52c4 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715355:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97e00/0x9383f985bc4d5086 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715364:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97e00/0x9383f985bc4d5086 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715372:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97e00/0x9383f985bc4d5086 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715386:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d508d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715393:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d508d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715400:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d508d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715617:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d5094 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715627:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d5094 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715634:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d5094 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201380.715649:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x408:0x0]: returning size 0 00000004:00200000:2.0:1788201380.715653:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201380.715664:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d5094 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715673:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d5094 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715679:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97e00/0x9383f985bc4d5086 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715685:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97e00/0x9383f985bc4d5086 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715690:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97e00/0x9383f985bc4d5086 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715695:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201380.715698:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97e00/0x9383f985bc4d5086 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715704:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97e00/0x9383f985bc4d5086 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715710:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:2.0:1788201380.715713:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201380.715716:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97e00/0x9383f985bc4d5086 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715721:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97e00/0x9383f985bc4d5086 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715731:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d508d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715741:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d508d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715746:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d508d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715751:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201380.715754:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d508d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715760:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d508d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715767:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x37639fea (ffff9e03c2ac6300) 00010000:00010000:2.0:1788201380.715769:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201380.715772:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d508d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715778:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d508d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715801:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96000/0x9383f985bc4d507f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c52c4 expref: 22 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715813:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d5094 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c52c4 expref: 21 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715819:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x408:0x0].0x0 (ffff9e03c316f600) 00010000:00010000:2.0:1788201380.715822:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201380.715825:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031400, rc 0) 00010000:00010000:2.0:1788201380.715829:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201380.715837:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d509b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c52cb expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715860:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d50a2 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715868:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d50a2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715875:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d50a2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715885:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d50a9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715891:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d50a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.715898:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d50a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716134:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d50b0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716144:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d50b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716150:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d50b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201380.716165:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x409:0x0]: returning size 0 00000004:00200000:2.0:1788201380.716169:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201380.716177:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d50b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716185:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d50b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716191:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d50a2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716197:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d50a2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716203:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d50a2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716208:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201380.716211:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d50a2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716217:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d50a2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716225:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:2.0:1788201380.716227:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201380.716230:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d50a2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716236:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d50a2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716247:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d50a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716257:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d50a9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716263:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d50a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716268:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201380.716271:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d50a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716276:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d50a9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716283:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x7fbd58ea (ffff9e03c2ac6900) 00010000:00010000:2.0:1788201380.716285:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201380.716288:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d50a9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716335:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d50a9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716359:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d509b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c52cb expref: 23 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716371:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d50b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c52cb expref: 22 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716378:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x409:0x0].0x0 (ffff9e03c316fb00) 00010000:00010000:2.0:1788201380.716380:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201380.716383:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031800, rc 0) 00010000:00010000:2.0:1788201380.716388:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201380.716396:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d50b7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c52d2 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716424:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d50be lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716432:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d50be lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716439:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d50be lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716450:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e000/0x9383f985bc4d50c5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716457:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e000/0x9383f985bc4d50c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716463:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e000/0x9383f985bc4d50c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716599:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d50be lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716606:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d50be lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716613:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d50be lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716618:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131e600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201380.716621:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d50be lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716627:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d50be lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716634:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:2.0:1788201380.716637:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201380.716639:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d50be lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716644:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d50be lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716653:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e000/0x9383f985bc4d50c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716659:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e000/0x9383f985bc4d50c5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716664:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e000/0x9383f985bc4d50c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716669:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131e000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201380.716672:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e000/0x9383f985bc4d50c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716677:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e000/0x9383f985bc4d50c5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716684:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0xc81711ea (ffff9e03c2ac6700) 00010000:00010000:2.0:1788201380.716686:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201380.716689:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e000/0x9383f985bc4d50c5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716694:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e000/0x9383f985bc4d50c5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716716:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d50b7 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c52d2 expref: 23 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716726:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:2.0:1788201380.716729:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201380.716732:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d50b7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c52d2 expref: 23 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.716740:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0030000, rc -2) 00000100:00100000:2.0:1788201380.716849:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:2362:x1875064442717696:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 3382us (4658us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201380.716860:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 891 00010000:00010000:1.0:1788201380.717468:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201380.721441:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201380.721665:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201380.721720:0:16722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442717824 00000100:00100000:2.0:1788201380.721733:0:16722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442717824 00000100:00100000:2.0:1788201380.721808:0:16722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 26 00000100:00100000:2.0:1788201380.721820:0:16722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+22:17240:x1875064442717824:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:2.0:1788201380.721847:0:16722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201380.721876:0:16722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d50cc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c52ee expref: -99 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.721960:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d50d3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.721977:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d50d3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.721990:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d50d3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.722020:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d50da lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.722028:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d50da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.722035:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d50da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.722798:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d50e1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.722813:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d50e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.722821:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d50e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201380.722866:0:16722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x406:0x0]: returning size 0 00000004:00200000:2.0:1788201380.722872:0:16722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201380.722896:0:16722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d50e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.722910:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d50e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.722925:0:16722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d50d3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.722932:0:16722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d50d3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.722940:0:16722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d50d3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.722948:0:16722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131f600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201380.722953:0:16722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d50d3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.722961:0:16722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d50d3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.722974:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:2.0:1788201380.722978:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201380.722983:0:16722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d50d3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.722990:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d50d3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.723014:0:16722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d50da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.723020:0:16722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d50da lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.723026:0:16722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d50da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.723033:0:16722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131f400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201380.723036:0:16722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d50da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.723042:0:16722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d50da lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.723048:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0xa6b02dea (ffff9e03c2ac6b00) 00010000:00010000:2.0:1788201380.723050:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201380.723053:0:16722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d50da lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.723058:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d50da lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.723096:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d50cc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c52ee expref: 24 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.723111:0:16722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d50e1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c52ee expref: 23 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.723119:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x406:0x0].0x0 (ffff9e03c316fe00) 00010000:00010000:2.0:1788201380.723121:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:0.0:1788201380.723336:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442717952 00000100:00100000:0.0:1788201380.723347:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442717952 00000100:00100000:0.0:1788201380.723400:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 892 00000100:00100000:0.0:1788201380.723411:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f977d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:2359:x1875064442717952:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:0.0:1788201380.723465:0:17129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201380.723478:0:17129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d50e8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c52f5 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.723533:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d50ef lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.723543:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d50ef lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.723552:0:17129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d50ef lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.723565:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d50f6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.723573:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d50f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.723580:0:17129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d50f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.723857:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d50fd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.723865:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d50fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.723870:0:17129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d50fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201380.723880:0:17129:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x407:0x0]: returning size 0 00000004:00200000:0.0:1788201380.723883:0:17129:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201380.723895:0:17129:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d50fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.723901:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d50fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.723906:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d50ef lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.723910:0:17129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d50ef lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.723914:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d50ef lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.723922:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201380.723924:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d50ef lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.723928:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d50ef lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.723933:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:0.0:1788201380.723935:0:17129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201380.723937:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d50ef lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.723940:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d50ef lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.723947:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d50f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.723952:0:17129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d50f6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.723956:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d50f6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.723959:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201380.723962:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d50f6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.723965:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d50f6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.723973:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0xef09e6ea (ffff9e03c2fc5800) 00010000:00010000:0.0:1788201380.723974:0:17129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201380.723976:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d50f6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.723979:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d50f6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.723995:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d50e8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c52f5 expref: 26 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724015:0:17129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d50fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c52f5 expref: 25 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724023:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x407:0x0].0x0 (ffff9e03c316f300) 00010000:00010000:0.0:1788201380.724025:0:17129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201380.724029:0:17129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc6400, rc 0) 00010000:00010000:0.0:1788201380.724034:0:17129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201380.724046:0:17129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d5104 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c52fc expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724069:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d510b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724078:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d510b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.724078:0:16722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c131f200, rc 0) 00010000:00010000:0.0:1788201380.724084:0:17129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d510b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724097:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d5112 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724115:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d5112 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724121:0:17129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d5112 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201380.724170:0:16722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:17240:x1875064442717824:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 2351us (2744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201380.724179:0:16722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 26 00010000:00010000:0.0:1788201380.724411:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d5119 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724421:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d5119 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724428:0:17129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d5119 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201380.724442:0:17129:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x408:0x0]: returning size 0 00000004:00200000:0.0:1788201380.724445:0:17129:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201380.724455:0:17129:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d5119 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724463:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d5119 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724469:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d510b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724475:0:17129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d510b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724484:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d510b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724489:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201380.724492:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d510b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724498:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d510b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724507:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:0.0:1788201380.724510:0:17129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201380.724513:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d510b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724519:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d510b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724529:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d5112 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724534:0:17129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d5112 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724540:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d5112 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724544:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201380.724547:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d5112 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724555:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d5112 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724562:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x37639fea (ffff9e03c2fc5100) 00010000:00010000:0.0:1788201380.724564:0:17129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201380.724566:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d5112 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724572:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d5112 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724594:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d5104 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c52fc expref: 26 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724605:0:17129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d5119 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c52fc expref: 25 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724612:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x408:0x0].0x0 (ffff9e03c316f600) 00010000:00010000:0.0:1788201380.724614:0:17129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201380.724617:0:17129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc7400, rc 0) 00010000:00010000:0.0:1788201380.724622:0:17129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201380.724630:0:17129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d5120 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5303 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724655:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d5127 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724663:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d5127 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724674:0:17129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d5127 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724686:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d512e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724693:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d512e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724700:0:17129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d512e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724922:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c200/0x9383f985bc4d5135 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724932:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c200/0x9383f985bc4d5135 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724938:0:17129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c200/0x9383f985bc4d5135 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201380.724949:0:17129:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x409:0x0]: returning size 0 00000004:00200000:0.0:1788201380.724951:0:17129:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201380.724958:0:17129:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c200/0x9383f985bc4d5135 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724964:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c200/0x9383f985bc4d5135 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724968:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d5127 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724975:0:17129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d5127 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724979:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d5127 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724982:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507c800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201380.724983:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d5127 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724987:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d5127 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724991:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:0.0:1788201380.724992:0:17129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201380.724994:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d5127 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.724997:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d5127 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725015:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d512e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725020:0:17129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d512e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725024:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d512e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725027:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201380.725029:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d512e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725033:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d512e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725038:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x7fbd58ea (ffff9e03c2fc5a00) 00010000:00010000:0.0:1788201380.725039:0:17129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201380.725040:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d512e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725044:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d512e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725059:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d5120 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5303 expref: 27 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725066:0:17129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c200/0x9383f985bc4d5135 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5303 expref: 26 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725071:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x409:0x0].0x0 (ffff9e03c316fb00) 00010000:00010000:0.0:1788201380.725072:0:17129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201380.725073:0:17129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c507c200, rc 0) 00010000:00010000:0.0:1788201380.725076:0:17129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201380.725082:0:17129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d513c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c530a expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725097:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5143 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725101:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5143 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725106:0:17129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5143 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725114:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d514a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725117:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d514a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725121:0:17129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d514a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725232:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5143 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725237:0:17129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5143 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725241:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5143 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725244:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201380.725246:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5143 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725250:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5143 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725255:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:0.0:1788201380.725257:0:17129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201380.725258:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5143 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725262:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5143 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725268:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d514a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725271:0:17129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d514a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725275:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d514a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725278:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201380.725279:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d514a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725282:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d514a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725286:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0xc81711ea (ffff9e03c2fc5500) 00010000:00010000:0.0:1788201380.725287:0:17129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201380.725288:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d514a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725291:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d514a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xc81711ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725334:0:17129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d513c lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c530a expref: 27 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725348:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:0.0:1788201380.725350:0:17129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201380.725354:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d513c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c530a expref: 27 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.725362:0:17129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3600, rc -2) 00000100:00100000:0.0:1788201380.725412:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f977d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:2359:x1875064442717952:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 2003us (3747us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201380.725422:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 892 00000100:00100000:2.0:1788201380.749687:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201380.749860:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442718080 00000100:00100000:0.0:1788201380.749874:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442718080 00000100:00100000:0.0:1788201380.749958:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:0.0:1788201380.749971:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:17244:x1875064442718080:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:0.0:1788201380.750072:0:17126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201380.750102:0:17126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d5151 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c532d expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.750260:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5158 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.750278:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5158 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.750340:0:17126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5158 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.750359:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d515f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.750368:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d515f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.750375:0:17126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d515f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201380.751537:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201380.751808:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442718208 00000100:00100000:2.0:1788201380.751822:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442718208 00010000:00010000:1.0:1788201380.751850:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d5166 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.751869:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d5166 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.751880:0:17126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d5166 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201380.751913:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 893 00000100:00100000:2.0:1788201380.751926:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:2361:x1875064442718208:12345-192.168.201.30@tcp:63:ll_sa.0 00000004:00200000:1.0:1788201380.751935:0:17126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x407:0x0]: returning size 0 00000004:00200000:1.0:1788201380.751941:0:17126:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:2.0:1788201380.751970:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00010000:1.0:1788201380.751974:0:17126:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d5166 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.751986:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d516d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5334 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.751991:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d5166 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.752020:0:17126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5158 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.752027:0:17126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5158 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.752035:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5158 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.752042:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201380.752047:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5158 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.752056:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5158 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.752059:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5174 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.752073:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5174 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.752088:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5174 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.752105:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d517b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x53c502ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.752124:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d517b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.752131:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d517b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.753242:0:17126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:1.0:1788201380.753251:0:17126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201380.753261:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5158 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.753270:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5158 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.753351:0:17126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d515f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.753360:0:17126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d515f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.753368:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d515f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.753376:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201380.753380:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d515f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.753387:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d515f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.753401:0:17126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0xef09e6ea (ffff9e03c2fc5500) 00010000:00010000:1.0:1788201380.753404:0:17126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201380.753408:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d515f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.753414:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d515f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201380.753451:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:1.0:1788201380.753477:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d5151 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c532d expref: 30 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.753511:0:17126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d5166 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c532d expref: 29 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.753526:0:17126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x407:0x0].0x0 (ffff9e03c316f300) 00010000:00010000:1.0:1788201380.753528:0:17126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201380.753531:0:17126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9ce5200, rc 0) 00000100:00100000:1.0:1788201380.753626:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+29:17244:x1875064442718080:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 3656us (3951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201380.753636:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:0.0:1788201380.754274:0:16711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442718336 00000100:00100000:0.0:1788201380.754284:0:16711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442718336 00000100:00100000:0.0:1788201380.754366:0:16711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 68 00000100:00100000:0.0:1788201380.754374:0:16711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2361:x1875064442718336:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201380.754427:0:16711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2361:x1875064442718336:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 54us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201380.754432:0:16711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 68 00010000:00010000:2.0:1788201380.754559:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5174 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.754568:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5174 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.754576:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5174 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.754581:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131f400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201380.754584:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5174 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.754588:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5174 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.754597:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:2.0:1788201380.754599:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201380.754601:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5174 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.754605:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5174 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.754618:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d517b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.754623:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d517b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.754626:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d517b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.754629:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131f600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201380.754630:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d517b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.754637:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d517b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.754641:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x53c502ea (ffff9e03c2ac6b00) 00010000:00010000:2.0:1788201380.754642:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201380.754644:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d517b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.754647:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d517b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x53c502ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.754675:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d516d lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5334 expref: 28 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.754682:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:2.0:1788201380.754683:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201380.754685:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d516d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5334 expref: 28 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.754691:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c131e200, rc -2) 00000100:00100000:2.0:1788201380.754737:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:2361:x1875064442718208:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 2816us (3211us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201380.754743:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 893 00000100:00100000:3.0:1788201380.759395:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201380.759546:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442718464 00000100:00100000:0.0:1788201380.759566:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442718464 00000100:00100000:0.0:1788201380.759661:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 38 00000100:00100000:0.0:1788201380.759675:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:2361:x1875064442718464:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201380.759697:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201380.759732:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d5166 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c532d expref: 27 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.759759:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x407:0x0].0x0 (ffff9e03c316f300) 00010000:00010000:0.0:1788201380.759766:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201380.759850:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:2361:x1875064442718464:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 178us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201380.759859:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 38 00000100:00100000:3.0:1788201380.769789:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201380.769891:0:16720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442718592 00000100:00100000:2.0:1788201380.769907:0:16720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442718592 00000100:00100000:2.0:1788201380.769995:0:16720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 28 00000100:00100000:2.0:1788201380.770018:0:16720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:17245:x1875064442718592:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:2.0:1788201380.770051:0:16720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201380.770079:0:16720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5182 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c533b expref: -99 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.770160:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d5189 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.770174:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d5189 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.770183:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d5189 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.770195:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5190 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.770199:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5190 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.770204:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5190 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.772441:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e000/0x9383f985bc4d5197 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.772467:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e000/0x9383f985bc4d5197 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.772482:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e000/0x9383f985bc4d5197 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201380.772534:0:16720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x408:0x0]: returning size 0 00000004:00200000:2.0:1788201380.772541:0:16720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201380.772569:0:16720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e000/0x9383f985bc4d5197 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.772584:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e000/0x9383f985bc4d5197 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.772594:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d5189 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.772600:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d5189 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.772606:0:16720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d5189 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.772610:0:16720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131f600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201380.772614:0:16720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d5189 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.772619:0:16720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d5189 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.772631:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:2.0:1788201380.772633:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201380.772637:0:16720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d5189 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.772642:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d5189 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.772653:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5190 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.772660:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5190 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.772664:0:16720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5190 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.772666:0:16720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131f400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201380.772668:0:16720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5190 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.772671:0:16720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5190 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.772675:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x37639fea (ffff9e03c2ac6b00) 00010000:00010000:2.0:1788201380.772676:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201380.772677:0:16720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5190 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.772680:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5190 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.772717:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5182 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c533b expref: 28 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.772728:0:16720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e000/0x9383f985bc4d5197 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c533b expref: 27 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.772733:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x408:0x0].0x0 (ffff9e03c316f600) 00010000:00010000:2.0:1788201380.772734:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201380.772736:0:16720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c131e000, rc 0) 00000100:00100000:2.0:1788201380.772826:0:16720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:17245:x1875064442718592:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 2812us (3047us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201380.772834:0:16720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 28 00000100:00100000:1.0:1788201380.776682:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201380.776819:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442718720 00000100:00100000:2.0:1788201380.776832:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442718720 00000100:00100000:2.0:1788201380.776975:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:2.0:1788201380.776988:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5114e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:2361:x1875064442718720:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201380.777020:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201380.777056:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e000/0x9383f985bc4d5197 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c533b expref: 27 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.777080:0:13458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x408:0x0].0x0 (ffff9e03c316f600) 00010000:00010000:2.0:1788201380.777086:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201380.777164:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5114e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:2361:x1875064442718720:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 178us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201380.777172:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:3.0:1788201380.784535:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201380.784957:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442718848 00000100:00100000:1.0:1788201380.784972:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442718848 00000100:00100000:1.0:1788201380.785066:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:1.0:1788201380.785078:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2202300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:17246:x1875064442718848:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:1.0:1788201380.785110:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201380.785141:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5400/0x9383f985bc4d519e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5342 expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.785231:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d51a5 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.785249:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d51a5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.785263:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d51a5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.785280:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d51ac lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.785288:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d51ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.785333:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d51ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.785803:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4e00/0x9383f985bc4d51b3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.785814:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4e00/0x9383f985bc4d51b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.785822:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4e00/0x9383f985bc4d51b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201380.785867:0:17130:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x409:0x0]: returning size 0 00000004:00200000:1.0:1788201380.785872:0:17130:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201380.785896:0:17130:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4e00/0x9383f985bc4d51b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.785910:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4e00/0x9383f985bc4d51b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.785920:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d51a5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.785927:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d51a5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.785936:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d51a5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.785944:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9ce5200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201380.785949:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d51a5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.785958:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d51a5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.785973:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:1.0:1788201380.785976:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201380.785982:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d51a5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.785989:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d51a5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.786018:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d51ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.786025:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d51ac lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.786032:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d51ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.786038:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9ce4200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201380.786041:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d51ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.786047:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d51ac lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.786055:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x7fbd58ea (ffff9e03c316fa00) 00010000:00010000:1.0:1788201380.786057:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201380.786060:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d51ac lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.786068:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d51ac lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.786109:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5400/0x9383f985bc4d519e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5342 expref: 28 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.786125:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4e00/0x9383f985bc4d51b3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5342 expref: 27 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.786133:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x409:0x0].0x0 (ffff9e03c316fb00) 00010000:00010000:1.0:1788201380.786135:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201380.786138:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9ce4e00, rc 0) 00000100:00100000:1.0:1788201380.786232:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2202300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:17246:x1875064442718848:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 1156us (1713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201380.786241:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:3.0:1788201380.791692:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201380.791819:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442718976 00000100:00100000:2.0:1788201380.791833:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442718976 00000100:00100000:2.0:1788201380.791920:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 40 00000100:00100000:2.0:1788201380.791933:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2200700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:2360:x1875064442718976:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201380.791955:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201380.791989:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4e00/0x9383f985bc4d51b3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5342 expref: 27 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.792026:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x409:0x0].0x0 (ffff9e03c316fb00) 00010000:00010000:2.0:1788201380.792033:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201380.792117:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2200700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:2360:x1875064442718976:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 186us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201380.792126:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 40 00000100:00100000:3.0:1788201380.807125:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201380.807252:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442719232 00000100:00100000:1.0:1788201380.807265:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442719232 00000100:00100000:1.0:1788201380.807381:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 30 00000100:00100000:1.0:1788201380.807394:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c6630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:17247:x1875064442719232:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1788201380.807425:0:17126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201380.807454:0:17126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5400/0x9383f985bc4d51ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5349 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201380.807807:0:17126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x402:0x0]: returning size 7680 00010000:00010000:1.0:1788201380.808078:0:17126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5400/0x9383f985bc4d51ba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5349 expref: 28 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.808103:0:17126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33e8100) 00010000:00010000:1.0:1788201380.808106:0:17126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788201380.808111:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5400/0x9383f985bc4d51ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5349 expref: 28 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.808127:0:17126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9ce5400, rc 0) 00000100:00100000:1.0:1788201380.808211:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c6630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:17247:x1875064442719232:12345-192.168.201.30@tcp:101:rm.0 Request processed in 820us (1103us total) trans 17179869185 rc 301/301 00000100:00100000:1.0:1788201380.808219:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 30 00000100:00100000:0.0:1788201380.812525:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201380.813842:0:16723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442719360 00000100:00100000:1.0:1788201380.813856:0:16723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442719360 00000100:00100000:1.0:1788201380.813928:0:16723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:1.0:1788201380.813938:0:16723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:17247:x1875064442719360:12345-192.168.201.30@tcp:37:rm.0 00000100:00100000:1.0:1788201380.819324:0:16723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:17247:x1875064442719360:12345-192.168.201.30@tcp:37:rm.0 Request processed in 5355us (6781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201380.819342:0:16723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:3.0:1788201380.824062:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201380.827229:0:16724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442719616 00000100:00100000:0.0:1788201380.827250:0:16724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442719616 00000100:00100000:0.0:1788201380.827333:0:16724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:0.0:1788201380.827346:0:16724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c6630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:17247:x1875064442719616:12345-192.168.201.30@tcp:35:rm.0 00000100:00100000:0.0:1788201380.827845:0:16724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c6630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:17247:x1875064442719616:12345-192.168.201.30@tcp:35:rm.0 Request processed in 501us (3800us total) trans 17179869186 rc 0/0 00000100:00100000:0.0:1788201380.827852:0:16724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:0.0:1788201380.833422:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201380.833547:0:16720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442719872 00000100:00100000:2.0:1788201380.833560:0:16720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442719872 00000100:00100000:2.0:1788201380.833637:0:16720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:2.0:1788201380.833647:0:16720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:17247:x1875064442719872:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1788201380.833677:0:16720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201380.833705:0:16720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e000/0x9383f985bc4d51c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5350 expref: -99 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.834203:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d51cf lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.834221:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d51cf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.834234:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d51cf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201380.834248:0:16720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x402:0x0]: returning size 7680 00010000:00010000:2.0:1788201380.834517:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e000/0x9383f985bc4d51c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5350 expref: 31 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.834537:0:16720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d51cf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5350 expref: 30 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.834547:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:2.0:1788201380.834550:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788201380.834554:0:16720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c131e200, rc 0) 00000100:00100000:2.0:1788201380.834637:0:16720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+30:17247:x1875064442719872:12345-192.168.201.30@tcp:101:rm.0 Request processed in 991us (1231us total) trans 17179869187 rc 0/0 00000100:00100000:2.0:1788201380.834645:0:16720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:3.0:1788201380.838528:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201380.838868:0:16721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442720128 00000100:00100000:2.0:1788201380.838936:0:16721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442720128 00000100:00100000:2.0:1788201380.839025:0:16721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 32 00000100:00100000:2.0:1788201380.839037:0:16721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c6632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+30:17247:x1875064442720128:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1788201380.839193:0:16721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788201380.839231:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d5040 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x405:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c52af expref: 30 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.839258:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4c00/0x9383f985bc4d4ef0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x405:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5293 expref: 29 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.839273:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x405:0x0].0x0 (ffff9e03c316f200) 00010000:00010000:2.0:1788201380.840028:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d4fec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c529a expref: 28 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.840048:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:2.0:1788201380.840052:0:16721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201380.840082:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d51dd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.840096:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d51dd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.840215:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d51dd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.840237:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d51e4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.840244:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d51e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.840251:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d51e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.841054:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d51eb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x405:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.841067:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d51eb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x405:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.841075:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d51eb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x405:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201380.844594:0:16721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 64 off8320 00000004:00080000:2.0:1788201380.844614:0:16721:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 656102319088ns, next at 657102315202ns, rc = 0 00010000:00010000:2.0:1788201380.844711:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e000/0x9383f985bc4d51f2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.844731:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e000/0x9383f985bc4d51f2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.844744:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e000/0x9383f985bc4d51f2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.844753:0:16721:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e000/0x9383f985bc4d51f2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.844764:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e000/0x9383f985bc4d51f2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.844770:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e000/0x9383f985bc4d51f2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.844833:0:16721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201380.844865:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d51eb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x405:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.844871:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d51eb lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x405:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.844877:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d51eb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x405:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.844892:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131e600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201380.844896:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d51eb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x405:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.844905:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d51eb lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x405:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.844918:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x405:0x0].0x0 (ffff9e03c2ac6700) 00010000:00010000:2.0:1788201380.844921:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201380.844926:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d51eb lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x405:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.844932:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d51eb lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x405:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.844957:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d51dd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.844962:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d51dd lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.844967:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d51dd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.844972:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131f400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201380.844974:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d51dd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.844979:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d51dd lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.844985:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:2.0:1788201380.844987:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201380.844990:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d51dd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.844995:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d51dd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201380.845014:0:16721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004aaffc12 reply state 0000000005ecaf21 transno 17179869188 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d51e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201380.845023:0:16721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201380.845143:0:16721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c6632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+29:17247:x1875064442720128:12345-192.168.201.30@tcp:36:rm.0 Request processed in 6100us (6621us total) trans 17179869188 rc 0/0 00000100:00100000:2.0:1788201380.845155:0:16721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 32 00010000:00010000:3.0:1788201380.845906:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201380.845918:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e000/0x9383f985bc4d51f2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201380.845925:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131e000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201380.845930:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e000/0x9383f985bc4d51f2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201380.845937:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e000/0x9383f985bc4d51f2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201380.845954:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x405:0x0].0x0 (ffff9e03c2ac6700) 00010000:00010000:3.0:1788201380.845956:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788201380.845959:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e000/0x9383f985bc4d51f2 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201380.845964:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e000/0x9383f985bc4d51f2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x405:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201380.845982:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201380.845984:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201380.845986:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201380.846951:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d51e4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.846965:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d51e4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.846973:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d51e4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.846979:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131f600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201380.846984:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d51e4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.846992:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d51e4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.847016:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x5e5674ea (ffff9e03c2ac6b00) 00010000:00010000:2.0:1788201380.847020:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201380.847024:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d51e4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.847031:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d51e4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x402:0x0].0x5e5674ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201380.849010:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201380.849253:0:16722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442720384 00000100:00100000:0.0:1788201380.849267:0:16722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442720384 00000100:00100000:0.0:1788201380.851194:0:16722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:0.0:1788201380.851218:0:16722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d80f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+28:17247:x1875064442720384:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:0.0:1788201380.851317:0:16722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788201380.851352:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d505c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c52b6 expref: 28 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.851373:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d50e1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x406:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c52ee expref: 27 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.851386:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5000/0x9383f985bc4d4ee9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x406:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c528c expref: 26 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.851398:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x406:0x0].0x0 (ffff9e03c316fe00) 00010000:00010000:0.0:1788201380.851412:0:16722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201380.851442:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d51f9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.851462:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d51f9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.851473:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d51f9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.851490:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d5200 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.851497:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d5200 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.851504:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d5200 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.851637:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d5207 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x406:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.851645:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d5207 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x406:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.851651:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d5207 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x406:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201380.852508:0:16722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 64 off8320 00000004:00080000:0.0:1788201380.852522:0:16722:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 656110227873ns, next at 657110224843ns, rc = 0 00010000:00010000:0.0:1788201380.852594:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d520e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.852605:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d520e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.852617:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d520e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.852624:0:16722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d520e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.852630:0:16722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d520e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.852636:0:16722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d520e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.852670:0:16722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201380.852694:0:16722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d5207 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x406:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.852700:0:16722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d5207 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x406:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.852706:0:16722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d5207 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x406:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.852712:0:16722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201380.852717:0:16722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d5207 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x406:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.852724:0:16722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d5207 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x406:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.852733:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x406:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:0.0:1788201380.852736:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201380.852740:0:16722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d5207 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x406:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.852746:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d5207 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x406:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.852764:0:16722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d51f9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.852770:0:16722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d51f9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.852775:0:16722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d51f9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.852779:0:16722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201380.852782:0:16722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d51f9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.852787:0:16722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d51f9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.852793:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:0.0:1788201380.852795:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201380.852797:0:16722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d51f9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.852802:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d51f9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201380.852810:0:16722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004d60ea16 reply state 000000007391b6b6 transno 17179869189 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d5200 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201380.852823:0:16722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201380.852934:0:16722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d80f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:17247:x1875064442720384:12345-192.168.201.30@tcp:36:rm.0 Request processed in 1724us (3944us total) trans 17179869189 rc 0/0 00000100:00100000:0.0:1788201380.852941:0:16722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 33 00010000:00010000:1.0:1788201380.853055:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201380.853064:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d520e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.853071:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201380.853075:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d520e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.853081:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d520e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.853094:0:7645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x406:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:1.0:1788201380.853097:0:7645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201380.853099:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d520e lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.853104:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d520e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x406:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.853120:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201380.853122:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201380.853123:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201380.854964:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d5200 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.854986:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d5200 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.854995:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d5200 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.855012:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201380.855018:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d5200 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.855025:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d5200 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.855041:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0xa6b02dea (ffff9e03c2fc5a00) 00010000:00010000:1.0:1788201380.855045:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201380.855049:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d5200 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.855057:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d5200 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x402:0x0].0xa6b02dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201380.855407:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201380.855841:0:16720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442720640 00000100:00100000:2.0:1788201380.855854:0:16720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442720640 00000100:00100000:2.0:1788201380.855927:0:16720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 34 00000100:00100000:2.0:1788201380.855938:0:16720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d80f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:17247:x1875064442720640:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1788201380.856025:0:16720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788201380.856050:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c200/0x9383f985bc4d5135 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5303 expref: 26 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.856076:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d50b0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x409:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c52cb expref: 25 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.856089:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d4ed4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x409:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5277 expref: 24 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.856098:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x409:0x0].0x0 (ffff9e03c316fb00) 00010000:00010000:2.0:1788201380.856106:0:16720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201380.856129:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5215 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.856142:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5215 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.856152:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5215 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.856167:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d521c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.856173:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d521c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.856178:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d521c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.856335:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5223 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x409:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.856344:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5223 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x409:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.856352:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5223 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x409:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201380.857467:0:16720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].3, 64 off8384 00010000:00010000:2.0:1788201380.857552:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d522a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.857566:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d522a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.857574:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d522a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.857581:0:16720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d522a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.857588:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d522a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.857593:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d522a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.857652:0:16720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201380.857677:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5223 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x409:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.857683:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5223 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x409:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.857689:0:16720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5223 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x409:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.857699:0:16720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131e400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201380.857704:0:16720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5223 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x409:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.857711:0:16720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5223 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x409:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.857721:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x409:0x0].0x0 (ffff9e03c2ac6300) 00010000:00010000:2.0:1788201380.857723:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201380.857727:0:16720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5223 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x409:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.857733:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5223 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x409:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.857752:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5215 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.857758:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5215 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.857763:0:16720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5215 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.857767:0:16720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131fc00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201380.857770:0:16720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5215 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.857775:0:16720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5215 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.857785:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:2.0:1788201380.857787:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201380.857789:0:16720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5215 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.857794:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5215 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201380.857803:0:16720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031eb5c73 reply state 00000000e8721b77 transno 17179869190 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d521c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201380.857812:0:16720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201380.857958:0:16720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d80f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+25:17247:x1875064442720640:12345-192.168.201.30@tcp:36:rm.0 Request processed in 2018us (2552us total) trans 17179869190 rc 0/0 00000100:00100000:2.0:1788201380.857968:0:16720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 34 00010000:00010000:0.0:1788201380.858690:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201380.858699:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d522a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.858708:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131fe00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201380.858711:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d522a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.858718:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d522a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.858730:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x409:0x0].0x0 (ffff9e03c2ac6300) 00010000:00010000:0.0:1788201380.858733:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201380.858736:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d522a lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.858740:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d522a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x409:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.858755:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201380.858757:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201380.858758:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201380.862845:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:2.0:1788201380.862955:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d521c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.862970:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d521c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.862978:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d521c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.862984:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131e800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201380.862989:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d521c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.862997:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d521c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.863033:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x7fbd58ea (ffff9e03c2ac6900) 00010000:00010000:2.0:1788201380.863036:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201380.863041:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d521c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.863047:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d521c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x402:0x0].0x7fbd58ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201380.863768:0:16721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442720896 00000100:00100000:0.0:1788201380.863783:0:16721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442720896 00000100:00100000:0.0:1788201380.863904:0:16721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 35 00000100:00100000:0.0:1788201380.863916:0:16721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d80f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:17247:x1875064442720896:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:0.0:1788201380.863993:0:16721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788201380.864029:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d50fd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c52f5 expref: 24 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.864048:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97200/0x9383f985bc4d5078 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x407:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c52bd expref: 23 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.864060:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4a00/0x9383f985bc4d4ee2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x407:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5285 expref: 22 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.864069:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x407:0x0].0x0 (ffff9e03c316f300) 00010000:00010000:0.0:1788201380.864079:0:16721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201380.864204:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d5231 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.864221:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d5231 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.864233:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d5231 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.864252:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d5238 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.864259:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d5238 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.864264:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d5238 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.864474:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d523f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x407:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.864483:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d523f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x407:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.864492:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d523f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x407:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201380.865174:0:16721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].4, 64 off8448 00010000:00010000:1.0:1788201380.865244:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d5246 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.865254:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d5246 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.865262:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d5246 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.865269:0:16721:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d5246 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.865275:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d5246 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.865281:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d5246 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.865329:0:16721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201380.865355:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d523f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x407:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.865361:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d523f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x407:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.865368:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d523f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x407:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.865375:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9ce4200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201380.865380:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d523f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x407:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.865387:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d523f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x407:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.865397:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x407:0x0].0x0 (ffff9e03c316fa00) 00010000:00010000:1.0:1788201380.865400:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201380.865405:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d523f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x407:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.865411:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d523f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x407:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.865431:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d5231 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.865438:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d5231 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.865443:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d5231 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.865451:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201380.865454:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d5231 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.865459:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d5231 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.865466:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:1.0:1788201380.865468:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201380.865471:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d5231 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.865475:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d5231 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201380.865484:0:16721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d831ee79 reply state 00000000b88d5364 transno 17179869191 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d5238 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201380.865494:0:16721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788201380.865661:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201380.865669:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d5246 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201380.865675:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9ce5200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201380.865679:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d5246 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201380.865685:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d5246 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201380.865694:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x407:0x0].0x0 (ffff9e03c316fa00) 00010000:00010000:3.0:1788201380.865696:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788201380.865698:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d5246 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201380.865703:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d5246 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x407:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201380.865717:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201380.865719:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201380.865721:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201380.865757:0:16721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d80f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:17247:x1875064442720896:12345-192.168.201.30@tcp:36:rm.0 Request processed in 1840us (2923us total) trans 17179869191 rc 0/0 00000100:00100000:1.0:1788201380.865766:0:16721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 35 00000100:00100000:3.0:1788201380.867777:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201380.867929:0:16722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442721152 00000100:00100000:0.0:1788201380.867941:0:16722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442721152 00000100:00100000:0.0:1788201380.868025:0:16722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 36 00000100:00100000:0.0:1788201380.868037:0:16722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d80f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:17247:x1875064442721152:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:0.0:1788201380.868120:0:16722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788201380.868152:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d5024 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x404:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c52a8 expref: 23 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.868175:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4400/0x9383f985bc4d4f28 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x404:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5269 expref: 22 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.868189:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x404:0x0].0x0 (ffff9e03c316fd00) 00010000:00010000:0.0:1788201380.868200:0:16722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201380.868226:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d524d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.868247:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d524d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.868258:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d524d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.868275:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d5254 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.868283:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d5254 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.868290:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d5254 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.868453:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d525b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x404:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.868475:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d525b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x404:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.868482:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d525b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x404:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201380.869165:0:16722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].3, 64 off8384 00010000:00010000:0.0:1788201380.869245:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d5262 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.869257:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d5262 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.869266:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d5262 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.869273:0:16722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d5262 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.869279:0:16722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d5262 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.869286:0:16722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d5262 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.869352:0:16722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201380.869378:0:16722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d525b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x404:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.869390:0:16722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d525b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x404:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.869397:0:16722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d525b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x404:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.869403:0:16722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201380.869408:0:16722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d525b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x404:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.869416:0:16722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d525b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x404:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.869428:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x404:0x0].0x0 (ffff9e03c2fc5d00) 00010000:00010000:0.0:1788201380.869431:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201380.869435:0:16722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d525b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x404:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.869442:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d525b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x404:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.869461:0:16722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d524d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201380.869465:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201380.869468:0:16722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d524d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.869473:0:16722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d524d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201380.869473:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d5262 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201380.869479:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201380.869480:0:16722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201380.869483:0:16722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d524d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201380.869484:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d5262 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.869490:0:16722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d524d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201380.869492:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d5262 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.869497:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:0.0:1788201380.869499:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201380.869501:0:7645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x404:0x0].0x0 (ffff9e03c2fc5d00) 00010000:00010000:0.0:1788201380.869502:0:16722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d524d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201380.869504:0:7645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788201380.869507:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d5262 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.869508:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d524d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201380.869513:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d5262 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x404:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201380.869517:0:16722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a87027a7 reply state 0000000029656201 transno 17179869192 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d5254 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201380.869526:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201380.869527:0:16722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788201380.869528:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201380.869530:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201380.869629:0:16722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d80f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:17247:x1875064442721152:12345-192.168.201.30@tcp:36:rm.0 Request processed in 1592us (1859us total) trans 17179869192 rc 0/0 00000100:00100000:0.0:1788201380.869637:0:16722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 36 00010000:00010000:1.0:1788201380.869907:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d5238 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.869917:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d5238 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.869923:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d5238 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.869933:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201380.869936:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d5238 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.869943:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d5238 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.869952:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0xef09e6ea (ffff9e03c2fc5800) 00010000:00010000:1.0:1788201380.869955:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201380.869958:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d5238 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.869964:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d5238 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x402:0x0].0xef09e6ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.871282:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d5254 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.871330:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d5254 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.871339:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d5254 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.871346:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201380.871349:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d5254 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.871356:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d5254 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.871370:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x15fcbbea (ffff9e03c2fc5900) 00010000:00010000:2.0:1788201380.871372:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201380.871376:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d5254 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.871382:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d5254 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x402:0x0].0x15fcbbea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201380.872451:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201380.872525:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442721408 00000100:00100000:1.0:1788201380.872537:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442721408 00000100:00100000:1.0:1788201380.872602:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 37 00000100:00100000:1.0:1788201380.872610:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:17247:x1875064442721408:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201380.872675:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788201380.872694:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d5119 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c52fc expref: 21 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.872707:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d5094 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x408:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c52c4 expref: 20 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.872716:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4600/0x9383f985bc4d4ecd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x408:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5270 expref: 19 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.872726:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x408:0x0].0x0 (ffff9e03c316f600) 00010000:00010000:1.0:1788201380.872732:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201380.872751:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d5269 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.872761:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d5269 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.872768:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d5269 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.872777:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4400/0x9383f985bc4d5270 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.872781:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4400/0x9383f985bc4d5270 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.872785:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4400/0x9383f985bc4d5270 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.872889:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d5277 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x408:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.872894:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d5277 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x408:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.872898:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d5277 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x408:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201380.874243:0:17130:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].4, 64 off8448 00010000:00010000:1.0:1788201380.874556:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4a00/0x9383f985bc4d527e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.874572:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4a00/0x9383f985bc4d527e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.874582:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4a00/0x9383f985bc4d527e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.874590:0:17130:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4a00/0x9383f985bc4d527e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.874596:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4a00/0x9383f985bc4d527e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.874602:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4a00/0x9383f985bc4d527e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.874659:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201380.874687:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d5277 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x408:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.874692:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d5277 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x408:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.874697:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d5277 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x408:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.874703:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9ce5200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201380.874708:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d5277 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x408:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.874714:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d5277 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x408:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.874729:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x408:0x0].0x0 (ffff9e03c316f400) 00010000:00010000:1.0:1788201380.874732:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201380.874736:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d5277 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x408:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.874741:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d5277 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x408:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.874760:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d5269 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.874766:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d5269 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.874771:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d5269 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.874776:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9ce4200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201380.874779:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d5269 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.874784:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d5269 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.874790:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:1.0:1788201380.874793:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201380.874796:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d5269 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.874801:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d5269 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201380.874816:0:17130:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000383e7b3c reply state 00000000df6f1ff6 transno 17179869193 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4400/0x9383f985bc4d5270 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201380.874826:0:17130:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201380.874943:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:17247:x1875064442721408:12345-192.168.201.30@tcp:36:rm.0 Request processed in 2328us (2556us total) trans 17179869193 rc 0/0 00000100:00100000:1.0:1788201380.874955:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 37 00010000:00010000:0.0:1788201380.875018:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201380.875026:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4a00/0x9383f985bc4d527e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.875034:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9ce4a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201380.875038:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4a00/0x9383f985bc4d527e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.875046:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4a00/0x9383f985bc4d527e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.875061:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x408:0x0].0x0 (ffff9e03c316f400) 00010000:00010000:0.0:1788201380.875063:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201380.875066:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4a00/0x9383f985bc4d527e lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.875071:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4a00/0x9383f985bc4d527e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x408:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201380.875087:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201380.875089:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201380.875090:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201380.876751:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4400/0x9383f985bc4d5270 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.876772:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4400/0x9383f985bc4d5270 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.876779:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4400/0x9383f985bc4d5270 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.876784:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9ce4400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201380.876789:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4400/0x9383f985bc4d5270 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.876796:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4400/0x9383f985bc4d5270 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.876810:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x37639fea (ffff9e03c316f500) 00010000:00010000:1.0:1788201380.876813:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201380.876817:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4400/0x9383f985bc4d5270 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.876822:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4400/0x9383f985bc4d5270 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x402:0x0].0x37639fea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201380.878017:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201380.878235:0:16721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442721664 00000100:00100000:2.0:1788201380.878250:0:16721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442721664 00000100:00100000:2.0:1788201380.878553:0:16721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 38 00000100:00100000:2.0:1788201380.878566:0:16721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:17247:x1875064442721664:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1788201380.878672:0:16721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788201380.878702:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96600/0x9383f985bc4d5008 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x403:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c52a1 expref: 19 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.878722:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d4edb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x403:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c527e expref: 18 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.878732:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x403:0x0].0x0 (ffff9e03c316f100) 00010000:00010000:2.0:1788201380.878744:0:16721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201380.878771:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d5285 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.878785:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d5285 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.878794:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d5285 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.878808:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d528c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.878814:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d528c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.878819:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d528c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.878964:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5293 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x403:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.878971:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5293 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x403:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.878977:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5293 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x403:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201380.881660:0:16721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].5, 64 off8512 00010000:00010000:2.0:1788201380.881779:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d529a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.881799:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d529a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.881812:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d529a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.881820:0:16721:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d529a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.881827:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d529a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.881833:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d529a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.881946:0:16721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201380.881978:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5293 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x403:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.881988:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5293 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x403:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.881994:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5293 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x403:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.882010:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131e400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201380.882014:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5293 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x403:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.882022:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5293 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x403:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.882035:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x403:0x0].0x0 (ffff9e03c2ac6b00) 00010000:00010000:2.0:1788201380.882038:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201380.882043:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5293 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x403:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.882049:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5293 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x403:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.882072:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d5285 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.882077:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d5285 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.882083:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d5285 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.882087:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131e800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201380.882090:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d5285 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.882096:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d5285 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.882111:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:2.0:1788201380.882113:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201380.882116:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d5285 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.882121:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d5285 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x402:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201380.882130:0:16721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000daab5314 reply state 00000000c087abd8 transno 17179869194 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d528c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201380.882139:0:16721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201380.882271:0:16721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:17247:x1875064442721664:12345-192.168.201.30@tcp:36:rm.0 Request processed in 3702us (4265us total) trans 17179869194 rc 0/0 00000100:00100000:2.0:1788201380.882280:0:16721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 38 00010000:00010000:3.0:1788201380.883978:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201380.883992:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d529a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201380.884016:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131f600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201380.884020:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d529a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201380.884030:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d529a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201380.884049:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x403:0x0].0x0 (ffff9e03c2ac6b00) 00010000:00010000:3.0:1788201380.884053:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788201380.884057:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d529a lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201380.884068:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d529a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x403:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201380.884092:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201380.884094:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201380.884095:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201380.884330:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d528c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.884339:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d528c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.884345:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d528c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.884349:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131fc00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201380.884353:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d528c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.884361:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d528c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.884371:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0xcda302ea (ffff9e03c2ac6900) 00010000:00010000:2.0:1788201380.884373:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201380.884377:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d528c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.884394:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d528c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x402:0x0].0xcda302ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201380.885099:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201380.885161:0:16720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442721792 00000100:00100000:2.0:1788201380.885174:0:16720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442721792 00000100:00100000:2.0:1788201380.885235:0:16720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:2.0:1788201380.885245:0:16720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+18:17247:x1875064442721792:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1788201380.885274:0:16720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201380.885329:0:16720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d52a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5357 expref: -99 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.885424:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d52a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.885440:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d52a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.885453:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d52a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.885829:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d52af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.885839:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d52af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.885846:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d52af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.886189:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ee00/0x9383f985bc4d52b6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.886199:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ee00/0x9383f985bc4d52b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.886207:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ee00/0x9383f985bc4d52b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201380.886253:0:16720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x402:0x0]: returning size 7680 00000004:00200000:2.0:1788201380.886257:0:16720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201380.886281:0:16720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ee00/0x9383f985bc4d52b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.886712:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d52a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.886722:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d52a8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.886729:0:16720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d52a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.886735:0:16720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131e600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201380.886739:0:16720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d52a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.886747:0:16720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d52a8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.886760:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33e8100) 00010000:00010000:2.0:1788201380.886763:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201380.886767:0:16720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d52a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.886773:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d52a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.886788:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d52af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.886793:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d52af lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.886798:0:16720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d52af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.886803:0:16720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131ec00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201380.886805:0:16720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d52af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.886811:0:16720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d52af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.886816:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x430dc47c (ffff9e03c2ac6f00) 00010000:00010000:2.0:1788201380.886818:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201380.886820:0:16720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d52af lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.886829:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d52af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.886872:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d52a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5357 expref: 20 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.886898:0:16720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ee00/0x9383f985bc4d52b6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x402:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5357 expref: 19 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.886905:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:2.0:1788201380.886907:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201380.886909:0:16720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c131ee00, rc 0) 00000100:00100000:2.0:1788201380.886992:0:16720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:17247:x1875064442721792:12345-192.168.201.30@tcp:101:rm.0 Request processed in 1748us (1899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201380.887011:0:16720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:0.0:1788201380.890820:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201380.890940:0:16723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442722048 00000100:00100000:1.0:1788201380.890953:0:16723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442722048 00000100:00100000:1.0:1788201380.891037:0:16723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:1.0:1788201380.891050:0:16723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:17247:x1875064442722048:12345-192.168.201.30@tcp:35:rm.0 00000100:00100000:1.0:1788201380.891438:0:16723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:17247:x1875064442722048:12345-192.168.201.30@tcp:35:rm.0 Request processed in 389us (631us total) trans 17179869195 rc 0/0 00000100:00100000:1.0:1788201380.891445:0:16723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:1.0:1788201380.894365:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201380.894951:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442722304 00000100:00100000:2.0:1788201380.894965:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442722304 00000100:00100000:2.0:1788201380.895086:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 40 00000100:00100000:2.0:1788201380.895098:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:17247:x1875064442722304:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1788201380.895184:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788201380.895219:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ee00/0x9383f985bc4d52b6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x402:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5357 expref: 20 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.895243:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d51cf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5350 expref: 19 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.895259:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:2.0:1788201380.895276:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28c00/0x9383f985bc4d4dae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5078 expref: 18 pid: 16757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.895285:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33e8100) 00010000:00010000:2.0:1788201380.895337:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201380.895369:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d52bd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.895391:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d52bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.895401:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d52bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.895413:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d52c4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x430dc47c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.895419:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d52c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.895424:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d52c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.896053:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d52cb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.896065:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d52cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.896076:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d52cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201380.897175:0:17130:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x402:0x0]: returning size 7680 00010000:00010000:2.0:1788201380.897200:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d52cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.897208:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d52cb lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.897216:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d52cb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.897222:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131e600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201380.897227:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d52cb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.897235:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d52cb lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.897249:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e03c2ac6100) 00010000:00010000:2.0:1788201380.897252:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201380.897258:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d52cb lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.897264:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d52cb lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.897322:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d52bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.897334:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d52bd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.897340:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d52bd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.897345:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131f400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201380.897348:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d52bd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.897354:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d52bd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.897362:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c2ac6f00) 00010000:00010000:2.0:1788201380.897365:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201380.897368:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d52bd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201380.897373:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d52bd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201380.897397:0:17130:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000015e15ae5 reply state 00000000d072a090 transno 17179869196 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d52c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201380.897408:0:17130:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201380.898129:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:17247:x1875064442722304:12345-192.168.201.30@tcp:36:rm.0 Request processed in 3025us (3770us total) trans 17179869196 rc 0/0 00000100:00100000:2.0:1788201380.898140:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 40 00010000:00010000:1.0:1788201380.909919:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d52c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.909944:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d52c4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.909954:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d52c4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.909961:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131ec00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201380.909966:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d52c4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.909976:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d52c4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.910027:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x430dc47c (ffff9e03c2ac6900) 00010000:00010000:1.0:1788201380.910032:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201380.910038:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d52c4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201380.910048:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d52c4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x430dc47c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201381.093627:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201381.093660:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458262400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201381.093762:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201381.094546:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458262400 00000100:00100000:2.0:1788201381.094558:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458262400 00000100:00100000:2.0:1788201381.094639:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788201381.094649:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458262400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201381.094681:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524746752 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1788201381.094743:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458262400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201381.094751:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:2.0:1788201381.094778:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201381.094906:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458262528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201381.094949:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201381.095037:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458262528 00000100:00100000:3.0:1788201381.095042:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458262528 00000100:00100000:3.0:1788201381.095074:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788201381.095080:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458262528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201381.095094:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 13631488 granted 524746752 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201381.095195:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458262400:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788201381.099320:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201381.109579:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458262528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 14375us (14504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201381.109598:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788201381.109870:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458262528:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788201381.187720:0:16726:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869192 is committed 00000004:00080000:2.0:1788201381.187745:0:16726:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788201381.187770:0:16726:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869195 is committed 00000001:00080000:2.0:1788201381.187786:0:16726:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869196 is committed 00000004:00080000:2.0:1788201381.187797:0:16726:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1788201381.188142:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0005f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458262656:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201381.188248:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201381.188336:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201381.188344:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458262784:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201381.188374:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201381.188408:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458262656 00000100:00100000:3.0:1788201381.188417:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458262656 00000100:00100000:3.0:1788201381.188469:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458262784 00000100:00100000:3.0:1788201381.188473:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458262784 00000100:00100000:3.0:1788201381.188499:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4282 00000100:00100000:3.0:1788201381.188509:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9659050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458262656:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788201381.188544:0:13443:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1091 count 1 00010000:00010000:3.0:1788201381.188580:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d52d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x443:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201381.188609:0:13443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d4a2e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x443:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5135 expref: 9 pid: 13449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201381.188619:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x443:0x0].0x0 since=55s v=(0 0) 00010000:00010000:3.0:1788201381.188624:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x443:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201381.188629:0:13443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d52d2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x443:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201381.188660:0:13443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d4a2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x443:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5135 expref: 9 pid: 13449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201381.188675:0:13443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d4a2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x443:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5135 expref: 9 pid: 13449 timeout: 756 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201381.188688:0:13443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13443:1875064458262912:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201381.188765:0:13443:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c1b92780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201381.188783:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4283 00000100:00100000:3.0:1788201381.188790:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458262784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201381.188805:0:13450:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1091 count 1 00010000:00010000:3.0:1788201381.188822:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bcb7128/0x9383f985bc4d52d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x443:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201381.188833:0:13450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bb412d5a/0x9383f985bc4d4a27 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x443:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c512e expref: 507 pid: 13449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201381.188840:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x443:0x0].0x0 since=55s v=(0 0) 00010000:00010000:3.0:1788201381.188843:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x443:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201381.188846:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bcb7128/0x9383f985bc4d52d9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x443:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201381.188863:0:13450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bb412d5a/0x9383f985bc4d4a27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x443:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c512e expref: 507 pid: 13449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201381.188872:0:13450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bb412d5a/0x9383f985bc4d4a27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x443:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c512e expref: 507 pid: 13449 timeout: 756 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201381.188955:0:13450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:13450:1875064458263040:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201381.188983:0:13450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c1b92c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201381.195091:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201381.195271:0:13450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:13450:1875064458263040:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201381.195359:0:13450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005bcb7128/0x9383f985bc4d52d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x443:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201381.195529:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201381.195615:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442722432 00000100:00100000:2.0:1788201381.195625:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442722432 00010000:00010000:2.0:1788201381.195675:0:7646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d4a2e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x443:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5135 expref: 10 pid: 13449 timeout: 756 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201381.195721:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442722560 00000100:00100000:2.0:1788201381.195725:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442722560 00010000:00010000:2.0:1788201381.195741:0:7646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bb412d5a/0x9383f985bc4d4a27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x443:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c512e expref: 508 pid: 13449 timeout: 756 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201381.195764:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1561 00000100:00100000:2.0:1788201381.195776:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c7e17850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2361:x1875064442722432:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201381.195796:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201381.195803:0:7646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d4a2e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x443:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5135 expref: 10 pid: 13449 timeout: 756 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.195826:0:7646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d4a2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x443:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5135 expref: 10 pid: 13449 timeout: 756 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.195864:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x443:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201381.195871:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x443:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201381.195891:0:7646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d52d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x443:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.195904:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d52d2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x443:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.195928:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201381.195990:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c7e17850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2361:x1875064442722432:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 215us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201381.196009:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1561 00000100:00100000:2.0:1788201381.196071:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1562 00000100:00100000:2.0:1788201381.196079:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5117100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2361:x1875064442722560:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201381.196088:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201381.196093:0:7646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bb412d5a/0x9383f985bc4d4a27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x443:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c512e expref: 508 pid: 13449 timeout: 756 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.196173:0:7646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bb412d5a/0x9383f985bc4d4a27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x443:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c512e expref: 508 pid: 13449 timeout: 756 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.196198:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb412d5a/0x9383f985bc4d4a27 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x443:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c512e expref: 508 pid: 13449 timeout: 756 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.196213:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x443:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201381.196216:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x443:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201381.196220:0:7646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005bcb7128/0x9383f985bc4d52d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x443:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.196227:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bcb7128/0x9383f985bc4d52d9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x443:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.196244:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201381.196264:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5117100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+507:2361:x1875064442722560:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 187us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201381.196271:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1562 00010000:00010000:3.0:1788201381.196543:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b327931f/0x9383f985bc4d4a2e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x443:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5135 expref: 9 pid: 13449 timeout: 756 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201381.196557:0:13443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13443:1875064458262912:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201381.196579:0:13443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d52d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x443:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201381.196590:0:13443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d52d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x443:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201381.196605:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d52d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x443:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201381.196617:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d52d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x443:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201381.196627:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d52d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x443:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201381.196656:0:13443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201381.197182:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201381.197192:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d52d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x443:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.197204:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201381.197209:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d52d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x443:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.197220:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d52d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x443:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.197240:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d52d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x443:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.197248:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d52d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x443:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.197267:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201381.197270:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201381.197271:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201381.197354:0:13450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005bcb7128/0x9383f985bc4d52d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x443:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201381.197364:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bcb7128/0x9383f985bc4d52d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x443:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201381.197373:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bcb7128/0x9383f985bc4d52d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x443:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201381.197381:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bcb7128/0x9383f985bc4d52d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x443:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201381.197403:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201381.197883:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3311:x1875064458262784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9088us (9503us total) trans 4294968873 rc 0/0 00000100:00100000:0.0:1788201381.197893:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4283 00000004:00080000:0.0:1788201381.197957:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00a5880/2, rc 0, transno 4294968873 00000100:00100000:0.0:1788201381.197972:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458262784:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788201381.198091:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201381.198345:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bcb7128/0x9383f985bc4d52d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x443:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.198358:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201381.198363:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bcb7128/0x9383f985bc4d52d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x443:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.198373:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bcb7128/0x9383f985bc4d52d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x443:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.198388:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bcb7128/0x9383f985bc4d52d9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x443:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.198395:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bcb7128/0x9383f985bc4d52d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x443:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201381.198419:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201381.198420:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201381.198422:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201381.198811:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9659050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3313:x1875064458262656:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10300us (10559us total) trans 4294968874 rc 0/0 00000100:00100000:3.0:1788201381.198823:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4282 00000004:00080000:2.0:1788201381.199960:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f0005f80/2, rc 0, transno 4294968874 00000100:00100000:2.0:1788201381.199984:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0005f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458262656:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788201381.733532:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201382.758053:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201383.781795:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201384.677598:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458263168:0@lo:400:kworker.0 00000100:00100000:3.0:1788201384.677707:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201384.677954:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458263552:0@lo:400:kworker.0 00000100:00100000:2.0:1788201384.677997:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201384.678045:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458263424:0@lo:400:kworker.0 00000100:00100000:2.0:1788201384.678075:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201384.678097:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201384.678103:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458263296:0@lo:400:kworker.0 00000100:00100000:2.0:1788201384.678124:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201384.678157:0:16721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458263424 00000100:00100000:2.0:1788201384.678166:0:16721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458263424 00000100:00100000:2.0:1788201384.678243:0:16721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458263296 00000100:00100000:2.0:1788201384.678247:0:16721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458263296 00000100:00100000:2.0:1788201384.678274:0:16721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788201384.678285:0:16721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458263424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201384.678369:0:16721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458263424:12345-0@lo:400:kworker.0 Request processed in 86us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201384.678378:0:16721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788201384.678398:0:16721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788201384.678404:0:16721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875064458263296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201384.678431:0:16721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875064458263296:12345-0@lo:400:kworker.0 Request processed in 28us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201384.678437:0:16721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788201384.678455:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201384.678494:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458263296:0@lo:400:kworker.0 00000100:00100000:2.0:1788201384.678506:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458263424:0@lo:400:kworker.0 00000100:00100000:2.0:1788201384.678560:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458263552 00000100:00100000:2.0:1788201384.678564:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458263552 00000100:00100000:2.0:1788201384.678599:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788201384.678605:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3310:x1875064458263552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201384.678643:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3310:x1875064458263552:12345-0@lo:400:kworker.0 Request processed in 38us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201384.678650:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00080000:2.0:1788201384.678664:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201384.678682:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458263552:0@lo:400:kworker.0 00000100:00100000:1.0:1788201384.679101:0:16712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458263168 00000100:00100000:1.0:1788201384.679107:0:16712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458263168 00000100:00100000:1.0:1788201384.679156:0:16712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788201384.679165:0:16712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458263168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201384.680789:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458263808:0@lo:400:kworker.0 00000100:00100000:0.0:1788201384.680880:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201384.680931:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201384.680951:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458263680:0@lo:400:kworker.0 00000100:00100000:0.0:1788201384.680981:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201384.681206:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458263808 00000100:00100000:2.0:1788201384.681216:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458263808 00000100:00100000:2.0:1788201384.681279:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788201384.681315:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458263808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201384.681379:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458263808:12345-0@lo:400:kworker.0 Request processed in 90us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201384.681387:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788201384.681416:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458263680 00000100:00100000:2.0:1788201384.681420:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458263680 00000100:00100000:2.0:1788201384.681465:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788201384.681472:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1875064458263680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201384.681508:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1875064458263680:12345-0@lo:400:kworker.0 Request processed in 37us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201384.681515:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00080000:2.0:1788201384.681532:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201384.682058:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458263808:0@lo:400:kworker.0 00000100:00100000:0.0:1788201384.682101:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458263680:0@lo:400:kworker.0 00000100:00100000:1.0:1788201384.682437:0:16712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458263168:12345-0@lo:400:kworker.0 Request processed in 3270us (4727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201384.682449:0:16712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788201384.682635:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458263168:0@lo:400:kworker.0 00010000:00010000:1.0:1788201384.807559:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788201385.784539:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968874 is committed 00000001:00080000:1.0:1788201385.785894:0:6732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294968873 is committed 00010000:00010000:2.0:1788201385.829543:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201385.873019:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201385.873163:0:16711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442722688 00000100:00100000:0.0:1788201385.873173:0:16711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442722688 00000100:00100000:0.0:1788201385.873243:0:16711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:0.0:1788201385.873254:0:16711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2361:x1875064442722688:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201385.873367:0:16711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2361:x1875064442722688:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 115us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201385.873375:0:16711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:3.0:1788201385.873978:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201385.874017:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201385.874149:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201385.874336:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442722944 00000100:00100000:1.0:1788201385.874342:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442722944 00000100:00100000:1.0:1788201385.874385:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442723072 00000100:00100000:1.0:1788201385.874389:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442723072 00000100:00100000:1.0:1788201385.874414:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 238 00000100:00100000:1.0:1788201385.874423:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+507:2361:x1875064442722944:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201385.874469:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+507:2361:x1875064442722944:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 48us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201385.874476:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 238 00000100:00100000:1.0:1788201385.874491:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 239 00000100:00100000:1.0:1788201385.874498:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:2361:x1875064442723072:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201385.874525:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:2361:x1875064442723072:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 27us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201385.874529:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 239 00000100:00080000:3.0:1788201385.874988:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201385.874999:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201385.877235:0:16720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442722816 00000100:00100000:2.0:1788201385.877250:0:16720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442722816 00000100:00100000:2.0:1788201385.877366:0:16720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:2.0:1788201385.877377:0:16720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2361:x1875064442722816:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201385.877455:0:16720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2361:x1875064442722816:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 80us (3437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201385.877463:0:16720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00080000:1.0:1788201385.877856:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201386.214142:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458263936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201386.214218:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201386.214318:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458263936 00000100:00100000:2.0:1788201386.214326:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458263936 00000100:00100000:2.0:1788201386.214383:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788201386.214392:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0007b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458263936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201386.214427:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 13631488 granted 524746752 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201386.214470:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0007b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458263936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201386.214477:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:2.0:1788201386.214502:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788201386.215053:0:16746:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 661471226609ns, next at 662471224113ns, rc = 0 00000100:00100000:2.0:1788201386.215679:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968874 gen 2 00000004:00080000:2.0:1788201386.215686:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f0005f80, transno 4294968874 00000100:00100000:2.0:1788201386.215714:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458263936:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1788201386.216104:0:16744:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 661473809304ns, next at 662473806986ns, rc = 0 00000100:00100000:3.0:1788201386.216119:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201386.216133:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458264064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201386.216188:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201386.216230:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458264064 00000100:00100000:3.0:1788201386.216236:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458264064 00000100:00100000:3.0:1788201386.216282:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788201386.216308:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458264064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201386.216341:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524746752 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1788201386.216385:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458264064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201386.216392:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788201386.216425:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968873 gen 2 00000004:00080000:3.0:1788201386.216429:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00a5880, transno 4294968873 00000100:00100000:3.0:1788201386.216441:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458264064:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788201386.216973:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788201386.222369:0:16726:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:1.0:1788201386.222627:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201386.222628:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458264320:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201386.222659:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458264192:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201386.222861:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201386.222930:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458264320 00000100:00100000:3.0:1788201386.222940:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458264320 00000100:00100000:3.0:1788201386.223003:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4284 00000100:00100000:3.0:1788201386.223025:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c6bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458264320:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788201386.223063:0:13446:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1092 count 1 00010000:00010000:3.0:1788201386.223409:0:13446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d52e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x444:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201386.223440:0:13446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b8b36adf/0x9383f985bc4d4a66 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x444:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5197 expref: 8 pid: 13445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201386.223449:0:13446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e094923/0x9383f985bc4d4a6d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x444:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c516d expref: 8 pid: 13445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201386.223465:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x444:0x0].0x0 since=60s v=(0 0) 00010000:00010000:3.0:1788201386.223470:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x444:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201386.223476:0:13446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d52e0 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x444:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201386.223512:0:13446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e094923/0x9383f985bc4d4a6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x444:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c516d expref: 8 pid: 13445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201386.223527:0:13446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e094923/0x9383f985bc4d4a6d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x444:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c516d expref: 8 pid: 13445 timeout: 761 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201386.223542:0:13446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:13446:1875064458264576:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201386.223631:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458264448:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201386.227713:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201386.227804:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458264192 00000100:00100000:1.0:1788201386.227812:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458264192 00000100:00100000:1.0:1788201386.228014:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4285 00000100:00100000:1.0:1788201386.228027:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5115500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3310:x1875064458264192:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788201386.228062:0:12363:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1093 count 1 00010000:00010000:1.0:1788201386.228093:0:12363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8ecab97/0x9383f985bc4d52e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x445:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201386.228118:0:12363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003bf3c8de/0x9383f985bc4d4a35 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x445:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c513c expref: 8 pid: 13441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201386.228127:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x445:0x0].0x0 since=60s v=(0 0) 00010000:00010000:1.0:1788201386.228131:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x445:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201386.228136:0:12363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8ecab97/0x9383f985bc4d52e7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x445:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201386.228174:0:12363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003bf3c8de/0x9383f985bc4d4a35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x445:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c513c expref: 8 pid: 13441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201386.228193:0:12363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003bf3c8de/0x9383f985bc4d4a35 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x445:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c513c expref: 8 pid: 13441 timeout: 761 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201386.228207:0:12363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5117b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12363:1875064458264704:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201386.228517:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201386.228615:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458264448 00000100:00100000:0.0:1788201386.228624:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458264448 00000100:00100000:0.0:1788201386.228673:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4286 00000100:00100000:0.0:1788201386.228682:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:3313:x1875064458264448:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201386.228709:0:13444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1090 count 1 00010000:00010000:0.0:1788201386.228892:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002593d32f/0x9383f985bc4d52ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x442:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201386.228925:0:13444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ab0efb21/0x9383f985bc4d4a5f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x442:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c514a expref: 8 pid: 13445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201386.228934:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x442:0x0].0x0 since=60s v=(0 0) 00010000:00010000:0.0:1788201386.228939:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x442:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201386.228943:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002593d32f/0x9383f985bc4d52ee lrc: 4/0,1 mode: --/PW res: [0x280000400:0x442:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201386.228979:0:13444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ab0efb21/0x9383f985bc4d4a5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x442:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c514a expref: 8 pid: 13445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201386.228994:0:13444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ab0efb21/0x9383f985bc4d4a5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x442:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c514a expref: 8 pid: 13445 timeout: 761 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201386.229005:0:12363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c1b92780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201386.229076:0:13444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f4dec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13444:1875064458264832:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201386.229366:0:13444:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c56a9180 going to sleep for 11 seconds 00010000:00010000:3.0:1788201386.238544:0:13446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b8b36adf/0x9383f985bc4d4a66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x444:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5197 expref: 8 pid: 13445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201386.238573:0:13446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b8b36adf/0x9383f985bc4d4a66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x444:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5197 expref: 8 pid: 13445 timeout: 761 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201386.238593:0:13446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:13446:1875064458264960:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201386.239634:0:12363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5117b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12363:1875064458264704:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201386.239671:0:12363:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f8ecab97/0x9383f985bc4d52e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x445:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201386.239817:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201386.239852:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201386.239903:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442723200 00000100:00100000:1.0:1788201386.239920:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442723200 00010000:00010000:1.0:1788201386.239966:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003bf3c8de/0x9383f985bc4d4a35 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x445:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c513c expref: 9 pid: 13441 timeout: 761 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201386.240000:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442723328 00000100:00100000:1.0:1788201386.240003:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442723328 00010000:00010000:1.0:1788201386.240016:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ab0efb21/0x9383f985bc4d4a5f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x442:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c514a expref: 10 pid: 13445 timeout: 761 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201386.240037:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1563 00000100:00100000:1.0:1788201386.240047:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5114700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2361:x1875064442723200:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201386.240062:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201386.240068:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003bf3c8de/0x9383f985bc4d4a35 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x445:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c513c expref: 10 pid: 13441 timeout: 761 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201386.240079:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003bf3c8de/0x9383f985bc4d4a35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x445:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c513c expref: 10 pid: 13441 timeout: 761 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201386.240120:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bf3c8de/0x9383f985bc4d4a35 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x445:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c513c expref: 10 pid: 13441 timeout: 761 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201386.240436:0:13444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f4dec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13444:1875064458264832:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201386.240465:0:13444:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002593d32f/0x9383f985bc4d52ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x442:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201386.240505:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1564 00000100:00100000:0.0:1788201386.240516:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5116a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2361:x1875064442723328:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201386.240527:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201386.240532:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ab0efb21/0x9383f985bc4d4a5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x442:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c514a expref: 10 pid: 13445 timeout: 761 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201386.240543:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ab0efb21/0x9383f985bc4d4a5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x442:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c514a expref: 10 pid: 13445 timeout: 761 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201386.240557:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab0efb21/0x9383f985bc4d4a5f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x442:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c514a expref: 10 pid: 13445 timeout: 761 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201386.240586:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x442:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201386.240591:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x442:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201386.240598:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002593d32f/0x9383f985bc4d52ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x442:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201386.240610:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002593d32f/0x9383f985bc4d52ee lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x442:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201386.240637:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201386.240688:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5116a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:2361:x1875064442723328:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 174us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201386.240697:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1564 00010000:00010000:0.0:1788201386.240760:0:13444:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002593d32f/0x9383f985bc4d52ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x442:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201386.240771:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002593d32f/0x9383f985bc4d52ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x442:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201386.240783:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002593d32f/0x9383f985bc4d52ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x442:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201386.240804:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002593d32f/0x9383f985bc4d52ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x442:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201386.240825:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201386.241724:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x445:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201386.241728:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x445:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201386.241735:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8ecab97/0x9383f985bc4d52e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x445:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201386.241770:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8ecab97/0x9383f985bc4d52e7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x445:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201386.241811:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201386.242586:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5114700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2361:x1875064442723200:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1809us (2039us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201386.242602:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1563 00010000:00010000:1.0:1788201386.242860:0:12363:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f8ecab97/0x9383f985bc4d52e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x445:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201386.242873:0:12363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8ecab97/0x9383f985bc4d52e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x445:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201386.242885:0:12363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8ecab97/0x9383f985bc4d52e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x445:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201386.242893:0:12363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8ecab97/0x9383f985bc4d52e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x445:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201386.242923:0:12363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788201386.243765:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3313:x1875064458264448:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15076us (15247us total) trans 4294968875 rc 0/0 00000100:00100000:0.0:1788201386.243780:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4286 00010000:00010000:0.0:1788201386.245241:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201386.245255:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002593d32f/0x9383f985bc4d52ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x442:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201386.245469:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201386.245475:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002593d32f/0x9383f985bc4d52ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x442:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201386.245489:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002593d32f/0x9383f985bc4d52ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x442:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201386.245518:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002593d32f/0x9383f985bc4d52ee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x442:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201386.245526:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002593d32f/0x9383f985bc4d52ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x442:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201386.245554:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201386.245558:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8ecab97/0x9383f985bc4d52e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x445:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201386.245565:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9ce4800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201386.245568:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8ecab97/0x9383f985bc4d52e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x445:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201386.245580:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8ecab97/0x9383f985bc4d52e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x445:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201386.245589:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8ecab97/0x9383f985bc4d52e7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x445:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201386.245595:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8ecab97/0x9383f985bc4d52e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x445:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201386.245609:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201386.245611:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201386.245613:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201386.246007:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5115500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3310:x1875064458264192:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17978us (18295us total) trans 4294968876 rc 0/0 00000100:00100000:1.0:1788201386.246346:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4285 00010000:00010000:1.0:1788201386.246412:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788201386.246610:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c53ebb80/2, rc 0, transno 4294968876 00000100:00100000:0.0:1788201386.246619:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458264192:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788201386.247899:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c53e8700/2, rc 0, transno 4294968875 00000100:00100000:1.0:1788201386.247923:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458264448:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201386.251642:0:13446:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d127d840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201386.254935:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201386.255014:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442723456 00000100:00100000:0.0:1788201386.255028:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442723456 00010000:00010000:0.0:1788201386.255087:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e094923/0x9383f985bc4d4a6d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x444:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c516d expref: 7 pid: 13445 timeout: 761 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201386.255146:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1565 00000100:00100000:0.0:1788201386.255159:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5116300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2359:x1875064442723456:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201386.255189:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201386.255196:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e094923/0x9383f985bc4d4a6d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x444:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c516d expref: 7 pid: 13445 timeout: 761 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201386.255219:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e094923/0x9383f985bc4d4a6d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x444:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c516d expref: 7 pid: 13445 timeout: 761 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201386.255256:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201386.255364:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5116300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2359:x1875064442723456:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 207us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201386.255373:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1565 00010000:00010000:3.0:1788201386.255558:0:13446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e094923/0x9383f985bc4d4a6d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x444:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c516d expref: 6 pid: 13445 timeout: 761 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201386.255585:0:13446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:13446:1875064458264576:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201386.256852:0:13446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:13446:1875064458264960:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201386.256893:0:13446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d52e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x444:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201386.257894:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201386.258025:0:13526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442723584 00000100:00100000:2.0:1788201386.258036:0:13526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442723584 00010000:00010000:2.0:1788201386.258083:0:13526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b8b36adf/0x9383f985bc4d4a66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x444:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5197 expref: 6 pid: 13445 timeout: 761 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201386.258128:0:13526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1566 00000100:00100000:2.0:1788201386.258141:0:13526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5115880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2360:x1875064442723584:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201386.258161:0:13526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201386.258179:0:13526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b8b36adf/0x9383f985bc4d4a66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x444:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5197 expref: 6 pid: 13445 timeout: 761 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201386.258195:0:13526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b8b36adf/0x9383f985bc4d4a66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x444:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5197 expref: 6 pid: 13445 timeout: 761 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201386.258235:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8b36adf/0x9383f985bc4d4a66 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x444:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5197 expref: 6 pid: 13445 timeout: 761 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201386.258255:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x444:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201386.258261:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x444:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201386.258268:0:13526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d52e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x444:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201386.258340:0:13526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d52e0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x444:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201386.258373:0:13526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201386.258432:0:13526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5115880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2360:x1875064442723584:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 293us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201386.258441:0:13526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1566 00010000:00010000:3.0:1788201386.261348:0:13446:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d52e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x444:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201386.261375:0:13446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d52e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x444:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201386.261391:0:13446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d52e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x444:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201386.261401:0:13446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d52e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x444:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201386.261437:0:13446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201386.262060:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c6bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+8:3312:x1875064458264320:12345-0@lo:6:osp-syn-1-0.0 Request processed in 39042us (39195us total) trans 4294968877 rc 0/0 00000100:00100000:3.0:1788201386.262072:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4284 00000004:00080000:3.0:1788201386.262158:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c53eb800/2, rc 0, transno 4294968877 00010000:00010000:1.0:1788201386.262644:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201386.262654:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d52e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x444:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201386.262667:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201386.262673:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d52e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x444:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201386.262685:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d52e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x444:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201386.262711:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d52e0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x444:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201386.262720:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d52e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x444:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201386.262749:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201386.262752:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201386.262753:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201386.264421:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458264320:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788201386.855969:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201387.274849:0:17563:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 103: Check otr_next_id overflow ==== 14:36:25 (1788201385) 00010000:00010000:1.0:1788201387.883925:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201388.638196:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201388.638290:0:16722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442723712 00000100:00100000:0.0:1788201388.638340:0:16722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442723712 00000100:00100000:0.0:1788201388.638427:0:16722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00100000:0.0:1788201388.638443:0:16722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:17856:x1875064442723712:12345-192.168.201.30@tcp:101:mkdir.0 00010000:00010000:0.0:1788201388.638472:0:16722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201388.638504:0:16722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d52f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c535e expref: -99 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.638596:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d52fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.638613:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d52fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.638629:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d52fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201388.638916:0:16722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1788201388.638921:0:16722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201388.639033:0:16722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d52fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.639066:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d52f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c535e expref: 8 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.639086:0:16722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d52fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c535e expref: 7 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.639096:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:0.0:1788201388.639099:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201388.639103:0:16722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3800, rc 0) 00000100:00100000:0.0:1788201388.639193:0:16722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:17856:x1875064442723712:12345-192.168.201.30@tcp:101:mkdir.0 Request processed in 754us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201388.639201:0:16722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00080000:2.0:1788201388.639612:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201388.649240:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201388.650105:0:16721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442723968 00000100:00100000:3.0:1788201388.650120:0:16721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442723968 00000100:00100000:3.0:1788201388.650196:0:16721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00100000:3.0:1788201388.650355:0:16721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:17856:x1875064442723968:12345-192.168.201.30@tcp:36:mkdir.0 00010000:00010000:3.0:1788201388.650423:0:16721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201388.650458:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d52fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c535e expref: 7 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.650480:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:3.0:1788201388.650494:0:16721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201388.651187:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d5303 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.651211:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d5303 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.651224:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d5303 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.651238:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d530a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe5a0002c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.651244:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d530a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe5a0002c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.651251:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d530a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe5a0002c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201388.656662:0:16721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x40a:0x0]: returning size 512 00010000:00010000:3.0:1788201388.656688:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d5303 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.656702:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d5303 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.656711:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d5303 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.656718:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201388.656725:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d5303 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.656734:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d5303 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.656755:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c2fc5600) 00010000:00010000:3.0:1788201388.656758:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201388.656765:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d5303 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.656770:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d5303 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201388.656795:0:16721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0230a65 reply state 00000000d414f44f transno 17179869197 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d530a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe5a0002c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201388.656806:0:16721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201388.656970:0:16721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:17856:x1875064442723968:12345-192.168.201.30@tcp:36:mkdir.0 Request processed in 6756us (7732us total) trans 17179869197 rc 0/0 00000100:00100000:3.0:1788201388.656982:0:16721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 42 00010000:00010000:3.0:1788201388.663448:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d530a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe5a0002c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.663474:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d530a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe5a0002c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.663483:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d530a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe5a0002c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.663490:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201388.663496:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d530a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe5a0002c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.663505:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d530a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe5a0002c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.663527:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe5a0002c (ffff9e03c2fc5700) 00010000:00010000:3.0:1788201388.663530:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201388.663535:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d530a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe5a0002c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.663544:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d530a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe5a0002c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201388.752415:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201388.752482:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442724096 00000100:00100000:3.0:1788201388.752500:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442724096 00000100:00100000:3.0:1788201388.752574:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:3.0:1788201388.752588:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:17857:x1875064442724096:12345-192.168.201.30@tcp:101:createmany.0 00010000:00010000:3.0:1788201388.752624:0:17126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201388.752655:0:17126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d5311 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5365 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.752816:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3000/0x9383f985bc4d5318 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.752836:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3000/0x9383f985bc4d5318 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.752852:0:17126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3000/0x9383f985bc4d5318 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201388.753108:0:17126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788201388.753113:0:17126:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201388.753169:0:17126:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3000/0x9383f985bc4d5318 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.753203:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d5311 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5365 expref: 9 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.753225:0:17126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3000/0x9383f985bc4d5318 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5365 expref: 8 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.753237:0:17126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c270a400) 00010000:00010000:3.0:1788201388.753241:0:17126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201388.753244:0:17126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2ef3000, rc 0) 00000100:00100000:3.0:1788201388.753357:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:17857:x1875064442724096:12345-192.168.201.30@tcp:101:createmany.0 Request processed in 772us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201388.753365:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:3.0:1788201388.758345:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201388.758408:0:16722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442724224 00000100:00100000:3.0:1788201388.758422:0:16722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442724224 00000100:00100000:3.0:1788201388.758492:0:16722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:3.0:1788201388.758504:0:16722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:17857:x1875064442724224:12345-192.168.201.30@tcp:101:createmany.0 00010000:00010000:3.0:1788201388.758535:0:16722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201388.758564:0:16722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d531f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c536c expref: -99 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.758655:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5326 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.758671:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5326 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.758685:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5326 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.758702:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d532d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe5a0002c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.758710:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d532d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe5a0002c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.758718:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d532d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe5a0002c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.759289:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2200/0x9383f985bc4d5334 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.759337:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2200/0x9383f985bc4d5334 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.759349:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2200/0x9383f985bc4d5334 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201388.759395:0:16722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x40a:0x0]: returning size 512 00000004:00200000:3.0:1788201388.759400:0:16722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201388.759441:0:16722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2200/0x9383f985bc4d5334 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.759457:0:16722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5326 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.759465:0:16722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5326 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.759473:0:16722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5326 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.759481:0:16722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201388.759487:0:16722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5326 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.759496:0:16722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5326 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.759514:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c270a400) 00010000:00010000:3.0:1788201388.759517:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201388.759525:0:16722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5326 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.759533:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5326 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.759549:0:16722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d532d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe5a0002c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.759556:0:16722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d532d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe5a0002c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.759563:0:16722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d532d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe5a0002c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.759571:0:16722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201388.759575:0:16722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d532d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe5a0002c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.759582:0:16722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d532d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe5a0002c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.759593:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe5a0002c (ffff9e03c270a600) 00010000:00010000:3.0:1788201388.759596:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201388.759600:0:16722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d532d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe5a0002c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.759607:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d532d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe5a0002c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.759663:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d531f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c536c expref: 10 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.759689:0:16722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2200/0x9383f985bc4d5334 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c536c expref: 9 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.759697:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:3.0:1788201388.759700:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788201388.759703:0:16722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2ef2200, rc 0) 00000100:00100000:3.0:1788201388.760421:0:16722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:17857:x1875064442724224:12345-192.168.201.30@tcp:101:createmany.0 Request processed in 1910us (2084us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201388.760434:0:16722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:3.0:1788201388.762821:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201388.763024:0:16721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442724480 00000100:00100000:3.0:1788201388.763037:0:16721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442724480 00000100:00100000:3.0:1788201388.763119:0:16721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:3.0:1788201388.763132:0:16721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:17857:x1875064442724480:12345-192.168.201.30@tcp:101:createmany.0 00010000:00010000:3.0:1788201388.766972:0:16721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201388.767015:0:16721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d533b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5373 expref: -99 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.767212:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d5342 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.767231:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d5342 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.767250:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d5342 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.767271:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5349 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x9d5a3f99 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.767278:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5349 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x9d5a3f99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.767286:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5349 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x9d5a3f99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201388.773381:0:16721:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x445:0x0], count =29 00000004:00080000:3.0:1788201388.773399:0:16721:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x445:0x0]+29 in llog 00000004:00080000:3.0:1788201388.773504:0:16721:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x462:0x0], index 0: 0 00010000:00010000:3.0:1788201388.774018:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5350 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x40b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.774102:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5350 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.774119:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5350 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.774269:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d5342 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.774278:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d5342 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.774287:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d5342 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.777224:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201388.777235:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d5342 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.777251:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d5342 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.777277:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:3.0:1788201388.777281:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201388.777287:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d5342 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.777337:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d5342 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201388.777369:0:16721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e352b36 reply state 000000004ad760e2 transno 17179869198 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5349 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x9d5a3f99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201388.777381:0:16721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788201388.777472:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d533b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5373 expref: 12 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.777490:0:16721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5350 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x40b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5373 expref: 11 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.777498:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40b:0x0].0x0 (ffff9e03c270a100) 00010000:00010000:3.0:1788201388.777500:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201388.777503:0:16721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2ef3e00, rc 0) 00000100:00100000:3.0:1788201388.777613:0:16721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:17857:x1875064442724480:12345-192.168.201.30@tcp:101:createmany.0 Request processed in 14483us (14804us total) trans 17179869198 rc 0/0 00000100:00100000:3.0:1788201388.777625:0:16721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 45 00010000:00010000:3.0:1788201388.780423:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5349 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x9d5a3f99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.780446:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5349 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x9d5a3f99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.780455:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5349 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x9d5a3f99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.780463:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201388.780469:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5349 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x9d5a3f99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.780478:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5349 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x9d5a3f99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.780498:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x9d5a3f99 (ffff9e03c270af00) 00010000:00010000:3.0:1788201388.780501:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201388.780507:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5349 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x9d5a3f99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.780514:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5349 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x9d5a3f99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201388.790443:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201388.792027:0:16724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442724736 00000100:00100000:0.0:1788201388.792040:0:16724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442724736 00000100:00100000:0.0:1788201388.792108:0:16724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:0.0:1788201388.792119:0:16724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:17857:x1875064442724736:12345-192.168.201.30@tcp:35:createmany.0 00000100:00100000:0.0:1788201388.792635:0:16724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:17857:x1875064442724736:12345-192.168.201.30@tcp:35:createmany.0 Request processed in 516us (2199us total) trans 17179869199 rc 0/0 00000100:00100000:0.0:1788201388.792645:0:16724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:3.0:1788201388.803643:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201388.803726:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442724992 00000100:00100000:0.0:1788201388.803742:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442724992 00000100:00100000:0.0:1788201388.803826:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:0.0:1788201388.803838:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:17857:x1875064442724992:12345-192.168.201.30@tcp:101:createmany.0 00010000:00010000:0.0:1788201388.803875:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201388.803904:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d535e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c537a expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.804047:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d5365 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.804062:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d5365 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.804073:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d5365 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.804088:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d536c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xca7d0de1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.804099:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d536c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xca7d0de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.804105:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d536c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xca7d0de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201388.806581:0:17130:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x446:0x0], count =28 00000004:00080000:0.0:1788201388.806594:0:17130:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x446:0x0]+28 in llog 00000004:00080000:0.0:1788201388.806609:0:17130:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x462:0x0], index 1: 0 00010000:00010000:0.0:1788201388.806807:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d5373 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x40c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.806822:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d5373 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.806834:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d5373 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.807693:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d5365 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.807705:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d5365 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.807712:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d5365 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.807718:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201388.807722:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d5365 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.807734:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d5365 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.807747:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:0.0:1788201388.807750:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201388.807755:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d5365 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.807761:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d5365 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201388.807776:0:17130:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005db01aad reply state 000000005bcadf8e transno 17179869200 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d536c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xca7d0de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201388.807784:0:17130:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201388.807825:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d535e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c537a expref: 15 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.807839:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d5373 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x40c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c537a expref: 14 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.807846:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40c:0x0].0x0 (ffff9e03c2fc5700) 00010000:00010000:0.0:1788201388.807848:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201388.807850:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2800, rc 0) 00000100:00100000:0.0:1788201388.808804:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:17857:x1875064442724992:12345-192.168.201.30@tcp:101:createmany.0 Request processed in 4962us (5170us total) trans 17179869200 rc 0/0 00000100:00100000:0.0:1788201388.808816:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 46 00010000:00010000:2.0:1788201388.813320:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d536c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xca7d0de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.813344:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d536c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xca7d0de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.813353:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d536c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xca7d0de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.813361:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201388.813369:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d536c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xca7d0de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.813379:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d536c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xca7d0de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.813402:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0xca7d0de1 (ffff9e03c2fc5000) 00010000:00010000:2.0:1788201388.813406:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201388.813411:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d536c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xca7d0de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.813421:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d536c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xca7d0de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201388.813624:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201388.813678:0:16724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442725248 00000100:00100000:0.0:1788201388.813695:0:16724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442725248 00000100:00100000:0.0:1788201388.813772:0:16724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:0.0:1788201388.813782:0:16724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:17857:x1875064442725248:12345-192.168.201.30@tcp:35:createmany.0 00000100:00100000:0.0:1788201388.815221:0:16724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:17857:x1875064442725248:12345-192.168.201.30@tcp:35:createmany.0 Request processed in 1099us (1262us total) trans 17179869201 rc 0/0 00000100:00100000:0.0:1788201388.815233:0:16724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:2.0:1788201388.821242:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201388.821377:0:16722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442725504 00000100:00100000:3.0:1788201388.821395:0:16722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442725504 00000100:00100000:3.0:1788201388.821492:0:16722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00100000:3.0:1788201388.821507:0:16722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:17857:x1875064442725504:12345-192.168.201.30@tcp:101:createmany.0 00010000:00010000:3.0:1788201388.821540:0:16722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201388.821568:0:16722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5381 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5381 expref: -99 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.821738:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5388 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.821887:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5388 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.821905:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5388 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.821923:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d538f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xf79fdc29 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.821930:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d538f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xf79fdc29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.821936:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d538f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xf79fdc29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201388.823591:0:16722:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x463:0x0], index 0: 0 00010000:00010000:3.0:1788201388.824121:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d5396 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x40d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.824140:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d5396 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.824668:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d5396 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.824726:0:16722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5388 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.824735:0:16722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5388 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.824743:0:16722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5388 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.824819:0:16722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201388.824825:0:16722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5388 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.824832:0:16722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5388 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.824849:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:3.0:1788201388.824852:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201388.824857:0:16722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5388 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.824871:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5388 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201388.824889:0:16722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c05f9e9 reply state 0000000013a176d3 transno 17179869202 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d538f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xf79fdc29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201388.824900:0:16722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788201388.824955:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5381 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5381 expref: 18 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.825220:0:16722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d5396 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x40d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5381 expref: 17 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.825228:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40d:0x0].0x0 (ffff9e03c270a600) 00010000:00010000:3.0:1788201388.825231:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201388.825234:0:16722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2ef2600, rc 0) 00000100:00100000:3.0:1788201388.825372:0:16722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+18:17857:x1875064442725504:12345-192.168.201.30@tcp:101:createmany.0 Request processed in 3867us (4137us total) trans 17179869202 rc 0/0 00000100:00100000:3.0:1788201388.825384:0:16722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 47 00010000:00010000:1.0:1788201388.827943:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d538f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xf79fdc29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201388.827963:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d538f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xf79fdc29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201388.827972:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d538f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xf79fdc29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201388.827979:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201388.827985:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d538f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xf79fdc29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201388.827993:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d538f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xf79fdc29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201388.828009:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0xf79fdc29 (ffff9e03c270af00) 00010000:00010000:1.0:1788201388.828012:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201388.828016:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d538f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xf79fdc29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201388.828022:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d538f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xf79fdc29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201388.836056:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201388.836147:0:16723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442725760 00000100:00100000:1.0:1788201388.836171:0:16723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442725760 00000100:00100000:1.0:1788201388.836236:0:16723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:1.0:1788201388.836246:0:16723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2450c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+17:17857:x1875064442725760:12345-192.168.201.30@tcp:35:createmany.0 00000100:00100000:1.0:1788201388.836957:0:16723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2450c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+18:17857:x1875064442725760:12345-192.168.201.30@tcp:35:createmany.0 Request processed in 708us (908us total) trans 17179869203 rc 0/0 00000100:00100000:1.0:1788201388.836967:0:16723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:2.0:1788201388.844600:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201388.844709:0:16721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442726016 00000100:00100000:0.0:1788201388.844735:0:16721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442726016 00000100:00100000:0.0:1788201388.844812:0:16721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:0.0:1788201388.844827:0:16721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+18:17857:x1875064442726016:12345-192.168.201.30@tcp:101:createmany.0 00010000:00010000:0.0:1788201388.844856:0:16721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201388.844887:0:16721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d53a4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5388 expref: -99 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.845024:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d53ab lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.845038:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d53ab lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.845049:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d53ab lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.845064:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d53b2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x24c2aa72 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.845073:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d53b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x24c2aa72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.845079:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d53b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x24c2aa72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201388.846110:0:16721:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x463:0x0], index 1: 0 00010000:00010000:0.0:1788201388.846320:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d53b9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x40e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.846336:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d53b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.846345:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d53b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.846384:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d53ab lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.846392:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d53ab lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.846398:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d53ab lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.846405:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201388.846409:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d53ab lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.846416:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d53ab lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.846429:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:0.0:1788201388.846432:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201388.846437:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d53ab lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.846456:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d53ab lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201388.846471:0:16721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7e17d13 reply state 00000000e9eca82c transno 17179869204 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d53b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x24c2aa72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201388.846480:0:16721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201388.846516:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d53a4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5388 expref: 21 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.846530:0:16721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d53b9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x40e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5388 expref: 20 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.846538:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40e:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:0.0:1788201388.846540:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201388.846542:0:16721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3e00, rc 0) 00000100:00100000:0.0:1788201388.846624:0:16721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:17857:x1875064442726016:12345-192.168.201.30@tcp:101:createmany.0 Request processed in 1801us (2041us total) trans 17179869204 rc 0/0 00000100:00100000:0.0:1788201388.846632:0:16721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 48 00010000:00010000:2.0:1788201388.851253:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d53b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x24c2aa72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.851278:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d53b2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x24c2aa72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.851286:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d53b2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x24c2aa72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.851319:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201388.851325:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d53b2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x24c2aa72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.851333:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d53b2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x24c2aa72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.851354:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x24c2aa72 (ffff9e03c2fc5600) 00010000:00010000:2.0:1788201388.851358:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201388.851363:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d53b2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x24c2aa72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.851370:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d53b2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x24c2aa72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201388.855595:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201388.855760:0:16724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442726272 00000100:00100000:1.0:1788201388.855776:0:16724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442726272 00000100:00100000:1.0:1788201388.855852:0:16724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:1.0:1788201388.855873:0:16724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:17857:x1875064442726272:12345-192.168.201.30@tcp:35:createmany.0 00000100:00100000:1.0:1788201388.856253:0:16724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:17857:x1875064442726272:12345-192.168.201.30@tcp:35:createmany.0 Request processed in 390us (672us total) trans 17179869205 rc 0/0 00000100:00100000:1.0:1788201388.856262:0:16724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:0.0:1788201388.865481:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201388.865571:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442726528 00000100:00100000:3.0:1788201388.865588:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442726528 00000100:00100000:3.0:1788201388.865667:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:3.0:1788201388.865685:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:17857:x1875064442726528:12345-192.168.201.30@tcp:101:createmany.0 00010000:00010000:3.0:1788201388.865719:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201388.865748:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d53c7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c538f expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.865986:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d53ce lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.866004:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d53ce lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.866019:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d53ce lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.866036:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d53d5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x51e578ba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.866254:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d53d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x51e578ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.866263:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d53d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x51e578ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201388.868435:0:17130:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x464:0x0], index 0: 0 00010000:00010000:3.0:1788201388.868671:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d53dc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x40f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.868690:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d53dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.868705:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d53dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.868816:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d53ce lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.868825:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d53ce lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.868834:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d53ce lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.868841:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201388.868847:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d53ce lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.868856:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d53ce lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.868949:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:3.0:1788201388.868954:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201388.868959:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d53ce lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.869028:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d53ce lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201388.869106:0:17130:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003dc5691d reply state 0000000070709cfe transno 17179869206 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d53d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x51e578ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201388.869118:0:17130:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788201388.869215:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d53c7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c538f expref: 24 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.869232:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d53dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x40f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c538f expref: 23 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.869240:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40f:0x0].0x0 (ffff9e03c270af00) 00010000:00010000:3.0:1788201388.869242:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201388.869245:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2ef3800, rc 0) 00000100:00100000:3.0:1788201388.869499:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:17857:x1875064442726528:12345-192.168.201.30@tcp:101:createmany.0 Request processed in 3819us (4025us total) trans 17179869206 rc 0/0 00000100:00100000:3.0:1788201388.869509:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 49 00010000:00010000:1.0:1788201388.873448:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d53d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x51e578ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201388.873470:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d53d5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x51e578ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201388.873479:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d53d5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x51e578ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201388.873485:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201388.873492:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d53d5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x51e578ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201388.873504:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d53d5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x51e578ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201388.873525:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x51e578ba (ffff9e03c270ad00) 00010000:00010000:1.0:1788201388.873528:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201388.873534:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d53d5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x51e578ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201388.873540:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d53d5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x51e578ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201388.883572:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201388.883693:0:16723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442726784 00000100:00100000:2.0:1788201388.883704:0:16723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442726784 00000100:00100000:2.0:1788201388.883841:0:16723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:2.0:1788201388.883852:0:16723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+23:17857:x1875064442726784:12345-192.168.201.30@tcp:35:createmany.0 00000100:00100000:2.0:1788201388.884262:0:16723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:17857:x1875064442726784:12345-192.168.201.30@tcp:35:createmany.0 Request processed in 411us (698us total) trans 17179869207 rc 0/0 00000100:00100000:2.0:1788201388.884271:0:16723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:3.0:1788201388.887413:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201388.887588:0:16722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442727040 00000100:00100000:0.0:1788201388.887602:0:16722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442727040 00000100:00100000:0.0:1788201388.887690:0:16722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:0.0:1788201388.887705:0:16722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+24:17857:x1875064442727040:12345-192.168.201.30@tcp:101:createmany.0 00010000:00010000:0.0:1788201388.887739:0:16722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201388.887770:0:16722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d53ea lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5396 expref: -99 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.888154:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d53f1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.888173:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d53f1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.888185:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d53f1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.888202:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d53f8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x7f084702 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.888210:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d53f8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x7f084702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.888217:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d53f8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x7f084702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201388.888896:0:16722:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x464:0x0], index 1: 0 00010000:00010000:0.0:1788201388.890266:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d53ff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x410:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.890288:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d53ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x410:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.890326:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d53ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x410:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.890373:0:16722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d53f1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.890387:0:16722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d53f1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.890395:0:16722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d53f1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.890403:0:16722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201388.890408:0:16722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d53f1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.890417:0:16722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d53f1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.890433:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:0.0:1788201388.890436:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201388.890441:0:16722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d53f1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.890448:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d53f1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201388.890464:0:16722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009dde0309 reply state 0000000047cabbb3 transno 17179869208 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d53f8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x7f084702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201388.890474:0:16722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201388.890520:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d53ea lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5396 expref: 27 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.890535:0:16722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d53ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x410:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5396 expref: 26 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.890549:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x410:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:0.0:1788201388.890551:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201388.890554:0:16722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2e00, rc 0) 00000100:00100000:0.0:1788201388.890740:0:16722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:17857:x1875064442727040:12345-192.168.201.30@tcp:101:createmany.0 Request processed in 3038us (3339us total) trans 17179869208 rc 0/0 00000100:00100000:0.0:1788201388.890751:0:16722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 50 00010000:00010000:2.0:1788201388.897728:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d53f8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x7f084702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.897742:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d53f8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x7f084702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.897747:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d53f8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x7f084702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.897751:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201388.897754:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d53f8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x7f084702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.897759:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d53f8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x7f084702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.897776:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x7f084702 (ffff9e03c2fc5300) 00010000:00010000:2.0:1788201388.897779:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201388.897784:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d53f8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x7f084702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.897795:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d53f8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x7f084702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201388.898163:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201388.900310:0:16724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442727296 00000100:00100000:1.0:1788201388.900326:0:16724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442727296 00000100:00100000:1.0:1788201388.900407:0:16724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:1.0:1788201388.900418:0:16724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+26:17857:x1875064442727296:12345-192.168.201.30@tcp:35:createmany.0 00000100:00100000:1.0:1788201388.900808:0:16724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:17857:x1875064442727296:12345-192.168.201.30@tcp:35:createmany.0 Request processed in 391us (2655us total) trans 17179869209 rc 0/0 00000100:00100000:1.0:1788201388.900816:0:16724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00010000:00010000:1.0:1788201388.905019:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201388.909409:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201388.912249:0:16721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442727552 00000100:00100000:0.0:1788201388.912270:0:16721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442727552 00000100:00100000:0.0:1788201388.912468:0:16721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00100000:0.0:1788201388.912483:0:16721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+27:17857:x1875064442727552:12345-192.168.201.30@tcp:101:createmany.0 00010000:00010000:0.0:1788201388.912518:0:16721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201388.912549:0:16721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d540d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c539d expref: -99 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.912735:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d5414 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.912765:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d5414 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.912777:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d5414 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.912797:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d541b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xac2b154b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.912804:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d541b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xac2b154b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.912812:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d541b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xac2b154b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201388.913494:0:16721:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x465:0x0], index 0: 0 00010000:00010000:0.0:1788201388.913699:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d5422 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x411:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.913713:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d5422 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x411:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.913724:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d5422 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x411:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.913768:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d5414 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.913776:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d5414 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.913784:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d5414 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.913791:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201388.913797:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d5414 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.913807:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d5414 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.913843:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:0.0:1788201388.913852:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201388.913870:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d5414 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.913879:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d5414 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201388.913897:0:16721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004ae30b5a reply state 000000004445a48c transno 17179869210 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d541b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xac2b154b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201388.913907:0:16721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201388.913949:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d540d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c539d expref: 30 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.913965:0:16721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d5422 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x411:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c539d expref: 29 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.913973:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x411:0x0].0x0 (ffff9e03c2fc5d00) 00010000:00010000:0.0:1788201388.913975:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201388.913977:0:16721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2c00, rc 0) 00000100:00100000:0.0:1788201388.914084:0:16721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+30:17857:x1875064442727552:12345-192.168.201.30@tcp:101:createmany.0 Request processed in 1605us (4685us total) trans 17179869210 rc 0/0 00000100:00100000:0.0:1788201388.914094:0:16721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 51 00010000:00010000:1.0:1788201388.921680:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d541b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xac2b154b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201388.921686:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:1.0:1788201388.921703:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d541b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xac2b154b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201388.921722:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d541b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xac2b154b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201388.921731:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201388.921740:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d541b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xac2b154b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201388.921749:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d541b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xac2b154b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201388.921770:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0xac2b154b (ffff9e03c2fc5800) 00010000:00010000:1.0:1788201388.921774:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201388.921780:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d541b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xac2b154b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201388.921787:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d541b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xac2b154b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201388.921901:0:16723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442727808 00000100:00100000:3.0:1788201388.921915:0:16723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442727808 00000100:00100000:3.0:1788201388.921985:0:16723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:3.0:1788201388.922005:0:16723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+29:17857:x1875064442727808:12345-192.168.201.30@tcp:35:createmany.0 00000100:00100000:3.0:1788201388.922535:0:16723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+30:17857:x1875064442727808:12345-192.168.201.30@tcp:35:createmany.0 Request processed in 530us (859us total) trans 17179869211 rc 0/0 00000100:00100000:3.0:1788201388.922545:0:16723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:2.0:1788201388.930218:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201388.930350:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442728064 00000100:00100000:3.0:1788201388.930361:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442728064 00000100:00100000:3.0:1788201388.930432:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:3.0:1788201388.930443:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+30:17857:x1875064442728064:12345-192.168.201.30@tcp:101:createmany.0 00010000:00010000:3.0:1788201388.930479:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201388.930500:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5430 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c53a4 expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.930627:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5437 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.930642:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5437 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.930653:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5437 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.930667:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d543e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xd94de393 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.930675:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d543e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xd94de393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.930683:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d543e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xd94de393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201388.932505:0:17130:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x465:0x0], index 1: 0 00010000:00010000:3.0:1788201388.932659:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d5445 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x412:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.932670:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d5445 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x412:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.932678:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d5445 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x412:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.932705:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5437 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.932710:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5437 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.932725:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5437 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.932729:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201388.932733:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5437 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.932738:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5437 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.932745:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:3.0:1788201388.932748:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201388.932750:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5437 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.932757:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5437 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201388.932773:0:17130:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081384b00 reply state 000000001faaff0d transno 17179869212 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d543e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xd94de393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201388.932780:0:17130:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788201388.932806:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5430 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53a4 expref: 33 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.932815:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d5445 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x412:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53a4 expref: 32 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.932821:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x412:0x0].0x0 (ffff9e03c270a700) 00010000:00010000:3.0:1788201388.932822:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201388.932824:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2ef3c00, rc 0) 00000100:00100000:3.0:1788201388.933084:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+33:17857:x1875064442728064:12345-192.168.201.30@tcp:101:createmany.0 Request processed in 2641us (2874us total) trans 17179869212 rc 0/0 00000100:00100000:3.0:1788201388.933094:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 52 00010000:00010000:2.0:1788201388.939520:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d543e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xd94de393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.939538:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d543e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xd94de393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.939547:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d543e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xd94de393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.939554:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201388.939560:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d543e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xd94de393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.939568:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d543e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xd94de393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.939585:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0xd94de393 (ffff9e03c270a000) 00010000:00010000:2.0:1788201388.939588:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201388.939593:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d543e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xd94de393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.939600:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d543e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xd94de393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201388.947688:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201388.947854:0:16723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442728320 00000100:00100000:3.0:1788201388.947875:0:16723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442728320 00000100:00100000:3.0:1788201388.947946:0:16723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:3.0:1788201388.947958:0:16723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+32:17857:x1875064442728320:12345-192.168.201.30@tcp:35:createmany.0 00000100:00100000:2.0:1788201388.949592:0:16723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+33:17857:x1875064442728320:12345-192.168.201.30@tcp:35:createmany.0 Request processed in 1627us (1906us total) trans 17179869213 rc 0/0 00000100:00100000:2.0:1788201388.949604:0:16723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:0.0:1788201388.959182:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201388.959337:0:16722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442728576 00000100:00100000:3.0:1788201388.959350:0:16722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442728576 00000100:00100000:3.0:1788201388.959409:0:16722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:3.0:1788201388.959418:0:16722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+33:17857:x1875064442728576:12345-192.168.201.30@tcp:101:createmany.0 00010000:00010000:3.0:1788201388.959449:0:16722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201388.959479:0:16722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5453 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c53ab expref: -99 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.959651:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d545a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.959666:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d545a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.959677:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d545a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.959689:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5461 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x670b1db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.959693:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5461 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x670b1db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.959697:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5461 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x670b1db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201388.960337:0:16722:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x466:0x0], index 0: 0 00010000:00010000:2.0:1788201388.960772:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f000/0x9383f985bc4d5468 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x413:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.960794:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f000/0x9383f985bc4d5468 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x413:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.960806:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f000/0x9383f985bc4d5468 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x413:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.960846:0:16722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d545a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.960854:0:16722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d545a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.960871:0:16722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d545a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.960878:0:16722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201388.960882:0:16722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d545a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.961172:0:16722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d545a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.961187:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:2.0:1788201388.961190:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201388.961195:0:16722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d545a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.961207:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d545a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201388.961224:0:16722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053da696a reply state 00000000f48e22a4 transno 17179869214 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5461 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x670b1db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201388.961233:0:16722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201388.961270:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5453 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53ab expref: 36 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.961285:0:16722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f000/0x9383f985bc4d5468 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x413:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53ab expref: 35 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.961356:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x413:0x0].0x0 (ffff9e03c2ac6b00) 00010000:00010000:2.0:1788201388.961360:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201388.961362:0:16722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c131f000, rc 0) 00000100:00100000:2.0:1788201388.961553:0:16722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+36:17857:x1875064442728576:12345-192.168.201.30@tcp:101:createmany.0 Request processed in 2134us (2384us total) trans 17179869214 rc 0/0 00000100:00100000:2.0:1788201388.961562:0:16722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:0.0:1788201388.966123:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201388.966208:0:16724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442728832 00000100:00100000:2.0:1788201388.966227:0:16724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442728832 00000100:00100000:2.0:1788201388.966351:0:16724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:2.0:1788201388.966364:0:16724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2451050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+36:17857:x1875064442728832:12345-192.168.201.30@tcp:35:createmany.0 00010000:00010000:3.0:1788201388.966469:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5461 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x670b1db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.966488:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5461 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x670b1db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.966508:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5461 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x670b1db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.966522:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201388.966528:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5461 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x670b1db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.966538:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5461 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x670b1db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.966562:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x670b1db (ffff9e03c270a000) 00010000:00010000:3.0:1788201388.966565:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201388.966571:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5461 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x670b1db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.966577:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5461 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x670b1db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201388.967161:0:16724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2451050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+36:17857:x1875064442728832:12345-192.168.201.30@tcp:35:createmany.0 Request processed in 794us (1049us total) trans 17179869215 rc 0/0 00000100:00100000:2.0:1788201388.967171:0:16724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:0.0:1788201388.970197:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201388.970327:0:16721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442729088 00000100:00100000:3.0:1788201388.970342:0:16721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442729088 00000100:00100000:3.0:1788201388.970418:0:16721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00100000:3.0:1788201388.970432:0:16721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+36:17857:x1875064442729088:12345-192.168.201.30@tcp:101:createmany.0 00010000:00010000:3.0:1788201388.970468:0:16721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201388.970510:0:16721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5476 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c53b2 expref: -99 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.970694:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d547d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.970713:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d547d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.970734:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d547d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.971954:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d5484 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x33938024 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.972040:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d5484 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x33938024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.972057:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d5484 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x33938024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201388.973112:0:16721:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x466:0x0], index 1: 0 00010000:00010000:0.0:1788201388.973471:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d548b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x414:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.973488:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d548b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x414:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.973571:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d548b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x414:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.973623:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d547d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.973631:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d547d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.973639:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d547d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.973645:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201388.973650:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d547d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.973658:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d547d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.973672:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:0.0:1788201388.973676:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201388.973682:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d547d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.973689:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d547d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201388.973705:0:16721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe58deb6 reply state 00000000643b2dc4 transno 17179869216 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d5484 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x33938024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201388.973714:0:16721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201388.973832:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5476 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53b2 expref: 39 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.973854:0:16721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d548b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x414:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53b2 expref: 38 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.973873:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x414:0x0].0x0 (ffff9e03c2fc5a00) 00010000:00010000:0.0:1788201388.973875:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201388.973878:0:16721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2200, rc 0) 00000100:00100000:0.0:1788201388.974113:0:16721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+39:17857:x1875064442729088:12345-192.168.201.30@tcp:101:createmany.0 Request processed in 3683us (3931us total) trans 17179869216 rc 0/0 00000100:00100000:0.0:1788201388.974122:0:16721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 54 00010000:00010000:2.0:1788201388.977568:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d5484 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x33938024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.977587:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d5484 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x33938024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.977596:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d5484 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x33938024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.977603:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201388.977608:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d5484 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x33938024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.977617:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d5484 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x33938024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.977635:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x33938024 (ffff9e03c2fc5900) 00010000:00010000:2.0:1788201388.977639:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201388.977643:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d5484 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x33938024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.977650:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d5484 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x33938024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201388.978218:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201388.978426:0:16723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442729344 00000100:00100000:0.0:1788201388.978440:0:16723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442729344 00000100:00100000:0.0:1788201388.978510:0:16723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:0.0:1788201388.978523:0:16723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+38:17857:x1875064442729344:12345-192.168.201.30@tcp:35:createmany.0 00000100:00100000:0.0:1788201388.979021:0:16723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+39:17857:x1875064442729344:12345-192.168.201.30@tcp:35:createmany.0 Request processed in 498us (812us total) trans 17179869217 rc 0/0 00000100:00100000:0.0:1788201388.979031:0:16723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:0.0:1788201388.981848:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201388.981972:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442729600 00000100:00100000:3.0:1788201388.981987:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442729600 00000100:00100000:3.0:1788201388.982062:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 55 00000100:00100000:3.0:1788201388.982074:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+39:17857:x1875064442729600:12345-192.168.201.30@tcp:101:createmany.0 00010000:00010000:3.0:1788201388.982108:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201388.982138:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5499 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c53b9 expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.982372:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d54a0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.982390:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d54a0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.982406:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d54a0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.982424:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d54a7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x512a9eb4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.982431:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d54a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x512a9eb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.982438:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d54a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x512a9eb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201388.983068:0:17130:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x467:0x0], index 0: 0 00010000:00010000:3.0:1788201388.983279:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d54ae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x415:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.983290:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d54ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x415:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.983336:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d54ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x415:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.983379:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d54a0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.983388:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d54a0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.983396:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d54a0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.983402:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201388.983407:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d54a0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.983415:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d54a0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.983432:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:3.0:1788201388.983437:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201388.983443:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d54a0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.984214:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d54a0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201388.984247:0:17130:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000030b6d541 reply state 000000003a4ef59a transno 17179869218 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d54a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x512a9eb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201388.984257:0:17130:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201388.985118:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5499 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53b9 expref: 42 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.985153:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d54ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x415:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53b9 expref: 41 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.985164:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x415:0x0].0x0 (ffff9e03c270ad00) 00010000:00010000:2.0:1788201388.985168:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201388.985172:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2ef2e00, rc 0) 00000100:00100000:2.0:1788201388.985273:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+42:17857:x1875064442729600:12345-192.168.201.30@tcp:101:createmany.0 Request processed in 3199us (3438us total) trans 17179869218 rc 0/0 00000100:00100000:2.0:1788201388.985282:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 55 00010000:00010000:3.0:1788201388.989083:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d54a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x512a9eb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201388.989131:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201388.989563:0:16724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442729856 00000100:00100000:1.0:1788201388.989574:0:16724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442729856 00010000:00010000:3.0:1788201388.989619:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d54a7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x512a9eb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201388.989643:0:16724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:1.0:1788201388.989658:0:16724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+42:17857:x1875064442729856:12345-192.168.201.30@tcp:35:createmany.0 00010000:00010000:3.0:1788201388.989708:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d54a7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x512a9eb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.989716:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201388.989723:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d54a7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x512a9eb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.989732:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d54a7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x512a9eb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.989815:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x512a9eb4 (ffff9e03c270a000) 00010000:00010000:3.0:1788201388.989821:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201388.989827:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d54a7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x512a9eb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201388.989834:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d54a7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x512a9eb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201388.991464:0:16724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+42:17857:x1875064442729856:12345-192.168.201.30@tcp:35:createmany.0 Request processed in 1791us (2325us total) trans 17179869219 rc 0/0 00000100:00100000:1.0:1788201388.991477:0:16724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:1.0:1788201388.995225:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201388.995352:0:16722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442730112 00000100:00100000:2.0:1788201388.995363:0:16722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442730112 00000100:00100000:2.0:1788201388.995429:0:16722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 56 00000100:00100000:2.0:1788201388.995452:0:16722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+42:17857:x1875064442730112:12345-192.168.201.30@tcp:101:createmany.0 00010000:00010000:2.0:1788201388.995479:0:16722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201388.995503:0:16722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d54bc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c53c0 expref: -99 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.995642:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d54c3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.995656:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d54c3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.995667:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d54c3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.995683:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d54ca lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x73f8e70d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.995691:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d54ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x73f8e70d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201388.995697:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d54ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x73f8e70d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201388.996263:0:16722:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x467:0x0], index 1: 0 00010000:00010000:0.0:1788201388.997175:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d54d1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x416:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.997190:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d54d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x416:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.997201:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d54d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x416:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.997240:0:16722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d54c3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.997248:0:16722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d54c3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.997256:0:16722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d54c3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.997262:0:16722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131fe00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201388.997267:0:16722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d54c3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.997275:0:16722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d54c3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.997288:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:0.0:1788201388.997291:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201388.997316:0:16722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d54c3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.997323:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d54c3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201388.997344:0:16722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001cba98a8 reply state 000000002fd7f040 transno 17179869220 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d54ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x73f8e70d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201388.997353:0:16722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201388.997387:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d54bc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53c0 expref: 45 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.997403:0:16722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d54d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x416:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53c0 expref: 44 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201388.997411:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x416:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:0.0:1788201388.997413:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201388.997416:0:16722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3200, rc 0) 00000100:00100000:0.0:1788201388.997500:0:16722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+45:17857:x1875064442730112:12345-192.168.201.30@tcp:101:createmany.0 Request processed in 2061us (2283us total) trans 17179869220 rc 0/0 00000100:00100000:0.0:1788201388.997509:0:16722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 56 00010000:00010000:2.0:1788201389.001162:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d54ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x73f8e70d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.001182:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d54ca lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x73f8e70d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.001194:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d54ca lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x73f8e70d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201389.001197:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:2.0:1788201389.001209:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131f600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.001215:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d54ca lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x73f8e70d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.001234:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d54ca lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x73f8e70d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.001254:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x73f8e70d (ffff9e03c2ac6f00) 00010000:00010000:2.0:1788201389.001257:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.001262:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d54ca lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x73f8e70d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.001267:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d54ca lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x73f8e70d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201389.001475:0:16723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442730368 00000100:00100000:1.0:1788201389.001486:0:16723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442730368 00000100:00100000:1.0:1788201389.001555:0:16723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:1.0:1788201389.001566:0:16723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+44:17857:x1875064442730368:12345-192.168.201.30@tcp:35:createmany.0 00000100:00100000:1.0:1788201389.002002:0:16723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+45:17857:x1875064442730368:12345-192.168.201.30@tcp:35:createmany.0 Request processed in 428us (806us total) trans 17179869221 rc 0/0 00000100:00100000:1.0:1788201389.002013:0:16723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:2.0:1788201389.006966:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201389.007399:0:16721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442730624 00000100:00100000:0.0:1788201389.007416:0:16721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442730624 00000100:00100000:0.0:1788201389.007509:0:16721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:0.0:1788201389.007522:0:16721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+45:17857:x1875064442730624:12345-192.168.201.30@tcp:101:createmany.0 00010000:00010000:0.0:1788201389.007555:0:16721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201389.007583:0:16721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d54df lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c53c7 expref: -99 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.007763:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d54e6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.007780:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d54e6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.007794:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d54e6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.007813:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d54ed lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x96c72f67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.007821:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d54ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x96c72f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.007829:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d54ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x96c72f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201389.008488:0:16721:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x468:0x0], index 0: 0 00010000:00010000:0.0:1788201389.008681:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d54f4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x417:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.008695:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d54f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x417:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.008705:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d54f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x417:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.008744:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d54e6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.008753:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d54e6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.008760:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d54e6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.008769:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201389.008774:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d54e6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.008783:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d54e6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.008799:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:0.0:1788201389.008802:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201389.008807:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d54e6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.008814:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d54e6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201389.008830:0:16721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b64267e7 reply state 000000000656ebf1 transno 17179869222 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d54ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x96c72f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201389.008840:0:16721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201389.008913:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d54df lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53c7 expref: 48 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.008930:0:16721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d54f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x417:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53c7 expref: 47 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.008939:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x417:0x0].0x0 (ffff9e03c2fc5200) 00010000:00010000:0.0:1788201389.008942:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201389.008945:0:16721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3c00, rc 0) 00000100:00100000:0.0:1788201389.009044:0:16721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+48:17857:x1875064442730624:12345-192.168.201.30@tcp:101:createmany.0 Request processed in 1523us (2087us total) trans 17179869222 rc 0/0 00000100:00100000:0.0:1788201389.009053:0:16721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 57 00010000:00010000:1.0:1788201389.011394:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d54ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x96c72f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.011415:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d54ed lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x96c72f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.011424:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d54ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x96c72f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.011430:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201389.011436:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d54ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x96c72f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.011452:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d54ed lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x96c72f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.011471:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x96c72f67 (ffff9e03c2fc5500) 00010000:00010000:1.0:1788201389.011474:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201389.011479:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d54ed lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x96c72f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.011486:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d54ed lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x96c72f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.014664:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201389.014755:0:16724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442730880 00000100:00100000:0.0:1788201389.014767:0:16724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442730880 00000100:00100000:0.0:1788201389.014833:0:16724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:0.0:1788201389.014845:0:16724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+47:17857:x1875064442730880:12345-192.168.201.30@tcp:35:createmany.0 00000100:00100000:0.0:1788201389.015348:0:16724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+48:17857:x1875064442730880:12345-192.168.201.30@tcp:35:createmany.0 Request processed in 502us (704us total) trans 17179869223 rc 0/0 00000100:00100000:0.0:1788201389.015357:0:16724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:0.0:1788201389.018468:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201389.018570:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442731136 00000100:00100000:2.0:1788201389.018585:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442731136 00000100:00100000:2.0:1788201389.018668:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 58 00000100:00100000:2.0:1788201389.018682:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+48:17857:x1875064442731136:12345-192.168.201.30@tcp:101:createmany.0 00010000:00010000:2.0:1788201389.018717:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201389.018754:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d5502 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c53ce expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.018935:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5509 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.018953:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5509 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.018977:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5509 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.018997:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ee00/0x9383f985bc4d5510 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xb99577c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.019005:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ee00/0x9383f985bc4d5510 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xb99577c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.019012:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ee00/0x9383f985bc4d5510 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xb99577c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201389.019652:0:17130:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x468:0x0], index 1: 0 00010000:00010000:2.0:1788201389.019842:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5517 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x418:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.019854:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5517 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x418:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.019875:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5517 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x418:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.019920:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5509 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.019929:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5509 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.019936:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5509 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.019944:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131e200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.019949:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5509 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.019958:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5509 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.019973:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:2.0:1788201389.019977:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.019983:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5509 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.019990:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5509 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201389.020007:0:17130:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000063d5795b reply state 00000000d1b871ed transno 17179869224 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ee00/0x9383f985bc4d5510 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xb99577c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.020018:0:17130:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201389.020054:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d5502 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53ce expref: 51 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.020075:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5517 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x418:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53ce expref: 50 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.020083:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x418:0x0].0x0 (ffff9e03c2ac6300) 00010000:00010000:2.0:1788201389.020086:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201389.020088:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c131fc00, rc 0) 00000100:00100000:2.0:1788201389.020190:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+51:17857:x1875064442731136:12345-192.168.201.30@tcp:101:createmany.0 Request processed in 1508us (1745us total) trans 17179869224 rc 0/0 00000100:00100000:2.0:1788201389.020199:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 58 00010000:00010000:3.0:1788201389.024198:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ee00/0x9383f985bc4d5510 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xb99577c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.024225:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ee00/0x9383f985bc4d5510 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xb99577c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.024234:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ee00/0x9383f985bc4d5510 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xb99577c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.024242:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131ee00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201389.024249:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ee00/0x9383f985bc4d5510 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xb99577c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.024259:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ee00/0x9383f985bc4d5510 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xb99577c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.024282:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0xb99577c1 (ffff9e03c2ac6f00) 00010000:00010000:3.0:1788201389.024287:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.024338:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ee00/0x9383f985bc4d5510 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xb99577c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.024349:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ee00/0x9383f985bc4d5510 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xb99577c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201389.024368:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201389.024470:0:16724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442731392 00000100:00100000:2.0:1788201389.024484:0:16724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442731392 00000100:00100000:2.0:1788201389.024570:0:16724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:2.0:1788201389.024583:0:16724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+50:17857:x1875064442731392:12345-192.168.201.30@tcp:35:createmany.0 00000100:00100000:2.0:1788201389.025059:0:16724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+51:17857:x1875064442731392:12345-192.168.201.30@tcp:35:createmany.0 Request processed in 477us (716us total) trans 17179869225 rc 0/0 00000100:00100000:2.0:1788201389.025069:0:16724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:2.0:1788201389.028790:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201389.028917:0:16722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442731648 00000100:00100000:0.0:1788201389.028931:0:16722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442731648 00000100:00100000:0.0:1788201389.029106:0:16722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:0.0:1788201389.029119:0:16722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+51:17857:x1875064442731648:12345-192.168.201.30@tcp:101:createmany.0 00010000:00010000:0.0:1788201389.029154:0:16722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201389.029182:0:16722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5525 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c53d5 expref: -99 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.029383:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d552c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.029403:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d552c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.029416:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d552c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.029433:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d5533 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xdc63c01a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.029443:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d5533 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xdc63c01a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.029450:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d5533 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xdc63c01a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201389.030139:0:16722:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x469:0x0], index 0: 0 00010000:00010000:0.0:1788201389.030365:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d553a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x419:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.030379:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d553a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x419:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.030389:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d553a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x419:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.030430:0:16722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d552c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.030438:0:16722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d552c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.030444:0:16722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d552c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.030451:0:16722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201389.030466:0:16722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d552c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.030476:0:16722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d552c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.030495:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:0.0:1788201389.030499:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201389.030505:0:16722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d552c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.030511:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d552c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201389.030526:0:16722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3a26186 reply state 0000000028066309 transno 17179869226 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d5533 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xdc63c01a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201389.030535:0:16722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201389.030577:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5525 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53d5 expref: 54 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.030593:0:16722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d553a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x419:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53d5 expref: 53 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.030601:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x419:0x0].0x0 (ffff9e03c2fc5800) 00010000:00010000:0.0:1788201389.030603:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201389.030606:0:16722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3600, rc 0) 00000100:00100000:0.0:1788201389.030711:0:16722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+54:17857:x1875064442731648:12345-192.168.201.30@tcp:101:createmany.0 Request processed in 1594us (1936us total) trans 17179869226 rc 0/0 00000100:00100000:0.0:1788201389.030721:0:16722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 59 00010000:00010000:0.0:1788201389.034195:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d5533 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xdc63c01a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.034221:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d5533 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xdc63c01a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.034231:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d5533 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xdc63c01a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.034238:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201389.034244:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d5533 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xdc63c01a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.034253:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d5533 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xdc63c01a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.034274:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0xdc63c01a (ffff9e03c2fc5900) 00010000:00010000:0.0:1788201389.034277:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201389.034283:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d5533 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xdc63c01a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.034291:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d5533 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xdc63c01a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.034604:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201389.034790:0:16723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442731904 00000100:00100000:0.0:1788201389.034803:0:16723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442731904 00000100:00100000:0.0:1788201389.034878:0:16723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:0.0:1788201389.034891:0:16723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2452c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+53:17857:x1875064442731904:12345-192.168.201.30@tcp:35:createmany.0 00000100:00100000:0.0:1788201389.035625:0:16723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2452c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+54:17857:x1875064442731904:12345-192.168.201.30@tcp:35:createmany.0 Request processed in 732us (1023us total) trans 17179869227 rc 0/0 00000100:00100000:0.0:1788201389.035638:0:16723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:3.0:1788201389.040983:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201389.041752:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442732160 00000100:00100000:0.0:1788201389.041773:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442732160 00000100:00100000:0.0:1788201389.041919:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:0.0:1788201389.041935:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+54:17857:x1875064442732160:12345-192.168.201.30@tcp:101:createmany.0 00010000:00010000:0.0:1788201389.041970:0:17126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201389.041999:0:17126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d5548 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c53dc expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.042210:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d554f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.042230:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d554f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.042244:0:17126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d554f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.042261:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5556 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xff320874 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.042269:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5556 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xff320874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.042275:0:17126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5556 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xff320874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201389.042954:0:17126:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x469:0x0], index 1: 0 00010000:00010000:0.0:1788201389.043156:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d555d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x41a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.043168:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d555d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x41a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.043178:0:17126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d555d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x41a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.043219:0:17126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d554f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.043227:0:17126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d554f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.043235:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d554f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.043243:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201389.043248:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d554f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.043256:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d554f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.043269:0:17126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:0.0:1788201389.043273:0:17126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201389.043277:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d554f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.043284:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d554f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201389.043344:0:17126:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de65551e reply state 00000000e03b82ec transno 17179869228 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5556 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xff320874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201389.043355:0:17126:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201389.043396:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d5548 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53dc expref: 57 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.043416:0:17126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d555d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x41a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53dc expref: 56 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.043423:0:17126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x41a:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:0.0:1788201389.043426:0:17126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201389.043429:0:17126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2000, rc 0) 00000100:00100000:0.0:1788201389.043561:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+57:17857:x1875064442732160:12345-192.168.201.30@tcp:101:createmany.0 Request processed in 1628us (2585us total) trans 17179869228 rc 0/0 00000100:00100000:0.0:1788201389.043570:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 60 00010000:00010000:2.0:1788201389.045186:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5556 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xff320874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.045208:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5556 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xff320874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.045216:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5556 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xff320874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.045227:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.045234:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5556 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xff320874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.045242:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5556 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xff320874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.045259:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0xff320874 (ffff9e03c2fc5900) 00010000:00010000:2.0:1788201389.045263:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.045268:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5556 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xff320874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.045275:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5556 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xff320874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201389.048882:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201389.049101:0:16724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442732416 00000100:00100000:2.0:1788201389.049116:0:16724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442732416 00000100:00100000:2.0:1788201389.049229:0:16724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:2.0:1788201389.049243:0:16724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+56:17857:x1875064442732416:12345-192.168.201.30@tcp:35:createmany.0 00000100:00100000:2.0:1788201389.049770:0:16724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+57:17857:x1875064442732416:12345-192.168.201.30@tcp:35:createmany.0 Request processed in 528us (912us total) trans 17179869229 rc 0/0 00000100:00100000:2.0:1788201389.049781:0:16724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:1.0:1788201389.052538:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201389.052662:0:16720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442732672 00000100:00100000:3.0:1788201389.052676:0:16720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442732672 00000100:00100000:3.0:1788201389.052759:0:16720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00100000:3.0:1788201389.052771:0:16720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+57:17857:x1875064442732672:12345-192.168.201.30@tcp:101:createmany.0 00010000:00010000:3.0:1788201389.052803:0:16720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201389.052831:0:16720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d556b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c53e3 expref: -99 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.053024:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5572 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.053042:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5572 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.053055:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5572 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.053073:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5579 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x220050ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.053080:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5579 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x220050ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.053086:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5579 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x220050ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201389.053725:0:16720:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x46a:0x0], index 0: 0 00010000:00010000:3.0:1788201389.053929:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5580 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x41b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.053941:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5580 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x41b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.053949:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5580 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x41b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.053987:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5572 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.053997:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5572 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.054004:0:16720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5572 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.054011:0:16720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201389.054015:0:16720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5572 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.054023:0:16720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5572 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.054037:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:3.0:1788201389.054040:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.054045:0:16720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5572 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.054051:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5572 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201389.054066:0:16720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014f50b9a reply state 0000000069a0a3a6 transno 17179869230 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5579 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x220050ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201389.054075:0:16720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788201389.054113:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d556b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53e3 expref: 60 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.054127:0:16720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5580 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x41b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53e3 expref: 59 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.054140:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x41b:0x0].0x0 (ffff9e04d9f56700) 00010000:00010000:3.0:1788201389.054143:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201389.054145:0:16720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2ef2c00, rc 0) 00000100:00100000:3.0:1788201389.054241:0:16720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+60:17857:x1875064442732672:12345-192.168.201.30@tcp:101:createmany.0 Request processed in 1470us (1714us total) trans 17179869230 rc 0/0 00000100:00100000:3.0:1788201389.054251:0:16720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 61 00010000:00010000:3.0:1788201389.057883:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5579 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x220050ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.057907:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5579 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x220050ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.057915:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5579 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x220050ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.057924:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201389.057929:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5579 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x220050ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.057937:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5579 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x220050ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.057956:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x220050ce (ffff9e03c270a000) 00010000:00010000:3.0:1788201389.058092:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.058101:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5579 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x220050ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.058107:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5579 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x220050ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201389.059785:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201389.060122:0:16723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442732928 00000100:00100000:0.0:1788201389.060136:0:16723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442732928 00000100:00100000:0.0:1788201389.060211:0:16723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:0.0:1788201389.060224:0:16723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+59:17857:x1875064442732928:12345-192.168.201.30@tcp:35:createmany.0 00000100:00100000:0.0:1788201389.060817:0:16723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+60:17857:x1875064442732928:12345-192.168.201.30@tcp:35:createmany.0 Request processed in 592us (1041us total) trans 17179869231 rc 0/0 00000100:00100000:0.0:1788201389.060828:0:16723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:3.0:1788201389.067734:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201389.068091:0:16722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442733184 00000100:00100000:0.0:1788201389.068111:0:16722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442733184 00000100:00100000:0.0:1788201389.068194:0:16722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 62 00000100:00100000:0.0:1788201389.068208:0:16722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+60:17857:x1875064442733184:12345-192.168.201.30@tcp:101:createmany.0 00010000:00010000:0.0:1788201389.068241:0:16722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201389.068269:0:16722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d558e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c53ea expref: -99 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.068462:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5595 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.068479:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5595 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.068493:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5595 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.068510:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d559c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x44ce9928 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.068518:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d559c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x44ce9928 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.068525:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d559c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x44ce9928 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201389.069387:0:16722:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x46a:0x0], index 1: 0 00010000:00010000:0.0:1788201389.069628:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d55a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x41c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.069716:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d55a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x41c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.069730:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d55a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x41c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.069841:0:16722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5595 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.069851:0:16722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5595 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.069870:0:16722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5595 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.069878:0:16722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201389.069883:0:16722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5595 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.069892:0:16722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5595 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.069908:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:0.0:1788201389.069912:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201389.069917:0:16722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5595 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.069923:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5595 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201389.069941:0:16722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000052b67b5e reply state 00000000189c1f39 transno 17179869232 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d559c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x44ce9928 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201389.069951:0:16722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201389.070012:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d558e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53ea expref: 63 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.070029:0:16722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d55a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x41c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53ea expref: 62 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.070037:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x41c:0x0].0x0 (ffff9e03c2fc5000) 00010000:00010000:0.0:1788201389.070039:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201389.070042:0:16722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2400, rc 0) 00000100:00100000:0.0:1788201389.070161:0:16722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+63:17857:x1875064442733184:12345-192.168.201.30@tcp:101:createmany.0 Request processed in 1955us (2442us total) trans 17179869232 rc 0/0 00000100:00100000:0.0:1788201389.070172:0:16722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 62 00010000:00010000:2.0:1788201389.074113:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d559c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x44ce9928 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.074142:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d559c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x44ce9928 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.074162:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d559c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x44ce9928 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.074170:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.074176:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d559c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x44ce9928 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.074186:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d559c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x44ce9928 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.074209:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x44ce9928 (ffff9e03c2fc5600) 00010000:00010000:2.0:1788201389.074212:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.074218:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d559c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x44ce9928 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.074226:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d559c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x44ce9928 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201389.074814:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201389.074949:0:16723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442733440 00000100:00100000:2.0:1788201389.074971:0:16723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442733440 00000100:00100000:2.0:1788201389.075059:0:16723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:2.0:1788201389.075073:0:16723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+62:17857:x1875064442733440:12345-192.168.201.30@tcp:35:createmany.0 00000100:00100000:2.0:1788201389.075565:0:16723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+63:17857:x1875064442733440:12345-192.168.201.30@tcp:35:createmany.0 Request processed in 493us (757us total) trans 17179869233 rc 0/0 00000100:00100000:2.0:1788201389.075575:0:16723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:2.0:1788201389.079525:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201389.079617:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442733696 00000100:00100000:0.0:1788201389.079630:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442733696 00000100:00100000:0.0:1788201389.079711:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:0.0:1788201389.079725:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+63:17857:x1875064442733696:12345-192.168.201.30@tcp:101:createmany.0 00010000:00010000:0.0:1788201389.079766:0:17126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201389.079793:0:17126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d55b1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c53f1 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.079987:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d55b8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.080005:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d55b8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.080019:0:17126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d55b8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.080037:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d55bf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x679ce181 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.080045:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d55bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x679ce181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.080052:0:17126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d55bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x679ce181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201389.080673:0:17126:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x46b:0x0], index 0: 0 00010000:00010000:0.0:1788201389.080877:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29600/0x9383f985bc4d55c6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x41d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.080889:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29600/0x9383f985bc4d55c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x41d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.080897:0:17126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29600/0x9383f985bc4d55c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x41d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.080940:0:17126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d55b8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.080948:0:17126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d55b8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.080956:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d55b8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.080963:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201389.080967:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d55b8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.080976:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d55b8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.080991:0:17126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:0.0:1788201389.080995:0:17126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201389.081000:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d55b8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.081007:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d55b8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201389.081028:0:17126:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f8a8e55 reply state 00000000624ec784 transno 17179869234 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d55bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x679ce181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201389.081038:0:17126:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201389.081074:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d55b1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53f1 expref: 66 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.081091:0:17126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29600/0x9383f985bc4d55c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x41d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53f1 expref: 65 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.081099:0:17126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x41d:0x0].0x0 (ffff9e03c2fc5500) 00010000:00010000:0.0:1788201389.081102:0:17126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201389.081105:0:17126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0501b29600, rc 0) 00000100:00100000:0.0:1788201389.082344:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+66:17857:x1875064442733696:12345-192.168.201.30@tcp:101:createmany.0 Request processed in 2611us (2823us total) trans 17179869234 rc 0/0 00000100:00100000:0.0:1788201389.082358:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:2.0:1788201389.089549:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1788201389.090106:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d55bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x679ce181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.090123:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d55bf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x679ce181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.090131:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d55bf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x679ce181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.090137:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201389.090143:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d55bf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x679ce181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.090151:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d55bf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x679ce181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.090173:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x679ce181 (ffff9e03c2fc5900) 00010000:00010000:3.0:1788201389.090177:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.090182:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d55bf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x679ce181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.090189:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d55bf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x679ce181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201389.090262:0:16723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442733952 00000100:00100000:0.0:1788201389.090275:0:16723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442733952 00000100:00100000:1.0:1788201389.090558:0:16723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:1.0:1788201389.090572:0:16723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+65:17857:x1875064442733952:12345-192.168.201.30@tcp:35:createmany.0 00000100:00100000:1.0:1788201389.091173:0:16723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+66:17857:x1875064442733952:12345-192.168.201.30@tcp:35:createmany.0 Request processed in 601us (1638us total) trans 17179869235 rc 0/0 00000100:00100000:1.0:1788201389.091183:0:16723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:3.0:1788201389.094139:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201389.094262:0:16721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442734208 00000100:00100000:2.0:1788201389.094276:0:16721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442734208 00000100:00100000:2.0:1788201389.094386:0:16721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00100000:2.0:1788201389.094399:0:16721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+66:17857:x1875064442734208:12345-192.168.201.30@tcp:101:createmany.0 00010000:00010000:2.0:1788201389.094431:0:16721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201389.094458:0:16721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d55d4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c53f8 expref: -99 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.094629:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d55db lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.094659:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d55db lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.094673:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d55db lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.094691:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d55e2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x8a6b29db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.094699:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d55e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x8a6b29db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.094706:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d55e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x8a6b29db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201389.095338:0:16721:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x46b:0x0], index 1: 0 00010000:00010000:2.0:1788201389.095536:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d55e9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x41e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.095549:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d55e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x41e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.095564:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d55e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x41e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.095606:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d55db lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.095615:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d55db lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.095624:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d55db lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.095631:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131e200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.095636:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d55db lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.095646:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d55db lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.095661:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:2.0:1788201389.095665:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.095670:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d55db lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.095678:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d55db lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201389.095695:0:16721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ee0cd2e1 reply state 000000007c30f1b0 transno 17179869236 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d55e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x8a6b29db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.095706:0:16721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201389.095745:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d55d4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53f8 expref: 69 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.095760:0:16721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d55e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x41e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53f8 expref: 68 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.095769:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x41e:0x0].0x0 (ffff9e03c2ac6f00) 00010000:00010000:2.0:1788201389.095771:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201389.095774:0:16721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c131e400, rc 0) 00000100:00100000:2.0:1788201389.095878:0:16721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+69:17857:x1875064442734208:12345-192.168.201.30@tcp:101:createmany.0 Request processed in 1481us (1752us total) trans 17179869236 rc 0/0 00000100:00100000:2.0:1788201389.095887:0:16721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00100000:3.0:1788201389.099632:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:2.0:1788201389.099894:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d55e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x8a6b29db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.099911:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d55e2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x8a6b29db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.099921:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d55e2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x8a6b29db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.099929:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131e800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.099935:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d55e2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x8a6b29db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.099944:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d55e2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x8a6b29db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.099973:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x8a6b29db (ffff9e03c2ac6700) 00010000:00010000:2.0:1788201389.099978:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.099985:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d55e2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x8a6b29db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.099992:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d55e2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x8a6b29db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201389.101067:0:16724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442734464 00000100:00100000:0.0:1788201389.101083:0:16724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442734464 00000100:00100000:0.0:1788201389.101182:0:16724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:0.0:1788201389.101195:0:16724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+68:17857:x1875064442734464:12345-192.168.201.30@tcp:35:createmany.0 00000100:00100000:0.0:1788201389.102109:0:16724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+69:17857:x1875064442734464:12345-192.168.201.30@tcp:35:createmany.0 Request processed in 913us (2491us total) trans 17179869237 rc 0/0 00000100:00100000:0.0:1788201389.102120:0:16724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:0.0:1788201389.113009:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201389.113481:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442734720 00000100:00100000:2.0:1788201389.113494:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442734720 00000100:00100000:2.0:1788201389.113577:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00100000:2.0:1788201389.113591:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+69:17857:x1875064442734720:12345-192.168.201.30@tcp:101:createmany.0 00010000:00010000:2.0:1788201389.113625:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201389.113653:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d55f7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c53ff expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.113838:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d55fe lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.113888:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d55fe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.113903:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d55fe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.113921:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5605 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x7e4d6cfc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.113929:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5605 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x7e4d6cfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.113937:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5605 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x7e4d6cfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201389.114709:0:17130:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x46c:0x0], index 0: 0 00010000:00010000:2.0:1788201389.114932:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ee00/0x9383f985bc4d560c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x41f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.114946:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ee00/0x9383f985bc4d560c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x41f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.114957:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ee00/0x9383f985bc4d560c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x41f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.115003:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d55fe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.115012:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d55fe lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.115019:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d55fe lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.115025:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131e600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.115030:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d55fe lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.115038:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d55fe lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.115054:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:2.0:1788201389.115058:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.115064:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d55fe lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.115076:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d55fe lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201389.115091:0:17130:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000095a15e21 reply state 000000008881741b transno 17179869238 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5605 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x7e4d6cfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.115101:0:17130:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201389.115144:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d55f7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53ff expref: 72 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.115162:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ee00/0x9383f985bc4d560c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x41f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53ff expref: 71 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.115171:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x41f:0x0].0x0 (ffff9e03c2ac6100) 00010000:00010000:2.0:1788201389.115174:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201389.115176:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c131ee00, rc 0) 00000100:00100000:2.0:1788201389.117029:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+72:17857:x1875064442734720:12345-192.168.201.30@tcp:101:createmany.0 Request processed in 3426us (4020us total) trans 17179869238 rc 0/0 00000100:00100000:2.0:1788201389.117045:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 65 00010000:00010000:3.0:1788201389.123451:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5605 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x7e4d6cfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.123482:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5605 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x7e4d6cfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.123491:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5605 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x7e4d6cfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.123499:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131e200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201389.123505:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5605 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x7e4d6cfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.123514:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5605 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x7e4d6cfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.123536:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x7e4d6cfc (ffff9e03c2ac6700) 00010000:00010000:3.0:1788201389.123540:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.123544:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5605 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x7e4d6cfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.123552:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5605 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x7e4d6cfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201389.125175:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201389.125273:0:16724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442734976 00000100:00100000:2.0:1788201389.125288:0:16724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442734976 00000100:00100000:2.0:1788201389.125397:0:16724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:2.0:1788201389.125411:0:16724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2453050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+71:17857:x1875064442734976:12345-192.168.201.30@tcp:35:createmany.0 00000100:00100000:2.0:1788201389.125880:0:16724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2453050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+72:17857:x1875064442734976:12345-192.168.201.30@tcp:35:createmany.0 Request processed in 470us (717us total) trans 17179869239 rc 0/0 00000100:00100000:2.0:1788201389.125888:0:16724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:2.0:1788201389.134036:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201389.134163:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442735232 00000100:00100000:0.0:1788201389.134179:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442735232 00000100:00100000:0.0:1788201389.134259:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 66 00000100:00100000:0.0:1788201389.134273:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+72:17857:x1875064442735232:12345-192.168.201.30@tcp:101:createmany.0 00010000:00010000:0.0:1788201389.134351:0:17126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201389.134382:0:17126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28c00/0x9383f985bc4d561a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5406 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.134571:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d5621 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.134589:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d5621 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.134603:0:17126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d5621 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.134622:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d5628 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xa11bb556 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.134629:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d5628 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xa11bb556 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.134637:0:17126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d5628 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xa11bb556 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201389.135245:0:17126:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x46c:0x0], index 1: 0 00010000:00010000:0.0:1788201389.135472:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d562f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x420:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.135488:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d562f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x420:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.135497:0:17126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d562f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x420:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.135541:0:17126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d5621 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.135550:0:17126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d5621 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.135558:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d5621 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.135565:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b29a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201389.135571:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d5621 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.135580:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d5621 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.135595:0:17126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:0.0:1788201389.135599:0:17126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201389.135604:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d5621 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.135611:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29a00/0x9383f985bc4d5621 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201389.135626:0:17126:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd923656 reply state 000000002acd81d7 transno 17179869240 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d5628 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xa11bb556 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201389.135637:0:17126:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201389.135675:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28c00/0x9383f985bc4d561a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5406 expref: 75 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.135691:0:17126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d562f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x420:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5406 expref: 74 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.135700:0:17126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x420:0x0].0x0 (ffff9e03c2fc5600) 00010000:00010000:0.0:1788201389.135702:0:17126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201389.135705:0:17126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0501b28800, rc 0) 00000100:00100000:0.0:1788201389.135818:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+75:17857:x1875064442735232:12345-192.168.201.30@tcp:101:createmany.0 Request processed in 1546us (1797us total) trans 17179869240 rc 0/0 00000100:00100000:0.0:1788201389.135829:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 66 00000100:00100000:0.0:1788201389.139423:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201389.139516:0:16724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442735488 00000100:00100000:1.0:1788201389.139532:0:16724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442735488 00000100:00100000:1.0:1788201389.139610:0:16724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:1.0:1788201389.139623:0:16724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+75:17857:x1875064442735488:12345-192.168.201.30@tcp:35:createmany.0 00010000:00010000:2.0:1788201389.139742:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d5628 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xa11bb556 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.139756:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d5628 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xa11bb556 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.139764:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d5628 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xa11bb556 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.139771:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b28200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.139776:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d5628 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xa11bb556 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.139785:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d5628 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xa11bb556 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.139803:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0xa11bb556 (ffff9e03c2fc5900) 00010000:00010000:2.0:1788201389.139806:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.139812:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d5628 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xa11bb556 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.139818:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d5628 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xa11bb556 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201389.140129:0:16724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+75:17857:x1875064442735488:12345-192.168.201.30@tcp:35:createmany.0 Request processed in 507us (720us total) trans 17179869241 rc 0/0 00000100:00100000:1.0:1788201389.140140:0:16724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:3.0:1788201389.142392:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201389.144102:0:16722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442735744 00000100:00100000:0.0:1788201389.144117:0:16722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442735744 00000100:00100000:0.0:1788201389.144206:0:16722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 67 00000100:00100000:0.0:1788201389.144218:0:16722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+75:17857:x1875064442735744:12345-192.168.201.30@tcp:101:createmany.0 00010000:00010000:0.0:1788201389.144253:0:16722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201389.144283:0:16722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d563d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c540d expref: -99 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.144490:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d5644 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.144508:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d5644 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.144523:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d5644 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.144541:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d564b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xc3e9fdaf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.144550:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d564b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xc3e9fdaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.144557:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d564b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xc3e9fdaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201389.145269:0:16722:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x46d:0x0], index 0: 0 00010000:00010000:1.0:1788201389.148396:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4c00/0x9383f985bc4d5652 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x421:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.148428:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4c00/0x9383f985bc4d5652 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x421:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.148444:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4c00/0x9383f985bc4d5652 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x421:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.148509:0:16722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d5644 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.148517:0:16722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d5644 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.148525:0:16722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d5644 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.148531:0:16722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201389.148538:0:16722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d5644 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.148547:0:16722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d5644 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.148563:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:1.0:1788201389.148566:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201389.148572:0:16722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d5644 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.148579:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d5644 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201389.148600:0:16722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000779dff38 reply state 0000000096f6047c transno 17179869242 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d564b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xc3e9fdaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201389.148610:0:16722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201389.148661:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d563d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c540d expref: 78 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.148678:0:16722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4c00/0x9383f985bc4d5652 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x421:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c540d expref: 77 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.148685:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x421:0x0].0x0 (ffff9e03c316f600) 00010000:00010000:1.0:1788201389.148687:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201389.148689:0:16722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9ce4c00, rc 0) 00000100:00100000:1.0:1788201389.148990:0:16722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+78:17857:x1875064442735744:12345-192.168.201.30@tcp:101:createmany.0 Request processed in 4772us (6608us total) trans 17179869242 rc 0/0 00000100:00100000:1.0:1788201389.149000:0:16722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 67 00010000:00010000:0.0:1788201389.152120:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d564b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xc3e9fdaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.152149:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d564b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xc3e9fdaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.152158:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d564b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xc3e9fdaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.152166:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201389.152172:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d564b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xc3e9fdaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.152182:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d564b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xc3e9fdaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.152202:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0xc3e9fdaf (ffff9e05020e0300) 00010000:00010000:0.0:1788201389.152207:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201389.152213:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d564b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xc3e9fdaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.152220:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d564b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xc3e9fdaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201389.152669:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201389.152749:0:16723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442736000 00000100:00100000:0.0:1788201389.152762:0:16723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442736000 00000100:00100000:0.0:1788201389.152829:0:16723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:0.0:1788201389.152841:0:16723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+77:17857:x1875064442736000:12345-192.168.201.30@tcp:35:createmany.0 00000100:00100000:0.0:1788201389.153333:0:16723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+78:17857:x1875064442736000:12345-192.168.201.30@tcp:35:createmany.0 Request processed in 455us (631us total) trans 17179869243 rc 0/0 00000100:00100000:0.0:1788201389.153343:0:16723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:2.0:1788201389.159730:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201389.159810:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442736256 00000100:00100000:0.0:1788201389.159824:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442736256 00000100:00100000:0.0:1788201389.159979:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 68 00000100:00100000:0.0:1788201389.159994:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+78:17857:x1875064442736256:12345-192.168.201.30@tcp:101:createmany.0 00010000:00010000:0.0:1788201389.160030:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201389.160058:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d5660 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5414 expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.160236:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5667 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.160254:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5667 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.160268:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5667 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.160286:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d566e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xe6b84609 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.160572:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d566e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xe6b84609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.160582:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d566e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xe6b84609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201389.161683:0:17130:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x46d:0x0], index 1: 0 00010000:00010000:1.0:1788201389.161905:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4e00/0x9383f985bc4d5675 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x422:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.161921:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4e00/0x9383f985bc4d5675 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x422:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.161931:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4e00/0x9383f985bc4d5675 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x422:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.162705:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5667 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.162717:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5667 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.162726:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5667 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.162734:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201389.162738:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5667 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.162746:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5667 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.162762:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:1.0:1788201389.162765:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201389.162771:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5667 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.162777:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5667 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201389.162798:0:17130:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000010ca2d8e reply state 00000000873f6c29 transno 17179869244 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d566e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xe6b84609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201389.162808:0:17130:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201389.162865:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d5660 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5414 expref: 81 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.162882:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4e00/0x9383f985bc4d5675 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x422:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5414 expref: 80 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.162891:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x422:0x0].0x0 (ffff9e03c316f100) 00010000:00010000:1.0:1788201389.162894:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201389.162897:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9ce4e00, rc 0) 00000100:00100000:1.0:1788201389.164234:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+81:17857:x1875064442736256:12345-192.168.201.30@tcp:101:createmany.0 Request processed in 4236us (4511us total) trans 17179869244 rc 0/0 00000100:00100000:1.0:1788201389.164249:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 68 00000100:00100000:3.0:1788201389.169957:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:2.0:1788201389.170354:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d566e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xe6b84609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.170371:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d566e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xe6b84609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.170386:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d566e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xe6b84609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.170394:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.170400:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d566e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xe6b84609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.170409:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d566e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xe6b84609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.170431:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0xe6b84609 (ffff9e05020e0d00) 00010000:00010000:2.0:1788201389.170435:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.170440:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d566e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xe6b84609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.170516:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d566e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xe6b84609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201389.173227:0:16724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442736512 00000100:00100000:1.0:1788201389.173248:0:16724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442736512 00000100:00100000:1.0:1788201389.173349:0:16724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 26 00000100:00100000:1.0:1788201389.173363:0:16724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+80:17857:x1875064442736512:12345-192.168.201.30@tcp:35:createmany.0 00000100:00100000:1.0:1788201389.173843:0:16724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+81:17857:x1875064442736512:12345-192.168.201.30@tcp:35:createmany.0 Request processed in 482us (3900us total) trans 17179869245 rc 0/0 00000100:00100000:1.0:1788201389.173852:0:16724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 26 00000100:00100000:0.0:1788201389.178007:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201389.178436:0:16721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442736768 00000100:00100000:2.0:1788201389.178450:0:16721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442736768 00000100:00100000:2.0:1788201389.178534:0:16721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:2.0:1788201389.178547:0:16721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+81:17857:x1875064442736768:12345-192.168.201.30@tcp:101:createmany.0 00010000:00010000:2.0:1788201389.178580:0:16721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201389.178610:0:16721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d5683 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c541b expref: -99 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.178946:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d568a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.178970:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d568a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.178983:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d568a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.179001:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d5691 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x9868e63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.179009:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d5691 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x9868e63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.179017:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d5691 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x9868e63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201389.179622:0:16721:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x46e:0x0], index 0: 0 00010000:00010000:2.0:1788201389.181651:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d5698 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x423:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.181677:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d5698 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x423:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.181690:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d5698 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x423:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.182196:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d568a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.182209:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d568a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.182217:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d568a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.182227:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131f400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.182232:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d568a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.182241:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d568a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.182256:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:2.0:1788201389.182258:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.182263:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d568a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.182270:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d568a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201389.182291:0:16721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000172a7baa reply state 0000000033f43bd7 transno 17179869246 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d5691 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x9868e63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.182440:0:16721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201389.182983:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e600/0x9383f985bc4d5683 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c541b expref: 84 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.183008:0:16721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d5698 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x423:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c541b expref: 83 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.183017:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x423:0x0].0x0 (ffff9e03c2ac6500) 00010000:00010000:2.0:1788201389.183021:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201389.183024:0:16721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c131f200, rc 0) 00000100:00100000:2.0:1788201389.183198:0:16721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+84:17857:x1875064442736768:12345-192.168.201.30@tcp:101:createmany.0 Request processed in 4652us (5204us total) trans 17179869246 rc 0/0 00000100:00100000:2.0:1788201389.183210:0:16721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 69 00010000:00010000:3.0:1788201389.202067:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d5691 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x9868e63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.202092:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d5691 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x9868e63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.202106:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d5691 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x9868e63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.202114:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131f600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201389.202120:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d5691 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x9868e63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.202129:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d5691 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x9868e63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.202151:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x9868e63 (ffff9e03c2ac6600) 00010000:00010000:3.0:1788201389.202155:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.202160:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d5691 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x9868e63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.202166:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d5691 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x9868e63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.204581:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201389.204796:0:16723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442737024 00000100:00100000:1.0:1788201389.204811:0:16723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442737024 00000100:00100000:1.0:1788201389.204895:0:16723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:1.0:1788201389.204908:0:16723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+83:17857:x1875064442737024:12345-192.168.201.30@tcp:35:createmany.0 00000100:00100000:1.0:1788201389.205407:0:16723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+84:17857:x1875064442737024:12345-192.168.201.30@tcp:35:createmany.0 Request processed in 499us (837us total) trans 17179869247 rc 0/0 00000100:00100000:1.0:1788201389.205416:0:16723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:0.0:1788201389.210119:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201389.211135:0:16722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442737280 00000100:00100000:1.0:1788201389.211158:0:16722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442737280 00000100:00100000:1.0:1788201389.211250:0:16722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:1.0:1788201389.211264:0:16722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+84:17857:x1875064442737280:12345-192.168.201.30@tcp:101:createmany.0 00010000:00010000:1.0:1788201389.211315:0:16722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201389.211347:0:16722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5400/0x9383f985bc4d56a6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5422 expref: -99 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.211525:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d56ad lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.211542:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d56ad lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.211556:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d56ad lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.211575:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d56b4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x2c54d6bd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.211588:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d56b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x2c54d6bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.211597:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d56b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x2c54d6bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201389.212937:0:16722:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x46e:0x0], index 1: 0 00010000:00010000:1.0:1788201389.213565:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4400/0x9383f985bc4d56bb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x424:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.213584:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4400/0x9383f985bc4d56bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x424:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.213597:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4400/0x9383f985bc4d56bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x424:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.213642:0:16722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d56ad lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.213650:0:16722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d56ad lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.213658:0:16722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d56ad lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.213665:0:16722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9ce5c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201389.213670:0:16722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d56ad lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.213679:0:16722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d56ad lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.213694:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:1.0:1788201389.213698:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201389.213704:0:16722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d56ad lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.213714:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d56ad lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201389.213731:0:16722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a29ff156 reply state 00000000af5a2260 transno 17179869248 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d56b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x2c54d6bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201389.213852:0:16722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201389.213929:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5400/0x9383f985bc4d56a6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5422 expref: 87 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.213947:0:16722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4400/0x9383f985bc4d56bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x424:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5422 expref: 86 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.213955:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x424:0x0].0x0 (ffff9e03c316fd00) 00010000:00010000:1.0:1788201389.214031:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201389.214037:0:16722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9ce4400, rc 0) 00000100:00100000:1.0:1788201389.214192:0:16722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+87:17857:x1875064442737280:12345-192.168.201.30@tcp:101:createmany.0 Request processed in 2887us (4045us total) trans 17179869248 rc 0/0 00000100:00100000:1.0:1788201389.214203:0:16722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:2.0:1788201389.217769:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201389.217852:0:16724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442737536 00000100:00100000:1.0:1788201389.217875:0:16724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442737536 00000100:00100000:1.0:1788201389.217955:0:16724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 28 00000100:00100000:1.0:1788201389.217979:0:16724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+87:17857:x1875064442737536:12345-192.168.201.30@tcp:35:createmany.0 00000100:00100000:1.0:1788201389.218619:0:16724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+88:17857:x1875064442737536:12345-192.168.201.30@tcp:35:createmany.0 Request processed in 642us (864us total) trans 17179869249 rc 0/0 00000100:00100000:1.0:1788201389.218629:0:16724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 28 00010000:00010000:3.0:1788201389.222395:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d56b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x2c54d6bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.222417:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d56b4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x2c54d6bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.222426:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d56b4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x2c54d6bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.222433:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9ce5200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201389.222439:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d56b4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x2c54d6bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.222463:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d56b4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x2c54d6bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.222592:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x2c54d6bd (ffff9e03c316f400) 00010000:00010000:3.0:1788201389.222596:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.222603:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d56b4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x2c54d6bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.222611:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d56b4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x2c54d6bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.228651:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201389.228760:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442737792 00000100:00100000:1.0:1788201389.228774:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442737792 00000100:00100000:1.0:1788201389.228852:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 71 00000100:00100000:1.0:1788201389.228875:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+87:17857:x1875064442737792:12345-192.168.201.30@tcp:101:createmany.0 00010000:00010000:1.0:1788201389.228910:0:17130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201389.228940:0:17130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5400/0x9383f985bc4d56c9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5429 expref: -99 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.229144:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d56d0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.229171:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d56d0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.229186:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d56d0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.229204:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5000/0x9383f985bc4d56d7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x4f231f16 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.229212:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5000/0x9383f985bc4d56d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x4f231f16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.229220:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5000/0x9383f985bc4d56d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x4f231f16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201389.229862:0:17130:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x46f:0x0], index 0: 0 00010000:00010000:1.0:1788201389.230058:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d56de lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x425:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.230071:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d56de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x425:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.230081:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d56de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x425:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.230119:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d56d0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.230128:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d56d0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.230136:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d56d0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.230144:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9ce5c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201389.230149:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d56d0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.230158:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d56d0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.230172:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:1.0:1788201389.230176:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201389.230181:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d56d0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.230189:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d56d0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201389.230206:0:17130:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014052620 reply state 00000000f344f863 transno 17179869250 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5000/0x9383f985bc4d56d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x4f231f16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201389.230217:0:17130:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201389.230253:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5400/0x9383f985bc4d56c9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5429 expref: 90 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.230269:0:17130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d56de lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x425:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5429 expref: 89 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.230277:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x425:0x0].0x0 (ffff9e03c316f300) 00010000:00010000:1.0:1788201389.230280:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201389.230283:0:17130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9ce4200, rc 0) 00000100:00100000:1.0:1788201389.230404:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+90:17857:x1875064442737792:12345-192.168.201.30@tcp:101:createmany.0 Request processed in 1532us (1768us total) trans 17179869250 rc 0/0 00000100:00100000:1.0:1788201389.230413:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 71 00010000:00010000:2.0:1788201389.233682:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5000/0x9383f985bc4d56d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x4f231f16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.233704:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5000/0x9383f985bc4d56d7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x4f231f16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.233715:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5000/0x9383f985bc4d56d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x4f231f16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.233722:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9ce5000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.233728:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5000/0x9383f985bc4d56d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x4f231f16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.233738:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5000/0x9383f985bc4d56d7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x4f231f16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.233771:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x4f231f16 (ffff9e03c316fa00) 00010000:00010000:2.0:1788201389.233775:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.233780:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5000/0x9383f985bc4d56d7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x4f231f16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.233788:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5000/0x9383f985bc4d56d7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x4f231f16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.240079:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201389.240263:0:16723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442738048 00000100:00100000:0.0:1788201389.240278:0:16723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442738048 00000100:00100000:0.0:1788201389.240374:0:16723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:0.0:1788201389.240386:0:16723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2452450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+89:17857:x1875064442738048:12345-192.168.201.30@tcp:35:createmany.0 00000100:00100000:0.0:1788201389.241124:0:16723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2452450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+90:17857:x1875064442738048:12345-192.168.201.30@tcp:35:createmany.0 Request processed in 736us (1058us total) trans 17179869251 rc 0/0 00000100:00100000:0.0:1788201389.241135:0:16723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:0.0:1788201389.250611:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201389.250713:0:16721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442738304 00000100:00100000:2.0:1788201389.250729:0:16721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442738304 00000100:00100000:2.0:1788201389.250821:0:16721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 72 00000100:00100000:2.0:1788201389.250834:0:16721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+90:17857:x1875064442738304:12345-192.168.201.30@tcp:101:createmany.0 00010000:00010000:2.0:1788201389.250882:0:16721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201389.250912:0:16721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e000/0x9383f985bc4d56ec lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5430 expref: -99 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.251116:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d56f3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.251134:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d56f3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.251149:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d56f3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.251169:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d56fa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x71f16770 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.251175:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d56fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x71f16770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.251181:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d56fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x71f16770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201389.252209:0:16721:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x46f:0x0], index 1: 0 00010000:00010000:2.0:1788201389.252662:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d5701 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x426:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.252680:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d5701 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x426:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.252696:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d5701 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x426:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.253288:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d56f3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.253347:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d56f3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.253357:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d56f3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.253365:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131ec00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.253371:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d56f3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.253380:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d56f3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.253397:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:2.0:1788201389.253401:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.253406:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d56f3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.253414:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d56f3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201389.253434:0:16721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bbf9903e reply state 00000000d924b696 transno 17179869252 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d56fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x71f16770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.253814:0:16721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201389.253890:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e000/0x9383f985bc4d56ec lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5430 expref: 93 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.253909:0:16721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d5701 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x426:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5430 expref: 92 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.253917:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x426:0x0].0x0 (ffff9e03c2ac6a00) 00010000:00010000:2.0:1788201389.253920:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201389.253922:0:16721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c131fe00, rc 0) 00000100:00100000:2.0:1788201389.254141:0:16721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+93:17857:x1875064442738304:12345-192.168.201.30@tcp:101:createmany.0 Request processed in 3308us (3543us total) trans 17179869252 rc 0/0 00000100:00100000:2.0:1788201389.254152:0:16721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 72 00000100:00100000:2.0:1788201389.257639:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201389.257899:0:16723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442738560 00000100:00100000:0.0:1788201389.257913:0:16723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442738560 00000100:00100000:0.0:1788201389.257988:0:16723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 30 00000100:00100000:0.0:1788201389.258000:0:16723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+93:17857:x1875064442738560:12345-192.168.201.30@tcp:35:createmany.0 00010000:00010000:3.0:1788201389.258169:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d56fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x71f16770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.258181:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d56fa lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x71f16770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.258190:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d56fa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x71f16770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.258196:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131f600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201389.258201:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d56fa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x71f16770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.258209:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d56fa lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x71f16770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.258228:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x71f16770 (ffff9e03c2ac6200) 00010000:00010000:3.0:1788201389.258231:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.258237:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d56fa lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x71f16770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.258245:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d56fa lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x71f16770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201389.258751:0:16723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+93:17857:x1875064442738560:12345-192.168.201.30@tcp:35:createmany.0 Request processed in 750us (1126us total) trans 17179869253 rc 0/0 00000100:00100000:0.0:1788201389.258762:0:16723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 30 00000100:00100000:0.0:1788201389.261894:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201389.262045:0:16722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442738816 00000100:00100000:1.0:1788201389.262058:0:16722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442738816 00000100:00100000:1.0:1788201389.262191:0:16722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 73 00000100:00100000:1.0:1788201389.262205:0:16722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+93:17857:x1875064442738816:12345-192.168.201.30@tcp:101:createmany.0 00010000:00010000:1.0:1788201389.262242:0:16722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201389.262270:0:16722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5400/0x9383f985bc4d570f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5437 expref: -99 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.262671:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d5716 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.262690:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d5716 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.262704:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d5716 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.262728:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d571d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x94bfafca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.262748:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d571d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x94bfafca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.262756:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d571d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x94bfafca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201389.264134:0:16722:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x470:0x0], index 0: 0 00010000:00010000:1.0:1788201389.264644:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4a00/0x9383f985bc4d5724 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x427:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.264663:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4a00/0x9383f985bc4d5724 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x427:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.264676:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4a00/0x9383f985bc4d5724 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x427:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.264719:0:16722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d5716 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.264728:0:16722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d5716 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.264890:0:16722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d5716 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.264898:0:16722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9ce5c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201389.264903:0:16722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d5716 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.264916:0:16722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d5716 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.264932:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:1.0:1788201389.264936:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201389.264942:0:16722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d5716 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.264949:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d5716 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201389.265028:0:16722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d86888cf reply state 00000000a012e540 transno 17179869254 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d571d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x94bfafca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201389.265040:0:16722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201389.265087:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5400/0x9383f985bc4d570f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5437 expref: 96 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.265104:0:16722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4a00/0x9383f985bc4d5724 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x427:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5437 expref: 95 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.265113:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x427:0x0].0x0 (ffff9e03c316fb00) 00010000:00010000:1.0:1788201389.265116:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201389.265119:0:16722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9ce4a00, rc 0) 00000100:00100000:1.0:1788201389.265271:0:16722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+96:17857:x1875064442738816:12345-192.168.201.30@tcp:101:createmany.0 Request processed in 3067us (3389us total) trans 17179869254 rc 0/0 00000100:00100000:1.0:1788201389.265283:0:16722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 73 00000100:00100000:0.0:1788201389.269759:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201389.269831:0:16724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442739072 00000100:00100000:1.0:1788201389.269846:0:16724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442739072 00000100:00100000:1.0:1788201389.269927:0:16724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:1.0:1788201389.269941:0:16724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+96:17857:x1875064442739072:12345-192.168.201.30@tcp:35:createmany.0 00000100:00100000:1.0:1788201389.270467:0:16724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+97:17857:x1875064442739072:12345-192.168.201.30@tcp:35:createmany.0 Request processed in 527us (727us total) trans 17179869255 rc 0/0 00000100:00100000:1.0:1788201389.270477:0:16724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:3.0:1788201389.273428:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201389.273647:0:16720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442739328 00000100:00100000:0.0:1788201389.273660:0:16720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442739328 00000100:00100000:0.0:1788201389.273725:0:16720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 74 00000100:00100000:0.0:1788201389.273738:0:16720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+97:17857:x1875064442739328:12345-192.168.201.30@tcp:101:createmany.0 00010000:00010000:0.0:1788201389.273782:0:16720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201389.273811:0:16720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d5732 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c543e expref: -99 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.274166:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d5739 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.274186:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d5739 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.274200:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d5739 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.274219:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5740 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xb78df823 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.274227:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5740 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xb78df823 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.274234:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5740 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xb78df823 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201389.275709:0:16720:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x470:0x0], index 1: 0 00010000:00010000:2.0:1788201389.276077:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d571d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x94bfafca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.276092:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d571d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x94bfafca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.276101:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d571d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x94bfafca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.276108:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9ce4800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.276115:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d571d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x94bfafca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.276123:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d571d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x94bfafca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.276141:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x94bfafca (ffff9e03c316fe00) 00010000:00010000:2.0:1788201389.276146:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.276151:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d571d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x94bfafca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.276159:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d571d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x94bfafca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.277824:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d5747 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x428:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.277863:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d5747 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x428:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.277878:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d5747 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x428:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.278069:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d5739 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.278077:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d5739 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.278084:0:16720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d5739 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.278090:0:16720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201389.278094:0:16720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d5739 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.278101:0:16720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d5739 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.278112:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:0.0:1788201389.278115:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201389.278119:0:16720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d5739 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.278125:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3000/0x9383f985bc4d5739 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201389.278143:0:16720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fc8d5153 reply state 000000003d8ff22d transno 17179869256 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5740 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xb78df823 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201389.278156:0:16720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201389.278214:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d5732 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c543e expref: 99 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.278230:0:16720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d5747 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x428:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c543e expref: 98 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.278238:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x428:0x0].0x0 (ffff9e05020e0d00) 00010000:00010000:0.0:1788201389.278240:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201389.278243:0:16720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3800, rc 0) 00000100:00100000:0.0:1788201389.284175:0:16720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+99:17857:x1875064442739328:12345-192.168.201.30@tcp:101:createmany.0 Request processed in 4709us (5029us total) trans 17179869256 rc 0/0 00000100:00100000:0.0:1788201389.284191:0:16720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 74 00000100:00100000:3.0:1788201389.287712:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:2.0:1788201389.287902:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5740 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xb78df823 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.287919:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5740 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xb78df823 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.287929:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5740 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xb78df823 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.287938:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.287945:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5740 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xb78df823 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.287954:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5740 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xb78df823 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.288038:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0xb78df823 (ffff9e05020e0300) 00010000:00010000:2.0:1788201389.288042:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.288050:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5740 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xb78df823 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.288058:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5740 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xb78df823 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201389.288135:0:16724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442739584 00000100:00100000:1.0:1788201389.288151:0:16724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442739584 00000100:00100000:1.0:1788201389.288259:0:16724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 32 00000100:00100000:1.0:1788201389.288271:0:16724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+98:17857:x1875064442739584:12345-192.168.201.30@tcp:35:createmany.0 00000100:00100000:1.0:1788201389.289078:0:16724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+99:17857:x1875064442739584:12345-192.168.201.30@tcp:35:createmany.0 Request processed in 800us (1372us total) trans 17179869257 rc 0/0 00000100:00100000:1.0:1788201389.289089:0:16724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 32 00000100:00100000:1.0:1788201389.311167:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201389.311290:0:16721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442739840 00000100:00100000:2.0:1788201389.311346:0:16721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442739840 00000100:00100000:2.0:1788201389.311425:0:16721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 75 00000100:00100000:2.0:1788201389.311437:0:16721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+99:17674:x1875064442739840:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:2.0:1788201389.311490:0:16721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201389.311519:0:16721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d5755 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5445 expref: -99 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201389.311680:0:16721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x40a:0x0]: returning size 512 00010000:00010000:2.0:1788201389.311873:0:16721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d5755 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5445 expref: 101 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.311890:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c270a400) 00010000:00010000:2.0:1788201389.311893:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788201389.311899:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ec00/0x9383f985bc4d5755 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5445 expref: 101 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.311915:0:16721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c131ec00, rc 0) 00000100:00100000:2.0:1788201389.312001:0:16721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+100:17674:x1875064442739840:12345-192.168.201.30@tcp:101:bash.0 Request processed in 565us (850us total) trans 17179869258 rc 301/301 00000100:00100000:2.0:1788201389.312010:0:16721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 75 00000100:00100000:3.0:1788201389.314694:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201389.314880:0:16722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442739968 00000100:00100000:1.0:1788201389.314894:0:16722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442739968 00000100:00100000:1.0:1788201389.314980:0:16722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 76 00000100:00100000:1.0:1788201389.314995:0:16722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+100:17674:x1875064442739968:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:1.0:1788201389.315028:0:16722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201389.315056:0:16722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5400/0x9383f985bc4d5763 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c544c expref: -99 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.315139:0:16722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d576a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.315156:0:16722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d576a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.315174:0:16722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d576a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201389.315248:0:16722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x40a:0x0]: returning size 512 00000004:00200000:1.0:1788201389.315253:0:16722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 30 stripe count 1 MDT count 1 00000004:00010000:1.0:1788201389.315285:0:16722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d576a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.315342:0:16722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5400/0x9383f985bc4d5763 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c544c expref: 102 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.315364:0:16722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d576a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c544c expref: 101 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.315374:0:16722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:1.0:1788201389.315377:0:16722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201389.315381:0:16722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04f9ce5c00, rc 0) 00000100:00100000:1.0:1788201389.315532:0:16722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:17674:x1875064442739968:12345-192.168.201.30@tcp:101:bash.0 Request processed in 540us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201389.315541:0:16722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 76 00000100:00100000:3.0:1788201389.320820:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201389.320939:0:16723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442740096 00000100:00100000:0.0:1788201389.320953:0:16723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442740096 00000100:00100000:0.0:1788201389.321127:0:16723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:0.0:1788201389.321141:0:16723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:17674:x1875064442740096:12345-192.168.201.30@tcp:37:bash.0 00000100:00100000:1.0:1788201389.327356:0:16723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:17674:x1875064442740096:12345-192.168.201.30@tcp:37:bash.0 Request processed in 6200us (6534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201389.327375:0:16723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:3.0:1788201389.331041:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201389.331352:0:16724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442740352 00000100:00100000:1.0:1788201389.331367:0:16724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442740352 00000100:00100000:1.0:1788201389.331435:0:16724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 34 00000100:00100000:1.0:1788201389.331466:0:16724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:17674:x1875064442740352:12345-192.168.201.30@tcp:35:bash.0 00000100:00100000:1.0:1788201389.331860:0:16724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17674:x1875064442740352:12345-192.168.201.30@tcp:35:bash.0 Request processed in 406us (828us total) trans 17179869259 rc 0/0 00000100:00100000:1.0:1788201389.331870:0:16724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 34 00000100:00100000:3.0:1788201389.341834:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201389.342140:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442740480 00000100:00100000:0.0:1788201389.342153:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442740480 00000100:00100000:0.0:1788201389.342244:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4287 00000100:00100000:0.0:1788201389.342261:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+507:2361:x1875064442740480:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1788201389.342285:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201389.342356:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0a1d546/0x9383f985bc4d5771 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x462:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5453 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201389.342391:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x462:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201389.342417:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x462:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1788201389.342422:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x462:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201389.342434:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0a1d546/0x9383f985bc4d5771 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x462:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5453 expref: 508 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.342466:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b0a1d546/0x9383f985bc4d5771 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x462:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5453 expref: 508 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.342482:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3000, rc 0) 00000100:00100000:0.0:1788201389.342552:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2361:x1875064442740480:12345-192.168.201.30@tcp:101:rm.0 Request processed in 297us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201389.342561:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4287 00000100:00080000:2.0:1788201389.343005:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201389.348840:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201389.348956:0:16720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442740736 00000100:00100000:3.0:1788201389.348980:0:16720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442740736 00000100:00100000:3.0:1788201389.349056:0:16720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 77 00000100:00100000:3.0:1788201389.349068:0:16720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17859:x1875064442740736:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:3.0:1788201389.349149:0:16720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788201389.349185:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5350 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x40b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5373 expref: 102 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.349212:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40b:0x0].0x0 (ffff9e03c270a100) 00010000:00010000:3.0:1788201389.349232:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d576a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c544c expref: 101 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.349242:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:3.0:1788201389.349246:0:16720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201389.349278:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5778 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.349617:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5778 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.349633:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5778 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.350239:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d577f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x9d5a3f99 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.350254:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d577f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x9d5a3f99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.350262:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d577f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x9d5a3f99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.350439:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5786 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x40b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.350594:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5786 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x40b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.350603:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5786 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x40b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201389.351382:0:16720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].5, 64 off8512 00000004:00080000:0.0:1788201389.351396:0:16720:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 664609101410ns, next at 665609098130ns, rc = 0 00010000:00010000:0.0:1788201389.351821:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d578d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.351837:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d578d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.351849:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d578d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.351869:0:16720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d578d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x40b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.351877:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d578d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x40b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.351885:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d578d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.351991:0:16720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201389.352021:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5786 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x40b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.352028:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5786 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x40b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.352035:0:16720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5786 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x40b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.352043:0:16720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201389.352049:0:16720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5786 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x40b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.352058:0:16720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5786 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x40b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.352073:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40b:0x0].0x0 (ffff9e03c1f72400) 00010000:00010000:0.0:1788201389.352076:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201389.352081:0:16720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5786 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x40b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.352089:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2600/0x9383f985bc4d5786 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x40b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.352112:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5778 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.352119:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5778 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.352125:0:16720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5778 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.352131:0:16720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201389.352133:0:16720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5778 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.352139:0:16720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5778 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.352147:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:0.0:1788201389.352149:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201389.352152:0:16720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5778 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.352158:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5778 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201389.352169:0:16720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae186865 reply state 00000000f934b766 transno 17179869260 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d577f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x9d5a3f99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201389.352180:0:16720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201389.352326:0:16720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17859:x1875064442740736:12345-192.168.201.30@tcp:36:rm.0 Request processed in 3253us (3494us total) trans 17179869260 rc 0/0 00000100:00100000:0.0:1788201389.352336:0:16720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 77 00010000:00010000:2.0:1788201389.354693:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d577f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x9d5a3f99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.354717:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d577f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x9d5a3f99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.354725:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d577f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x9d5a3f99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.354737:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.354752:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d577f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x9d5a3f99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.354762:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d577f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x9d5a3f99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.354781:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x9d5a3f99 (ffff9e03c1f72700) 00010000:00010000:2.0:1788201389.354785:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.354791:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d577f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x9d5a3f99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.354797:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3a00/0x9383f985bc4d577f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x9d5a3f99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.356451:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788201389.356849:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201389.357110:0:13451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442740864 00000100:00100000:2.0:1788201389.357123:0:13451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442740864 00000100:00100000:2.0:1788201389.357221:0:13451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4288 00000100:00100000:2.0:1788201389.357235:0:13451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2359:x1875064442740864:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1788201389.357262:0:13451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201389.357324:0:13451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbefc526/0x9383f985bc4d5794 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x462:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c545a expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201389.357359:0:13451:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x462:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201389.357387:0:13451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x462:0x0].0x0 since=664s v=(0 0) 00010000:00010000:2.0:1788201389.357393:0:13451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x462:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201389.357404:0:13451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbefc526/0x9383f985bc4d5794 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x462:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c545a expref: 6 pid: 13451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.357433:0:13451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cbefc526/0x9383f985bc4d5794 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x462:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c545a expref: 6 pid: 13451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.357449:0:13451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c131ec00, rc 0) 00000100:00100000:2.0:1788201389.357523:0:13451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2359:x1875064442740864:12345-192.168.201.30@tcp:101:rm.0 Request processed in 291us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201389.357531:0:13451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4288 00000100:00080000:3.0:1788201389.357656:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788201389.358205:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d578d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.358216:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201389.358221:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d578d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.358233:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d578d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.358252:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40b:0x0].0x0 (ffff9e03c1f72400) 00010000:00010000:1.0:1788201389.358256:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201389.358261:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d578d lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x40b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.358267:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d578d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.358401:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201389.358404:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201389.358406:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201389.360823:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201389.360928:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442741120 00000100:00100000:1.0:1788201389.360942:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442741120 00000100:00100000:1.0:1788201389.361021:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 78 00000100:00100000:1.0:1788201389.361033:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:17859:x1875064442741120:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201389.361119:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201389.361151:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d5373 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x40c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c537a expref: 101 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.361175:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40c:0x0].0x0 (ffff9e03c2fc5700) 00010000:00010000:1.0:1788201389.361187:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201389.361215:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4600/0x9383f985bc4d579b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.361232:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4600/0x9383f985bc4d579b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.361242:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4600/0x9383f985bc4d579b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.361262:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d57a2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xca7d0de1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.361268:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d57a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xca7d0de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.361275:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d57a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xca7d0de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.361633:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5400/0x9383f985bc4d57a9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x40c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.361644:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5400/0x9383f985bc4d57a9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x40c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.361653:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5400/0x9383f985bc4d57a9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x40c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201389.364975:0:17130:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].6, 64 off8576 00000004:00080000:1.0:1788201389.365002:0:17130:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 664622707024ns, next at 665622701968ns, rc = 0 00010000:00010000:1.0:1788201389.365130:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d57b0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.365745:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d57b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.365764:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d57b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.365775:0:17130:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d57b0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x40c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.365782:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d57b0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x40c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.365789:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d57b0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.365960:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201389.365998:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5400/0x9383f985bc4d57a9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x40c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.366006:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5400/0x9383f985bc4d57a9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x40c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.366012:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5400/0x9383f985bc4d57a9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x40c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.366019:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9ce5400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.366024:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5400/0x9383f985bc4d57a9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x40c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.366033:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5400/0x9383f985bc4d57a9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x40c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.366049:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40c:0x0].0x0 (ffff9e03c316fc00) 00010000:00010000:2.0:1788201389.366053:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201389.366058:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5400/0x9383f985bc4d57a9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x40c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.366069:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5400/0x9383f985bc4d57a9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x40c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.366098:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4600/0x9383f985bc4d579b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.366105:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4600/0x9383f985bc4d579b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.366111:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4600/0x9383f985bc4d579b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.366116:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9ce4600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.366119:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4600/0x9383f985bc4d579b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.366125:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4600/0x9383f985bc4d579b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.366133:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:2.0:1788201389.366135:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.366139:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4600/0x9383f985bc4d579b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.366145:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4600/0x9383f985bc4d579b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201389.366157:0:17130:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007644c103 reply state 00000000b0e0fcb1 transno 17179869261 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d57a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xca7d0de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.366168:0:17130:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201389.366394:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17859:x1875064442741120:12345-192.168.201.30@tcp:36:rm.0 Request processed in 5356us (5579us total) trans 17179869261 rc 0/0 00000100:00100000:2.0:1788201389.366405:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 78 00010000:00010000:1.0:1788201389.366632:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201389.366640:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d57b0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.366647:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9ce4800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201389.366651:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d57b0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.366658:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d57b0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.366673:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40c:0x0].0x0 (ffff9e03c316fc00) 00010000:00010000:1.0:1788201389.366675:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201389.366678:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d57b0 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x40c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.366684:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4800/0x9383f985bc4d57b0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.366702:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201389.366704:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201389.366705:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201389.368131:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d57a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xca7d0de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.368165:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d57a2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xca7d0de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.368173:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d57a2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xca7d0de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.368180:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9ce5c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.368186:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d57a2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xca7d0de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.368193:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d57a2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xca7d0de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.368211:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0xca7d0de1 (ffff9e03c316f200) 00010000:00010000:2.0:1788201389.368215:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.368220:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d57a2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xca7d0de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.368226:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5c00/0x9383f985bc4d57a2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xca7d0de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201389.372042:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201389.376526:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442741248 00000100:00100000:1.0:1788201389.376551:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442741248 00000100:00100000:0.0:1788201389.377744:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4289 00000100:00100000:0.0:1788201389.377769:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2362:x1875064442741248:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1788201389.377795:0:13443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201389.377823:0:13443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c13fcde/0x9383f985bc4d57b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x467:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5461 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201389.377867:0:13443:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x467:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201389.377895:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x467:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1788201389.377901:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x467:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201389.377913:0:13443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c13fcde/0x9383f985bc4d57b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x467:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5461 expref: 509 pid: 13443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.377934:0:13443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007c13fcde/0x9383f985bc4d57b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x467:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5461 expref: 509 pid: 13443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.377958:0:13443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2600, rc 0) 00000100:00100000:0.0:1788201389.378054:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2362:x1875064442741248:12345-192.168.201.30@tcp:101:rm.0 Request processed in 298us (6026us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201389.378063:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4289 00000100:00100000:3.0:1788201389.384386:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201389.384558:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442741504 00000100:00100000:1.0:1788201389.384572:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442741504 00000100:00100000:1.0:1788201389.384653:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 79 00000100:00100000:1.0:1788201389.384666:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:17859:x1875064442741504:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201389.384750:0:17126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201389.384783:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d54ae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x415:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53b9 expref: 101 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.384807:0:17126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x415:0x0].0x0 (ffff9e03c270ad00) 00010000:00010000:1.0:1788201389.384819:0:17126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201389.384848:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5000/0x9383f985bc4d57be lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.384874:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5000/0x9383f985bc4d57be lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.384891:0:17126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5000/0x9383f985bc4d57be lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.384910:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d57c5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x512a9eb4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.384918:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d57c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x512a9eb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.384926:0:17126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d57c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x512a9eb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.385065:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d57cc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x415:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.385074:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d57cc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x415:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.385081:0:17126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d57cc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x415:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201389.385677:0:17126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].6, 64 off8576 00010000:00010000:1.0:1788201389.385734:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d57d3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x415:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.385741:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d57d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x415:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.385746:0:17126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d57d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x415:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.385751:0:17126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d57d3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x415:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.385756:0:17126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d57d3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x415:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.385761:0:17126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d57d3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x415:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.385778:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201389.385797:0:17126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d57cc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x415:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.385800:0:17126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d57cc lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x415:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.385804:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d57cc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x415:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.385809:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff128a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201389.385813:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d57cc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x415:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.385818:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d57cc lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x415:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.385823:0:17126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x415:0x0].0x0 (ffff9e03c316fa00) 00010000:00010000:1.0:1788201389.385825:0:17126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201389.385829:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d57cc lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x415:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.385835:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d57cc lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x415:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.385868:0:17126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5000/0x9383f985bc4d57be lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.385875:0:17126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5000/0x9383f985bc4d57be lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.385881:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5000/0x9383f985bc4d57be lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.385887:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9ce5000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201389.385889:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5000/0x9383f985bc4d57be lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.385895:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5000/0x9383f985bc4d57be lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.385903:0:17126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:1.0:1788201389.385905:0:17126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201389.385909:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5000/0x9383f985bc4d57be lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.385915:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5000/0x9383f985bc4d57be lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201389.385926:0:17126:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0a8b19a reply state 000000002c10b96b transno 17179869262 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d57c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x512a9eb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201389.385936:0:17126:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201389.386028:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17859:x1875064442741504:12345-192.168.201.30@tcp:36:rm.0 Request processed in 1363us (1657us total) trans 17179869262 rc 0/0 00000100:00100000:1.0:1788201389.386034:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 79 00010000:00010000:1.0:1788201389.386071:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201389.386076:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d57d3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x415:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.386081:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201389.386083:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d57d3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x415:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.386087:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d57d3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x415:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.386093:0:7645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x415:0x0].0x0 (ffff9e03c316fa00) 00010000:00010000:1.0:1788201389.386095:0:7645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201389.386097:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d57d3 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x415:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.386100:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d57d3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x415:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.386109:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201389.386110:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201389.386111:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201389.390524:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1788201389.392315:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d57c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x512a9eb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.392330:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d57c5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x512a9eb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.392337:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d57c5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x512a9eb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.392342:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9ce5200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201389.392346:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d57c5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x512a9eb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.392351:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d57c5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x512a9eb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.392367:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x512a9eb4 (ffff9e03c316fe00) 00010000:00010000:3.0:1788201389.392369:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.392373:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d57c5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x512a9eb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.392378:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce5200/0x9383f985bc4d57c5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x512a9eb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.396335:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442741632 00000100:00100000:2.0:1788201389.396356:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442741632 00000100:00100000:2.0:1788201389.396515:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4290 00000100:00100000:2.0:1788201389.396530:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5117b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2360:x1875064442741632:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1788201389.396561:0:13445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201389.396591:0:13445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021e8ff12/0x9383f985bc4d57da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x467:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5468 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201389.396624:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x467:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201389.396652:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x467:0x0].0x0 since=664s v=(0 0) 00010000:00010000:2.0:1788201389.396658:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x467:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201389.396669:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021e8ff12/0x9383f985bc4d57da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x467:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5468 expref: 7 pid: 13445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.396690:0:13445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000021e8ff12/0x9383f985bc4d57da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x467:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5468 expref: 7 pid: 13445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.396706:0:13445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c131e600, rc 0) 00000100:00100000:2.0:1788201389.396788:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5117b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442741632:12345-192.168.201.30@tcp:101:rm.0 Request processed in 261us (6280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201389.396796:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4290 00000100:00100000:1.0:1788201389.411001:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201389.415128:0:16720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442741888 00000100:00100000:0.0:1788201389.415153:0:16720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442741888 00000100:00100000:0.0:1788201389.415260:0:16720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 80 00000100:00100000:0.0:1788201389.415273:0:16720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:17859:x1875064442741888:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:0.0:1788201389.415376:0:16720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201389.415412:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3200/0x9383f985bc4d54d1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x416:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53c0 expref: 101 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.415505:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x416:0x0].0x0 (ffff9e03c2fc5100) 00010000:00010000:0.0:1788201389.415521:0:16720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201389.415557:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d57e1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.415573:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d57e1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.415585:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d57e1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.415601:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d57e8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x73f8e70d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.415609:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d57e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x73f8e70d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.415617:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d57e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x73f8e70d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.415759:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d57ef lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x416:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.415768:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d57ef lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x416:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.415776:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d57ef lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x416:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201389.420105:0:16720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].7, 64 off8640 00010000:00010000:1.0:1788201389.420227:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d57f6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x416:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.420250:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d57f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x416:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.420264:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d57f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x416:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.420275:0:16720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d57f6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x416:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.420284:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d57f6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x416:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.420637:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d57f6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x416:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.420701:0:16720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201389.420735:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d57ef lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x416:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.420743:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d57ef lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x416:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.420749:0:16720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d57ef lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x416:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.420756:0:16720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201389.420762:0:16720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d57ef lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x416:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.420771:0:16720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d57ef lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x416:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.420786:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x416:0x0].0x0 (ffff9e03c1f72400) 00010000:00010000:1.0:1788201389.420790:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201389.420795:0:16720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d57ef lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x416:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.420807:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d57ef lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x416:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.420831:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d57e1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.420838:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d57e1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.420843:0:16720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d57e1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.420848:0:16720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201389.420861:0:16720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d57e1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.420868:0:16720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d57e1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.420875:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:1.0:1788201389.420878:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201389.420881:0:16720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d57e1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.420887:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2800/0x9383f985bc4d57e1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201389.420898:0:16720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f95ada67 reply state 00000000c88b9c72 transno 17179869263 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d57e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x73f8e70d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201389.420909:0:16720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201389.421037:0:16720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17859:x1875064442741888:12345-192.168.201.30@tcp:36:rm.0 Request processed in 5761us (10046us total) trans 17179869263 rc 0/0 00000100:00100000:1.0:1788201389.421048:0:16720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 80 00010000:00010000:0.0:1788201389.421943:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201389.421955:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d57f6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x416:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.421964:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201389.421968:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d57f6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x416:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.421977:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d57f6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x416:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.421992:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x416:0x0].0x0 (ffff9e03c1f72400) 00010000:00010000:0.0:1788201389.421995:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201389.422000:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d57f6 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x416:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.422007:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d57f6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x416:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.422090:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201389.422094:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201389.422096:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201389.425401:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201389.425560:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442742016 00000100:00100000:0.0:1788201389.425574:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442742016 00000100:00100000:0.0:1788201389.425645:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4291 00000100:00100000:0.0:1788201389.425657:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2359:x1875064442742016:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1788201389.425682:0:13447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201389.425711:0:13447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d57fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x468:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c546f expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201389.425746:0:13447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x468:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201389.425772:0:13447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x468:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1788201389.425778:0:13447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x468:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201389.425790:0:13447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d57fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x468:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c546f expref: 510 pid: 13447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.425811:0:13447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d57fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x468:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c546f expref: 510 pid: 13447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.425827:0:13447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3200, rc 0) 00000100:00100000:0.0:1788201389.425916:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35604eb4-baf9-45be-a20a-4883a2cd8cf9+510:2359:x1875064442742016:12345-192.168.201.30@tcp:101:rm.0 Request processed in 261us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201389.425924:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4291 00010000:00010000:3.0:1788201389.426188:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d57e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x73f8e70d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.426200:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d57e8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x73f8e70d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.426208:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d57e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x73f8e70d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.426215:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c3400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201389.426221:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d57e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x73f8e70d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.426229:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d57e8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x73f8e70d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.426245:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x73f8e70d (ffff9e03c1f72f00) 00010000:00010000:3.0:1788201389.426249:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.426253:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d57e8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x73f8e70d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.426260:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3400/0x9383f985bc4d57e8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x73f8e70d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201389.430499:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201389.430717:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442742272 00000100:00100000:2.0:1788201389.430731:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442742272 00000100:00100000:2.0:1788201389.430808:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 81 00000100:00100000:2.0:1788201389.430821:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c6630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:17859:x1875064442742272:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1788201389.430915:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201389.430951:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3c00/0x9383f985bc4d54f4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x417:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53c7 expref: 101 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.430982:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x417:0x0].0x0 (ffff9e03c2fc5200) 00010000:00010000:2.0:1788201389.430996:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201389.431025:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5804 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.431041:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5804 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.431053:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5804 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.431071:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d580b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x96c72f67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.431079:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d580b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x96c72f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.431087:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d580b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x96c72f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.431226:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d5812 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x417:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.431235:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d5812 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x417:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.431243:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d5812 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x417:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201389.432152:0:17130:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].7, 64 off8640 00010000:00010000:2.0:1788201389.432234:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5819 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x417:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.432249:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5819 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x417:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.432259:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5819 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x417:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.432268:0:17130:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5819 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x417:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.432276:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5819 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x417:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.432284:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5819 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x417:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.432691:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201389.432723:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d5812 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x417:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.432730:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d5812 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x417:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.432737:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d5812 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x417:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.432744:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131e800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.432750:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d5812 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x417:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.432760:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d5812 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x417:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.432774:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x417:0x0].0x0 (ffff9e03c2fc5700) 00010000:00010000:2.0:1788201389.432778:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201389.432783:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d5812 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x417:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.432790:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e800/0x9383f985bc4d5812 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x417:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.432812:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5804 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.432818:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5804 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.432824:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5804 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.432829:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131e200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.432832:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5804 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.432839:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5804 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.432846:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:2.0:1788201389.432848:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.432861:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5804 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.432867:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d5804 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201389.432883:0:17130:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c870caf reply state 00000000dfd47941 transno 17179869264 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d580b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x96c72f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.432893:0:17130:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201389.433018:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c6630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17859:x1875064442742272:12345-192.168.201.30@tcp:36:rm.0 Request processed in 2194us (2531us total) trans 17179869264 rc 0/0 00000100:00100000:2.0:1788201389.433028:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 81 00010000:00010000:3.0:1788201389.436550:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d580b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x96c72f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.436573:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d580b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x96c72f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.436583:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d580b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x96c72f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.436592:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131fa00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201389.436599:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d580b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x96c72f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.436608:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d580b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x96c72f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.436628:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x96c72f67 (ffff9e03c2fc5100) 00010000:00010000:3.0:1788201389.436631:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.436636:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d580b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x96c72f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.436643:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d580b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x96c72f67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201389.437863:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201389.438436:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442742400 00000100:00100000:2.0:1788201389.438515:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442742400 00000100:00100000:2.0:1788201389.438633:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4292 00000100:00100000:2.0:1788201389.438647:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2359:x1875064442742400:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1788201389.438673:0:13440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201389.438702:0:13440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033a0bd08/0x9383f985bc4d5820 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x468:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5476 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201389.438751:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x468:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201389.438778:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x468:0x0].0x0 since=664s v=(0 0) 00010000:00010000:2.0:1788201389.438783:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x468:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201389.438795:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033a0bd08/0x9383f985bc4d5820 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x468:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5476 expref: 8 pid: 13440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.438817:0:13440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000033a0bd08/0x9383f985bc4d5820 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x468:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5476 expref: 8 pid: 13440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.438833:0:13440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c131e000, rc 0) 00000100:00100000:2.0:1788201389.438924:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2359:x1875064442742400:12345-192.168.201.30@tcp:101:rm.0 Request processed in 279us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201389.438933:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4292 00010000:00010000:1.0:1788201389.441196:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201389.441213:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5819 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x417:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.441227:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131f400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201389.441233:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5819 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x417:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.441245:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5819 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x417:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.441267:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x417:0x0].0x0 (ffff9e03c2fc5700) 00010000:00010000:1.0:1788201389.441271:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201389.441276:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5819 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x417:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.441283:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5819 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x417:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.442816:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.442823:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.442825:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201389.445608:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201389.445859:0:16721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442742656 00000100:00100000:3.0:1788201389.445873:0:16721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442742656 00000100:00100000:3.0:1788201389.446016:0:16721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 82 00000100:00100000:3.0:1788201389.446029:0:16721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:17859:x1875064442742656:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:3.0:1788201389.446134:0:16721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201389.446181:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5517 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x418:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53ce expref: 101 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.446205:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x418:0x0].0x0 (ffff9e03c2ac6300) 00010000:00010000:3.0:1788201389.446218:0:16721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201389.446248:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5827 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.446269:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5827 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.446280:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5827 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.446355:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d582e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xb99577c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.446364:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d582e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xb99577c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.446371:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d582e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xb99577c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.446705:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5835 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x418:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.446714:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5835 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x418:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.446721:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5835 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x418:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201389.447911:0:16721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].8, 64 off8704 00010000:00010000:3.0:1788201389.452254:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d583c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x418:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.452289:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d583c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x418:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.452324:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d583c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x418:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.452339:0:16721:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d583c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x418:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.452347:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d583c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x418:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.452355:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d583c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x418:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.452388:0:16721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201389.452431:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5835 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x418:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.452553:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5835 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x418:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.452564:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5835 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x418:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.452572:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201389.452577:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5835 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x418:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.452585:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5835 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x418:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.452601:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x418:0x0].0x0 (ffff9e04d9f56f00) 00010000:00010000:3.0:1788201389.452605:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201389.452611:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5835 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x418:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.452623:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5835 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x418:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.452654:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5827 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.452660:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5827 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.452666:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5827 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.452671:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201389.452674:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5827 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.452680:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5827 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.452688:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:3.0:1788201389.452689:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.452692:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5827 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.452698:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2400/0x9383f985bc4d5827 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201389.452708:0:16721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009658f654 reply state 000000001ee86b70 transno 17179869265 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d582e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xb99577c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201389.452718:0:16721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201389.452928:0:16721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17859:x1875064442742656:12345-192.168.201.30@tcp:36:rm.0 Request processed in 6894us (7327us total) trans 17179869265 rc 0/0 00000100:00100000:3.0:1788201389.452940:0:16721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 82 00010000:00010000:0.0:1788201389.453249:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201389.453259:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d583c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x418:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.453266:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201389.453271:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d583c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x418:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.453278:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d583c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x418:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.453290:0:7645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x418:0x0].0x0 (ffff9e04d9f56f00) 00010000:00010000:0.0:1788201389.453325:0:7645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201389.453329:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d583c lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x418:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.453335:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d583c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x418:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.453354:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.453356:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.453359:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201389.455522:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d582e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xb99577c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.455543:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d582e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xb99577c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.455551:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d582e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xb99577c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.455559:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.455564:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d582e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xb99577c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.455573:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d582e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xb99577c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.455590:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0xb99577c1 (ffff9e04d9f56900) 00010000:00010000:2.0:1788201389.455593:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.455598:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d582e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xb99577c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.455605:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d582e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xb99577c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.459418:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201389.459518:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442742784 00000100:00100000:0.0:1788201389.459531:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442742784 00000100:00100000:0.0:1788201389.459610:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4293 00000100:00100000:0.0:1788201389.459623:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+510:2359:x1875064442742784:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1788201389.459649:0:13449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201389.459677:0:13449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002359bf1/0x9383f985bc4d5843 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x469:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c547d expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201389.459713:0:13449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x469:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201389.459748:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x469:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1788201389.459755:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x469:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201389.459768:0:13449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002359bf1/0x9383f985bc4d5843 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x469:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c547d expref: 511 pid: 13449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.459791:0:13449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000002359bf1/0x9383f985bc4d5843 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x469:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c547d expref: 511 pid: 13449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.459807:0:13449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3a00, rc 0) 00000100:00100000:0.0:1788201389.459896:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2359:x1875064442742784:12345-192.168.201.30@tcp:101:rm.0 Request processed in 275us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201389.459904:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4293 00000100:00100000:3.0:1788201389.466410:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201389.467135:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442742912 00000100:00100000:0.0:1788201389.467150:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442742912 00000100:00100000:0.0:1788201389.467230:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4294 00000100:00100000:0.0:1788201389.467242:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2362:x1875064442742912:12345-192.168.201.30@tcp:101:ll_agl.0 00010000:00010000:0.0:1788201389.467267:0:13438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201389.467339:0:13438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f1c741f/0x9383f985bc4d584a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x469:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5484 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201389.467375:0:13438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x469:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201389.467405:0:13438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x469:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1788201389.467411:0:13438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x469:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201389.467424:0:13438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f1c741f/0x9383f985bc4d584a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x469:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5484 expref: 9 pid: 13438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.467446:0:13438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007f1c741f/0x9383f985bc4d584a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x469:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5484 expref: 9 pid: 13438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.467464:0:13438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3c00, rc 0) 00000100:00100000:0.0:1788201389.467542:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:2362:x1875064442742912:12345-192.168.201.30@tcp:101:ll_agl.0 Request processed in 302us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201389.467550:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4294 00000100:00100000:3.0:1788201389.468588:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201389.468626:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201389.468652:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201389.468684:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201389.468701:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201389.468722:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201389.468755:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201389.468780:0:13442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442743040 00000100:00100000:3.0:1788201389.468788:0:13442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442743040 00000100:00100000:3.0:1788201389.468830:0:13442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442743168 00000100:00100000:3.0:1788201389.468834:0:13442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442743168 00000100:00100000:3.0:1788201389.468864:0:13442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442743552 00000100:00100000:3.0:1788201389.468868:0:13442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442743552 00000100:00100000:2.0:1788201389.469323:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442743808 00000100:00100000:2.0:1788201389.469330:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442743808 00000100:00100000:2.0:1788201389.469360:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442743296 00000100:00100000:2.0:1788201389.469364:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442743296 00000100:00100000:2.0:1788201389.469380:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442743424 00000100:00100000:2.0:1788201389.469383:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442743424 00000100:00100000:2.0:1788201389.469398:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442743680 00000100:00100000:2.0:1788201389.469401:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442743680 00000100:00100000:2.0:1788201389.469425:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4295 00000100:00100000:2.0:1788201389.469447:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35604eb4-baf9-45be-a20a-4883a2cd8cf9+514:2362:x1875064442743040:12345-192.168.201.30@tcp:101:ll_agl.0 00010000:00010000:2.0:1788201389.469471:0:13446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201389.469497:0:13446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab45217d/0x9383f985bc4d5851 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x46a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c548b expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201389.469528:0:13446:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x46a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201389.469551:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46a:0x0].0x0 since=664s v=(0 0) 00010000:00010000:2.0:1788201389.469557:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201389.469567:0:13446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab45217d/0x9383f985bc4d5851 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x46a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c548b expref: 515 pid: 13446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.469588:0:13446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab45217d/0x9383f985bc4d5851 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x46a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c548b expref: 515 pid: 13446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.469603:0:13446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c131e200, rc 0) 00000100:00100000:2.0:1788201389.469663:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35604eb4-baf9-45be-a20a-4883a2cd8cf9+515:2362:x1875064442743040:12345-192.168.201.30@tcp:101:ll_agl.0 Request processed in 228us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201389.469671:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4295 00000100:00100000:2.0:1788201389.469694:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4296 00000100:00100000:2.0:1788201389.469701:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:2360:x1875064442743168:12345-192.168.201.30@tcp:101:ll_sa.0 00010000:00010000:2.0:1788201389.469709:0:13446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201389.469723:0:13446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000097fb199/0x9383f985bc4d5858 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x46a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5492 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201389.469741:0:13446:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x46a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201389.469751:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46a:0x0].0x0 since=664s v=(0 0) 00010000:00010000:2.0:1788201389.469755:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201389.469782:0:13446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000097fb199/0x9383f985bc4d5858 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x46a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5492 expref: 12 pid: 13446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.469796:0:13446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000097fb199/0x9383f985bc4d5858 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x46a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5492 expref: 12 pid: 13446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.469806:0:13446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c131e800, rc 0) 00000100:00100000:2.0:1788201389.469826:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:2360:x1875064442743168:12345-192.168.201.30@tcp:101:ll_sa.0 Request processed in 126us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201389.469832:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4296 00000100:00100000:2.0:1788201389.469846:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4297 00000100:00100000:2.0:1788201389.469865:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35604eb4-baf9-45be-a20a-4883a2cd8cf9+514:2360:x1875064442743808:12345-192.168.201.30@tcp:101:ll_sa.0 00000100:00100000:0.0:1788201389.470572:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4298 00000100:00100000:0.0:1788201389.470591:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35604eb4-baf9-45be-a20a-4883a2cd8cf9+514:2362:x1875064442743296:12345-192.168.201.30@tcp:101:ll_agl.0 00010000:00010000:0.0:1788201389.470603:0:13444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201389.470620:0:13444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c440989/0x9383f985bc4d585f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x46b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5499 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201389.470646:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x46b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201389.470661:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46b:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1788201389.470666:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201389.470673:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c440989/0x9383f985bc4d585f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x46b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5499 expref: 515 pid: 13444 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.470688:0:13444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003c440989/0x9383f985bc4d585f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x46b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5499 expref: 515 pid: 13444 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.470699:0:13444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c3400, rc 0) 00000100:00100000:0.0:1788201389.470750:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35604eb4-baf9-45be-a20a-4883a2cd8cf9+515:2362:x1875064442743296:12345-192.168.201.30@tcp:101:ll_agl.0 Request processed in 167us (2047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201389.470758:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4298 00000100:00100000:0.0:1788201389.470780:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4299 00000100:00100000:0.0:1788201389.470787:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:2359:x1875064442743424:12345-192.168.201.30@tcp:101:ll_sa.0 00010000:00010000:0.0:1788201389.470795:0:13444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201389.470806:0:13444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000def97333/0x9383f985bc4d5866 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x46b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c54a0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201389.470821:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x46b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201389.470830:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46b:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1788201389.470834:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201389.470839:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000def97333/0x9383f985bc4d5866 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x46b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54a0 expref: 12 pid: 13444 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.470860:0:13444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000def97333/0x9383f985bc4d5866 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x46b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54a0 expref: 12 pid: 13444 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.470869:0:13444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c20c2800, rc 0) 00000100:00100000:1.0:1788201389.470985:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4300 00000100:00100000:1.0:1788201389.470999:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:2359:x1875064442743680:12345-192.168.201.30@tcp:101:ll_sa.0 00010000:00010000:1.0:1788201389.471008:0:12363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201389.471020:0:12363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d586d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x46c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c54ae expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201389.471036:0:12363:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x46c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201389.471045:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46c:0x0].0x0 since=664s v=(0 0) 00010000:00010000:1.0:1788201389.471048:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201389.471055:0:12363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d586d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x46c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54ae expref: 13 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.471068:0:12363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d586d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x46c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54ae expref: 13 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.471077:0:12363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04ff129800, rc 0) 00000100:00100000:1.0:1788201389.471104:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:2359:x1875064442743680:12345-192.168.201.30@tcp:101:ll_sa.0 Request processed in 111us (2349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201389.471111:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4300 00010000:00010000:2.0:1788201389.471269:0:13446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201389.471286:0:13446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e749fcab/0x9383f985bc4d5874 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x46d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c54b5 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201389.471316:0:13446:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x46d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201389.471326:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46d:0x0].0x0 since=664s v=(0 0) 00010000:00010000:2.0:1788201389.471330:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201389.471337:0:13446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e749fcab/0x9383f985bc4d5874 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x46d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54b5 expref: 515 pid: 13446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.471351:0:13446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e749fcab/0x9383f985bc4d5874 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x46d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54b5 expref: 515 pid: 13446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.471360:0:13446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c131f600, rc 0) 00000100:00100000:2.0:1788201389.471382:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35604eb4-baf9-45be-a20a-4883a2cd8cf9+515:2360:x1875064442743808:12345-192.168.201.30@tcp:101:ll_sa.0 Request processed in 1519us (2698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201389.471389:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4297 00000100:00100000:3.0:1788201389.474135:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4301 00000100:00100000:3.0:1788201389.474152:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35604eb4-baf9-45be-a20a-4883a2cd8cf9+514:2360:x1875064442743552:12345-192.168.201.30@tcp:101:ll_sa.0 00010000:00010000:3.0:1788201389.474178:0:13442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201389.474206:0:13442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007f5270e/0x9383f985bc4d587b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x46c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c54a7 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201389.474242:0:13442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x46c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201389.474265:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46c:0x0].0x0 since=664s v=(0 0) 00010000:00010000:3.0:1788201389.474270:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201389.474282:0:13442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007f5270e/0x9383f985bc4d587b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x46c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54a7 expref: 515 pid: 13442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.474329:0:13442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000007f5270e/0x9383f985bc4d587b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x46c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54a7 expref: 515 pid: 13442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.474344:0:13442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2ef2400, rc 0) 00000100:00100000:3.0:1788201389.474412:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35604eb4-baf9-45be-a20a-4883a2cd8cf9+515:2360:x1875064442743552:12345-192.168.201.30@tcp:101:ll_sa.0 Request processed in 264us (5758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201389.474420:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4301 00000100:00100000:0.0:1788201389.474563:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:2359:x1875064442743424:12345-192.168.201.30@tcp:101:ll_sa.0 Request processed in 3774us (5837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201389.474572:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4299 00000100:00100000:2.0:1788201389.477730:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201389.479987:0:16720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442744064 00000100:00100000:1.0:1788201389.480005:0:16720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442744064 00000100:00100000:1.0:1788201389.480084:0:16720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 83 00000100:00100000:1.0:1788201389.480096:0:16720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:17859:x1875064442744064:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201389.480180:0:16720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201389.480214:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3600/0x9383f985bc4d553a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x419:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53d5 expref: 101 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.480239:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x419:0x0].0x0 (ffff9e03c2fc5800) 00010000:00010000:1.0:1788201389.480252:0:16720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201389.480284:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129e00/0x9383f985bc4d5882 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.480349:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129e00/0x9383f985bc4d5882 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.480362:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129e00/0x9383f985bc4d5882 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.480397:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129200/0x9383f985bc4d5889 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xdc63c01a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.480405:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129200/0x9383f985bc4d5889 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xdc63c01a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.480413:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129200/0x9383f985bc4d5889 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xdc63c01a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.482059:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5890 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x419:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.482081:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5890 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x419:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.482094:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5890 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x419:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201389.483275:0:16720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].8, 64 off8704 00010000:00010000:0.0:1788201389.483554:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d5897 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x419:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.483570:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d5897 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x419:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.483583:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d5897 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x419:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.483593:0:16720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d5897 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x419:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.483601:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d5897 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x419:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.483608:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d5897 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x419:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.483680:0:16720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201389.483712:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5890 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x419:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.483719:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5890 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x419:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.483727:0:16720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5890 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x419:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.483743:0:16720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c20c2a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201389.483749:0:16720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5890 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x419:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.483760:0:16720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5890 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x419:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.483774:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x419:0x0].0x0 (ffff9e03c33e8600) 00010000:00010000:0.0:1788201389.483778:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201389.483783:0:16720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5890 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x419:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.483790:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2a00/0x9383f985bc4d5890 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x419:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.483814:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129e00/0x9383f985bc4d5882 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.483821:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129e00/0x9383f985bc4d5882 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.483827:0:16720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129e00/0x9383f985bc4d5882 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.483833:0:16720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201389.483836:0:16720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129e00/0x9383f985bc4d5882 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.483842:0:16720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129e00/0x9383f985bc4d5882 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.483860:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:0.0:1788201389.483863:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201389.483866:0:16720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129e00/0x9383f985bc4d5882 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.483887:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129e00/0x9383f985bc4d5882 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201389.483900:0:16720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f9b338b8 reply state 00000000211a7a6a transno 17179869266 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129200/0x9383f985bc4d5889 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xdc63c01a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201389.483911:0:16720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201389.484046:0:16720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17859:x1875064442744064:12345-192.168.201.30@tcp:36:rm.0 Request processed in 3945us (6326us total) trans 17179869266 rc 0/0 00000100:00100000:0.0:1788201389.484057:0:16720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 83 00010000:00010000:1.0:1788201389.484825:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201389.484837:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d5897 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x419:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.484846:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b28200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201389.484859:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d5897 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x419:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.484867:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d5897 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x419:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.484941:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x419:0x0].0x0 (ffff9e03c33e8600) 00010000:00010000:1.0:1788201389.484945:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201389.484950:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d5897 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x419:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.484962:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28200/0x9383f985bc4d5897 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x419:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.485061:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.485065:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.485067:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201389.487667:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129200/0x9383f985bc4d5889 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xdc63c01a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.487689:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129200/0x9383f985bc4d5889 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xdc63c01a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.487698:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129200/0x9383f985bc4d5889 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xdc63c01a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.487707:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201389.487713:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129200/0x9383f985bc4d5889 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xdc63c01a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.487723:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129200/0x9383f985bc4d5889 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xdc63c01a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.487742:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0xdc63c01a (ffff9e03c316f400) 00010000:00010000:3.0:1788201389.487745:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.487751:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129200/0x9383f985bc4d5889 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xdc63c01a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.487763:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129200/0x9383f985bc4d5889 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xdc63c01a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201389.490228:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201389.490537:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442744320 00000100:00100000:2.0:1788201389.490553:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442744320 00000100:00100000:2.0:1788201389.490684:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 84 00000100:00100000:2.0:1788201389.490701:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:17859:x1875064442744320:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1788201389.490805:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201389.490839:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2000/0x9383f985bc4d555d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x41a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53dc expref: 101 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.490879:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x41a:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:2.0:1788201389.490894:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201389.490927:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d589e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.490947:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d589e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.490960:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d589e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.490983:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d58a5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xff320874 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.490991:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d58a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xff320874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.490999:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d58a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xff320874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.491135:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d58ac lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x41a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.491144:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d58ac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x41a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.491151:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d58ac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x41a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201389.491912:0:17130:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].9, 64 off8768 00010000:00010000:2.0:1788201389.491994:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d58b3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x41a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.492006:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d58b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x41a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.492017:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d58b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x41a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.492026:0:17130:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d58b3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x41a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.492034:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d58b3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x41a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.492042:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d58b3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x41a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.492067:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201389.492093:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d58ac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x41a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.492100:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d58ac lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x41a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.492107:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d58ac lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x41a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.492114:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131f400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.492120:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d58ac lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x41a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.492128:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d58ac lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x41a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.492139:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x41a:0x0].0x0 (ffff9e03c33ed600) 00010000:00010000:2.0:1788201389.492142:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201389.492146:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d58ac lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x41a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.492153:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d58ac lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x41a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.492172:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d589e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.492185:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d589e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.492192:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d589e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.492198:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131fc00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.492201:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d589e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.492207:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d589e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.492215:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:2.0:1788201389.492217:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.492221:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d589e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.492228:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d589e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201389.492237:0:17130:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007605a9f2 reply state 00000000dfb32a9d transno 17179869267 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d58a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xff320874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.492246:0:17130:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201389.492378:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17859:x1875064442744320:12345-192.168.201.30@tcp:36:rm.0 Request processed in 1678us (2161us total) trans 17179869267 rc 0/0 00000100:00100000:2.0:1788201389.492389:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 84 00010000:00010000:0.0:1788201389.493174:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201389.493185:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d58b3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x41a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.493195:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201389.493200:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d58b3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x41a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.493209:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d58b3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x41a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.493223:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x41a:0x0].0x0 (ffff9e03c33ed600) 00010000:00010000:0.0:1788201389.493227:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201389.493230:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d58b3 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x41a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.493237:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d58b3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x41a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.493260:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.493262:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.493264:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201389.494262:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d58a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xff320874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.494277:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d58a5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xff320874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.494285:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d58a5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xff320874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.494603:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131fa00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201389.494610:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d58a5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xff320874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.494620:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d58a5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xff320874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.494636:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0xff320874 (ffff9e03c33edb00) 00010000:00010000:3.0:1788201389.494639:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.494644:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d58a5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xff320874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.494652:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d58a5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xff320874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201389.496397:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201389.496681:0:16721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442744576 00000100:00100000:2.0:1788201389.496695:0:16721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442744576 00000100:00100000:2.0:1788201389.496780:0:16721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 85 00000100:00100000:2.0:1788201389.496794:0:16721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:17859:x1875064442744576:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1788201389.497033:0:16721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201389.497067:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5580 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x41b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53e3 expref: 101 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.497090:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x41b:0x0].0x0 (ffff9e04d9f56700) 00010000:00010000:2.0:1788201389.497104:0:16721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201389.497134:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d58ba lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.497247:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d58ba lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.497261:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d58ba lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.497281:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d58c1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x220050ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.497290:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d58c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x220050ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.497364:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d58c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x220050ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.497633:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d58c8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x41b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.497643:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d58c8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x41b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.497657:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d58c8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x41b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201389.500980:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201389.501034:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201389.501058:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201389.501086:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201389.501108:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201389.501132:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201389.501326:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442744704 00000100:00100000:1.0:1788201389.501341:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442744704 00000100:00100000:1.0:1788201389.501401:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442744960 00000100:00100000:1.0:1788201389.501405:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442744960 00000100:00100000:1.0:1788201389.501423:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442745216 00000100:00100000:1.0:1788201389.501438:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442745216 00000100:00100000:1.0:1788201389.501458:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442745472 00000100:00100000:1.0:1788201389.501461:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442745472 00000100:00100000:1.0:1788201389.501487:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442745088 00000100:00100000:1.0:1788201389.501490:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442745088 00000100:00100000:1.0:1788201389.501514:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4302 00000100:00100000:1.0:1788201389.501526:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:2362:x1875064442744704:12345-192.168.201.30@tcp:101:ll_agl.0 00010000:00010000:1.0:1788201389.501556:0:13440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201389.501586:0:13440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d58cf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x46d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c54bc expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201389.501620:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x46d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201389.501648:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46d:0x0].0x0 since=664s v=(0 0) 00010000:00010000:1.0:1788201389.501653:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201389.501664:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d58cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x46d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54bc expref: 14 pid: 13440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.501686:0:13440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d58cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x46d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54bc expref: 14 pid: 13440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.501710:0:13440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04ff128600, rc 0) 00000100:00100000:1.0:1788201389.501794:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35604eb4-baf9-45be-a20a-4883a2cd8cf9+14:2362:x1875064442744704:12345-192.168.201.30@tcp:101:ll_agl.0 Request processed in 269us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201389.501802:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4302 00000100:00100000:1.0:1788201389.501826:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4303 00000100:00100000:1.0:1788201389.501834:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35604eb4-baf9-45be-a20a-4883a2cd8cf9+517:2360:x1875064442744960:12345-192.168.201.30@tcp:101:ll_sa.0 00010000:00010000:1.0:1788201389.501842:0:13440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201389.501864:0:13440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001687b5b9/0x9383f985bc4d58d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x46e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5548 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201389.502202:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x46e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201389.502217:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46e:0x0].0x0 since=664s v=(0 0) 00010000:00010000:1.0:1788201389.502220:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201389.502228:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001687b5b9/0x9383f985bc4d58d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x46e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5548 expref: 518 pid: 13440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.502243:0:13440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001687b5b9/0x9383f985bc4d58d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x46e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5548 expref: 518 pid: 13440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.502253:0:13440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04ff128400, rc 0) 00000100:00100000:1.0:1788201389.502281:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35604eb4-baf9-45be-a20a-4883a2cd8cf9+518:2360:x1875064442744960:12345-192.168.201.30@tcp:101:ll_sa.0 Request processed in 449us (1246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201389.502289:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4303 00000100:00100000:1.0:1788201389.502332:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4304 00000100:00100000:1.0:1788201389.502340:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35604eb4-baf9-45be-a20a-4883a2cd8cf9+517:2360:x1875064442745216:12345-192.168.201.30@tcp:101:ll_sa.0 00010000:00010000:1.0:1788201389.502349:0:13440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201389.502361:0:13440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e4d980a/0x9383f985bc4d58dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x46f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5556 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201389.502374:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x46f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201389.502383:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46f:0x0].0x0 since=664s v=(0 0) 00010000:00010000:1.0:1788201389.502387:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201389.502393:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e4d980a/0x9383f985bc4d58dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x46f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5556 expref: 518 pid: 13440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.502404:0:13440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004e4d980a/0x9383f985bc4d58dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x46f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5556 expref: 518 pid: 13440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.502414:0:13440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04ff128200, rc 0) 00000100:00100000:1.0:1788201389.502434:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35604eb4-baf9-45be-a20a-4883a2cd8cf9+518:2360:x1875064442745216:12345-192.168.201.30@tcp:101:ll_sa.0 Request processed in 95us (1374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201389.502441:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4304 00000100:00100000:1.0:1788201389.502453:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4305 00000100:00100000:1.0:1788201389.502460:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35604eb4-baf9-45be-a20a-4883a2cd8cf9+517:2360:x1875064442745472:12345-192.168.201.30@tcp:101:ll_sa.0 00010000:00010000:1.0:1788201389.502466:0:13440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1788201389.502588:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201389.502694:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201389.502864:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442745344 00000100:00100000:0.0:1788201389.502880:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442745344 00000100:00100000:0.0:1788201389.502919:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442745600 00000100:00100000:0.0:1788201389.502923:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442745600 00000100:00100000:0.0:1788201389.502944:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4306 00000100:00100000:0.0:1788201389.502952:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:2360:x1875064442745088:12345-192.168.201.30@tcp:101:ll_sa.0 00010000:00010000:0.0:1788201389.502962:0:13449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201389.502977:0:13449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ef08765/0x9383f985bc4d58e4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x46e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c554f expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201389.502998:0:13449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x46e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201389.503008:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46e:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1788201389.503011:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201389.503017:0:13449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ef08765/0x9383f985bc4d58e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x46e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c554f expref: 16 pid: 13449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.503030:0:13449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000ef08765/0x9383f985bc4d58e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x46e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c554f expref: 16 pid: 13449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.503039:0:13449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0501b28c00, rc 0) 00000100:00100000:0.0:1788201389.503065:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:2360:x1875064442745088:12345-192.168.201.30@tcp:101:ll_sa.0 Request processed in 115us (1932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201389.503071:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4306 00000100:00100000:0.0:1788201389.503087:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4307 00000100:00100000:0.0:1788201389.503094:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:2360:x1875064442745344:12345-192.168.201.30@tcp:101:ll_sa.0 00010000:00010000:0.0:1788201389.503101:0:13449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201389.503111:0:13449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031c8e9d7/0x9383f985bc4d58eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x46f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c555d expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201389.503125:0:13449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x46f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201389.503133:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46f:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1788201389.503137:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201389.503142:0:13449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031c8e9d7/0x9383f985bc4d58eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x46f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c555d expref: 16 pid: 13449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.503348:0:13449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000031c8e9d7/0x9383f985bc4d58eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x46f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c555d expref: 16 pid: 13449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.503359:0:13449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0501b29a00, rc 0) 00000100:00100000:0.0:1788201389.503382:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:2360:x1875064442745344:12345-192.168.201.30@tcp:101:ll_sa.0 Request processed in 289us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201389.503389:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4307 00000100:00100000:0.0:1788201389.503404:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4308 00000100:00100000:0.0:1788201389.503411:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+15:2360:x1875064442745600:12345-192.168.201.30@tcp:101:ll_sa.0 00010000:00010000:0.0:1788201389.503419:0:13449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201389.503431:0:13449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab0efb21/0x9383f985bc4d58f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x470:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c556b expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201389.503444:0:13449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x470:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201389.503454:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x470:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1788201389.503457:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x470:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201389.503463:0:13449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab0efb21/0x9383f985bc4d58f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x470:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c556b expref: 16 pid: 13449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.504060:0:13449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ab0efb21/0x9383f985bc4d58f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x470:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c556b expref: 16 pid: 13449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.504080:0:13449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0501b28200, rc 0) 00000100:00100000:0.0:1788201389.504120:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:2360:x1875064442745600:12345-192.168.201.30@tcp:101:ll_sa.0 Request processed in 709us (1425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201389.504128:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4308 00010000:00010000:1.0:1788201389.504596:0:13440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066520edc/0x9383f985bc4d58f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x470:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5564 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201389.504629:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x470:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201389.504647:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x470:0x0].0x0 since=664s v=(0 0) 00010000:00010000:1.0:1788201389.504651:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x470:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201389.504659:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066520edc/0x9383f985bc4d58f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x470:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5564 expref: 518 pid: 13440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.504674:0:13440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000066520edc/0x9383f985bc4d58f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x470:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5564 expref: 518 pid: 13440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.504685:0:13440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04ff129e00, rc 0) 00000100:00100000:1.0:1788201389.504716:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35604eb4-baf9-45be-a20a-4883a2cd8cf9+518:2360:x1875064442745472:12345-192.168.201.30@tcp:101:ll_sa.0 Request processed in 2256us (3629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201389.504724:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4305 00000040:00080000:2.0:1788201389.505920:0:16721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].9, 64 off8768 00010000:00010000:2.0:1788201389.506061:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5900 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x41b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.506081:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5900 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x41b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.506097:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5900 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x41b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.506108:0:16721:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5900 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x41b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.506117:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5900 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x41b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.506125:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5900 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x41b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201389.506669:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442744832 00000100:00100000:3.0:1788201389.506683:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442744832 00010000:00010000:2.0:1788201389.508235:0:16721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201389.508284:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201389.508313:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5900 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x41b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.508327:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201389.508332:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5900 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x41b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.508348:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5900 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x41b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.508369:0:7645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x41b:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:2.0:1788201389.508372:0:7645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788201389.508378:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5900 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x41b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.508384:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5900 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x41b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.508405:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201389.508407:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201389.508409:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201389.508427:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d58c8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x41b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.508434:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d58c8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x41b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.508441:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d58c8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x41b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.508445:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.508449:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d58c8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x41b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.508455:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d58c8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x41b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.508461:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x41b:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:2.0:1788201389.508464:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201389.508467:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d58c8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x41b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.508484:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d58c8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x41b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.508510:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d58ba lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.508516:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d58ba lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.508522:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d58ba lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.508526:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.508529:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d58ba lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.508535:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d58ba lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.508542:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:2.0:1788201389.508544:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.508547:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d58ba lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.508552:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d58ba lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201389.508561:0:16721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9675ed1 reply state 000000004aeee3dc transno 17179869268 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d58c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x220050ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.508576:0:16721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201389.508701:0:16721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+103:17859:x1875064442744576:12345-192.168.201.30@tcp:36:rm.0 Request processed in 11902us (12310us total) trans 17179869268 rc 0/0 00000100:00100000:2.0:1788201389.508712:0:16721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 85 00000100:00100000:1.0:1788201389.508833:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 894 00000100:00100000:1.0:1788201389.508862:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:2360:x1875064442744832:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:1.0:1788201389.515235:0:17128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201389.515274:0:17128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129600/0x9383f985bc4d5907 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c54c3 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.515686:0:17128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d590e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.515704:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d590e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.515723:0:17128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d590e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.515753:0:17128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d5915 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x40a:0x0].0xab703b44 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.515761:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d5915 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0xab703b44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.515769:0:17128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d5915 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0xab703b44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.515877:0:17128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d590e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.515885:0:17128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d590e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.515891:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d590e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.515898:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff128a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201389.515903:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d590e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.515911:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d590e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.515926:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:1.0:1788201389.515930:0:17128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201389.515935:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d590e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.515943:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d590e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.515969:0:17128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d5915 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0xab703b44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.515977:0:17128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d5915 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0xab703b44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.515983:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d5915 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0xab703b44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.515989:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201389.515993:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d5915 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0xab703b44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.515999:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d5915 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0xab703b44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.516006:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0xab703b44 (ffff9e03c23c1f00) 00010000:00010000:1.0:1788201389.516008:0:17128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201389.516011:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d5915 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x40a:0x0].0xab703b44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.516018:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d5915 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x40a:0x0].0xab703b44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.516059:0:17128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129600/0x9383f985bc4d5907 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54c3 expref: 104 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.516076:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:1.0:1788201389.516078:0:17128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201389.516083:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129600/0x9383f985bc4d5907 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54c3 expref: 104 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.516093:0:17128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04ff129600, rc -2) 00000100:00100000:1.0:1788201389.516400:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:2360:x1875064442744832:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 7553us (15288us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201389.516412:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 894 00010000:00010000:1.0:1788201389.516465:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d58c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x220050ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201389.516801:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201389.516926:0:16720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442745856 00000100:00100000:3.0:1788201389.516937:0:16720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442745856 00010000:00010000:1.0:1788201389.517815:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d58c1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x220050ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.517829:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d58c1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x220050ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.517836:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201389.517841:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d58c1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x220050ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.517861:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d58c1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x220050ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.517877:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x220050ce (ffff9e03c33edc00) 00010000:00010000:1.0:1788201389.517880:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201389.517885:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d58c1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x220050ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.517892:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d58c1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x220050ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201389.518260:0:16720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 86 00000100:00100000:3.0:1788201389.518276:0:16720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:17859:x1875064442745856:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:3.0:1788201389.518364:0:16720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201389.518385:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2400/0x9383f985bc4d55a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x41c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53ea expref: 101 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.518398:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x41c:0x0].0x0 (ffff9e03c2fc5000) 00010000:00010000:3.0:1788201389.518407:0:16720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201389.518434:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d591c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.518448:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d591c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.518458:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d591c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.518613:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d5923 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x44ce9928 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.518623:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d5923 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x44ce9928 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.518631:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d5923 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x44ce9928 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.518776:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d592a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x41c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.518785:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d592a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x41c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.518793:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d592a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x41c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201389.525206:0:16720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].10, 64 off8832 00010000:00010000:3.0:1788201389.525343:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5931 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x41c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.525366:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5931 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x41c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.525382:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5931 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x41c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.525393:0:16720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5931 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x41c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.525400:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5931 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x41c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.525407:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5931 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x41c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.525428:0:16720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201389.525458:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d592a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x41c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.525466:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d592a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x41c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.525473:0:16720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d592a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x41c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.525480:0:16720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201389.525486:0:16720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d592a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x41c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.525494:0:16720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d592a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x41c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.525508:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x41c:0x0].0x0 (ffff9e04d9f56600) 00010000:00010000:3.0:1788201389.525511:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201389.525517:0:16720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d592a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x41c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.525523:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d592a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x41c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.525545:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d591c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.525551:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d591c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.525562:0:16720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d591c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.525567:0:16720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201389.525570:0:16720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d591c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.525575:0:16720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d591c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.525582:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:3.0:1788201389.525585:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.525588:0:16720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d591c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.525594:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d591c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201389.525602:0:16720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000092f73d57 reply state 00000000e52f022c transno 17179869269 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d5923 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x44ce9928 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201389.525612:0:16720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201389.527983:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201389.528002:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5931 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x41c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.528016:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201389.528022:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5931 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x41c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.528034:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5931 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x41c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.528056:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x41c:0x0].0x0 (ffff9e04d9f56600) 00010000:00010000:0.0:1788201389.528060:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201389.528065:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5931 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x41c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.528072:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5931 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x41c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.528105:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.528107:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.528109:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201389.529504:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201389.529634:0:16720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17859:x1875064442745856:12345-192.168.201.30@tcp:36:rm.0 Request processed in 11358us (12829us total) trans 17179869269 rc 0/0 00000100:00100000:3.0:1788201389.529648:0:16720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 86 00000100:00100000:0.0:1788201389.533687:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442745984 00000100:00100000:0.0:1788201389.533713:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442745984 00000100:00100000:0.0:1788201389.533813:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 895 00000100:00100000:0.0:1788201389.533826:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4def800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:2360:x1875064442745984:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:2.0:1788201389.537682:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d5923 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x44ce9928 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.537711:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d5923 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x44ce9928 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.537731:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d5923 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x44ce9928 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.537746:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.537753:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d5923 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x44ce9928 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.537764:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d5923 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x44ce9928 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.537793:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x44ce9928 (ffff9e04d9f56500) 00010000:00010000:2.0:1788201389.537797:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.537803:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d5923 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x44ce9928 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.537810:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d5923 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x44ce9928 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.552921:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201389.552966:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c200/0x9383f985bc4d5938 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5572 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.553578:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d593f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.553599:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d593f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.553613:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d593f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.553633:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d5946 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x40a:0x0].0x11d394b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.553642:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d5946 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x11d394b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.553649:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d5946 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x11d394b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.553732:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d593f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.553741:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d593f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.553749:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d593f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.553758:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201389.553764:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d593f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.553774:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d593f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.553788:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:1.0:1788201389.553792:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201389.553797:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d593f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.553804:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d593f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.553819:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d5946 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x11d394b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.553894:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d5946 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x11d394b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.553900:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d5946 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x11d394b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.553905:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff128a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201389.553909:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d5946 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x11d394b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.553915:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d5946 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x11d394b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.553924:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x11d394b4 (ffff9e03c23c1f00) 00010000:00010000:1.0:1788201389.553927:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201389.553931:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d5946 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x40a:0x0].0x11d394b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.553937:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d5946 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x40a:0x0].0x11d394b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.553980:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c200/0x9383f985bc4d5938 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5572 expref: 103 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.553992:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:1.0:1788201389.553995:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201389.553999:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c200/0x9383f985bc4d5938 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5572 expref: 103 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.554010:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c507c200, rc -2) 00000100:00100000:1.0:1788201389.554374:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4def800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:2360:x1875064442745984:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 20547us (24877us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201389.554386:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 895 00000100:00100000:3.0:1788201389.555911:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201389.556097:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201389.556515:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442746368 00000100:00100000:0.0:1788201389.556529:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442746368 00000100:00100000:0.0:1788201389.556607:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 896 00000100:00100000:0.0:1788201389.556619:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4deb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:2359:x1875064442746368:12345-192.168.201.30@tcp:63:ll_sa.0 00000100:00100000:2.0:1788201389.558095:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442746240 00000100:00100000:2.0:1788201389.558113:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442746240 00010000:00010000:0.0:1788201389.559054:0:17129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201389.559088:0:17129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d594d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5659 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.560214:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 87 00000100:00100000:2.0:1788201389.560236:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+104:17859:x1875064442746240:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1788201389.560311:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201389.560347:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29600/0x9383f985bc4d55c6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x41d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53f1 expref: 104 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.560371:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x41d:0x0].0x0 (ffff9e03c2fc5500) 00010000:00010000:2.0:1788201389.560385:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201389.560403:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5954 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.560420:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5954 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.560432:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5954 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.560449:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d595b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x679ce181 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.560457:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d595b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x679ce181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.560464:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d595b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x679ce181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.560776:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5962 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x41d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.560786:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5962 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x41d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.560795:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5962 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x41d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201389.561809:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201389.561974:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442746496 00000100:00100000:0.0:1788201389.561989:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442746496 00000100:00100000:0.0:1788201389.562058:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 897 00000100:00100000:0.0:1788201389.562070:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4de9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+104:2360:x1875064442746496:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:0.0:1788201389.562116:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201389.562136:0:6715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d5969 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5819 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.562217:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d5970 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.562231:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d5970 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.562243:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d5970 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.562259:0:6715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d5977 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x40a:0x0].0x5fa6ad20 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.562265:0:6715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d5977 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x5fa6ad20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.562272:0:6715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d5977 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x5fa6ad20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.562346:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d5970 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.562355:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d5970 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.562363:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d5970 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.562371:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201389.562377:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d5970 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.562391:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d5970 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.562404:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:0.0:1788201389.562407:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201389.562412:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d5970 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.562419:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d5970 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.562435:0:6715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d5977 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x5fa6ad20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.562441:0:6715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d5977 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x5fa6ad20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.562448:0:6715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d5977 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x5fa6ad20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.562453:0:6715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201389.562456:0:6715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d5977 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x5fa6ad20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.562462:0:6715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d5977 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x5fa6ad20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.562469:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x5fa6ad20 (ffff9e04d82b6300) 00010000:00010000:0.0:1788201389.562605:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201389.562609:0:6715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d5977 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x40a:0x0].0x5fa6ad20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.562618:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d5977 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x40a:0x0].0x5fa6ad20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.562656:0:6715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d5969 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5819 expref: 105 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.562668:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:0.0:1788201389.562670:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201389.562674:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507c800/0x9383f985bc4d5969 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5819 expref: 105 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.562685:0:6715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c507c800, rc -2) 00000100:00100000:0.0:1788201389.562765:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4de9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+104:2360:x1875064442746496:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 697us (963us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201389.562774:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 897 00000040:00080000:2.0:1788201389.564726:0:17130:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].10, 64 off8832 00010000:00010000:2.0:1788201389.565058:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d597e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x41d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.565079:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d597e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x41d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.565094:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d597e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x41d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.565106:0:17130:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d597e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x41d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.565114:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d597e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x41d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.565121:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d597e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x41d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.565233:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201389.565265:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5962 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x41d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.565271:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5962 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x41d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.565278:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5962 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x41d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.565289:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.565320:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5962 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x41d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.565329:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5962 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x41d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.565345:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x41d:0x0].0x0 (ffff9e03c33ed200) 00010000:00010000:2.0:1788201389.565348:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201389.565353:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5962 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x41d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.565360:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5962 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x41d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.565385:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5954 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.565392:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5954 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.565398:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5954 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.565403:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.565406:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5954 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.565413:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5954 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.565426:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:2.0:1788201389.565429:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.565432:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5954 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.565439:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5954 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201389.565450:0:17130:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c48a130b reply state 00000000e2a56ff6 transno 17179869270 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d595b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x679ce181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.565460:0:17130:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201389.565582:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+105:17859:x1875064442746240:12345-192.168.201.30@tcp:36:rm.0 Request processed in 5350us (9675us total) trans 17179869270 rc 0/0 00000100:00100000:2.0:1788201389.565593:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 87 00010000:00010000:1.0:1788201389.567759:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d5985 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.567789:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d5985 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.567802:0:17129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d5985 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.567825:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d598c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x40a:0x0].0xd2bad361 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.567832:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d598c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0xd2bad361 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.567839:0:17129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d598c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0xd2bad361 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.567966:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d5985 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.567974:0:17129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d5985 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.567982:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d5985 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.567989:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff128a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201389.567994:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d5985 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.568002:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d5985 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.568016:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:1.0:1788201389.568020:0:17129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201389.568024:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d5985 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.568031:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d5985 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.568044:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d598c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0xd2bad361 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.568051:0:17129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d598c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0xd2bad361 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.568058:0:17129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d598c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0xd2bad361 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.568063:0:17129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201389.568065:0:17129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d598c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0xd2bad361 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.568072:0:17129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d598c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0xd2bad361 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.568079:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0xd2bad361 (ffff9e03c23c1f00) 00010000:00010000:1.0:1788201389.568081:0:17129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201389.568084:0:17129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d598c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x40a:0x0].0xd2bad361 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.568090:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d598c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x40a:0x0].0xd2bad361 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.568141:0:17129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d594d lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5659 expref: 104 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.568167:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:1.0:1788201389.568170:0:17129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201389.568174:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d594d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5659 expref: 104 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.568184:0:17129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c507d000, rc -2) 00000100:00100000:1.0:1788201389.568327:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4deb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:2359:x1875064442746368:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 11671us (12194us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201389.568343:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 896 00010000:00010000:3.0:1788201389.578209:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d595b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x679ce181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.578237:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d595b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x679ce181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.578246:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d595b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x679ce181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.578253:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201389.578258:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d595b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x679ce181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.578266:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d595b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x679ce181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.578287:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x679ce181 (ffff9e03c33edd00) 00010000:00010000:3.0:1788201389.578326:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.578333:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d595b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x679ce181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.578341:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d595b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x679ce181 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.579716:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201389.579732:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d597e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x41d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.579743:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201389.579748:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d597e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x41d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.579758:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d597e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x41d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.579774:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x41d:0x0].0x0 (ffff9e03c33ed200) 00010000:00010000:0.0:1788201389.579777:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201389.579782:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d597e lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x41d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.579788:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d597e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x41d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.579811:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.579813:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.579815:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201389.580861:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201389.580937:0:16721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442746752 00000100:00100000:2.0:1788201389.580950:0:16721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442746752 00000100:00100000:2.0:1788201389.581025:0:16721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 88 00000100:00100000:2.0:1788201389.581038:0:16721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:17859:x1875064442746752:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1788201389.581112:0:16721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201389.581140:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d55e9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x41e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53f8 expref: 101 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.581169:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x41e:0x0].0x0 (ffff9e03c2ac6f00) 00010000:00010000:2.0:1788201389.581181:0:16721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201389.581211:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5993 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.581233:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5993 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.581244:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5993 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.581270:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d599a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x8a6b29db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.581276:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d599a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x8a6b29db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.581283:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d599a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x8a6b29db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.581966:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d59a1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x41e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.581978:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d59a1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x41e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.581986:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d59a1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x41e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201389.584921:0:16721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].11, 64 off8896 00010000:00010000:2.0:1788201389.585036:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d59a8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x41e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.585057:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d59a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x41e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.585249:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d59a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x41e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.585262:0:16721:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d59a8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x41e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.585270:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d59a8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x41e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.585276:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d59a8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x41e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.585640:0:16721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201389.585673:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d59a1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x41e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.585681:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d59a1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x41e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.585688:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d59a1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x41e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.585696:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.585701:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d59a1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x41e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.585709:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d59a1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x41e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.585724:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x41e:0x0].0x0 (ffff9e03c33ed300) 00010000:00010000:2.0:1788201389.585727:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201389.585733:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d59a1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x41e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.585746:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d59a1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x41e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.585772:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5993 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.585778:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5993 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.585785:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5993 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.585790:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.585793:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5993 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.585799:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5993 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.585807:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:2.0:1788201389.585810:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.585813:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5993 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.585820:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5993 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201389.585843:0:16721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f20d0937 reply state 00000000243ae1d6 transno 17179869271 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d599a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x8a6b29db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.585864:0:16721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201389.585992:0:16721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17859:x1875064442746752:12345-192.168.201.30@tcp:36:rm.0 Request processed in 4950us (5145us total) trans 17179869271 rc 0/0 00000100:00100000:2.0:1788201389.586003:0:16721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 88 00010000:00010000:0.0:1788201389.590101:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201389.590121:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d59a8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x41e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.590136:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201389.590141:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d59a8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x41e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.590201:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d59a8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x41e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.590227:0:7645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x41e:0x0].0x0 (ffff9e03c33ed300) 00010000:00010000:0.0:1788201389.590230:0:7645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201389.590235:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d59a8 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x41e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.590241:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d59a8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x41e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.590266:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.590268:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.590269:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.594578:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d599a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x8a6b29db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.594602:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d599a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x8a6b29db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.594611:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d599a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x8a6b29db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.594618:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201389.594624:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d599a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x8a6b29db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.594633:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d599a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x8a6b29db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.594653:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x8a6b29db (ffff9e03c33edf00) 00010000:00010000:0.0:1788201389.594656:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201389.594661:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d599a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x8a6b29db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.594669:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d599a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x8a6b29db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.594781:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201389.594904:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201389.595230:0:13451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442746880 00000100:00100000:0.0:1788201389.595244:0:13451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442746880 00000100:00100000:0.0:1788201389.595346:0:13451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4309 00000100:00100000:0.0:1788201389.595358:0:13451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2200700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:35604eb4-baf9-45be-a20a-4883a2cd8cf9+518:2360:x1875064442746880:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1788201389.595383:0:13451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201389.595409:0:13451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d59af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x463:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5820 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201389.595457:0:13451:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x463:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201389.595490:0:13451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x463:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1788201389.595496:0:13451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x463:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201389.595507:0:13451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d59af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x463:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5820 expref: 519 pid: 13451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.595527:0:13451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d59af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x463:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5820 expref: 519 pid: 13451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.595541:0:13451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc7000, rc 0) 00000100:00100000:0.0:1788201389.595616:0:13451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2200700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:35604eb4-baf9-45be-a20a-4883a2cd8cf9+519:2360:x1875064442746880:12345-192.168.201.30@tcp:101:rm.0 Request processed in 259us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201389.595625:0:13451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4309 00000100:00100000:3.0:1788201389.598708:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201389.599389:0:16720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442747264 00000100:00100000:0.0:1788201389.599404:0:16720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442747264 00000100:00100000:0.0:1788201389.599497:0:16720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 89 00000100:00100000:0.0:1788201389.599513:0:16720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:17859:x1875064442747264:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:0.0:1788201389.599592:0:16720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201389.599628:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d5396 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x40d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5381 expref: 101 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.599653:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40d:0x0].0x0 (ffff9e03c270a600) 00010000:00010000:0.0:1788201389.599667:0:16720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201389.599697:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d59b6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.599715:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d59b6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.599728:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d59b6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.599744:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d59bd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xf79fdc29 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.599752:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d59bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xf79fdc29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.599759:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d59bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xf79fdc29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.600011:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d59c4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x40d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.600020:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d59c4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x40d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.600028:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d59c4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x40d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201389.601548:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442747008 00000100:00100000:1.0:1788201389.601562:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442747008 00000100:00100000:1.0:1788201389.601634:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 898 00000100:00100000:1.0:1788201389.601647:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:2359:x1875064442747008:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:1.0:1788201389.601688:0:17128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201389.601708:0:17128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d59cb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5827 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.601767:0:17128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d59d2 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.601781:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d59d2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.601794:0:17128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d59d2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.601809:0:17128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129400/0x9383f985bc4d59d9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x40a:0x0].0x2def06d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.601817:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129400/0x9383f985bc4d59d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x2def06d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.601839:0:17128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129400/0x9383f985bc4d59d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x2def06d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.601904:0:17128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d59d2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.601917:0:17128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d59d2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.601924:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d59d2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.601931:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201389.601936:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d59d2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.601944:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d59d2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.601957:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:1.0:1788201389.601960:0:17128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201389.601965:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d59d2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.601972:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d59d2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.601986:0:17128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129400/0x9383f985bc4d59d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x2def06d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.601992:0:17128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129400/0x9383f985bc4d59d9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x2def06d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.601997:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129400/0x9383f985bc4d59d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x2def06d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.602002:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201389.602005:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129400/0x9383f985bc4d59d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x2def06d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.602010:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129400/0x9383f985bc4d59d9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x2def06d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.602017:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x2def06d9 (ffff9e03c23c1f00) 00010000:00010000:1.0:1788201389.602019:0:17128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201389.602022:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129400/0x9383f985bc4d59d9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x40a:0x0].0x2def06d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.602027:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129400/0x9383f985bc4d59d9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x40a:0x0].0x2def06d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.602058:0:17128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d59cb lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5827 expref: 102 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.602068:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:1.0:1788201389.602071:0:17128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201389.602074:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d59cb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5827 expref: 102 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.602083:0:17128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04ff128a00, rc -2) 00000100:00100000:1.0:1788201389.602189:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:2359:x1875064442747008:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 544us (7285us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201389.602199:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 898 00000040:00080000:2.0:1788201389.604747:0:16720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].11, 64 off8896 00010000:00010000:2.0:1788201389.604931:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d59e0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.604953:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d59e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.604967:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d59e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.604977:0:16720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d59e0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x40d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.604984:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d59e0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x40d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.604991:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d59e0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.605064:0:16720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201389.605097:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d59c4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x40d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.605103:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d59c4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x40d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.605110:0:16720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d59c4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x40d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.605118:0:16720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.605124:0:16720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d59c4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x40d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.605132:0:16720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d59c4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x40d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.605145:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40d:0x0].0x0 (ffff9e04d82b6600) 00010000:00010000:2.0:1788201389.605158:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201389.605164:0:16720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d59c4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x40d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.605170:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d59c4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x40d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.605196:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d59b6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.605203:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d59b6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.605208:0:16720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d59b6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.605213:0:16720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.605216:0:16720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d59b6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.605222:0:16720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d59b6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.605235:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:2.0:1788201389.605237:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.605240:0:16720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d59b6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.605246:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d59b6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201389.605257:0:16720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003346ceaa reply state 00000000fe594b69 transno 17179869272 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d59bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xf79fdc29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.605267:0:16720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201389.605419:0:16720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17859:x1875064442747264:12345-192.168.201.30@tcp:36:rm.0 Request processed in 5905us (6719us total) trans 17179869272 rc 0/0 00000100:00100000:2.0:1788201389.605441:0:16720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 89 00010000:00010000:0.0:1788201389.606047:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201389.606058:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d59e0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.606065:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201389.606070:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d59e0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.606082:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d59e0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.606095:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40d:0x0].0x0 (ffff9e04d82b6600) 00010000:00010000:0.0:1788201389.606097:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201389.606101:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d59e0 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x40d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.606107:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d59e0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.606129:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.606131:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.606133:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201389.608102:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d59bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xf79fdc29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.608123:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d59bd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xf79fdc29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.608132:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d59bd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xf79fdc29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.608139:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201389.608144:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d59bd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xf79fdc29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.608162:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d59bd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xf79fdc29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.608180:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0xf79fdc29 (ffff9e04d82b6b00) 00010000:00010000:1.0:1788201389.608183:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201389.608188:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d59bd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xf79fdc29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.608194:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d59bd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xf79fdc29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201389.612663:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201389.612722:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442747520 00000100:00100000:2.0:1788201389.612735:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442747520 00000100:00100000:2.0:1788201389.612813:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 90 00000100:00100000:2.0:1788201389.612835:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f53e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:17859:x1875064442747520:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1788201389.612940:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201389.612974:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ee00/0x9383f985bc4d560c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x41f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53ff expref: 101 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.612996:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x41f:0x0].0x0 (ffff9e03c2ac6100) 00010000:00010000:2.0:1788201389.613011:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201389.613040:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d59e7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.613061:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d59e7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.613072:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d59e7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.613090:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d59ee lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x7e4d6cfc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.613098:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d59ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x7e4d6cfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.613105:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d59ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x7e4d6cfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.613252:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d59f5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x41f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.613261:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d59f5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x41f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.613268:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d59f5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x41f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201389.614497:0:17130:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].12, 64 off8960 00010000:00010000:3.0:1788201389.614585:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d59fc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x41f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.614597:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d59fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x41f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.614610:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d59fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x41f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.614616:0:17130:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d59fc lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x41f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.614621:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d59fc lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x41f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.614625:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d59fc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x41f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.614641:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201389.614662:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d59f5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x41f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.614666:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d59f5 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x41f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.614667:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201389.614670:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d59f5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x41f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.614678:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d59fc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x41f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.614678:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201389.614684:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d59f5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x41f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.614693:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201389.614695:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d59f5 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x41f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.614699:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d59fc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x41f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.614703:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x41f:0x0].0x0 (ffff9e03c33ed500) 00010000:00010000:3.0:1788201389.614709:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201389.614714:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d59f5 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x41f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.614715:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d59fc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x41f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.614721:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d59f5 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x41f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.614735:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x41f:0x0].0x0 (ffff9e03c33ed500) 00010000:00010000:0.0:1788201389.614743:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201389.614747:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d59fc lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x41f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.614754:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d59fc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x41f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.614756:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d59e7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.614771:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d59e7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.614776:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d59e7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.614779:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201389.614781:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d59e7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.614785:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d59e7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.614786:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.614791:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201389.614793:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:0.0:1788201389.614795:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201389.614796:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.614799:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d59e7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.614803:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d59e7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201389.614811:0:17130:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003078c3ea reply state 000000000679bb14 transno 17179869273 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d59ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x7e4d6cfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201389.614822:0:17130:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201389.614938:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f53e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17859:x1875064442747520:12345-192.168.201.30@tcp:36:rm.0 Request processed in 2105us (2287us total) trans 17179869273 rc 0/0 00000100:00100000:3.0:1788201389.614947:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 90 00010000:00010000:0.0:1788201389.617704:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d59ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x7e4d6cfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.617725:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d59ee lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x7e4d6cfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.617735:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d59ee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x7e4d6cfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.617743:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201389.617748:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d59ee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x7e4d6cfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.617757:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d59ee lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x7e4d6cfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.617777:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x7e4d6cfc (ffff9e03c33ed400) 00010000:00010000:0.0:1788201389.617781:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201389.617786:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d59ee lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x7e4d6cfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.617794:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d59ee lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x7e4d6cfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201389.624566:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201389.624676:0:16721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442747776 00000100:00100000:2.0:1788201389.624688:0:16721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442747776 00000100:00100000:2.0:1788201389.624753:0:16721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 91 00000100:00100000:2.0:1788201389.624762:0:16721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f53e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:17859:x1875064442747776:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1788201389.624830:0:16721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201389.624872:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d562f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x420:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5406 expref: 101 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.624893:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x420:0x0].0x0 (ffff9e03c2fc5600) 00010000:00010000:2.0:1788201389.624903:0:16721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201389.624928:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d5a03 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.624940:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d5a03 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.624947:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d5a03 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.625032:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d5a0a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xa11bb556 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.625040:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d5a0a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xa11bb556 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.625046:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d5a0a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xa11bb556 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.625183:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5a11 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x420:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.625191:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5a11 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x420:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.625198:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5a11 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x420:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201389.626423:0:16721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].12, 64 off8960 00010000:00010000:2.0:1788201389.626730:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5a18 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x420:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.626745:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5a18 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x420:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.626755:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5a18 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x420:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.626765:0:16721:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5a18 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x420:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.626772:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5a18 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x420:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.626780:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5a18 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x420:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.626805:0:16721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201389.626828:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5a11 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x420:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.626832:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5a11 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x420:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.626836:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5a11 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x420:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.626840:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.626843:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5a11 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x420:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.626860:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5a11 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x420:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.626873:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x420:0x0].0x0 (ffff9e03c33eda00) 00010000:00010000:2.0:1788201389.626876:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201389.626882:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5a11 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x420:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.626889:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5a11 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x420:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.626913:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d5a03 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.626919:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201389.626920:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d5a03 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.626931:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5a18 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x420:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.626931:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d5a03 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.626950:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.626956:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d5a03 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.626959:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201389.626966:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5a18 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x420:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.626968:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d5a03 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.626981:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5a18 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x420:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.626985:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:2.0:1788201389.626992:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.626996:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d5a03 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.627000:0:7645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x420:0x0].0x0 (ffff9e03c33eda00) 00010000:00010000:0.0:1788201389.627006:0:7645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788201389.627006:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d5a03 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.627010:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5a18 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x420:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.627026:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5a18 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x420:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201389.627040:0:16721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000076a899a9 reply state 0000000071fd3427 transno 17179869274 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d5a0a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xa11bb556 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.627048:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.627051:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201389.627054:0:16721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201389.627055:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201389.627171:0:16721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f53e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17859:x1875064442747776:12345-192.168.201.30@tcp:36:rm.0 Request processed in 2404us (2613us total) trans 17179869274 rc 0/0 00000100:00100000:2.0:1788201389.627181:0:16721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 91 00010000:00010000:1.0:1788201389.630987:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d5a0a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xa11bb556 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.631011:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d5a0a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xa11bb556 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.631020:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d5a0a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xa11bb556 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.631027:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201389.631033:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d5a0a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xa11bb556 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.631045:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d5a0a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xa11bb556 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.631067:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0xa11bb556 (ffff9e03c33ed100) 00010000:00010000:1.0:1788201389.631070:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201389.631076:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d5a0a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xa11bb556 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.631083:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d5a0a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xa11bb556 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201389.632938:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201389.633075:0:16720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442748032 00000100:00100000:2.0:1788201389.633089:0:16720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442748032 00000100:00100000:2.0:1788201389.633146:0:16720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 92 00000100:00100000:2.0:1788201389.633156:0:16720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f53e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:17859:x1875064442748032:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1788201389.633223:0:16720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201389.633248:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4c00/0x9383f985bc4d5652 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x421:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c540d expref: 101 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.633265:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x421:0x0].0x0 (ffff9e03c316f600) 00010000:00010000:2.0:1788201389.633274:0:16720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201389.633335:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5a1f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.633404:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5a1f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.633414:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5a1f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.633427:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d5a26 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xc3e9fdaf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.633435:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d5a26 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xc3e9fdaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.633439:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d5a26 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xc3e9fdaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.633652:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d5a2d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x421:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.633658:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d5a2d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x421:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.633662:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d5a2d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x421:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201389.634264:0:16720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].13, 64 off9024 00010000:00010000:2.0:1788201389.634358:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d5a34 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x421:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.634367:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d5a34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x421:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.634375:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d5a34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x421:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.634382:0:16720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d5a34 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x421:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.634387:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d5a34 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x421:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.634391:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d5a34 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x421:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.634411:0:16720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201389.634433:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d5a2d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x421:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.634437:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d5a2d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x421:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.634441:0:16720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d5a2d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x421:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.634446:0:16720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.634449:0:16720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d5a2d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x421:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.634454:0:16720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d5a2d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x421:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.634462:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x421:0x0].0x0 (ffff9e03c33ed700) 00010000:00010000:2.0:1788201389.634465:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201389.634468:0:16720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d5a2d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x421:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.634474:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d5a2d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x421:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.634503:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5a1f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.634510:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5a1f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.634518:0:16720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5a1f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.634522:0:16720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.634524:0:16720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5a1f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.634527:0:16720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5a1f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.634532:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:2.0:1788201389.634533:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.634535:0:16720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5a1f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.634538:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5a1f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201389.634546:0:16720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad983aab reply state 00000000d3c922a1 transno 17179869275 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d5a26 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xc3e9fdaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.634554:0:16720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201389.634570:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201389.634580:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d5a34 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x421:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.634590:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b28800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201389.634595:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d5a34 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x421:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.634603:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d5a34 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x421:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.634615:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x421:0x0].0x0 (ffff9e03c33ed700) 00010000:00010000:0.0:1788201389.634619:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201389.634622:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d5a34 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x421:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.634629:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b28800/0x9383f985bc4d5a34 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x421:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.634648:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.634650:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.634652:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201389.634670:0:16720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f53e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17859:x1875064442748032:12345-192.168.201.30@tcp:36:rm.0 Request processed in 1510us (1743us total) trans 17179869275 rc 0/0 00000100:00100000:2.0:1788201389.634679:0:16720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 92 00000100:00100000:3.0:1788201389.637671:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201389.638412:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442748288 00000100:00100000:2.0:1788201389.638428:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442748288 00000100:00100000:2.0:1788201389.638519:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93 00000100:00100000:2.0:1788201389.638532:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f53e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17859:x1875064442748288:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1788201389.638615:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201389.638650:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4e00/0x9383f985bc4d5675 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x422:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5414 expref: 102 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.638676:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x422:0x0].0x0 (ffff9e03c316f100) 00010000:00010000:2.0:1788201389.638689:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201389.638720:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29600/0x9383f985bc4d5a3b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.638746:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29600/0x9383f985bc4d5a3b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.638757:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29600/0x9383f985bc4d5a3b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.639102:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d5a42 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xe6b84609 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.639113:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d5a42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xe6b84609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.639120:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d5a42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xe6b84609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.639251:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5a49 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x422:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.639260:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5a49 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x422:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.639266:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5a49 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x422:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201389.640511:0:17130:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].13, 64 off9024 00010000:00010000:2.0:1788201389.640596:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d5a50 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x422:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.640611:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d5a50 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x422:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.640621:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d5a50 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x422:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.640630:0:17130:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d5a50 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x422:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.640636:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d5a50 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x422:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.640643:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d5a50 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x422:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.640679:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201389.640711:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5a49 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x422:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.640717:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5a49 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x422:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.640723:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5a49 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x422:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.640741:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.640746:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5a49 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x422:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.640755:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5a49 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x422:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.640926:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201389.640936:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d5a50 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x422:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.641349:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d5a26 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xc3e9fdaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.641367:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d5a26 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xc3e9fdaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.641374:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d5a26 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xc3e9fdaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.641380:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201389.641383:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d5a26 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xc3e9fdaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.641390:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d5a26 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xc3e9fdaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.641401:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0xc3e9fdaf (ffff9e03c33ed000) 00010000:00010000:0.0:1788201389.641405:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201389.641411:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d5a26 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xc3e9fdaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.641417:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d5a26 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xc3e9fdaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.643508:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201389.643525:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d5a50 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x422:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.643541:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d5a50 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x422:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.643562:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x422:0x0].0x0 (ffff9e03c33ed500) 00010000:00010000:1.0:1788201389.643565:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201389.643570:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d5a50 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x422:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.643578:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d5a50 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x422:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.643598:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201389.643602:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201389.643606:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201389.643686:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x422:0x0].0x0 (ffff9e03c33ed500) 00010000:00010000:2.0:1788201389.643691:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201389.643697:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5a49 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x422:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.643705:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5a49 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x422:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.643752:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29600/0x9383f985bc4d5a3b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.643761:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29600/0x9383f985bc4d5a3b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.643877:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29600/0x9383f985bc4d5a3b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.643882:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b29600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.643884:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29600/0x9383f985bc4d5a3b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.643889:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29600/0x9383f985bc4d5a3b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.643897:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:2.0:1788201389.643898:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.643900:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29600/0x9383f985bc4d5a3b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.643908:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0501b29600/0x9383f985bc4d5a3b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201389.643916:0:17130:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000007e99034 reply state 0000000096742dfe transno 17179869276 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d5a42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xe6b84609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.643926:0:17130:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201389.644231:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f53e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17859:x1875064442748288:12345-192.168.201.30@tcp:36:rm.0 Request processed in 5695us (6568us total) trans 17179869276 rc 0/0 00000100:00100000:2.0:1788201389.644242:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93 00010000:00010000:1.0:1788201389.648197:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d5a42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xe6b84609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.648222:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d5a42 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xe6b84609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.648232:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d5a42 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xe6b84609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.648239:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201389.648245:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d5a42 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xe6b84609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.648254:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d5a42 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xe6b84609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.648277:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0xe6b84609 (ffff9e03c33ed400) 00010000:00010000:1.0:1788201389.648281:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201389.648287:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d5a42 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xe6b84609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.648337:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d5a42 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xe6b84609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201389.653588:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201389.653975:0:16721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442748544 00000100:00100000:2.0:1788201389.653990:0:16721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442748544 00000100:00100000:2.0:1788201389.654058:0:16721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94 00000100:00100000:2.0:1788201389.654070:0:16721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f53e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:17859:x1875064442748544:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1788201389.654147:0:16721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201389.654180:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d5698 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x423:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c541b expref: 101 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.654205:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x423:0x0].0x0 (ffff9e03c2ac6500) 00010000:00010000:2.0:1788201389.654220:0:16721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201389.654249:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5a57 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.654264:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5a57 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.654275:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5a57 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.654311:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d5a5e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x9868e63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.654319:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d5a5e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x9868e63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.654326:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d5a5e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x9868e63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.654480:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d5a65 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x423:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.654490:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d5a65 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x423:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.654498:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d5a65 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x423:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201389.655118:0:16721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].14, 64 off9088 00010000:00010000:2.0:1788201389.655183:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d5a6c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x423:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.655194:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d5a6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x423:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.655202:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d5a6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x423:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.655211:0:16721:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d5a6c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x423:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.655219:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d5a6c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x423:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.655226:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d5a6c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x423:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.655254:0:16721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201389.655279:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d5a65 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x423:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.655286:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d5a65 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x423:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.655345:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d5a65 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x423:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.655353:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.655358:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d5a65 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x423:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.655367:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d5a65 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x423:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.655376:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x423:0x0].0x0 (ffff9e03c33ed300) 00010000:00010000:2.0:1788201389.655380:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201389.655384:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d5a65 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x423:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.655390:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031a00/0x9383f985bc4d5a65 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x423:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.655408:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5a57 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.655419:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5a57 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.655424:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5a57 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.655429:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.655432:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5a57 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.655437:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5a57 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.655446:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:2.0:1788201389.655447:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.655450:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5a57 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.655456:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5a57 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201389.655467:0:16721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000915b8e5e reply state 0000000072a8353b transno 17179869277 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d5a5e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x9868e63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.655476:0:16721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201389.655586:0:16721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f53e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17859:x1875064442748544:12345-192.168.201.30@tcp:36:rm.0 Request processed in 1513us (2011us total) trans 17179869277 rc 0/0 00000100:00100000:2.0:1788201389.655595:0:16721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94 00010000:00010000:0.0:1788201389.655620:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201389.655631:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d5a6c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x423:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.655640:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201389.655644:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d5a6c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x423:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.655651:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d5a6c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x423:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.655661:0:7645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x423:0x0].0x0 (ffff9e03c33ed300) 00010000:00010000:0.0:1788201389.655664:0:7645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201389.655667:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d5a6c lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x423:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.655674:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d5a6c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x423:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.655688:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.655690:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.655692:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.659518:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d5a5e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x9868e63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.659546:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d5a5e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x9868e63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.659555:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d5a5e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x9868e63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.659568:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201389.659574:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d5a5e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x9868e63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.659583:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d5a5e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x9868e63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.659604:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x9868e63 (ffff9e03c33edf00) 00010000:00010000:0.0:1788201389.659608:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201389.659614:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d5a5e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x9868e63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.659622:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031400/0x9383f985bc4d5a5e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x9868e63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201389.660205:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201389.660655:0:16720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442748800 00000100:00100000:2.0:1788201389.660670:0:16720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442748800 00000100:00100000:2.0:1788201389.660752:0:16720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 95 00000100:00100000:2.0:1788201389.660774:0:16720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f53e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:17859:x1875064442748800:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1788201389.660857:0:16720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201389.660887:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4400/0x9383f985bc4d56bb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x424:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5422 expref: 101 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.660909:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x424:0x0].0x0 (ffff9e03c316fd00) 00010000:00010000:2.0:1788201389.660920:0:16720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201389.660961:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5a73 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.661406:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5a73 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.661419:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5a73 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.661440:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5a7a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x2c54d6bd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.661447:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5a7a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x2c54d6bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.661455:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5a7a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x2c54d6bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.661601:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ee00/0x9383f985bc4d5a81 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x424:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.661610:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ee00/0x9383f985bc4d5a81 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x424:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.661621:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ee00/0x9383f985bc4d5a81 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x424:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201389.662509:0:16720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].14, 64 off9088 00010000:00010000:2.0:1788201389.662583:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5a88 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x424:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.662595:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5a88 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x424:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.662603:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5a88 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x424:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.662611:0:16720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5a88 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x424:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.662617:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5a88 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x424:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.662624:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5a88 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x424:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.662698:0:16720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201389.662872:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ee00/0x9383f985bc4d5a81 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x424:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.662881:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ee00/0x9383f985bc4d5a81 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x424:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.662888:0:16720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ee00/0x9383f985bc4d5a81 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x424:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.662900:0:16720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131ee00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.662905:0:16720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ee00/0x9383f985bc4d5a81 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x424:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.662913:0:16720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ee00/0x9383f985bc4d5a81 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x424:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.662924:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x424:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:2.0:1788201389.662927:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201389.662932:0:16720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ee00/0x9383f985bc4d5a81 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x424:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.662938:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131ee00/0x9383f985bc4d5a81 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x424:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.662966:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5a73 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.663024:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5a73 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.663030:0:16720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5a73 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.663036:0:16720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.663039:0:16720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5a73 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.663045:0:16720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5a73 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.663057:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:2.0:1788201389.663060:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.663063:0:16720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5a73 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.663069:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5a73 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201389.663079:0:16720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af230eb5 reply state 0000000046882645 transno 17179869278 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5a7a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x2c54d6bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.663088:0:16720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201389.663199:0:16720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f53e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17859:x1875064442748800:12345-192.168.201.30@tcp:36:rm.0 Request processed in 2433us (2997us total) trans 17179869278 rc 0/0 00000100:00100000:2.0:1788201389.663208:0:16720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 95 00000100:00100000:3.0:1788201389.667228:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201389.667273:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442749056 00000100:00100000:3.0:1788201389.667286:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442749056 00000100:00100000:3.0:1788201389.667379:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 96 00000100:00100000:3.0:1788201389.667392:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f53e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17859:x1875064442749056:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:3.0:1788201389.667487:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201389.667523:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4200/0x9383f985bc4d56de lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x425:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5429 expref: 102 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.667548:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x425:0x0].0x0 (ffff9e03c316f300) 00010000:00010000:3.0:1788201389.667562:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201389.667592:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5a8f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.667608:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5a8f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.667619:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5a8f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.667636:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5a96 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x4f231f16 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.667644:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5a96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x4f231f16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.667651:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5a96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x4f231f16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.668078:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201389.668089:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5a88 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x424:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.668098:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131e400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201389.668103:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5a88 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x424:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.668113:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5a88 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x424:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.668124:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x424:0x0].0x0 (ffff9e03c33edd00) 00010000:00010000:0.0:1788201389.668127:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201389.668132:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5a88 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x424:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.668142:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5a88 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x424:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.668161:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.668163:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.668165:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201389.668235:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5a7a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x2c54d6bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.668245:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5a7a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x2c54d6bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.668252:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5a7a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x2c54d6bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.668258:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.668263:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5a7a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x2c54d6bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.668269:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5a7a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x2c54d6bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.668284:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x2c54d6bd (ffff9e03c33ed500) 00010000:00010000:2.0:1788201389.668287:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.668290:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5a7a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x2c54d6bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.668441:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5a7a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x2c54d6bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.668618:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5a9d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x425:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.668627:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5a9d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x425:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.668633:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5a9d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x425:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201389.669382:0:17130:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].15, 64 off9152 00010000:00010000:3.0:1788201389.669585:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5aa4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x425:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.669595:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5aa4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x425:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.669603:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5aa4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x425:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.669609:0:17130:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5aa4 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x425:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.669613:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5aa4 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x425:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.669618:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5aa4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x425:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.669691:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201389.669716:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5a9d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x425:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.669720:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5a9d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x425:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.669724:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5a9d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x425:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.669728:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201389.669731:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5a9d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x425:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.669738:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5a9d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x425:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.669748:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x425:0x0].0x0 (ffff9e04d9f56200) 00010000:00010000:3.0:1788201389.669751:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201389.669754:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5a9d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x425:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.669760:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5a9d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x425:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.669790:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5a8f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.669800:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5a8f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.669804:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5a8f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.669806:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201389.669808:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5a8f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.669811:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5a8f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.669816:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:3.0:1788201389.669817:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.669819:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5a8f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.669823:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5a8f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201389.669830:0:17130:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c6dd2eb reply state 000000004799ac71 transno 17179869279 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5a96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x4f231f16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201389.669837:0:17130:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201389.669882:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201389.669890:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5aa4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x425:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.669896:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201389.669900:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5aa4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x425:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.669907:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5aa4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x425:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.669916:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x425:0x0].0x0 (ffff9e04d9f56200) 00010000:00010000:1.0:1788201389.669918:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201389.669921:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5aa4 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x425:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.669926:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5aa4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x425:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.669940:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201389.669942:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201389.669943:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201389.672809:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f53e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17859:x1875064442749056:12345-192.168.201.30@tcp:36:rm.0 Request processed in 5397us (5574us total) trans 17179869279 rc 0/0 00000100:00100000:3.0:1788201389.672827:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 96 00010000:00010000:2.0:1788201389.672974:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5a96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x4f231f16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.672987:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5a96 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x4f231f16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.672995:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5a96 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x4f231f16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.673003:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.673009:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5a96 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x4f231f16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.673018:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5a96 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x4f231f16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.673037:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x4f231f16 (ffff9e04d9f56300) 00010000:00010000:2.0:1788201389.673041:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.673046:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5a96 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x4f231f16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.673053:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5a96 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x4f231f16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201389.673134:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201389.673214:0:16721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442749312 00000100:00100000:2.0:1788201389.673227:0:16721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442749312 00000100:00100000:2.0:1788201389.673592:0:16721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 97 00000100:00100000:2.0:1788201389.673606:0:16721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:17859:x1875064442749312:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1788201389.673685:0:16721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201389.673707:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d5701 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x426:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5430 expref: 101 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.673718:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x426:0x0].0x0 (ffff9e03c2ac6a00) 00010000:00010000:2.0:1788201389.673724:0:16721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201389.673752:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5aab lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.673824:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5aab lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.673835:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5aab lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.673860:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5ab2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x71f16770 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.673868:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5ab2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x71f16770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.673875:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5ab2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x71f16770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.674128:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d5ab9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x426:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.674137:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d5ab9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x426:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.674143:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d5ab9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x426:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201389.675194:0:16721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].15, 64 off9152 00010000:00010000:2.0:1788201389.675265:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d5ac0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x426:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.675276:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d5ac0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x426:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.675282:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d5ac0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x426:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.675288:0:16721:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d5ac0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x426:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.675325:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d5ac0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x426:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.675334:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d5ac0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x426:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.675358:0:16721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201389.675385:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d5ab9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x426:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.675393:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d5ab9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x426:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.675404:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d5ab9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x426:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.675411:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131fa00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.675416:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d5ab9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x426:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.675425:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d5ab9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x426:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.675435:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x426:0x0].0x0 (ffff9e03c33edc00) 00010000:00010000:2.0:1788201389.675437:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201389.675441:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d5ab9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x426:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.675446:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d5ab9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x426:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.675544:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201389.675553:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d5ac0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x426:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.675560:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131f200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201389.675564:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d5ac0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x426:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.675570:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d5ac0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x426:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.675579:0:7645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x426:0x0].0x0 (ffff9e03c33edc00) 00010000:00010000:0.0:1788201389.675581:0:7645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201389.675584:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d5ac0 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x426:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.675589:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d5ac0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x426:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.675603:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.675605:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.675607:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201389.675639:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5aab lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.675646:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5aab lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.675651:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5aab lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.675657:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131fc00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.675660:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5aab lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.675669:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5aab lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.675678:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:2.0:1788201389.675681:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.675684:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5aab lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.675689:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5aab lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201389.675698:0:16721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b997b8a4 reply state 00000000b54644e5 transno 17179869280 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5ab2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x71f16770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.675705:0:16721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201389.675913:0:16721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17859:x1875064442749312:12345-192.168.201.30@tcp:36:rm.0 Request processed in 2306us (2775us total) trans 17179869280 rc 0/0 00000100:00100000:2.0:1788201389.675920:0:16721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 97 00000100:00100000:2.0:1788201389.683073:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1788201389.683497:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5ab2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x71f16770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.683517:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5ab2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x71f16770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.683526:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5ab2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x71f16770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.683534:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131f400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201389.683540:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5ab2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x71f16770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.683550:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5ab2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x71f16770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.683572:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x71f16770 (ffff9e03c33ed200) 00010000:00010000:3.0:1788201389.683576:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.683581:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5ab2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x71f16770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.683588:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5ab2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x71f16770 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201389.683690:0:16720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442749568 00000100:00100000:0.0:1788201389.683705:0:16720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442749568 00000100:00100000:0.0:1788201389.683789:0:16720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 98 00000100:00100000:0.0:1788201389.683802:0:16720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:17859:x1875064442749568:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:0.0:1788201389.683886:0:16720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201389.683909:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04f9ce4a00/0x9383f985bc4d5724 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x427:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5437 expref: 101 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.683925:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x427:0x0].0x0 (ffff9e03c316fb00) 00010000:00010000:0.0:1788201389.683933:0:16720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201389.684112:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d5ac7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.684128:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d5ac7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.684138:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d5ac7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.684155:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d5ace lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x94bfafca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.684161:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d5ace lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x94bfafca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.684167:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d5ace lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x94bfafca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.684335:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d5ad5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x427:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.684343:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d5ad5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x427:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.684352:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d5ad5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x427:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201389.685742:0:16720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].16, 64 off9216 00010000:00010000:0.0:1788201389.685821:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d5adc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x427:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.685836:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d5adc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x427:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.685858:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d5adc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x427:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.685868:0:16720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d5adc lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x427:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.685876:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d5adc lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x427:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.685883:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d5adc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x427:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.685959:0:16720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201389.686140:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d5ad5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x427:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.686148:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d5ad5 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x427:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.686154:0:16720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d5ad5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x427:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.686167:0:16720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201389.686172:0:16720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d5ad5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x427:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.686181:0:16720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d5ad5 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x427:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.686193:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x427:0x0].0x0 (ffff9e04d82b6e00) 00010000:00010000:0.0:1788201389.686196:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201389.686200:0:16720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d5ad5 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x427:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.686206:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d5ad5 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x427:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.686228:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d5ac7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.686234:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d5ac7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.686240:0:16720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d5ac7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.686245:0:16720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201389.686248:0:16720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d5ac7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.686254:0:16720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d5ac7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.686267:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:0.0:1788201389.686270:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201389.686273:0:16720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d5ac7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.686278:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d5ac7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201389.686287:0:16720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000074f4c639 reply state 000000002987e242 transno 17179869281 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d5ace lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x94bfafca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201389.686322:0:16720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201389.686432:0:16720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17859:x1875064442749568:12345-192.168.201.30@tcp:36:rm.0 Request processed in 2628us (3368us total) trans 17179869281 rc 0/0 00000100:00100000:0.0:1788201389.686441:0:16720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 98 00010000:00010000:3.0:1788201389.690147:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201389.690166:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d5adc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x427:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.690182:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201389.690187:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d5adc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x427:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.690198:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d5adc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x427:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.690222:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x427:0x0].0x0 (ffff9e04d82b6e00) 00010000:00010000:3.0:1788201389.690226:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788201389.690232:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d5adc lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x427:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.690239:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d5adc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x427:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.690268:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201389.690271:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201389.690273:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201389.690770:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d5ace lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x94bfafca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.690784:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d5ace lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x94bfafca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.690792:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d5ace lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x94bfafca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.690798:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.690803:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d5ace lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x94bfafca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.690811:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d5ace lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x94bfafca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.690821:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x94bfafca (ffff9e04d82b6600) 00010000:00010000:2.0:1788201389.690825:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.690828:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d5ace lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x94bfafca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.690834:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d5ace lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x94bfafca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.692202:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201389.692525:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442749824 00000100:00100000:3.0:1788201389.692539:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442749824 00000100:00100000:3.0:1788201389.692610:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 99 00000100:00100000:3.0:1788201389.692623:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:17859:x1875064442749824:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:3.0:1788201389.692702:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201389.692744:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3800/0x9383f985bc4d5747 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x428:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c543e expref: 101 pid: 16720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.692764:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x428:0x0].0x0 (ffff9e05020e0d00) 00010000:00010000:3.0:1788201389.692774:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201389.692802:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5ae3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.692819:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5ae3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.692830:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5ae3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.692861:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5aea lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xb78df823 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.692869:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5aea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xb78df823 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.692876:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5aea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xb78df823 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.693258:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5af1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x428:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.693268:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5af1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x428:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.693276:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5af1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x428:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201389.694203:0:17130:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].16, 64 off9216 00010000:00010000:3.0:1788201389.694277:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5af8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x428:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.694288:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5af8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x428:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.694564:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5af8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x428:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.694573:0:17130:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5af8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x428:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.694579:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5af8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x428:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.694587:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5af8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x428:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.694613:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201389.694641:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5af1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x428:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.694648:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5af1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x428:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.694656:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5af1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x428:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.694662:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201389.694667:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5af1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x428:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.694676:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5af1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x428:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.694687:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x428:0x0].0x0 (ffff9e04d9f56e00) 00010000:00010000:3.0:1788201389.694690:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201389.694694:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5af1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x428:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.694701:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3200/0x9383f985bc4d5af1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x428:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.694719:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5ae3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.694931:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201389.694941:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5af8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x428:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.694955:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201389.694959:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5af8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x428:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.694966:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5af8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x428:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.694984:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x428:0x0].0x0 (ffff9e04d9f56e00) 00010000:00010000:1.0:1788201389.694987:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201389.694990:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5af8 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x428:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.694996:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2c00/0x9383f985bc4d5af8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x428:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.695013:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201389.695015:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201389.695017:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201389.695126:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5ae3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.695133:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5ae3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.695138:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201389.695140:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5ae3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.695146:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5ae3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.695153:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:3.0:1788201389.695155:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.695158:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5ae3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.695163:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5ae3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201389.695174:0:17130:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000028dfb1da reply state 00000000b7ddd1e9 transno 17179869282 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5aea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xb78df823 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201389.695182:0:17130:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201389.695376:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17859:x1875064442749824:12345-192.168.201.30@tcp:36:rm.0 Request processed in 2749us (3179us total) trans 17179869282 rc 0/0 00000100:00100000:3.0:1788201389.695387:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 99 00010000:00010000:3.0:1788201389.701086:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5aea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xb78df823 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.701115:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5aea lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xb78df823 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.701123:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5aea lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xb78df823 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.701129:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201389.701134:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5aea lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xb78df823 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.701142:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5aea lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xb78df823 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.701162:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0xb78df823 (ffff9e04d9f56c00) 00010000:00010000:3.0:1788201389.701166:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.701171:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5aea lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xb78df823 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.701178:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3600/0x9383f985bc4d5aea lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xb78df823 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201389.701280:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201389.702059:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442750080 00000100:00100000:3.0:1788201389.702076:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442750080 00000100:00100000:1.0:1788201389.702156:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201389.702638:0:13442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442749952 00000100:00100000:2.0:1788201389.702645:0:13442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442749952 00000100:00100000:2.0:1788201389.702701:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4310 00000100:00100000:2.0:1788201389.702713:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:2359:x1875064442749952:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1788201389.702749:0:13442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201389.702778:0:13442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000270dcb9a/0x9383f985bc4d5aff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x463:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c582e expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201389.702812:0:13442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x463:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201389.702839:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x463:0x0].0x0 since=664s v=(0 0) 00010000:00010000:2.0:1788201389.702844:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x463:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201389.702864:0:13442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000270dcb9a/0x9383f985bc4d5aff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x463:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c582e expref: 17 pid: 13442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.702884:0:13442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000270dcb9a/0x9383f985bc4d5aff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x463:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c582e expref: 17 pid: 13442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.702901:0:13442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c131fa00, rc 0) 00000100:00100000:2.0:1788201389.703188:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35604eb4-baf9-45be-a20a-4883a2cd8cf9+17:2359:x1875064442749952:12345-192.168.201.30@tcp:101:rm.0 Request processed in 476us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201389.703196:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4310 00000100:00100000:3.0:1788201389.703412:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 899 00000100:00100000:3.0:1788201389.703426:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:2360:x1875064442750080:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:3.0:1788201389.703608:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201389.703626:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5b06 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5835 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.703695:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d5b0d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.703710:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d5b0d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.703722:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d5b0d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.703747:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d5b14 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x40a:0x0].0xfc376092 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.703755:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d5b14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0xfc376092 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.703762:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d5b14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0xfc376092 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.703836:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d5b0d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.703844:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d5b0d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.703865:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d5b0d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.703872:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201389.703877:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d5b0d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.703889:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d5b0d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.703901:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:3.0:1788201389.703904:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.703910:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d5b0d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.703916:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2e00/0x9383f985bc4d5b0d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.703932:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d5b14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0xfc376092 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.703937:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d5b14 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0xfc376092 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.703943:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d5b14 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0xfc376092 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.704118:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201389.704124:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d5b14 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0xfc376092 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.704132:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d5b14 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0xfc376092 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.704139:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0xfc376092 (ffff9e04d9f56b00) 00010000:00010000:3.0:1788201389.704142:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.704145:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d5b14 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x40a:0x0].0xfc376092 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.704152:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d5b14 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x40a:0x0].0xfc376092 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.704191:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5b06 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5835 expref: 102 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.704202:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:3.0:1788201389.704204:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201389.704207:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5b06 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5835 expref: 102 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.704217:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2ef3e00, rc -2) 00000100:00100000:3.0:1788201389.704286:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:2360:x1875064442750080:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 864us (3012us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201389.704366:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 899 00000100:00100000:0.0:1788201389.710245:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201389.710932:0:16721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442750336 00000100:00100000:2.0:1788201389.710947:0:16721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442750336 00000100:00100000:2.0:1788201389.711189:0:16721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 100 00000100:00100000:2.0:1788201389.711203:0:16721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:17859:x1875064442750336:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1788201389.711285:0:16721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201389.711350:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c3e00/0x9383f985bc4d53b9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x40e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5388 expref: 101 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.711373:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40e:0x0].0x0 (ffff9e03c2fc5f00) 00010000:00010000:2.0:1788201389.711389:0:16721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201389.711426:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d5b1b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.711443:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d5b1b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.711697:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d5b1b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.711720:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5b22 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x24c2aa72 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.711838:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5b22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x24c2aa72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.711857:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5b22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x24c2aa72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.712123:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5b29 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x40e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.712132:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5b29 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x40e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.712141:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5b29 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x40e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201389.713193:0:16721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].17, 64 off9280 00010000:00010000:2.0:1788201389.713267:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d5b30 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.713281:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d5b30 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.713597:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d5b30 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.713610:0:16721:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d5b30 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x40e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.713618:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d5b30 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x40e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.713625:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d5b30 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.713682:0:16721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201389.713712:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5b29 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x40e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.713717:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5b29 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x40e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.713723:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5b29 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x40e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.713740:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131f400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.713745:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5b29 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x40e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.713752:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5b29 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x40e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.713765:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40e:0x0].0x0 (ffff9e03c33ed200) 00010000:00010000:2.0:1788201389.713768:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201389.713772:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5b29 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x40e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.713778:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5b29 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x40e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.713798:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d5b1b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.713804:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d5b1b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.713810:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d5b1b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.713818:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131fe00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.713821:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d5b1b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.713826:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d5b1b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.713835:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:2.0:1788201389.713837:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.713840:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d5b1b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.713854:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d5b1b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201389.713864:0:16721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d93e50d reply state 00000000e2a77824 transno 17179869283 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5b22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x24c2aa72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.713873:0:16721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201389.714015:0:16721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17859:x1875064442750336:12345-192.168.201.30@tcp:36:rm.0 Request processed in 2809us (3782us total) trans 17179869283 rc 0/0 00000100:00100000:2.0:1788201389.714025:0:16721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 100 00010000:00010000:2.0:1788201389.717065:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5b22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x24c2aa72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.717089:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5b22 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x24c2aa72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.717098:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5b22 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x24c2aa72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.717110:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131fc00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.717116:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5b22 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x24c2aa72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.717125:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5b22 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x24c2aa72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.717145:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x24c2aa72 (ffff9e03c33ed600) 00010000:00010000:2.0:1788201389.717148:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.717153:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5b22 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x24c2aa72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.717159:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d5b22 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x24c2aa72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201389.717232:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201389.717331:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442750464 00000100:00100000:2.0:1788201389.717343:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442750464 00000100:00100000:2.0:1788201389.717407:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4311 00000100:00100000:2.0:1788201389.717418:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f53e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35604eb4-baf9-45be-a20a-4883a2cd8cf9+519:2360:x1875064442750464:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1788201389.717442:0:13444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201389.717465:0:13444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5cf63c8/0x9383f985bc4d5b37 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x464:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c587b expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201389.717496:0:13444:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x464:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201389.717521:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x464:0x0].0x0 since=664s v=(0 0) 00010000:00010000:2.0:1788201389.717527:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x464:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201389.717538:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5cf63c8/0x9383f985bc4d5b37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x464:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c587b expref: 520 pid: 13444 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.717561:0:13444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e5cf63c8/0x9383f985bc4d5b37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x464:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c587b expref: 520 pid: 13444 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.717576:0:13444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c131ee00, rc 0) 00000100:00100000:2.0:1788201389.717640:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f53e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35604eb4-baf9-45be-a20a-4883a2cd8cf9+520:2360:x1875064442750464:12345-192.168.201.30@tcp:101:rm.0 Request processed in 223us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201389.717647:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4311 00010000:00010000:0.0:1788201389.718804:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201389.718814:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d5b30 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.718822:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131f200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201389.718827:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d5b30 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.718837:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d5b30 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.718861:0:7645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40e:0x0].0x0 (ffff9e03c33ed200) 00010000:00010000:0.0:1788201389.718864:0:7645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201389.718870:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d5b30 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x40e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.718877:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f200/0x9383f985bc4d5b30 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.718900:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.718903:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.718904:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201389.721175:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201389.721330:0:16720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442750720 00000100:00100000:0.0:1788201389.721341:0:16720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442750720 00000100:00100000:0.0:1788201389.721417:0:16720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 101 00000100:00100000:0.0:1788201389.721428:0:16720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f53e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:17859:x1875064442750720:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:0.0:1788201389.721524:0:16720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201389.721555:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3800/0x9383f985bc4d53dc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x40f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c538f expref: 101 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.721578:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40f:0x0].0x0 (ffff9e03c270af00) 00010000:00010000:0.0:1788201389.721589:0:16720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201389.721614:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d5b3e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.721627:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d5b3e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.721634:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d5b3e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.721646:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d5b45 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x51e578ba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.721653:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d5b45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x51e578ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.721657:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d5b45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x51e578ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.721781:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5b4c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x40f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.721785:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5b4c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x40f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.721789:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5b4c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x40f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201389.724240:0:16720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].17, 64 off9280 00010000:00010000:1.0:1788201389.724542:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129400/0x9383f985bc4d5b53 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.724563:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129400/0x9383f985bc4d5b53 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.724577:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129400/0x9383f985bc4d5b53 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.724588:0:16720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129400/0x9383f985bc4d5b53 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x40f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.724594:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129400/0x9383f985bc4d5b53 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x40f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.724602:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129400/0x9383f985bc4d5b53 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.724680:0:16720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201389.724713:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5b4c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x40f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.724719:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5b4c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x40f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.724741:0:16720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5b4c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x40f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.724749:0:16720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201389.724754:0:16720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5b4c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x40f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.724764:0:16720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5b4c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x40f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.724777:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40f:0x0].0x0 (ffff9e04d82b6600) 00010000:00010000:1.0:1788201389.724781:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201389.724786:0:16720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5b4c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x40f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.724792:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5b4c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x40f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.724815:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d5b3e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.724821:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d5b3e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.724826:0:16720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d5b3e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.724831:0:16720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201389.724834:0:16720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d5b3e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.724843:0:16720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d5b3e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.724859:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:1.0:1788201389.724861:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201389.724865:0:16720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d5b3e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.724870:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d5b3e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201389.724879:0:16720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e93b8279 reply state 000000005015ef0c transno 17179869284 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d5b45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x51e578ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201389.724889:0:16720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201389.725081:0:16720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f53e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17859:x1875064442750720:12345-192.168.201.30@tcp:36:rm.0 Request processed in 3649us (3912us total) trans 17179869284 rc 0/0 00000100:00100000:1.0:1788201389.725091:0:16720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 101 00010000:00010000:3.0:1788201389.726531:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201389.726545:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129400/0x9383f985bc4d5b53 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.726555:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201389.726559:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129400/0x9383f985bc4d5b53 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.726566:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129400/0x9383f985bc4d5b53 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.726583:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40f:0x0].0x0 (ffff9e04d82b6600) 00010000:00010000:3.0:1788201389.726586:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788201389.726589:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129400/0x9383f985bc4d5b53 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x40f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.726593:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129400/0x9383f985bc4d5b53 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.726913:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d5b45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x51e578ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.726919:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d5b45 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x51e578ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.726923:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d5b45 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x51e578ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.726927:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201389.726930:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d5b45 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x51e578ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.726935:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d5b45 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x51e578ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.726944:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x51e578ba (ffff9e04d82b6500) 00010000:00010000:3.0:1788201389.726957:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.726960:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d5b45 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x51e578ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.727052:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7800/0x9383f985bc4d5b45 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x51e578ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.728738:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.728744:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.728747:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201389.729209:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201389.729345:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442750848 00000100:00100000:2.0:1788201389.729358:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442750848 00000100:00100000:2.0:1788201389.729431:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4312 00000100:00100000:2.0:1788201389.729440:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f53e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+17:2361:x1875064442750848:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1788201389.729471:0:13439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201389.729496:0:13439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000940106f/0x9383f985bc4d5b5a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x464:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5882 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201389.729529:0:13439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x464:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201389.729555:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x464:0x0].0x0 since=664s v=(0 0) 00010000:00010000:2.0:1788201389.729559:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x464:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201389.729569:0:13439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000940106f/0x9383f985bc4d5b5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x464:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5882 expref: 18 pid: 13439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.729586:0:13439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000940106f/0x9383f985bc4d5b5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x464:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5882 expref: 18 pid: 13439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.729603:0:13439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c131fc00, rc 0) 00000100:00100000:2.0:1788201389.729665:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f53e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+18:2361:x1875064442750848:12345-192.168.201.30@tcp:101:rm.0 Request processed in 226us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201389.729670:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4312 00000100:00100000:1.0:1788201389.732425:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201389.732614:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442751104 00000100:00100000:3.0:1788201389.732626:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442751104 00000100:00100000:3.0:1788201389.732685:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 102 00000100:00100000:3.0:1788201389.732694:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:17859:x1875064442751104:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:3.0:1788201389.733045:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201389.733081:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2e00/0x9383f985bc4d53ff lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x410:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5396 expref: 101 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.733103:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x410:0x0].0x0 (ffff9e03c2fc5b00) 00010000:00010000:3.0:1788201389.733117:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201389.733146:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5b61 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.733163:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5b61 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.733173:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5b61 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.733188:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5b68 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x7f084702 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.733194:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5b68 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x7f084702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.733200:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5b68 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x7f084702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.733857:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5b6f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x410:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.733870:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5b6f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x410:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.733878:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5b6f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x410:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201389.734450:0:17130:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].18, 64 off9344 00010000:00010000:2.0:1788201389.734533:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5b76 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x410:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.734545:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5b76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x410:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.734553:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5b76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x410:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.734559:0:17130:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5b76 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x410:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.734566:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5b76 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x410:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.734571:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5b76 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x410:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.734802:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201389.734826:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5b6f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x410:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.734834:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5b6f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x410:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.734840:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5b6f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x410:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.734855:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131f400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.734860:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5b6f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x410:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.734869:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5b6f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x410:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.734879:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x410:0x0].0x0 (ffff9e03c33ed300) 00010000:00010000:2.0:1788201389.734883:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201389.734888:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5b6f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x410:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.734895:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5b6f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x410:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.734912:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5b61 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.734916:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5b61 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.734923:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5b61 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.734927:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.734929:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5b61 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.734932:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5b61 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.734936:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:2.0:1788201389.734938:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.734939:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5b61 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.734942:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2000/0x9383f985bc4d5b61 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201389.734949:0:17130:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000039df143e reply state 000000006258d252 transno 17179869285 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5b68 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x7f084702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.734955:0:17130:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201389.735089:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17859:x1875064442751104:12345-192.168.201.30@tcp:36:rm.0 Request processed in 2393us (2673us total) trans 17179869285 rc 0/0 00000100:00100000:2.0:1788201389.735097:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 102 00010000:00010000:0.0:1788201389.736953:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201389.736970:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5b76 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x410:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.736981:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131e400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201389.736987:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5b76 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x410:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.736997:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5b76 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x410:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.737017:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x410:0x0].0x0 (ffff9e03c33ed300) 00010000:00010000:0.0:1788201389.737020:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201389.737027:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5b76 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x410:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.737033:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5b76 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x410:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.737060:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.737062:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.737064:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201389.738338:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5b68 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x7f084702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.738355:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5b68 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x7f084702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.738368:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5b68 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x7f084702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.738375:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.738381:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5b68 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x7f084702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.738390:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5b68 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x7f084702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.738404:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x7f084702 (ffff9e04d9f56b00) 00010000:00010000:2.0:1788201389.738408:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.738412:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5b68 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x7f084702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.738418:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5b68 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x7f084702 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201389.741398:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201389.741500:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442751232 00000100:00100000:2.0:1788201389.741513:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442751232 00000100:00100000:2.0:1788201389.741587:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4313 00000100:00100000:2.0:1788201389.741599:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c23d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35604eb4-baf9-45be-a20a-4883a2cd8cf9+520:2360:x1875064442751232:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1788201389.741625:0:13440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201389.741653:0:13440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c8e357f/0x9383f985bc4d5b7d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x465:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5889 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201389.741687:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x465:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201389.741710:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x465:0x0].0x0 since=664s v=(0 0) 00010000:00010000:2.0:1788201389.741715:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x465:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201389.741727:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c8e357f/0x9383f985bc4d5b7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x465:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5889 expref: 521 pid: 13440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.741752:0:13440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c8e357f/0x9383f985bc4d5b7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x465:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5889 expref: 521 pid: 13440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.741766:0:13440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c131f200, rc 0) 00000100:00100000:2.0:1788201389.741829:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c23d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35604eb4-baf9-45be-a20a-4883a2cd8cf9+521:2360:x1875064442751232:12345-192.168.201.30@tcp:101:rm.0 Request processed in 232us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201389.741837:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4313 00000100:00100000:3.0:1788201389.750358:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201389.750469:0:16721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442751488 00000100:00100000:2.0:1788201389.750483:0:16721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442751488 00000100:00100000:2.0:1788201389.750558:0:16721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 103 00000100:00100000:2.0:1788201389.750571:0:16721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f53e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:17859:x1875064442751488:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1788201389.750682:0:16721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201389.750721:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2c00/0x9383f985bc4d5422 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x411:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c539d expref: 101 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.750746:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x411:0x0].0x0 (ffff9e03c2fc5d00) 00010000:00010000:2.0:1788201389.750758:0:16721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201389.750789:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5b84 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.750805:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5b84 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.750816:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5b84 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.750833:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d5b8b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xac2b154b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.750841:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d5b8b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xac2b154b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.750859:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d5b8b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xac2b154b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.750997:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5b92 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x411:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.751006:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5b92 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x411:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.751015:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5b92 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x411:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201389.751738:0:16721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].18, 64 off9344 00010000:00010000:2.0:1788201389.751805:0:16721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96600/0x9383f985bc4d5b99 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x411:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.751815:0:16721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96600/0x9383f985bc4d5b99 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x411:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.751824:0:16721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96600/0x9383f985bc4d5b99 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x411:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.751832:0:16721:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96600/0x9383f985bc4d5b99 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x411:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.751839:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96600/0x9383f985bc4d5b99 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x411:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.751860:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96600/0x9383f985bc4d5b99 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x411:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.751881:0:16721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201389.751906:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5b92 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x411:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.751913:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5b92 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x411:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.751920:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5b92 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x411:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.751927:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131e400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.751932:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5b92 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x411:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.751940:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5b92 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x411:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.751948:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x411:0x0].0x0 (ffff9e03c33eda00) 00010000:00010000:2.0:1788201389.751951:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201389.751955:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5b92 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x411:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.751961:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e400/0x9383f985bc4d5b92 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x411:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.751979:0:16721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5b84 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.751991:0:16721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5b84 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.751997:0:16721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5b84 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.752002:0:16721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131f400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.752005:0:16721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5b84 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.752011:0:16721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5b84 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.752018:0:16721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:2.0:1788201389.752021:0:16721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.752024:0:16721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5b84 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.752030:0:16721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f400/0x9383f985bc4d5b84 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201389.752040:0:16721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a9ed258 reply state 00000000a964c7eb transno 17179869286 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d5b8b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xac2b154b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.752051:0:16721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201389.752163:0:16721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f53e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17859:x1875064442751488:12345-192.168.201.30@tcp:36:rm.0 Request processed in 1592us (1875us total) trans 17179869286 rc 0/0 00000100:00100000:2.0:1788201389.752173:0:16721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 103 00010000:00010000:0.0:1788201389.752996:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201389.753008:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96600/0x9383f985bc4d5b99 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x411:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.753017:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b96600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201389.753021:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96600/0x9383f985bc4d5b99 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x411:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.753027:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96600/0x9383f985bc4d5b99 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x411:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.753039:0:7645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x411:0x0].0x0 (ffff9e03c33eda00) 00010000:00010000:0.0:1788201389.753042:0:7645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201389.753045:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96600/0x9383f985bc4d5b99 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x411:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.753051:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96600/0x9383f985bc4d5b99 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x411:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.753070:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.753072:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.753074:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201389.756274:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201389.756423:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442751616 00000100:00100000:1.0:1788201389.756437:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442751616 00000100:00100000:1.0:1788201389.756524:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4314 00000100:00100000:1.0:1788201389.756538:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f53e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+18:2359:x1875064442751616:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1788201389.756564:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201389.756594:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d5ba0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x465:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5890 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201389.756635:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x465:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201389.756659:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x465:0x0].0x0 since=665s v=(0 0) 00010000:00010000:1.0:1788201389.756665:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x465:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201389.756676:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d5ba0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x465:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5890 expref: 19 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.756699:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d5ba0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x465:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5890 expref: 19 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.756715:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04ff129a00, rc 0) 00000100:00100000:1.0:1788201389.756791:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f53e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:2359:x1875064442751616:12345-192.168.201.30@tcp:101:rm.0 Request processed in 255us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201389.756798:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4314 00000100:00100000:3.0:1788201389.759446:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201389.759680:0:16720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442751872 00000100:00100000:1.0:1788201389.759695:0:16720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442751872 00000100:00100000:1.0:1788201389.759777:0:16720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 104 00000100:00100000:1.0:1788201389.759790:0:16720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f53e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17859:x1875064442751872:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1788201389.759882:0:16720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201389.759918:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d5445 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x412:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53a4 expref: 102 pid: 17130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.759940:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x412:0x0].0x0 (ffff9e03c270a700) 00010000:00010000:1.0:1788201389.760355:0:16720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201389.760391:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129600/0x9383f985bc4d5ba7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.760409:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129600/0x9383f985bc4d5ba7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.760421:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129600/0x9383f985bc4d5ba7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.760438:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129200/0x9383f985bc4d5bae lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xd94de393 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.760446:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129200/0x9383f985bc4d5bae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xd94de393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.760453:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129200/0x9383f985bc4d5bae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xd94de393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.761173:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d5b8b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xac2b154b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.761189:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d5b8b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xac2b154b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.761196:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d5b8b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xac2b154b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.761204:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131fe00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.761208:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d5b8b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xac2b154b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.761217:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d5b8b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xac2b154b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.761229:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0xac2b154b (ffff9e03c33ed700) 00010000:00010000:2.0:1788201389.761232:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.761238:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d5b8b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xac2b154b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.761245:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fe00/0x9383f985bc4d5b8b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xac2b154b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.761359:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129400/0x9383f985bc4d5bb5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x412:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.761369:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129400/0x9383f985bc4d5bb5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x412:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.761377:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129400/0x9383f985bc4d5bb5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x412:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201389.762552:0:16720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].19, 64 off9408 00010000:00010000:1.0:1788201389.762624:0:16720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d5bbc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x412:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.762636:0:16720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d5bbc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x412:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.762643:0:16720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d5bbc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x412:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.762649:0:16720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d5bbc lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x412:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.762654:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d5bbc lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x412:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.762657:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d5bbc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x412:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.762674:0:16720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201389.762704:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129400/0x9383f985bc4d5bb5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x412:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.762709:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129400/0x9383f985bc4d5bb5 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x412:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.762713:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201389.762714:0:16720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129400/0x9383f985bc4d5bb5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x412:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.762720:0:16720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201389.762722:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d5bbc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x412:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.762724:0:16720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129400/0x9383f985bc4d5bb5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x412:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.762730:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff128a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201389.762734:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d5bbc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x412:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.762742:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d5bbc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x412:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.762755:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x412:0x0].0x0 (ffff9e03c23c1200) 00010000:00010000:0.0:1788201389.762757:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201389.762761:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d5bbc lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x412:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.762767:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128a00/0x9383f985bc4d5bbc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x412:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.762780:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.762782:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.762784:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201389.762799:0:16720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129400/0x9383f985bc4d5bb5 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x412:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.762808:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x412:0x0].0x0 (ffff9e03c23c1200) 00010000:00010000:1.0:1788201389.762810:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201389.762812:0:16720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129400/0x9383f985bc4d5bb5 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x412:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.762820:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129400/0x9383f985bc4d5bb5 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x412:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.762840:0:16720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129600/0x9383f985bc4d5ba7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.762889:0:16720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129600/0x9383f985bc4d5ba7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.762896:0:16720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129600/0x9383f985bc4d5ba7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.762901:0:16720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201389.762904:0:16720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129600/0x9383f985bc4d5ba7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.762910:0:16720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129600/0x9383f985bc4d5ba7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.762918:0:16720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:1.0:1788201389.762920:0:16720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201389.762923:0:16720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129600/0x9383f985bc4d5ba7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.762929:0:16720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129600/0x9383f985bc4d5ba7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201389.762940:0:16720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e914f881 reply state 00000000cdf5b45d transno 17179869287 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129200/0x9383f985bc4d5bae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xd94de393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201389.763054:0:16720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201389.763202:0:16720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f53e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17859:x1875064442751872:12345-192.168.201.30@tcp:36:rm.0 Request processed in 3410us (3767us total) trans 17179869287 rc 0/0 00000100:00100000:1.0:1788201389.763209:0:16720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 104 00010000:00010000:2.0:1788201389.767103:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129200/0x9383f985bc4d5bae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xd94de393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.767128:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129200/0x9383f985bc4d5bae lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xd94de393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.767136:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129200/0x9383f985bc4d5bae lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xd94de393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.767143:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.767149:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129200/0x9383f985bc4d5bae lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xd94de393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.767159:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129200/0x9383f985bc4d5bae lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0xd94de393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.767179:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0xd94de393 (ffff9e03c23c1700) 00010000:00010000:2.0:1788201389.767183:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.767190:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129200/0x9383f985bc4d5bae lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xd94de393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.767197:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129200/0x9383f985bc4d5bae lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0xd94de393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201389.767316:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201389.767384:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442752000 00000100:00100000:1.0:1788201389.767399:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442752000 00000100:00100000:1.0:1788201389.767479:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4315 00000100:00100000:1.0:1788201389.767492:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+521:2359:x1875064442752000:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1788201389.767516:0:12363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201389.767543:0:12363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e08abbd/0x9383f985bc4d5bc3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x466:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5897 expref: -99 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201389.767577:0:12363:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x466:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201389.767602:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x466:0x0].0x0 since=665s v=(0 0) 00010000:00010000:1.0:1788201389.767607:0:12363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x466:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201389.767619:0:12363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e08abbd/0x9383f985bc4d5bc3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x466:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5897 expref: 522 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.767641:0:12363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001e08abbd/0x9383f985bc4d5bc3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x466:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5897 expref: 522 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.767654:0:12363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031400, rc 0) 00000100:00100000:1.0:1788201389.767727:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+522:2359:x1875064442752000:12345-192.168.201.30@tcp:101:rm.0 Request processed in 238us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201389.767734:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4315 00000100:00100000:2.0:1788201389.770939:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201389.771070:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442752256 00000100:00100000:0.0:1788201389.771082:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442752256 00000100:00100000:0.0:1788201389.771162:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 105 00000100:00100000:0.0:1788201389.771175:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:17859:x1875064442752256:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:0.0:1788201389.771256:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201389.771290:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f000/0x9383f985bc4d5468 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x413:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53ab expref: 101 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.771355:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x413:0x0].0x0 (ffff9e03c2ac6b00) 00010000:00010000:0.0:1788201389.771371:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201389.771401:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5bca lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.771416:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5bca lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.771427:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5bca lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.771536:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5bd1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x670b1db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.771550:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5bd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x670b1db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.771558:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5bd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x670b1db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.771676:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5bd8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x413:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.771682:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5bd8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x413:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.771687:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5bd8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x413:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201389.772276:0:17130:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].19, 64 off9408 00010000:00010000:1.0:1788201389.772387:0:17130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5bdf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x413:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.772398:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5bdf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x413:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.772408:0:17130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5bdf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x413:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.772414:0:17130:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5bdf lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x413:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.772418:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5bdf lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x413:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.772422:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5bdf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x413:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.772442:0:17130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201389.772468:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201389.772475:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5bd8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x413:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.772476:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5bdf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x413:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.772482:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5bd8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x413:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.772488:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5bd8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x413:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.772495:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201389.772500:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5bd8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x413:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.772508:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5bd8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x413:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.772517:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x413:0x0].0x0 (ffff9e03c23c1c00) 00010000:00010000:1.0:1788201389.772520:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201389.772525:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5bd8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x413:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.772531:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031800/0x9383f985bc4d5bd8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x413:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.772551:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5bca lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.772557:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5bca lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.772570:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5bca lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.772575:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201389.772577:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5bca lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.772583:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5bca lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.772590:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:1.0:1788201389.772592:0:17130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201389.772595:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5bca lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.772600:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d5bca lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201389.772610:0:17130:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009570402f reply state 00000000cf1519e8 transno 17179869288 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5bd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x670b1db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201389.772619:0:17130:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201389.772738:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17859:x1875064442752256:12345-192.168.201.30@tcp:36:rm.0 Request processed in 1563us (1811us total) trans 17179869288 rc 0/0 00000100:00100000:1.0:1788201389.772748:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 105 00010000:00010000:0.0:1788201389.772771:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201389.772775:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5bdf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x413:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.772781:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5bdf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x413:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.772791:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x413:0x0].0x0 (ffff9e03c23c1c00) 00010000:00010000:0.0:1788201389.772794:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201389.772797:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5bdf lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x413:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.772803:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d5bdf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x413:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.772821:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.772835:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.772838:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201389.775202:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5bd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x670b1db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.775223:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5bd1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x670b1db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.775231:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5bd1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x670b1db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.775237:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.775242:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5bd1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x670b1db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.775250:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5bd1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x670b1db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.775266:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x670b1db (ffff9e03c23c1100) 00010000:00010000:2.0:1788201389.775270:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.775275:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5bd1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x670b1db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.775281:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d5bd1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x670b1db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.775722:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201389.776162:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442752384 00000100:00100000:1.0:1788201389.776177:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442752384 00000100:00100000:1.0:1788201389.776245:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4316 00000100:00100000:1.0:1788201389.776255:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:2361:x1875064442752384:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1788201389.776284:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201389.776333:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d5be6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x466:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c589e expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201389.776367:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x466:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201389.776395:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x466:0x0].0x0 since=665s v=(0 0) 00010000:00010000:1.0:1788201389.776401:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x466:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201389.776413:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d5be6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x466:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c589e expref: 20 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.776438:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d5be6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x466:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c589e expref: 20 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.776452:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031a00, rc 0) 00000100:00100000:1.0:1788201389.776546:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:2361:x1875064442752384:12345-192.168.201.30@tcp:101:rm.0 Request processed in 291us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201389.776554:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4316 00000100:00100000:3.0:1788201389.781114:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201389.781182:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442752640 00000100:00100000:0.0:1788201389.781195:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442752640 00000100:00100000:0.0:1788201389.781273:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 106 00000100:00100000:0.0:1788201389.781286:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f53e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:17859:x1875064442752640:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:0.0:1788201389.781457:0:17126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201389.781567:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c20c2200/0x9383f985bc4d548b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x414:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c53b2 expref: 101 pid: 16721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.781591:0:17126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x414:0x0].0x0 (ffff9e03c2fc5a00) 00010000:00010000:0.0:1788201389.781605:0:17126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201389.781635:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d5bed lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.782030:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d5bed lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.782044:0:17126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d5bed lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.782066:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d5bf4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x33938024 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.782074:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d5bf4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x33938024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.782080:0:17126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d5bf4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x33938024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.782226:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d5bfb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x414:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.782240:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d5bfb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x414:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.782247:0:17126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d5bfb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x414:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201389.784620:0:17126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].20, 64 off9472 00010000:00010000:0.0:1788201389.784720:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d5c02 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x414:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.784756:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d5c02 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x414:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.784771:0:17126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d5c02 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x414:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.784780:0:17126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d5c02 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x414:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.784787:0:17126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d5c02 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x414:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.784794:0:17126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d5c02 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x414:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.784972:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201389.785008:0:17126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d5bfb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x414:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.785015:0:17126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d5bfb lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x414:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.785027:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d5bfb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x414:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.785033:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201389.785038:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d5bfb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x414:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.785047:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d5bfb lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x414:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.785063:0:17126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x414:0x0].0x0 (ffff9e04d82b6b00) 00010000:00010000:0.0:1788201389.785066:0:17126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201389.785071:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d5bfb lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x414:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.785078:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d5bfb lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x414:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.785105:0:17126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d5bed lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.785112:0:17126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d5bed lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.785117:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d5bed lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.785122:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201389.785125:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d5bed lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.785136:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d5bed lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.785145:0:17126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e03c270ab00) 00010000:00010000:0.0:1788201389.785147:0:17126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201389.785151:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d5bed lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.785157:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d5bed lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201389.785168:0:17126:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000857e6018 reply state 000000000ce5c481 transno 17179869289 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d5bf4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x33938024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201389.785180:0:17126:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201389.785364:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f53e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+102:17859:x1875064442752640:12345-192.168.201.30@tcp:36:rm.0 Request processed in 4074us (4255us total) trans 17179869289 rc 0/0 00000100:00100000:0.0:1788201389.785375:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 106 00010000:00010000:2.0:1788201389.786236:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201389.786248:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d5c02 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x414:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.786258:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201389.786262:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d5c02 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x414:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.786270:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d5c02 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x414:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.786284:0:7645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x414:0x0].0x0 (ffff9e04d82b6b00) 00010000:00010000:2.0:1788201389.786287:0:7645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788201389.786290:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d5c02 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x414:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.786324:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d5c02 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x414:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.786457:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201389.786460:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201389.786462:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201389.790701:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d5bf4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x33938024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.791119:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d5bf4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x33938024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.791129:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d5bf4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x33938024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.791135:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201389.791141:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d5bf4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x33938024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.791150:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d5bf4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x40a:0x0].0x33938024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.791170:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x33938024 (ffff9e04d82b6e00) 00010000:00010000:2.0:1788201389.791174:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201389.791181:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d5bf4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x33938024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.791187:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d5bf4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x40a:0x0].0x33938024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201389.798611:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f53e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458265216:0@lo:400:kworker.0 00000100:00100000:3.0:1788201389.798647:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f53e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458265472:0@lo:400:kworker.0 00000100:00100000:0.0:1788201389.798717:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f53e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458265088:0@lo:400:kworker.0 00000100:00100000:2.0:1788201389.798798:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f53e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458265344:0@lo:400:kworker.0 00000100:00100000:1.0:1788201389.801654:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201389.801673:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201389.801743:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201389.801801:0:16721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458265216 00000100:00100000:2.0:1788201389.801812:0:16721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458265216 00000100:00100000:1.0:1788201389.802074:0:16720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458265344 00000100:00100000:1.0:1788201389.802079:0:16720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458265344 00000100:00100000:2.0:1788201389.802080:0:16721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788201389.802091:0:16721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c23d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875064458265216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201389.802112:0:16720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788201389.802120:0:16720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458265344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201389.802201:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458265600:0@lo:400:kworker.0 00000100:00100000:1.0:1788201389.804997:0:16720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458265344:12345-0@lo:400:kworker.0 Request processed in 2865us (3241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201389.805013:0:16720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788201389.805212:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201389.805276:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201389.805290:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875064458265728:0@lo:400:kworker.0 00000100:00100000:0.0:1788201389.805363:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201389.805408:0:16713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458265088 00000100:00100000:0.0:1788201389.805418:0:16713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458265088 00000100:00100000:0.0:1788201389.805492:0:16713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788201389.805503:0:16713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458265088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201389.805565:0:16713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458265088:12345-0@lo:400:kworker.0 Request processed in 64us (3891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201389.805572:0:16713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788201389.805647:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f53e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458265344:0@lo:400:kworker.0 00000100:00100000:0.0:1788201389.805696:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f53e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458265088:0@lo:400:kworker.0 00000100:00100000:0.0:1788201389.805714:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458265728 00000100:00100000:0.0:1788201389.805718:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458265728 00000100:00100000:1.0:1788201389.806097:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458265600 00000100:00100000:1.0:1788201389.806102:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458265600 00000100:00100000:0.0:1788201389.806115:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201389.806123:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875064458265728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201389.806141:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788201389.806148:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c548ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3310:x1875064458265600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201389.806171:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875064458265728:12345-0@lo:400:kworker.0 Request processed in 48us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201389.806177:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788201389.806179:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c548ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3310:x1875064458265600:12345-0@lo:400:kworker.0 Request processed in 33us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201389.806185:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788201389.806211:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875064458265728:0@lo:400:kworker.0 00000100:00100000:0.0:1788201389.806223:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458265600:0@lo:400:kworker.0 00000100:00080000:0.0:1788201389.806359:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201389.806366:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201389.806663:0:16721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c23d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875064458265216:12345-0@lo:400:kworker.0 Request processed in 4571us (5017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201389.806676:0:16721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788201389.806965:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f53e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458265216:0@lo:400:kworker.0 00000100:00100000:3.0:1788201389.807031:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201389.807147:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458265472 00000100:00100000:0.0:1788201389.807152:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458265472 00000100:00100000:0.0:1788201389.807251:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788201389.807261:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458265472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201389.807462:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458265472:12345-0@lo:400:kworker.0 Request processed in 202us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201389.807473:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788201389.807748:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f53e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458265472:0@lo:400:kworker.0 00000100:00080000:3.0:1788201389.807795:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788201389.925553:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788201390.934050:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968875 is committed 00000001:00080000:2.0:1788201390.934075:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968876 is committed 00000001:00080000:2.0:1788201390.934081:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968877 is committed 00010000:00010000:0.0:1788201390.950230:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201391.002838:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201391.002887:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201391.002918:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201391.003404:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442753024 00000100:00100000:2.0:1788201391.003417:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442753024 00000100:00100000:2.0:1788201391.003496:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 242 00000100:00100000:2.0:1788201391.003509:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+522:2359:x1875064442753024:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201391.003612:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+522:2359:x1875064442753024:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 106us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201391.003621:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 242 00000100:00100000:0.0:1788201391.003731:0:16711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442752768 00000100:00100000:0.0:1788201391.003737:0:16711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442752768 00000100:00100000:0.0:1788201391.003778:0:16711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 72 00000100:00100000:0.0:1788201391.003786:0:16711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442752768:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201391.003818:0:16711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442752768:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 34us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201391.003837:0:16711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 72 00000100:00100000:0.0:1788201391.003872:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442752896 00000100:00100000:0.0:1788201391.003877:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442752896 00000100:00100000:0.0:1788201391.003910:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:0.0:1788201391.003917:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:2359:x1875064442752896:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201391.003963:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+101:2359:x1875064442752896:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 46us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201391.003971:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:3.0:1788201391.004140:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00080000:3.0:1788201391.004271:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201391.004278:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201391.004375:0:13442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442753152 00000100:00100000:0.0:1788201391.004381:0:13442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442753152 00000100:00100000:0.0:1788201391.004423:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 243 00000100:00100000:0.0:1788201391.004431:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:2359:x1875064442753152:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201391.004469:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:2359:x1875064442753152:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 38us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201391.004476:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 243 00000100:00080000:3.0:1788201391.005495:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788201391.335271:0:16746:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 666592973563ns, next at 667592970523ns, rc = 0 00000004:00080000:3.0:1788201391.338909:0:16744:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 666596610998ns, next at 667596608010ns, rc = 0 00000100:00100000:1.0:1788201391.339017:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458265984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201391.339113:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201391.339169:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201391.339177:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458265856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201391.339203:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201391.339884:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458265984 00000100:00100000:3.0:1788201391.339897:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458265984 00000100:00100000:3.0:1788201391.339981:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458265856 00000100:00100000:3.0:1788201391.339985:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458265856 00000100:00100000:3.0:1788201391.340009:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788201391.340020:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c23d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458265984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201391.340071:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524746752 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1788201391.340139:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c23d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458265984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201391.340147:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788201391.340167:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788201391.340173:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d1f0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458265856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201391.340194:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 13631488 granted 524746752 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201391.340221:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d1f0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458265856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201391.340228:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788201391.340279:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968877 gen 2 00000004:00080000:3.0:1788201391.340285:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c53e8700, transno 4294968875 00000100:00080000:1.0:1788201391.340791:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201391.340797:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788201391.340945:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c53ebb80, transno 4294968876 00000004:00080000:3.0:1788201391.340951:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c53eb800, transno 4294968877 00000100:00100000:3.0:1788201391.340969:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458265856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201391.340997:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458265984:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1788201391.341460:0:16745:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 15 changes, 0 in progress, 0 in flight, 3 done 00000001:00080000:2.0:1788201391.487894:0:16726:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869289 is committed 00000004:00080000:2.0:1788201391.487932:0:16726:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:2.0:1788201391.488034:0:16726:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:2.0:1788201391.488140:0:16726:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:1.0:1788201391.488184:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458266368:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788201391.488188:0:16726:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:1.0:1788201391.488286:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201391.488408:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458266368 00000100:00100000:2.0:1788201391.488419:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458266368 00000100:00100000:2.0:1788201391.488487:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4317 00000100:00100000:2.0:1788201391.488498:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458266368:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201391.488535:0:13449:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1122 count 1 00010000:00010000:2.0:1788201391.488570:0:13449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5713b5a/0x9383f985bc4d5c09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x462:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.488598:0:13449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0a1d546/0x9383f985bc4d5771 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x462:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5453 expref: 521 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.488613:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x462:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788201391.488618:0:13449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x462:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201391.488623:0:13449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5713b5a/0x9383f985bc4d5c09 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x462:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.488655:0:13449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b0a1d546/0x9383f985bc4d5771 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x462:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5453 expref: 521 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.488671:0:13449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b0a1d546/0x9383f985bc4d5771 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x462:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5453 expref: 521 pid: 6705 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201391.488684:0:13449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:13449:1875064458266496:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201391.488765:0:13449:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d20f4000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201391.488998:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458266112:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201391.489038:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201391.489071:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201391.489077:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458266240:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201391.489109:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201391.489124:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458266112 00000100:00100000:1.0:1788201391.489129:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458266112 00000100:00100000:1.0:1788201391.489236:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458266240 00000100:00100000:1.0:1788201391.489241:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458266240 00000100:00100000:1.0:1788201391.489261:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4318 00000100:00100000:1.0:1788201391.489269:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3310:x1875064458266112:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201391.489285:0:13439:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1090 count 1 00010000:00010000:1.0:1788201391.489326:0:13439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d5c10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x442:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.489347:0:13439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2f6912d/0x9383f985bc4d49b0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x442:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5127 expref: 521 pid: 13450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.489354:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x442:0x0].0x0 since=65s v=(0 0) 00010000:00010000:1.0:1788201391.489358:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x442:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201391.489363:0:13439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d5c10 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x442:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.489387:0:13439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c2f6912d/0x9383f985bc4d49b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x442:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5127 expref: 521 pid: 13450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.489398:0:13439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c2f6912d/0x9383f985bc4d49b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x442:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5127 expref: 521 pid: 13450 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201391.489409:0:13439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:13439:1875064458266752:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201391.489444:0:13439:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d434a480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201391.489464:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4319 00000100:00100000:1.0:1788201391.489474:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f965a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+7:3310:x1875064458266240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201391.489488:0:13450:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1092 count 1 00010000:00010000:1.0:1788201391.489501:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5c17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x444:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.489512:0:13450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d94893d/0x9383f985bc4d4a58 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x444:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5143 expref: 521 pid: 13445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.489524:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x444:0x0].0x0 since=65s v=(0 0) 00010000:00010000:1.0:1788201391.489527:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x444:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201391.489530:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5c17 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x444:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.489550:0:13450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008d94893d/0x9383f985bc4d4a58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x444:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5143 expref: 521 pid: 13445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.489560:0:13450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008d94893d/0x9383f985bc4d4a58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x444:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5143 expref: 521 pid: 13445 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201391.489571:0:13450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:13450:1875064458266880:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201391.489593:0:13450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d434aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201391.489612:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458266624:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201391.489640:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201391.489672:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458266624 00000100:00100000:1.0:1788201391.489676:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458266624 00000100:00100000:1.0:1788201391.489705:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4320 00000100:00100000:1.0:1788201391.489712:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458266624:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788201391.489726:0:13445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1122 count 1 00010000:00010000:1.0:1788201391.489743:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d5c1e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x462:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.489756:0:13445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cbefc526/0x9383f985bc4d5794 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x462:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c545a expref: 19 pid: 13451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.489764:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x462:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788201391.489767:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x462:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201391.489771:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d5c1e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x462:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.489792:0:13445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cbefc526/0x9383f985bc4d5794 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x462:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c545a expref: 19 pid: 13451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.489801:0:13445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cbefc526/0x9383f985bc4d5794 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x462:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c545a expref: 19 pid: 13451 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201391.489823:0:13445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13445:1875064458267008:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201391.489849:0:13445:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201391.494243:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f53e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458267136:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201391.494392:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201391.494455:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458267136 00000100:00100000:2.0:1788201391.494466:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458267136 00000100:00100000:2.0:1788201391.494535:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4321 00000100:00100000:2.0:1788201391.494547:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3310:x1875064458267136:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201391.494584:0:13447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1127 count 1 00010000:00010000:2.0:1788201391.494620:0:13447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000750f20a6/0x9383f985bc4d5c25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x467:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.494648:0:13447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000021e8ff12/0x9383f985bc4d57da lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x467:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5468 expref: 19 pid: 13445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.494665:0:13447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x467:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788201391.494670:0:13447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x467:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201391.494675:0:13447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000750f20a6/0x9383f985bc4d5c25 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x467:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.494712:0:13447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000021e8ff12/0x9383f985bc4d57da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x467:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5468 expref: 19 pid: 13445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.494727:0:13447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000021e8ff12/0x9383f985bc4d57da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x467:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5468 expref: 19 pid: 13445 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201391.494742:0:13447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:13447:1875064458267264:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201391.494836:0:13447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d20f43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201391.497607:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201391.497634:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458267392:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201391.497724:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201391.498570:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458267392 00000100:00100000:2.0:1788201391.498584:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458267392 00000100:00100000:2.0:1788201391.498650:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4322 00000100:00100000:2.0:1788201391.498662:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:3310:x1875064458267392:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201391.498706:0:13443:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1128 count 1 00010000:00010000:2.0:1788201391.498741:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002790950b/0x9383f985bc4d5c2c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x468:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.498769:0:13443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000033a0bd08/0x9383f985bc4d5820 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x468:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5476 expref: 19 pid: 13440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.498785:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x468:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788201391.498790:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x468:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201391.498795:0:13443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002790950b/0x9383f985bc4d5c2c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x468:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.498850:0:13443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000033a0bd08/0x9383f985bc4d5820 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x468:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5476 expref: 19 pid: 13440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.498864:0:13443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000033a0bd08/0x9383f985bc4d5820 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x468:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5476 expref: 19 pid: 13440 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201391.498883:0:13443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13443:1875064458267520:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201391.498974:0:13443:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d20f4840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201391.499026:0:13449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:13449:1875064458266496:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201391.499054:0:13449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5713b5a/0x9383f985bc4d5c09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x462:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201391.500485:0:13439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:13439:1875064458266752:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201391.500525:0:13439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d5c10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x442:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201391.502562:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458267648:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201391.502655:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201391.502883:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458267776:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201391.502918:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201391.504684:0:13451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458267648 00000100:00100000:3.0:1788201391.504713:0:13451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458267648 00000100:00100000:2.0:1788201391.507460:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201391.507483:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458268160:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201391.507583:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201391.507650:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458267904:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201391.507706:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201391.507733:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201391.507739:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458268032:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201391.507764:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201391.507801:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458267776 00000100:00100000:2.0:1788201391.507811:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458267776 00000100:00100000:2.0:1788201391.507893:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458268160 00000100:00100000:2.0:1788201391.507897:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458268160 00000100:00100000:2.0:1788201391.507914:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458267904 00000100:00100000:2.0:1788201391.507917:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458267904 00000100:00100000:2.0:1788201391.507938:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458268032 00000100:00100000:2.0:1788201391.507941:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458268032 00000100:00100000:2.0:1788201391.507963:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4323 00000100:00100000:2.0:1788201391.507973:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3313:x1875064458267776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201391.508011:0:6703:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1130 count 1 00010000:00010000:2.0:1788201391.508046:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d5c33 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x46a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.508073:0:6703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000097fb199/0x9383f985bc4d5858 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x46a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5492 expref: 19 pid: 13446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.508083:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46a:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788201391.508088:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201391.508092:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d5c33 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x46a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201391.508125:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4324 00010000:00010000:2.0:1788201391.508125:0:6703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000097fb199/0x9383f985bc4d5858 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x46a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5492 expref: 19 pid: 13446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201391.508137:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+12:3313:x1875064458268160:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788201391.508144:0:6703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000097fb199/0x9383f985bc4d5858 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x46a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5492 expref: 19 pid: 13446 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788201391.508150:0:13446:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1133 count 1 00010000:00010000:0.0:1788201391.508163:0:13446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d5c3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x46d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201391.508172:0:6703:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1ba1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6703:1875064458268288:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201391.508176:0:13446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d58cf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x46d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54bc expref: 19 pid: 13440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.508182:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46d:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788201391.508185:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201391.508188:0:13446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d5c3a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x46d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.508208:0:13446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d58cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x46d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54bc expref: 19 pid: 13440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.508219:0:13446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d58cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x46d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54bc expref: 19 pid: 13440 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201391.508229:0:13446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f53e2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:13446:1875064458268416:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201391.508346:0:13451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4325 00000100:00100000:3.0:1788201391.508359:0:13451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+12:3310:x1875064458267904:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788201391.508372:0:13451:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1131 count 1 00010000:00010000:3.0:1788201391.508386:0:13451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b6707ed/0x9383f985bc4d5c41 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x46b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.508398:0:13451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000def97333/0x9383f985bc4d5866 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x46b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54a0 expref: 19 pid: 13444 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.508405:0:13451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46b:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788201391.508408:0:13451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201391.508412:0:13451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b6707ed/0x9383f985bc4d5c41 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x46b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.508431:0:13451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000def97333/0x9383f985bc4d5866 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x46b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54a0 expref: 19 pid: 13444 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.508441:0:13451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000def97333/0x9383f985bc4d5866 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x46b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54a0 expref: 19 pid: 13444 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201391.508464:0:13451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:13451:1875064458268544:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201391.511387:0:6703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d20f4000 going to sleep for 11 seconds 00000100:00100000:2.0:1788201391.511453:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4326 00000100:00100000:2.0:1788201391.511477:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+12:3310:x1875064458268032:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201391.511524:0:13448:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1132 count 1 00010000:00010000:2.0:1788201391.511561:0:13448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d5c48 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x46c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.511588:0:13448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d586d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x46c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54ae expref: 19 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.511599:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46c:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788201391.511604:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201391.511609:0:13448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d5c48 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x46c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.511656:0:13448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d586d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x46c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54ae expref: 19 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.511671:0:13448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d586d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x46c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54ae expref: 19 pid: 12363 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201391.511694:0:13448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1ba2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:13448:1875064458268672:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201391.511776:0:13448:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d20f4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201391.511801:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4327 00000100:00100000:2.0:1788201391.511811:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3312:x1875064458267648:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201391.511840:0:6706:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1129 count 1 00010000:00010000:2.0:1788201391.511855:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d5c4f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x469:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.511868:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007f1c741f/0x9383f985bc4d584a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x469:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5484 expref: 19 pid: 13438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.511875:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x469:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788201391.511879:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x469:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201391.511883:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d5c4f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x469:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.511903:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007f1c741f/0x9383f985bc4d584a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x469:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5484 expref: 19 pid: 13438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.511912:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007f1c741f/0x9383f985bc4d584a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x469:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5484 expref: 19 pid: 13438 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201391.511915:0:13446:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1f35480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201391.511922:0:6706:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1ba2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1875064458268800:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201391.511949:0:6706:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d20f4180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201391.512128:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201391.512688:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442753408 00000100:00100000:1.0:1788201391.512702:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442753408 00010000:00010000:1.0:1788201391.512750:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c2f6912d/0x9383f985bc4d49b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x442:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5127 expref: 522 pid: 13450 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201391.512790:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1567 00000100:00100000:1.0:1788201391.512799:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+522:2360:x1875064442753408:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201391.512823:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201391.512831:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c2f6912d/0x9383f985bc4d49b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x442:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5127 expref: 522 pid: 13450 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.512844:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c2f6912d/0x9383f985bc4d49b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x442:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5127 expref: 522 pid: 13450 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.512869:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2f6912d/0x9383f985bc4d49b0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x442:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5127 expref: 522 pid: 13450 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.512885:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x442:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201391.512890:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x442:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201391.512896:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d5c10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x442:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.512906:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d5c10 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x442:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.512935:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201391.512976:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+521:2360:x1875064442753408:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 178us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201391.512984:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1567 00000100:00100000:1.0:1788201391.513042:0:13450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:13450:1875064458266880:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201391.513067:0:13450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5c17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x444:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201391.513094:0:13445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13445:1875064458267008:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201391.513106:0:13445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d5c1e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x462:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.514118:0:13439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d5c10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x442:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.514137:0:13439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d5c10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x442:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.514149:0:13439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d5c10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x442:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.514158:0:13439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d5c10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x442:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.514182:0:13439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201391.514571:0:13451:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c5e2a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788201391.515331:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201391.515384:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201391.515407:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201391.515445:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201391.515500:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442753664 00000100:00100000:2.0:1788201391.515509:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442753664 00000100:00100000:3.0:1788201391.515527:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442753280 00000100:00100000:3.0:1788201391.515532:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442753280 00010000:00010000:2.0:1788201391.515550:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cbefc526/0x9383f985bc4d5794 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x462:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c545a expref: 20 pid: 13451 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.515559:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b0a1d546/0x9383f985bc4d5771 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x462:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5453 expref: 521 pid: 6705 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201391.515590:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442753536 00000100:00100000:2.0:1788201391.515594:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442753536 00010000:00010000:2.0:1788201391.515609:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008d94893d/0x9383f985bc4d4a58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x444:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5143 expref: 522 pid: 13445 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201391.515712:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3310:x1875064458266112:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26430us (26660us total) trans 4294968874 rc 0/0 00000100:00100000:0.0:1788201391.515724:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4318 00010000:00010000:0.0:1788201391.515755:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201391.515764:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d5c10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x442:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.515773:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201391.515779:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d5c10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x442:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.515789:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d5c10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x442:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.515903:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d5c10 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x442:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.515911:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d5c10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x442:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.515997:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.516000:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.516002:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201391.516102:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442753792 00000100:00100000:3.0:1788201391.516107:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442753792 00010000:00010000:3.0:1788201391.516124:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000033a0bd08/0x9383f985bc4d5820 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x468:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5476 expref: 21 pid: 13440 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201391.516144:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1568 00000100:00100000:3.0:1788201391.516154:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c7e17450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+21:2360:x1875064442753664:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201391.516171:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201391.516177:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cbefc526/0x9383f985bc4d5794 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x462:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c545a expref: 21 pid: 13451 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.516188:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cbefc526/0x9383f985bc4d5794 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x462:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c545a expref: 21 pid: 13451 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.516208:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbefc526/0x9383f985bc4d5794 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x462:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c545a expref: 21 pid: 13451 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.516222:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x462:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201391.516228:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x462:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201391.516234:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d5c1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x462:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.516244:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d5c1e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x462:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.516280:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201391.516313:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1569 00000100:00100000:1.0:1788201391.516326:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+522:2360:x1875064442753280:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201391.516336:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201391.516341:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b0a1d546/0x9383f985bc4d5771 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x462:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5453 expref: 522 pid: 6705 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.516354:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b0a1d546/0x9383f985bc4d5771 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x462:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5453 expref: 522 pid: 6705 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.516369:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0a1d546/0x9383f985bc4d5771 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x462:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5453 expref: 522 pid: 6705 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.516380:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x462:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201391.516383:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x462:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201391.516387:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5713b5a/0x9383f985bc4d5c09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x462:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.516395:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5713b5a/0x9383f985bc4d5c09 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x462:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201391.516410:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c7e17450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+20:2360:x1875064442753664:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 257us (1085us total) trans 0 rc 0/0 00010000:00010000:1.0:1788201391.516414:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201391.516418:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1568 00000100:00100000:1.0:1788201391.516432:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+521:2360:x1875064442753280:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 112us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201391.516439:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1569 00000100:00100000:1.0:1788201391.516452:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1570 00000100:00100000:1.0:1788201391.516459:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+520:2360:x1875064442753536:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201391.516467:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201391.516472:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008d94893d/0x9383f985bc4d4a58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x444:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5143 expref: 520 pid: 13445 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.516481:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008d94893d/0x9383f985bc4d4a58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x444:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5143 expref: 520 pid: 13445 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.516493:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d94893d/0x9383f985bc4d4a58 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x444:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5143 expref: 520 pid: 13445 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.516503:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x444:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201391.516507:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x444:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201391.516511:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5c17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x444:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.516519:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5c17 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x444:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.516535:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201391.516554:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+519:2360:x1875064442753536:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 95us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201391.516561:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1570 00000100:00100000:1.0:1788201391.516574:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1571 00000100:00100000:1.0:1788201391.516582:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:2359:x1875064442753792:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201391.516589:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201391.516594:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000033a0bd08/0x9383f985bc4d5820 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x468:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5476 expref: 19 pid: 13440 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.516604:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000033a0bd08/0x9383f985bc4d5820 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x468:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5476 expref: 19 pid: 13440 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.516616:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x468:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201391.516619:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x468:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201391.516623:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002790950b/0x9383f985bc4d5c2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x468:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.516631:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002790950b/0x9383f985bc4d5c2c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x468:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.517330:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201391.517367:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:2359:x1875064442753792:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 784us (1918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201391.517377:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1571 00010000:00010000:1.0:1788201391.517412:0:13445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d5c1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x462:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.517423:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d5c1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x462:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.517439:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d5c1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x462:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.517442:0:13443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033a0bd08/0x9383f985bc4d5820 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x468:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5476 expref: 18 pid: 13440 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.517449:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d5c1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x462:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201391.517468:0:13443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13443:1875064458267520:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201391.517470:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201391.517493:0:13443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002790950b/0x9383f985bc4d5c2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x468:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.517503:0:13443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002790950b/0x9383f985bc4d5c2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x468:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.517510:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002790950b/0x9383f985bc4d5c2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x468:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.517517:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002790950b/0x9383f985bc4d5c2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x468:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.517524:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002790950b/0x9383f985bc4d5c2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x468:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.517550:0:13443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788201391.519023:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3310:x1875064458267392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20356us (21293us total) trans 4294968878 rc 0/0 00000100:00100000:3.0:1788201391.519038:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4322 00000100:00100000:1.0:1788201391.519423:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+13:3313:x1875064458266624:12345-0@lo:6:osp-syn-1-0.0 Request processed in 29709us (29780us total) trans 4294968879 rc 0/0 00000100:00100000:1.0:1788201391.519431:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4320 00010000:00010000:1.0:1788201391.519459:0:13450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5c17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x444:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.519474:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5c17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x444:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.519486:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5c17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x444:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.519494:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5c17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x444:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.519517:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:3.0:1788201391.519908:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04c12a8380/2, rc 0, transno 4294968879 00000100:00100000:3.0:1788201391.519936:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458266624:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788201391.520760:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201391.520772:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d5c1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x462:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.520786:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201391.520792:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d5c1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x462:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.520881:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d5c1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x462:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.520908:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d5c1e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x462:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.520917:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000566e57bc/0x9383f985bc4d5c1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x462:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.521003:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201391.521008:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002790950b/0x9383f985bc4d5c2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x468:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.521016:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b96a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201391.521020:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002790950b/0x9383f985bc4d5c2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x468:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.521027:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002790950b/0x9383f985bc4d5c2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x468:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.521037:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002790950b/0x9383f985bc4d5c2c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x468:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.521045:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002790950b/0x9383f985bc4d5c2c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x468:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.521060:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201391.521064:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5c17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x444:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.521071:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201391.521074:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5c17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x444:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.521086:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5c17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x444:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.521098:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5c17 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x444:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.521106:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5c17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x444:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.521120:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.521122:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.521124:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.521132:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201391.521260:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f965a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+8:3310:x1875064458266240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 31785us (32146us total) trans 4294968875 rc 0/0 00000100:00100000:1.0:1788201391.521274:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4319 00000100:00100000:3.0:1788201391.521424:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458268928:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201391.521486:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201391.525731:0:13447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:13447:1875064458267264:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201391.525774:0:13447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000750f20a6/0x9383f985bc4d5c25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x467:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201391.525839:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458268928 00000100:00100000:2.0:1788201391.525848:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458268928 00000100:00100000:2.0:1788201391.525918:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4328 00000100:00100000:2.0:1788201391.525929:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3313:x1875064458268928:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201391.525976:0:13440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1134 count 1 00010000:00010000:2.0:1788201391.526007:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004b61b04/0x9383f985bc4d5c56 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x46e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201391.526016:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:2.0:1788201391.526033:0:13440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000ef08765/0x9383f985bc4d58e4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x46e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c554f expref: 17 pid: 13449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.526043:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46e:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788201391.526049:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201391.526054:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004b61b04/0x9383f985bc4d5c56 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x46e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.526094:0:13440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000ef08765/0x9383f985bc4d58e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x46e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c554f expref: 17 pid: 13449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.526109:0:13440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000ef08765/0x9383f985bc4d58e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x46e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c554f expref: 17 pid: 13449 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201391.526125:0:13440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1ba1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:13440:1875064458269056:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201391.526562:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201391.527046:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201391.527066:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442753920 00000100:00100000:3.0:1788201391.527074:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442753920 00010000:00010000:3.0:1788201391.527107:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000021e8ff12/0x9383f985bc4d57da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x467:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5468 expref: 18 pid: 13445 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201391.527140:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442754048 00000100:00100000:3.0:1788201391.527144:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442754048 00010000:00010000:3.0:1788201391.527158:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000097fb199/0x9383f985bc4d5858 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x46a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5492 expref: 19 pid: 13446 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201391.527181:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1572 00000100:00100000:3.0:1788201391.527190:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f53e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:2360:x1875064442753920:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201391.527204:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201391.527210:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000021e8ff12/0x9383f985bc4d57da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x467:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5468 expref: 19 pid: 13445 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.527225:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000021e8ff12/0x9383f985bc4d57da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x467:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5468 expref: 19 pid: 13445 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.527258:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021e8ff12/0x9383f985bc4d57da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x467:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5468 expref: 19 pid: 13445 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.527274:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x467:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201391.527280:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x467:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201391.527366:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000750f20a6/0x9383f985bc4d5c25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x467:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.527376:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000750f20a6/0x9383f985bc4d5c25 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x467:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.527407:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201391.527531:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f53e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+18:2360:x1875064442753920:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 341us (1515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201391.527541:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1572 00000100:00100000:3.0:1788201391.527561:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1573 00000100:00100000:3.0:1788201391.527569:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f53e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+17:2361:x1875064442754048:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201391.527578:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201391.527584:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000097fb199/0x9383f985bc4d5858 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x46a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5492 expref: 17 pid: 13446 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.527596:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000097fb199/0x9383f985bc4d5858 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x46a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5492 expref: 17 pid: 13446 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.527617:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201391.527621:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201391.527626:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d5c33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.527635:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d5c33 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x46a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.527647:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201391.527664:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f53e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+17:2361:x1875064442754048:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 97us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201391.527671:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1573 00000100:00100000:0.0:1788201391.528055:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201391.529314:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201391.529399:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442754304 00000100:00100000:3.0:1788201391.529410:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442754304 00000100:00100000:2.0:1788201391.529427:0:13440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d20f43c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788201391.529449:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d586d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x46c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54ae expref: 17 pid: 12363 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201391.529483:0:13448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1ba2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:13448:1875064458268672:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201391.529512:0:13448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d5c48 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x46c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201391.529548:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442754432 00000100:00100000:3.0:1788201391.529552:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442754432 00010000:00010000:3.0:1788201391.529567:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007f1c741f/0x9383f985bc4d584a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x469:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5484 expref: 18 pid: 13438 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201391.534603:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201391.536160:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442754560 00000100:00100000:3.0:1788201391.536175:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442754560 00010000:00010000:3.0:1788201391.536228:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000def97333/0x9383f985bc4d5866 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x46b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54a0 expref: 19 pid: 13444 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201391.536278:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1574 00000100:00100000:3.0:1788201391.536373:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2191880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+19:2361:x1875064442754304:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201391.536395:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201391.536403:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d586d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x46c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54ae expref: 19 pid: 12363 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.536420:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d586d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x46c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54ae expref: 19 pid: 12363 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.536554:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d586d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x46c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54ae expref: 19 pid: 12363 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.536576:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201391.536582:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201391.536589:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d5c48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.536599:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d5c48 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x46c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.536642:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201391.536770:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2191880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+18:2361:x1875064442754304:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 400us (9724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201391.536779:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1574 00000100:00100000:3.0:1788201391.536885:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1575 00000100:00100000:3.0:1788201391.536895:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c7e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+17:2362:x1875064442754432:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201391.536906:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201391.536913:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007f1c741f/0x9383f985bc4d584a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x469:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5484 expref: 17 pid: 13438 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.536934:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007f1c741f/0x9383f985bc4d584a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x469:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5484 expref: 17 pid: 13438 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.536948:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x469:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201391.536952:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x469:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201391.536957:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d5c4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x469:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.536965:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d5c4f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x469:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.536977:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201391.536997:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c7e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+17:2362:x1875064442754432:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 104us (8943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201391.537004:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1575 00000100:00100000:3.0:1788201391.537057:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1576 00000100:00100000:3.0:1788201391.537064:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2192300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:2362:x1875064442754560:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201391.537072:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201391.537077:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000def97333/0x9383f985bc4d5866 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x46b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54a0 expref: 16 pid: 13444 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.537089:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000def97333/0x9383f985bc4d5866 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x46b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54a0 expref: 16 pid: 13444 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.537101:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201391.537105:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201391.537110:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009b6707ed/0x9383f985bc4d5c41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.537119:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b6707ed/0x9383f985bc4d5c41 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x46b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.537132:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201391.537148:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2192300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+16:2362:x1875064442754560:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 84us (7866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201391.537155:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1576 00010000:00010000:3.0:1788201391.537413:0:13447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000750f20a6/0x9383f985bc4d5c25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x467:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.537426:0:13447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000750f20a6/0x9383f985bc4d5c25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x467:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.537439:0:13447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000750f20a6/0x9383f985bc4d5c25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x467:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.537448:0:13447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000750f20a6/0x9383f985bc4d5c25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x467:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.537482:0:13447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201391.538233:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+14:3310:x1875064458267136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 43684us (43838us total) trans 4294968880 rc 0/0 00000100:00100000:3.0:1788201391.538245:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4321 00010000:00010000:3.0:1788201391.538518:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f1c741f/0x9383f985bc4d584a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x469:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5484 expref: 15 pid: 13438 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201391.538538:0:6706:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1ba2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1875064458268800:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201391.538565:0:6706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d5c4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x469:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.538577:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d5c4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x469:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.538585:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d5c4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x469:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.538597:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d5c4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x469:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.538605:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d5c4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x469:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.538634:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788201391.539178:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3312:x1875064458267648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 27366us (36520us total) trans 4294968881 rc 0/0 00000100:00100000:3.0:1788201391.539187:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4327 00010000:00010000:3.0:1788201391.539227:0:13449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5713b5a/0x9383f985bc4d5c09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x462:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.539239:0:13449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5713b5a/0x9383f985bc4d5c09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x462:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.539249:0:13449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5713b5a/0x9383f985bc4d5c09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x462:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.539258:0:13449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5713b5a/0x9383f985bc4d5c09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x462:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.539268:0:13449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1788201391.539600:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+8:3312:x1875064458266368:12345-0@lo:6:osp-syn-0-0.0 Request processed in 51103us (51314us total) trans 4294968876 rc 0/0 00000100:00100000:3.0:1788201391.539609:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4317 00010000:00010000:2.0:1788201391.540339:0:13451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000def97333/0x9383f985bc4d5866 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x46b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54a0 expref: 14 pid: 13444 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201391.540360:0:13451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:13451:1875064458268544:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201391.540383:0:13451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009b6707ed/0x9383f985bc4d5c41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.540393:0:13451:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009b6707ed/0x9383f985bc4d5c41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.540401:0:13451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b6707ed/0x9383f985bc4d5c41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.540410:0:13451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b6707ed/0x9383f985bc4d5c41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.540418:0:13451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b6707ed/0x9383f985bc4d5c41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x46b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.540428:0:13451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1788201391.540810:0:13451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+14:3310:x1875064458267904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 32453us (33101us total) trans 4294968882 rc 0/0 00000100:00100000:2.0:1788201391.540829:0:13451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4325 00010000:00010000:2.0:1788201391.540864:0:13448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d5c48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.540874:0:13448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d5c48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.540883:0:13448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d5c48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.540891:0:13448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d5c48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x46c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.540901:0:13448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1788201391.541136:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+14:3310:x1875064458268032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 29671us (33370us total) trans 4294968883 rc 0/0 00000100:00100000:2.0:1788201391.541145:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4326 00010000:00010000:0.0:1788201391.541569:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788201391.541580:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000750f20a6/0x9383f985bc4d5c25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x467:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.541590:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b96200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201391.541595:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000750f20a6/0x9383f985bc4d5c25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x467:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.541610:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000750f20a6/0x9383f985bc4d5c25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x467:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.541636:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000750f20a6/0x9383f985bc4d5c25 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x467:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201391.541638:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00de680/2, rc 0, transno 4294968881 00010000:00010000:0.0:1788201391.541644:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000750f20a6/0x9383f985bc4d5c25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x467:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201391.541654:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458267648:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788201391.541668:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000004:00080000:1.0:1788201391.541668:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00ddf80/2, rc 0, transno 4294968876 00010000:00010000:0.0:1788201391.541673:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d5c4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x469:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201391.541679:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458266368:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788201391.541680:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201391.541683:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d5c4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x469:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.541691:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d5c4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x469:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.541713:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d5c4f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x469:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.541721:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d5c4f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x469:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.541740:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201391.541744:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5713b5a/0x9383f985bc4d5c09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x462:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.541751:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201391.541754:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5713b5a/0x9383f985bc4d5c09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x462:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.541762:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5713b5a/0x9383f985bc4d5c09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x462:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.541773:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5713b5a/0x9383f985bc4d5c09 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x462:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.541780:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5713b5a/0x9383f985bc4d5c09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x462:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.541793:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201391.541797:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b6707ed/0x9383f985bc4d5c41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x46b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.541929:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201391.541933:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b6707ed/0x9383f985bc4d5c41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x46b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.541948:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b6707ed/0x9383f985bc4d5c41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x46b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.541958:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b6707ed/0x9383f985bc4d5c41 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x46b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.541965:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b6707ed/0x9383f985bc4d5c41 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x46b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.541979:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201391.541982:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d5c48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x46c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.541989:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201391.541992:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d5c48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x46c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.541999:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d5c48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x46c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.542008:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d5c48 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x46c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.542015:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d5c48 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x46c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.542035:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.542036:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.542038:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.542049:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.542079:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000097fb199/0x9383f985bc4d5858 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x46a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5492 expref: 13 pid: 13446 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201391.542090:0:6703:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1ba1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6703:1875064458268288:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201391.542117:0:6703:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d5c33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.542126:0:6703:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d5c33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.542133:0:6703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d5c33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.542140:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d5c33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.542148:0:6703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d5c33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x46a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.542165:0:6703:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201391.542899:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3313:x1875064458267776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 34924us (39976us total) trans 4294968884 rc 0/0 00000100:00100000:0.0:1788201391.542910:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4323 00000100:00100000:0.0:1788201391.543020:0:13446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f53e2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:13446:1875064458268416:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201391.543039:0:13446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d5c3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x46d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201391.543168:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442754176 00000100:00100000:3.0:1788201391.543178:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442754176 00010000:00010000:3.0:1788201391.543214:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d58cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x46d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54bc expref: 13 pid: 13440 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201391.543247:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1577 00000100:00100000:3.0:1788201391.543257:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2192d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:2361:x1875064442754176:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201391.543272:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201391.543279:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d58cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x46d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54bc expref: 13 pid: 13440 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.543377:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d58cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x46d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54bc expref: 13 pid: 13440 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.543400:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d58cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x46d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54bc expref: 13 pid: 13440 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.543416:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201391.543422:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201391.543429:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d5c3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.543439:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d5c3a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x46d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.543539:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201391.543590:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2192d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:2361:x1875064442754176:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 334us (9001us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201391.543598:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1577 00010000:00010000:0.0:1788201391.543793:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201391.543986:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d5c33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x46a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.543997:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201391.544002:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d5c33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x46a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.544013:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d5c33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x46a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.544027:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d5c33 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x46a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.544035:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d5c33 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x46a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.544056:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.544058:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.544060:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201391.544071:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201391.544091:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458269184:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201391.544138:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201391.544180:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201391.544194:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458269184 00000100:00100000:0.0:1788201391.544200:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458269184 00000100:00100000:0.0:1788201391.544238:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4329 00000100:00100000:0.0:1788201391.544246:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3311:x1875064458269184:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201391.544279:0:13438:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1135 count 1 00010000:00010000:2.0:1788201391.545267:0:13446:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d5c3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.545285:0:13446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d5c3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.545314:0:13446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d5c3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.545324:0:13446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d5c3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x46d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.545350:0:13446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201391.545917:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+15:3313:x1875064458268160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 37781us (38331us total) trans 4294968885 rc 0/0 00000100:00100000:2.0:1788201391.545927:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4324 00000100:00100000:2.0:1788201391.545997:0:13440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1ba1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:13440:1875064458269056:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201391.546025:0:13440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000004b61b04/0x9383f985bc4d5c56 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x46e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201391.546066:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:0.0:1788201391.546161:0:13438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000170145d5/0x9383f985bc4d5c5d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x46f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.546181:0:13438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000031c8e9d7/0x9383f985bc4d58eb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x46f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c555d expref: 11 pid: 13449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.546191:0:13438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46f:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788201391.546197:0:13438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201391.546202:0:13438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000170145d5/0x9383f985bc4d5c5d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x46f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.546252:0:13438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000031c8e9d7/0x9383f985bc4d58eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x46f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c555d expref: 11 pid: 13449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.546266:0:13438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000031c8e9d7/0x9383f985bc4d58eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x46f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c555d expref: 11 pid: 13449 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201391.546442:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00dca80/2, rc 0, transno 4294968883 00000100:00100000:3.0:1788201391.546531:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458268032:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788201391.546549:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00dce00/2, rc 0, transno 4294968882 00000100:00100000:3.0:1788201391.546553:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458267904:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788201391.546566:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00dd500/2, rc 0, transno 4294968878 00000100:00100000:3.0:1788201391.546570:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458267392:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788201391.546579:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f53e3800/2, rc 0, transno 4294968880 00000100:00100000:3.0:1788201391.546582:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f53e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458267136:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788201391.546596:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00dd880/2, rc 0, transno 4294968875 00000100:00100000:3.0:1788201391.546606:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458266240:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788201391.546615:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04d1f0d880/2, rc 0, transno 4294968874 00000100:00100000:3.0:1788201391.546619:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d1f0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458266112:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201391.546783:0:13438:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2190380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13438:1875064458269312:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201391.547225:0:13438:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1f35c00 going to sleep for 11 seconds 00010000:00010000:0.0:1788201391.547245:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201391.547255:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d5c3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x46d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.547266:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201391.547271:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d5c3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x46d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.547281:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d5c3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x46d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201391.547287:0:13526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442754688 00000100:00100000:2.0:1788201391.547312:0:13526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442754688 00010000:00010000:2.0:1788201391.547350:0:13526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000ef08765/0x9383f985bc4d58e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x46e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c554f expref: 12 pid: 13449 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201391.547385:0:13526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1578 00000100:00100000:2.0:1788201391.547395:0:13526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:2360:x1875064442754688:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201391.547414:0:13526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201391.547420:0:13526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000ef08765/0x9383f985bc4d58e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x46e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c554f expref: 12 pid: 13449 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.547434:0:13526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000ef08765/0x9383f985bc4d58e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x46e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c554f expref: 12 pid: 13449 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.547461:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ef08765/0x9383f985bc4d58e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x46e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c554f expref: 12 pid: 13449 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.547476:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201391.547480:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201391.547486:0:13526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000004b61b04/0x9383f985bc4d5c56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.547495:0:13526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004b61b04/0x9383f985bc4d5c56 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x46e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.547527:0:13526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201391.547551:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d5c3a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x46d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201391.547558:0:13526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:2360:x1875064442754688:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 165us (1493us total) trans 0 rc 0/0 00010000:00010000:0.0:1788201391.547560:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d5c3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x46d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201391.547567:0:13526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1578 00010000:00010000:0.0:1788201391.547583:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.547585:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.547587:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201391.547598:0:13440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000004b61b04/0x9383f985bc4d5c56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.547606:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004b61b04/0x9383f985bc4d5c56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.547616:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004b61b04/0x9383f985bc4d5c56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201391.547624:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00df800/2, rc 0, transno 4294968885 00010000:00010000:2.0:1788201391.547624:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004b61b04/0x9383f985bc4d5c56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x46e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201391.547629:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458268160:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788201391.547639:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00dc000/2, rc 0, transno 4294968884 00010000:00010000:2.0:1788201391.547641:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201391.547643:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458267776:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788201391.547656:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201391.547661:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004b61b04/0x9383f985bc4d5c56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x46e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.547673:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b96c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201391.547676:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004b61b04/0x9383f985bc4d5c56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x46e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.547683:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004b61b04/0x9383f985bc4d5c56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x46e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.547694:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004b61b04/0x9383f985bc4d5c56 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x46e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201391.548110:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3313:x1875064458268928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22182us (26623us total) trans 4294968886 rc 0/0 00000100:00100000:2.0:1788201391.548119:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4328 00010000:00010000:0.0:1788201391.548962:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004b61b04/0x9383f985bc4d5c56 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x46e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.548993:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.548996:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.548998:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788201391.549039:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00de300/2, rc 0, transno 4294968886 00000100:00100000:0.0:1788201391.549048:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458268928:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201391.553607:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1ba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458269824:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201391.553709:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201391.553769:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788201391.553775:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1ba1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458269440:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201391.553798:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201391.553827:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1ba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458269952:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201391.553847:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201391.554279:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458269824 00000100:00100000:0.0:1788201391.554394:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458269824 00000100:00100000:0.0:1788201391.554535:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458269440 00000100:00100000:0.0:1788201391.554539:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458269440 00000100:00100000:3.0:1788201391.555199:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458269952 00000100:00100000:3.0:1788201391.555206:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458269952 00000100:00100000:3.0:1788201391.555250:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4330 00000100:00100000:3.0:1788201391.555261:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+17:3310:x1875064458269824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788201391.555332:0:13444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1125 count 1 00010000:00010000:3.0:1788201391.555367:0:13444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d5c64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x465:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.555394:0:13444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d5ba0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x465:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5890 expref: 10 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.555405:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x465:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788201391.555410:0:13444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x465:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201391.555415:0:13444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d5c64 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x465:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.555665:0:13444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d5ba0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x465:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5890 expref: 10 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.555682:0:13444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d5ba0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x465:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5890 expref: 10 pid: 6706 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201391.555701:0:13444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13444:1875064458270080:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201391.556085:0:13444:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c18493c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201391.558992:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201391.559032:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442754816 00000100:00100000:3.0:1788201391.559043:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442754816 00010000:00010000:3.0:1788201391.559090:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000031c8e9d7/0x9383f985bc4d58eb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x46f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c555d expref: 11 pid: 13449 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201391.559132:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1579 00000100:00100000:3.0:1788201391.559144:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:2360:x1875064442754816:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201391.559164:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201391.559170:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000031c8e9d7/0x9383f985bc4d58eb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x46f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c555d expref: 11 pid: 13449 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.559185:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000031c8e9d7/0x9383f985bc4d58eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x46f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c555d expref: 11 pid: 13449 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.559221:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201391.559226:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201391.559234:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000170145d5/0x9383f985bc4d5c5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.559252:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000170145d5/0x9383f985bc4d5c5d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x46f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.559279:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201391.559369:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:2360:x1875064442754816:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 226us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201391.559378:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1579 00000100:00100000:3.0:1788201391.560359:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201391.560389:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442754944 00000100:00100000:3.0:1788201391.560396:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442754944 00010000:00010000:3.0:1788201391.560424:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d5ba0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x465:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5890 expref: 11 pid: 6706 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201391.560586:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1580 00000100:00100000:3.0:1788201391.560596:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:2360:x1875064442754944:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201391.560610:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201391.560614:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d5ba0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x465:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5890 expref: 11 pid: 6706 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.560627:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d5ba0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x465:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5890 expref: 11 pid: 6706 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.560649:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x465:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201391.560653:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x465:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201391.560658:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d5c64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x465:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.560668:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d5c64 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x465:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.560685:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201391.560731:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:2360:x1875064442754944:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 136us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201391.560738:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1580 00000100:00100000:0.0:1788201391.560864:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4331 00000100:00100000:1.0:1788201391.560873:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1ba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458269568:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201391.560878:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3310:x1875064458269440:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201391.560915:0:13443:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1136 count 1 00000100:00100000:1.0:1788201391.560930:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201391.560971:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201391.560978:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458269696:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201391.561003:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201391.561030:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458269568 00000100:00100000:1.0:1788201391.561035:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458269568 00000100:00100000:1.0:1788201391.561066:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458269696 00000100:00100000:1.0:1788201391.561069:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458269696 00000100:00100000:1.0:1788201391.561090:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4332 00000100:00100000:1.0:1788201391.561097:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+19:3310:x1875064458269952:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788201391.561110:0:13445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1126 count 1 00010000:00010000:1.0:1788201391.561137:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d5c6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x466:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.561206:0:13443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ed1cf26/0x9383f985bc4d5c72 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x470:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.561221:0:13443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ab0efb21/0x9383f985bc4d58f2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x470:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c556b expref: 10 pid: 13449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.561228:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x470:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788201391.561232:0:13443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x470:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201391.561235:0:13443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ed1cf26/0x9383f985bc4d5c72 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x470:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.561270:0:13443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ab0efb21/0x9383f985bc4d58f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x470:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c556b expref: 10 pid: 13449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.561313:0:13443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ab0efb21/0x9383f985bc4d58f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x470:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c556b expref: 10 pid: 13449 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201391.561326:0:13443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2191f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13443:1875064458270208:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201391.561375:0:13443:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1f35480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201391.561394:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4333 00000100:00100000:0.0:1788201391.561403:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3312:x1875064458269568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201391.561419:0:10484:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1123 count 1 00010000:00010000:0.0:1788201391.561431:0:10484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d5c79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x463:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.561444:0:10484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000270dcb9a/0x9383f985bc4d5aff lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x463:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c582e expref: 10 pid: 13442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.561568:0:10484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x463:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788201391.561572:0:10484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x463:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201391.561577:0:10484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d5c79 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x463:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.561599:0:10484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000270dcb9a/0x9383f985bc4d5aff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x463:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c582e expref: 10 pid: 13442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.561610:0:10484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000270dcb9a/0x9383f985bc4d5aff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x463:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c582e expref: 10 pid: 13442 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201391.561622:0:10484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2192a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10484:1875064458270336:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201391.561649:0:10484:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1f35b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201391.561670:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4334 00000100:00100000:0.0:1788201391.561678:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3312:x1875064458269696:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201391.561691:0:13442:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1124 count 1 00010000:00010000:0.0:1788201391.561715:0:13442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000558b5a3d/0x9383f985bc4d5c80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x464:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.561729:0:13442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000940106f/0x9383f985bc4d5b5a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x464:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5882 expref: 10 pid: 13439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.561737:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x464:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788201391.561741:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x464:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201391.561745:0:13442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000558b5a3d/0x9383f985bc4d5c80 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x464:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.561765:0:13442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000940106f/0x9383f985bc4d5b5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x464:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5882 expref: 10 pid: 13439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.561775:0:13442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000940106f/0x9383f985bc4d5b5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x464:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5882 expref: 10 pid: 13439 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201391.561786:0:13442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2191c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:13442:1875064458270464:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201391.561893:0:13442:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1f35cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1788201391.562003:0:13444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d5ba0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x465:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5890 expref: 10 pid: 6706 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201391.562022:0:13444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13444:1875064458270080:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201391.562056:0:13444:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d5c64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x465:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.562069:0:13444:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d5c64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x465:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.562078:0:13444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d5c64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x465:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.562089:0:13444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d5c64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x465:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.562099:0:13444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d5c64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x465:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.562124:0:13444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201391.563263:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:3310:x1875064458269824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7998us (9549us total) trans 4294968887 rc 0/0 00000100:00100000:0.0:1788201391.563274:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4330 00010000:00010000:1.0:1788201391.563332:0:13445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d5be6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x466:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c589e expref: 9 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.563349:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x466:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788201391.563354:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x466:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201391.563360:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d5c6b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x466:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.563401:0:13445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d5be6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x466:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c589e expref: 9 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.563403:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201391.563412:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d5c64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x465:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.563414:0:13445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d5be6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x466:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c589e expref: 9 pid: 6705 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.563422:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201391.563428:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d5c64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x465:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201391.563431:0:13445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13445:1875064458270592:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201391.563441:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d5c64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x465:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201391.563489:0:13445:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91180 going to sleep for 11 seconds 00010000:00010000:0.0:1788201391.563543:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d5c64 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x465:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.563552:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d5c64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x465:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.563576:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.563578:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.563580:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.563618:0:13438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031c8e9d7/0x9383f985bc4d58eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x46f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c555d expref: 9 pid: 13449 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201391.563630:0:13438:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2190380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13438:1875064458269312:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201391.563650:0:13438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000170145d5/0x9383f985bc4d5c5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.563661:0:13438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000170145d5/0x9383f985bc4d5c5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.563669:0:13438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000170145d5/0x9383f985bc4d5c5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.563679:0:13438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000170145d5/0x9383f985bc4d5c5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.563688:0:13438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000170145d5/0x9383f985bc4d5c5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x46f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.564632:0:13438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201391.566112:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3311:x1875064458269184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 21858us (21966us total) trans 4294968888 rc 0/0 00000100:00100000:0.0:1788201391.566126:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4329 00000004:00080000:0.0:1788201391.566205:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c1ba3480/2, rc 0, transno 4294968887 00000100:00100000:0.0:1788201391.566213:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1ba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458269824:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788201391.566393:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00dc700/2, rc 0, transno 4294968888 00000100:00100000:3.0:1788201391.566399:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458269184:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788201391.566642:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201391.566654:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000170145d5/0x9383f985bc4d5c5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x46f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.566670:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201391.566675:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000170145d5/0x9383f985bc4d5c5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x46f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.566689:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000170145d5/0x9383f985bc4d5c5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x46f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.566794:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000170145d5/0x9383f985bc4d5c5d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x46f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.566802:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000170145d5/0x9383f985bc4d5c5d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x46f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.566834:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201391.566836:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201391.566837:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201391.573670:0:10484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2192a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10484:1875064458270336:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201391.573731:0:10484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d5c79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x463:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201391.573772:0:13443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2191f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13443:1875064458270208:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201391.573783:0:13443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008ed1cf26/0x9383f985bc4d5c72 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x470:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201391.573981:0:13442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2191c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:13442:1875064458270464:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201391.573997:0:13442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000558b5a3d/0x9383f985bc4d5c80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x464:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788201391.575440:0:17712:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788201391.575496:0:17712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c507da00/0x9383f985bc4d4cff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4d06 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.575510:0:17712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c507da00/0x9383f985bc4d4cff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d4d06 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.575517:0:17712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c507da00/0x9383f985bc4d4cff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d4d06 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.575524:0:17712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e03c507da00/0x9383f985bc4d4cff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d4d06 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.575548:0:17712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788201391.575554:0:17712:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788201391.575585:0:17712:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201391.575590:0:17712:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788201391.575596:0:17712:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788201391.575625:0:17712:0:(import.c:65:import_set_state_nolock()) ffff9e03c371d800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788201391.575711:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201391.575720:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e03c507da00/0x9383f985bc4d4cff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d4d06 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.575729:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507da00 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:1.0:1788201391.575733:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e03c507da00/0x9383f985bc4d4cff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d4d06 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.575742:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c507da00/0x9383f985bc4d4cff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x9383f985bc4d4d06 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201391.575750:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c507da00/0x9383f985bc4d4cff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x9383f985bc4d4d06 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201391.575756:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788201391.575759:0:5845:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788201391.575761:0:5845:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788201391.575791:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e03c507da00/0x9383f985bc4d4cff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d4d06 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.575798:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201391.575837:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e03c507da00/0x9383f985bc4d4cff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d4d06 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.575845:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c507da00/0x9383f985bc4d4cff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d4d06 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.575862:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201391.575864:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201391.575866:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201391.575875:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201391.575896:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458270848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201391.575981:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201391.576400:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458270848 00000100:00100000:1.0:1788201391.576409:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458270848 00000100:00100000:3.0:1788201391.576539:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1ba0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875064458270720:0@lo:39:umount.0 00000100:00100000:3.0:1788201391.576579:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201391.576685:0:16722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458270720 00000100:00100000:0.0:1788201391.576690:0:16722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458270720 00000100:00100000:0.0:1788201391.577085:0:16722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788201391.577099:0:16722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875064458270720:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788201391.577136:0:16722:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d4da7 00000100:00080000:0.0:1788201391.577156:0:16722:0:(import.c:65:import_set_state_nolock()) ffff9e04c6b1f800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788201391.577233:0:16722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3309:x1875064458270720:12345-0@lo:39:umount.0 Request processed in 137us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201391.577241:0:16722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000020:00000080:0.0:1788201391.577254:0:16722:0:(genops.c:906:class_export_put()) final put ffff9e04c6b18800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:1.0:1788201391.577847:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788201391.577863:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3313:x1875064458270848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201391.577881:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201391.577903:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c5065200/0x9383f985bc4d4d06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d4cff expref: 19 pid: 16738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.577920:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201391.577966:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b60c000b-7335-444d-a8dc-1a5956712fb2+18:3313:x1875064458270848:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (1985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201391.577973:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1788201391.577983:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788201391.577992:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c6b18800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:3.0:1788201391.578204:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e03c371d800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788201391.578220:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1ba0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875064458270720:0@lo:39:umount.0 00000100:00080000:2.0:1788201391.578379:0:17712:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201391.578383:0:17712:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788201391.578388:0:17712:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788201391.578712:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04c6b1f800 for lustre-MDT0000 00000100:00100000:1.0:1788201391.579287:0:13445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13445:1875064458270592:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201391.579334:0:13445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d5c6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x466:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201391.579375:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458270848:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201391.579899:0:17712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4000/0x9383f985bc4d4c50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4c57 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.579913:0:17712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4000/0x9383f985bc4d4c50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d4c57 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.579922:0:17712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4000/0x9383f985bc4d4c50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d4c57 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.579930:0:17712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4000/0x9383f985bc4d4c50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d4c57 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.579957:0:17712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201391.579965:0:17712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e0501b28000/0x9383f985bc4d4d29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4d30 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.579973:0:17712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e0501b28000/0x9383f985bc4d4d29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d4d30 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.579979:0:17712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e0501b28000/0x9383f985bc4d4d29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d4d30 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.579984:0:17712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e0501b28000/0x9383f985bc4d4d29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d4d30 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.580005:0:17712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788201391.580013:0:17712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c507d400/0x9383f985bc4d4cf1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4cf8 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.580019:0:17712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c507d400/0x9383f985bc4d4cf1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d4cf8 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.580026:0:17712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c507d400/0x9383f985bc4d4cf1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d4cf8 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.580031:0:17712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e03c507d400/0x9383f985bc4d4cf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d4cf8 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.580050:0:17712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788201391.580056:0:17712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce5e00/0x9383f985bc4d4c42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d4c49 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.580063:0:17712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce5e00/0x9383f985bc4d4c42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d4c49 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.580069:0:17712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce5e00/0x9383f985bc4d4c42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d4c49 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.580074:0:17712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce5e00/0x9383f985bc4d4c42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d4c49 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.580081:0:17712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1788201391.580084:0:17712:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788201391.580113:0:17712:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788201391.580119:0:17712:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:2.0:1788201391.580123:0:17712:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1788201391.580129:0:17712:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:3.0:1788201391.580170:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788201391.580179:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4000/0x9383f985bc4d4c50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d4c57 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.580187:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9ce4000 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1788201391.580191:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4000/0x9383f985bc4d4c50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d4c57 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.580201:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4000/0x9383f985bc4d4c50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x9383f985bc4d4c57 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201391.580216:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4000/0x9383f985bc4d4c50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x9383f985bc4d4c57 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201391.580223:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788201391.580226:0:5846:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1788201391.580228:0:5846:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1788201391.580235:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201391.580241:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e0501b28000/0x9383f985bc4d4d29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d4d30 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.580249:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0501b28000 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:1.0:1788201391.580251:0:7645:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e0501b28000/0x9383f985bc4d4d29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d4d30 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.580257:0:7645:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e0501b28000/0x9383f985bc4d4d29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9383f985bc4d4d30 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201391.580263:0:7645:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e0501b28000/0x9383f985bc4d4d29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9383f985bc4d4d30 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201391.580269:0:7645:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201391.580270:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4000/0x9383f985bc4d4c50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d4c57 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201391.580271:0:7645:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788201391.580273:0:7645:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788201391.580276:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201391.580285:0:7645:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e0501b28000/0x9383f985bc4d4d29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d4d30 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.580291:0:7645:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201391.580337:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4000/0x9383f985bc4d4c50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d4c57 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.580344:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce4000/0x9383f985bc4d4c50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d4c57 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.580355:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e0501b28000/0x9383f985bc4d4d29 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d4d30 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.580359:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201391.580362:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e0501b28000/0x9383f985bc4d4d29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d4d30 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.580362:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e03c507d400/0x9383f985bc4d4cf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d4cf8 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.580369:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d400 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1788201391.580371:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e03c507d400/0x9383f985bc4d4cf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d4cf8 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.580375:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201391.580379:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce5e00/0x9383f985bc4d4c42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d4c49 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.580379:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c507d400/0x9383f985bc4d4cf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9383f985bc4d4cf8 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.580385:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04f9ce5e00 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1788201391.580386:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c507d400/0x9383f985bc4d4cf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9383f985bc4d4cf8 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201391.580388:0:7645:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce5e00/0x9383f985bc4d4c42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d4c49 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.580396:0:7645:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce5e00/0x9383f985bc4d4c42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9383f985bc4d4c49 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201391.580398:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788201391.580400:0:5846:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788201391.580402:0:5846:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:00010000:1.0:1788201391.580403:0:7645:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce5e00/0x9383f985bc4d4c42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9383f985bc4d4c49 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201391.580408:0:7645:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788201391.580410:0:7645:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788201391.580412:0:7645:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788201391.580413:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e03c507d400/0x9383f985bc4d4cf1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d4cf8 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.580418:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201391.580420:0:7645:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce5e00/0x9383f985bc4d4c42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d4c49 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.580423:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e03c507d400/0x9383f985bc4d4cf1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d4cf8 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.580426:0:7645:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201391.580430:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c507d400/0x9383f985bc4d4cf1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d4cf8 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.580431:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce5e00/0x9383f985bc4d4c42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d4c49 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.580438:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e04f9ce5e00/0x9383f985bc4d4c42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d4c49 expref: -99 pid: 16708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.580438:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201391.580439:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201391.580441:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201391.580448:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201391.580449:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201391.580451:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201391.580468:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458271232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201391.580548:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201391.580837:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201391.580846:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458271104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201391.580871:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201391.581013:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458270976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201391.581041:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201391.581060:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458271232 00000100:00100000:3.0:1788201391.581069:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458271232 00000100:00100000:3.0:1788201391.581123:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458271104 00000100:00100000:3.0:1788201391.581126:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458271104 00000100:00100000:1.0:1788201391.581242:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201391.581249:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458271360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201391.581272:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201391.581322:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458270976 00000100:00100000:1.0:1788201391.581326:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458270976 00000100:00100000:1.0:1788201391.581355:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458271360 00000100:00100000:1.0:1788201391.581358:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458271360 00000100:00100000:1.0:1788201391.581375:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788201391.581386:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8093050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b60c000b-7335-444d-a8dc-1a5956712fb2+21:3311:x1875064458271232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201391.581402:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201391.581421:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c507cc00/0x9383f985bc4d4cf8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d4cf1 expref: 21 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.581437:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201391.581475:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8093050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b60c000b-7335-444d-a8dc-1a5956712fb2+20:3311:x1875064458271232:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201391.581483:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788201391.581534:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788201391.581541:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458271104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201391.581549:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201391.581559:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c5064000/0x9383f985bc4d4d30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d4d29 expref: 19 pid: 16711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.581569:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201391.581591:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b60c000b-7335-444d-a8dc-1a5956712fb2+18:3311:x1875064458271104:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201391.581597:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788201391.581610:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788201391.581616:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b60c000b-7335-444d-a8dc-1a5956712fb2+17:3313:x1875064458270976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201391.581623:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201391.581632:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c5064a00/0x9383f985bc4d4c57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d4c50 expref: 17 pid: 16738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.581641:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201391.581665:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b60c000b-7335-444d-a8dc-1a5956712fb2+16:3313:x1875064458270976:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201391.581671:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788201391.581683:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788201391.581690:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b60c000b-7335-444d-a8dc-1a5956712fb2+15:3313:x1875064458271360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201391.581697:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201391.581706:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0501b29200/0x9383f985bc4d4c49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d4c42 expref: 15 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.581717:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201391.581738:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b60c000b-7335-444d-a8dc-1a5956712fb2+14:3313:x1875064458271360:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201391.581744:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788201391.581782:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458271104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201391.581792:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458271232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201391.581833:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458271360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201391.581841:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458270976:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201391.582224:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:2.0:1788201391.582276:0:17712:0:(mdt_handler.c:8183:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000100:00100000:0.0:1788201391.583805:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201391.583849:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442755072 00000100:00100000:0.0:1788201391.583860:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442755072 00010000:00010000:0.0:1788201391.583901:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000270dcb9a/0x9383f985bc4d5aff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x463:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c582e expref: 9 pid: 13442 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201391.583941:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1581 00000100:00100000:0.0:1788201391.583951:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2191f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:2360:x1875064442755072:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201391.583967:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201391.583974:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000270dcb9a/0x9383f985bc4d5aff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x463:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c582e expref: 9 pid: 13442 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.583988:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000270dcb9a/0x9383f985bc4d5aff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x463:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c582e expref: 9 pid: 13442 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.584016:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000270dcb9a/0x9383f985bc4d5aff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x463:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c582e expref: 9 pid: 13442 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.584033:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x463:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201391.584039:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x463:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201391.584046:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d5c79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x463:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.584059:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d5c79 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x463:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.584090:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201391.584215:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2191f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2360:x1875064442755072:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 265us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201391.584226:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1581 00010000:00010000:0.0:1788201391.584260:0:10484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d5c79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x463:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.584271:0:10484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d5c79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x463:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.584282:0:10484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d5c79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x463:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.584290:0:10484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d5c79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x463:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.584331:0:10484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201391.585065:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3312:x1875064458269568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23663us (24132us total) trans 4294968889 rc 0/0 00000100:00100000:0.0:1788201391.585073:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4333 00010000:00010000:0.0:1788201391.585099:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201391.585104:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d5c79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x463:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.585111:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201391.585115:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d5c79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x463:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.585123:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d5c79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x463:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.585137:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d5c79 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x463:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.585143:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d5c79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x463:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.585680:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.585683:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.585684:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201391.585730:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201391.585838:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442755328 00000100:00100000:1.0:1788201391.585849:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442755328 00010000:00010000:1.0:1788201391.585882:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ab0efb21/0x9383f985bc4d58f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x470:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c556b expref: 8 pid: 13449 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201391.585910:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1582 00000100:00100000:1.0:1788201391.585919:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2192a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2360:x1875064442755328:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201391.585934:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201391.585942:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ab0efb21/0x9383f985bc4d58f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x470:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c556b expref: 8 pid: 13449 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201391.585946:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:1.0:1788201391.585956:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ab0efb21/0x9383f985bc4d58f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x470:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c556b expref: 8 pid: 13449 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201391.585972:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:1.0:1788201391.585974:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab0efb21/0x9383f985bc4d58f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x470:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c556b expref: 8 pid: 13449 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.585988:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x470:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201391.585992:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x470:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201391.585998:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ed1cf26/0x9383f985bc4d5c72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x470:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.586009:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ed1cf26/0x9383f985bc4d5c72 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x470:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.586042:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:2.0:1788201391.586087:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c1ba2300/2, rc 0, transno 4294968889 00000100:00100000:2.0:1788201391.586095:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1ba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458269568:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788201391.586265:0:13443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008ed1cf26/0x9383f985bc4d5c72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x470:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.586276:0:13443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ed1cf26/0x9383f985bc4d5c72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x470:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.586287:0:13443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ed1cf26/0x9383f985bc4d5c72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x470:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.586313:0:13443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ed1cf26/0x9383f985bc4d5c72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x470:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.586330:0:13443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201391.587594:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442755200 00000100:00100000:2.0:1788201391.587606:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442755200 00010000:00010000:2.0:1788201391.587642:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000940106f/0x9383f985bc4d5b5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x464:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5882 expref: 8 pid: 13439 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201391.587674:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442755456 00000100:00100000:2.0:1788201391.587678:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442755456 00010000:00010000:2.0:1788201391.587693:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d5be6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x466:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c589e expref: 9 pid: 6705 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201391.587716:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1583 00000100:00100000:2.0:1788201391.587725:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2190380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:2360:x1875064442755200:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201391.587742:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201391.587748:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000940106f/0x9383f985bc4d5b5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x464:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5882 expref: 9 pid: 13439 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.587761:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000940106f/0x9383f985bc4d5b5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x464:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5882 expref: 9 pid: 13439 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.587786:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000940106f/0x9383f985bc4d5b5a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x464:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5882 expref: 9 pid: 13439 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.587802:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x464:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201391.587807:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x464:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201391.587820:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000558b5a3d/0x9383f985bc4d5c80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x464:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.587831:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000558b5a3d/0x9383f985bc4d5c80 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x464:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.587858:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201391.588426:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201391.588436:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ed1cf26/0x9383f985bc4d5c72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x470:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.588447:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201391.588454:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ed1cf26/0x9383f985bc4d5c72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x470:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.588464:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ed1cf26/0x9383f985bc4d5c72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x470:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.588479:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ed1cf26/0x9383f985bc4d5c72 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x470:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.588488:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ed1cf26/0x9383f985bc4d5c72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x470:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.588508:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.588511:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.588513:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201391.588532:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1584 00000100:00100000:0.0:1788201391.588544:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8090450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2360:x1875064442755456:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201391.588558:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201391.588565:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d5be6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x466:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c589e expref: 8 pid: 6705 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.588578:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d5be6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x466:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c589e expref: 8 pid: 6705 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.588593:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002c7609e/0x9383f985bc4d5be6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x466:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c589e expref: 8 pid: 6705 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.588603:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x466:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201391.588607:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x466:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201391.588611:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d5c6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x466:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.588620:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d5c6b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x466:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.588806:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201391.588847:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8090450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442755456:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 305us (2872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201391.588855:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1584 00010000:00010000:0.0:1788201391.588887:0:13445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d5c6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x466:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.588897:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d5c6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x466:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.588908:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d5c6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x466:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.588916:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d5c6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x466:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.588933:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788201391.588989:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2192a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2360:x1875064442755328:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 3068us (3258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201391.588997:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1582 00000100:00100000:2.0:1788201391.589245:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2190380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2360:x1875064442755200:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1519us (3297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201391.589254:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1583 00010000:00010000:2.0:1788201391.589341:0:13442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000558b5a3d/0x9383f985bc4d5c80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x464:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.589351:0:13442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000558b5a3d/0x9383f985bc4d5c80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x464:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.589359:0:13442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000558b5a3d/0x9383f985bc4d5c80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x464:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.589367:0:13442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000558b5a3d/0x9383f985bc4d5c80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x464:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.589385:0:13442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788201391.589730:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3312:x1875064458269696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 28052us (28724us total) trans 4294968891 rc 0/0 00000100:00100000:2.0:1788201391.589740:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4334 00000004:00080000:2.0:1788201391.589798:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c1ba0a80/2, rc 0, transno 4294968891 00000100:00100000:2.0:1788201391.589806:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458269696:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201391.590332:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+21:3310:x1875064458269952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 29233us (36480us total) trans 4294968892 rc 0/0 00000100:00100000:0.0:1788201391.590340:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4332 00010000:00010000:0.0:1788201391.590363:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201391.590371:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d5c6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x466:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.590381:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030000 already unused, calling callback (ffffffffc13fbfe0) 00000100:00100000:1.0:1788201391.590383:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3310:x1875064458269440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 29509us (36582us total) trans 4294968890 rc 0/0 00010000:00010000:0.0:1788201391.590386:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d5c6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x466:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201391.590392:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4331 00010000:00010000:0.0:1788201391.590396:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d5c6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x466:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.590418:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d5c6b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x466:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.590427:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efdbf363/0x9383f985bc4d5c6b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x466:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.590449:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201391.590453:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000558b5a3d/0x9383f985bc4d5c80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x464:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.590466:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201391.590469:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000558b5a3d/0x9383f985bc4d5c80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x464:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.590477:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000558b5a3d/0x9383f985bc4d5c80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x464:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.590487:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000558b5a3d/0x9383f985bc4d5c80 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x464:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.590494:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000558b5a3d/0x9383f985bc4d5c80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x464:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.590508:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.590510:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.590512:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201391.590665:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788201391.590847:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c1ba0700/2, rc 0, transno 4294968892 00000100:00100000:2.0:1788201391.590853:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1ba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458269952:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788201391.590869:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c1ba1c00/2, rc 0, transno 4294968890 00000100:00100000:2.0:1788201391.590873:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1ba1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458269440:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788201391.621033:0:16726:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:0.0:1788201391.621260:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458271872:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201391.621374:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201391.621417:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2191500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458272384:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201391.621440:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201391.621464:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458271872 00000100:00100000:0.0:1788201391.621467:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788201391.621472:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458271488:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201391.621474:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458271872 00000100:00100000:0.0:1788201391.621493:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201391.621510:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458272000:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201391.621532:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201391.621732:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2190700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458271744:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201391.621767:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201391.623666:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458272384 00000100:00100000:3.0:1788201391.623682:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458272384 00000100:00100000:1.0:1788201391.623745:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458272256:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201391.623746:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458271488 00000100:00100000:3.0:1788201391.623749:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458271488 00000100:00100000:1.0:1788201391.623831:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201391.623859:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788201391.623865:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458271616:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201391.623887:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201391.623905:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458272128:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201391.624117:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201391.624152:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458272000 00000100:00100000:1.0:1788201391.624156:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458272000 00000100:00100000:1.0:1788201391.624184:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458271744 00000100:00100000:1.0:1788201391.624188:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458271744 00000100:00100000:1.0:1788201391.624203:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458272256 00000100:00100000:1.0:1788201391.624206:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458272256 00000100:00100000:1.0:1788201391.624222:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458271616 00000100:00100000:1.0:1788201391.624225:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458271616 00000100:00100000:1.0:1788201391.624242:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458272128 00000100:00100000:1.0:1788201391.624245:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458272128 00000100:00100000:1.0:1788201391.624264:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4335 00000100:00100000:1.0:1788201391.624275:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+15:3312:x1875064458271872:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201391.624343:0:13446:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1130 count 1 00010000:00010000:1.0:1788201391.624381:0:13446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4d5c87 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x46a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.624415:0:13446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab45217d/0x9383f985bc4d5851 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x46a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c548b expref: 518 pid: 13446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.624425:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46a:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788201391.624430:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201391.624436:0:13446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4d5c87 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x46a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.624478:0:13446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ab45217d/0x9383f985bc4d5851 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x46a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c548b expref: 518 pid: 13446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.624496:0:13446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ab45217d/0x9383f985bc4d5851 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x46a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c548b expref: 518 pid: 13446 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201391.624511:0:13446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:13446:1875064458272512:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201391.624592:0:13446:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201391.624611:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4336 00000100:00100000:1.0:1788201391.624619:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3312:x1875064458272384:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201391.624631:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4337 00002000:00080000:1.0:1788201391.624633:0:13440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1133 count 1 00000100:00100000:3.0:1788201391.624640:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3312:x1875064458272000:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788201391.624645:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002c7609e/0x9383f985bc4d5c8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x46d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788201391.624650:0:6706:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1131 count 1 00010000:00010000:1.0:1788201391.624658:0:13440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e749fcab/0x9383f985bc4d5874 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x46d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54b5 expref: 518 pid: 13446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.624663:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d5c95 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x46b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.624672:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46d:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788201391.624675:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201391.624675:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003c440989/0x9383f985bc4d585f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x46b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5499 expref: 518 pid: 13444 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.624680:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002c7609e/0x9383f985bc4d5c8e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x46d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.624682:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46b:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788201391.624685:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201391.624688:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d5c95 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x46b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.624707:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003c440989/0x9383f985bc4d585f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x46b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5499 expref: 518 pid: 13444 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.624712:0:13440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e749fcab/0x9383f985bc4d5874 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x46d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54b5 expref: 518 pid: 13446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.624717:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003c440989/0x9383f985bc4d585f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x46b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5499 expref: 518 pid: 13444 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.624721:0:13440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e749fcab/0x9383f985bc4d5874 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x46d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54b5 expref: 518 pid: 13446 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201391.624728:0:6706:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1875064458272640:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201391.624730:0:13440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:13440:1875064458272768:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201391.624753:0:13440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f919c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201391.624753:0:6706:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c1849e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201391.624772:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4338 00000100:00100000:3.0:1788201391.624780:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3311:x1875064458271744:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201391.624795:0:6703:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1129 count 1 00010000:00010000:3.0:1788201391.624807:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d5c9c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x469:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201391.625060:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4339 00000100:00100000:1.0:1788201391.625070:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+15:3311:x1875064458272256:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201391.625084:0:13450:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1132 count 1 00010000:00010000:1.0:1788201391.625097:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1c58db5/0x9383f985bc4d5ca3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x46c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.625110:0:13450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000007f5270e/0x9383f985bc4d587b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x46c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54a7 expref: 518 pid: 13442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.625118:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46c:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788201391.625122:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201391.625127:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1c58db5/0x9383f985bc4d5ca3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x46c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.625148:0:13450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000007f5270e/0x9383f985bc4d587b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x46c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54a7 expref: 518 pid: 13442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.625158:0:13450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000007f5270e/0x9383f985bc4d587b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x46c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54a7 expref: 518 pid: 13442 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201391.625169:0:13450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:13450:1875064458272896:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201391.625196:0:13450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201391.625216:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4340 00000100:00100000:1.0:1788201391.625224:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3311:x1875064458271616:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201391.625236:0:6705:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1128 count 1 00010000:00010000:1.0:1788201391.625249:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5caa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x468:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.625262:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d57fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x468:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c546f expref: 518 pid: 13447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.625269:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x468:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788201391.625272:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x468:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201391.625276:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5caa lrc: 4/0,1 mode: --/PW res: [0x240000400:0x468:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.625318:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d57fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x468:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c546f expref: 518 pid: 13447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.625330:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d57fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x468:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c546f expref: 518 pid: 13447 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201391.625341:0:6705:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6705:1875064458273024:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201391.625372:0:6705:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c640db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201391.625391:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4341 00000100:00100000:1.0:1788201391.625399:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+15:3311:x1875064458272128:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201391.625412:0:13447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1123 count 1 00010000:00010000:1.0:1788201391.625425:0:13447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d5cb1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x463:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.625437:0:13447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d59af lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x463:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5820 expref: 518 pid: 13451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.625445:0:13447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x463:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788201391.625449:0:13447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x463:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201391.625453:0:13447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d5cb1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x463:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.625472:0:13447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d59af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x463:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5820 expref: 518 pid: 13451 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.625482:0:13447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d59af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x463:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5820 expref: 518 pid: 13451 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201391.625500:0:13447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:13447:1875064458273152:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201391.625524:0:13447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c640d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201391.625663:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4342 00000100:00100000:1.0:1788201391.625672:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3312:x1875064458271488:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201391.625687:0:13439:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1127 count 1 00010000:00010000:1.0:1788201391.625698:0:13439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d5cb8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x467:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.625712:0:13439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007c13fcde/0x9383f985bc4d57b7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x467:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5461 expref: 518 pid: 13443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.625718:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x467:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788201391.625721:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x467:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201391.625725:0:13439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d5cb8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x467:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.625745:0:13439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007c13fcde/0x9383f985bc4d57b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x467:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5461 expref: 518 pid: 13443 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.625755:0:13439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007c13fcde/0x9383f985bc4d57b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x467:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5461 expref: 518 pid: 13443 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201391.625765:0:13439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:13439:1875064458273280:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201391.625791:0:13439:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c640d6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788201391.625793:0:6703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000002359bf1/0x9383f985bc4d5843 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x469:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c547d expref: 518 pid: 13449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.625880:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x469:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788201391.625883:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x469:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201391.625887:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d5c9c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x469:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.625908:0:6703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000002359bf1/0x9383f985bc4d5843 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x469:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c547d expref: 518 pid: 13449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.625916:0:6703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000002359bf1/0x9383f985bc4d5843 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x469:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c547d expref: 518 pid: 13449 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201391.625927:0:6703:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6703:1875064458273408:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201391.625953:0:6703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c18496c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201391.629971:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201391.629971:0:6706:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1875064458272640:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201391.629998:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1788201391.630013:0:6706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d5c95 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x46b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201391.630062:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442755712 00000100:00100000:3.0:1788201391.630070:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442755712 00010000:00010000:3.0:1788201391.630115:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000007f5270e/0x9383f985bc4d587b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x46c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54a7 expref: 519 pid: 13442 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201391.630148:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442755584 00000100:00100000:0.0:1788201391.630154:0:13450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:13450:1875064458272896:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201391.630172:0:13450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d1c58db5/0x9383f985bc4d5ca3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x46c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201391.630199:0:13446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:13446:1875064458272512:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201391.630212:0:13446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4d5c87 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x46a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201391.630224:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442755584 00010000:00010000:3.0:1788201391.630240:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003c440989/0x9383f985bc4d585f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x46b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5499 expref: 520 pid: 13444 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201391.630272:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1585 00000100:00100000:3.0:1788201391.630284:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2190380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+520:2359:x1875064442755712:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201391.630325:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201391.630332:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000007f5270e/0x9383f985bc4d587b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x46c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54a7 expref: 520 pid: 13442 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.630351:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000007f5270e/0x9383f985bc4d587b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x46c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54a7 expref: 520 pid: 13442 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.630380:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007f5270e/0x9383f985bc4d587b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x46c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54a7 expref: 520 pid: 13442 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.630443:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201391.630449:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201391.630455:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1c58db5/0x9383f985bc4d5ca3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.630467:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1c58db5/0x9383f985bc4d5ca3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x46c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201391.630494:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1586 00010000:00010000:3.0:1788201391.630494:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201391.630504:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2192300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+519:2359:x1875064442755584:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201391.630513:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201391.630518:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003c440989/0x9383f985bc4d585f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x46b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5499 expref: 519 pid: 13444 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.630528:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003c440989/0x9383f985bc4d585f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x46b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5499 expref: 519 pid: 13444 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.630542:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c440989/0x9383f985bc4d585f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x46b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5499 expref: 519 pid: 13444 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.630553:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201391.630557:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201391.630562:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d5c95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.630570:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d5c95 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x46b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.630589:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201391.630640:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2192300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+518:2359:x1875064442755584:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 138us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201391.630648:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1586 00000100:00100000:3.0:1788201391.631440:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2190380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+517:2359:x1875064442755712:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1151us (1474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201391.631455:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1585 00010000:00010000:3.0:1788201391.631487:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d5c95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.631499:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d5c95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.631888:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d5c95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.631899:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d5c95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x46b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.631966:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201391.632441:0:13450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d1c58db5/0x9383f985bc4d5ca3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.632455:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1c58db5/0x9383f985bc4d5ca3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.632464:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1c58db5/0x9383f985bc4d5ca3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.632471:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1c58db5/0x9383f985bc4d5ca3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x46c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201391.632665:0:13440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:13440:1875064458272768:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201391.632704:0:13440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000002c7609e/0x9383f985bc4d5c8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x46d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201391.632743:0:13447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:13447:1875064458273152:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201391.632759:0:13447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d5cb1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x463:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201391.637671:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3312:x1875064458272000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13016us (16121us total) trans 4294968877 rc 0/0 00000100:00100000:3.0:1788201391.637702:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4337 00000100:00100000:3.0:1788201391.639083:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201391.639116:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201391.639155:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201391.639176:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201391.639201:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201391.639241:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201391.639275:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442755840 00000100:00100000:3.0:1788201391.639286:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442755840 00010000:00010000:3.0:1788201391.639352:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ab45217d/0x9383f985bc4d5851 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x46a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c548b expref: 517 pid: 13446 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201391.639383:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442755968 00000100:00100000:3.0:1788201391.639386:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442755968 00010000:00010000:3.0:1788201391.639399:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e749fcab/0x9383f985bc4d5874 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x46d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54b5 expref: 518 pid: 13446 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201391.639411:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442756096 00000100:00100000:3.0:1788201391.639414:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442756096 00010000:00010000:3.0:1788201391.639426:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d59af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x463:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5820 expref: 519 pid: 13451 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201391.639437:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442756224 00000100:00100000:3.0:1788201391.639439:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442756224 00010000:00010000:3.0:1788201391.639450:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007c13fcde/0x9383f985bc4d57b7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x467:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5461 expref: 520 pid: 13443 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201391.639631:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442756352 00000100:00100000:1.0:1788201391.639636:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442756352 00010000:00010000:1.0:1788201391.639658:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d57fd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x468:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c546f expref: 521 pid: 13447 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201391.639673:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442756480 00000100:00100000:1.0:1788201391.639675:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442756480 00010000:00010000:1.0:1788201391.639686:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000002359bf1/0x9383f985bc4d5843 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x469:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c547d expref: 522 pid: 13449 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201391.639715:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1587 00000100:00100000:1.0:1788201391.639727:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+522:2360:x1875064442755840:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201391.639749:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201391.639756:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ab45217d/0x9383f985bc4d5851 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x46a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c548b expref: 522 pid: 13446 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.639781:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ab45217d/0x9383f985bc4d5851 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x46a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c548b expref: 522 pid: 13446 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.639821:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab45217d/0x9383f985bc4d5851 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x46a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c548b expref: 522 pid: 13446 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.639842:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201391.639848:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201391.639854:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4d5c87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.639866:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4d5c87 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x46a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.639905:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201391.639993:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+521:2360:x1875064442755840:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 267us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201391.640000:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1587 00000100:00100000:1.0:1788201391.640020:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1588 00000100:00100000:1.0:1788201391.640027:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+520:2359:x1875064442755968:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201391.640035:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201391.640040:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e749fcab/0x9383f985bc4d5874 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x46d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54b5 expref: 520 pid: 13446 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.640058:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e749fcab/0x9383f985bc4d5874 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x46d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54b5 expref: 520 pid: 13446 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.640070:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e749fcab/0x9383f985bc4d5874 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x46d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c54b5 expref: 520 pid: 13446 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.640081:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201391.640084:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201391.640088:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000002c7609e/0x9383f985bc4d5c8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.640096:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002c7609e/0x9383f985bc4d5c8e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x46d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.640115:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201391.640135:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+519:2359:x1875064442755968:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 109us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201391.640141:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1588 00000100:00100000:1.0:1788201391.640154:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1589 00000100:00100000:1.0:1788201391.640161:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+518:2360:x1875064442756096:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201391.640168:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201391.640174:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d59af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x463:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5820 expref: 518 pid: 13451 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.640188:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d59af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x463:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5820 expref: 518 pid: 13451 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.640201:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d59af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x463:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5820 expref: 518 pid: 13451 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.640210:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x463:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201391.640214:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x463:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201391.640219:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d5cb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x463:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.640227:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d5cb1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x463:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.640245:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201391.640263:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+517:2360:x1875064442756096:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 102us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201391.640270:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1589 00000100:00100000:1.0:1788201391.640284:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1590 00000100:00100000:1.0:1788201391.640291:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8093c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+516:2360:x1875064442756352:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201391.640328:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201391.640333:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d57fd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x468:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c546f expref: 516 pid: 13447 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.640350:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d57fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x468:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c546f expref: 516 pid: 13447 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.640363:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x468:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201391.640367:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x468:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201391.640371:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5caa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x468:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.640380:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5caa lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x468:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.640392:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201391.640410:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8093c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+516:2360:x1875064442756352:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 119us (1207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201391.640417:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1590 00000100:00100000:1.0:1788201391.640433:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1591 00000100:00100000:1.0:1788201391.640440:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+515:2359:x1875064442756480:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201391.640449:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201391.640629:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000002359bf1/0x9383f985bc4d5843 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x469:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c547d expref: 515 pid: 13449 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.640644:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000002359bf1/0x9383f985bc4d5843 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x469:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c547d expref: 515 pid: 13449 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.640664:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x469:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201391.640668:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x469:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201391.640672:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d5c9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x469:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.640680:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d5c9c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x469:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.640746:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201391.640766:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+515:2359:x1875064442756480:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 325us (1524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201391.640773:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1591 00000100:00100000:1.0:1788201391.640899:0:13439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:13439:1875064458273280:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201391.641038:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1592 00000100:00100000:3.0:1788201391.641049:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+514:2359:x1875064442756224:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201391.641059:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201391.641065:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007c13fcde/0x9383f985bc4d57b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x467:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5461 expref: 514 pid: 13443 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.641078:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007c13fcde/0x9383f985bc4d57b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x467:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5461 expref: 514 pid: 13443 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.641093:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c13fcde/0x9383f985bc4d57b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x467:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5461 expref: 514 pid: 13443 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.641107:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x467:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201391.641110:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x467:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201391.641115:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d5cb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x467:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.641124:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d5cb8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x467:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.641138:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201391.641161:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+513:2359:x1875064442756224:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 116us (1984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201391.641167:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1592 00010000:00010000:3.0:1788201391.641228:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002359bf1/0x9383f985bc4d5843 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x469:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c547d expref: 512 pid: 13449 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201391.641239:0:6703:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6703:1875064458273408:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201391.641256:0:6703:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d5c9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x469:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.641267:0:6703:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d5c9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x469:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.641275:0:6703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d5c9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x469:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.641310:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d5c9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x469:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201391.641320:0:6703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d5c9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x469:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.641384:0:13439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d5cb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x467:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.641395:0:13439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d5cb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x467:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.641403:0:13439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d5cb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x467:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.641413:0:13439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d5cb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x467:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.641428:0:13439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d5cb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x467:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.641586:0:13439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1788201391.642193:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3312:x1875064458271488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16519us (20695us total) trans 4294968878 rc 0/0 00000100:00100000:1.0:1788201391.642205:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4342 00010000:00010000:1.0:1788201391.642251:0:13440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000002c7609e/0x9383f985bc4d5c8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.642264:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002c7609e/0x9383f985bc4d5c8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.642276:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002c7609e/0x9383f985bc4d5c8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.642284:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002c7609e/0x9383f985bc4d5c8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x46d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.642320:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1788201391.642583:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788201391.642594:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d5c95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x46b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.642604:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201391.642610:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d5c95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x46b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.642621:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d5c95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x46b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.642641:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d5c95 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x46b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.642650:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d5c95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x46b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.642694:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788201391.642700:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1c58db5/0x9383f985bc4d5ca3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x46c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.642708:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201391.642712:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1c58db5/0x9383f985bc4d5ca3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x46c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.642721:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1c58db5/0x9383f985bc4d5ca3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x46c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.642731:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1c58db5/0x9383f985bc4d5ca3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x46c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.642740:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201391.642745:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d5c9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x469:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.642752:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201391.642756:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d5c9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x469:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.642763:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d5c9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x469:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.642778:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d5c9c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x469:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.642786:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201391.642790:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d5cb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x467:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.642798:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201391.642801:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d5cb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x467:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.642809:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d5cb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x467:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.642828:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d5cb8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x467:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.642834:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c5ceffe/0x9383f985bc4d5cb8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x467:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.642849:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201391.642853:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002c7609e/0x9383f985bc4d5c8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x46d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.642860:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201391.642864:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002c7609e/0x9383f985bc4d5c8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x46d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.642872:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002c7609e/0x9383f985bc4d5c8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x46d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.642882:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002c7609e/0x9383f985bc4d5c8e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x46d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.642890:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002c7609e/0x9383f985bc4d5c8e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x46d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.642902:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.642904:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.642906:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.643149:0:13446:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4d5c87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.643161:0:13446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4d5c87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.643170:0:13446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4d5c87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.643177:0:13446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4d5c87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x46a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.643199:0:13446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788201391.643747:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+16:3312:x1875064458271872:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19470us (22370us total) trans 4294968879 rc 0/0 00000100:00100000:0.0:1788201391.643759:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4335 00010000:00010000:0.0:1788201391.643787:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201391.643793:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4d5c87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x46a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.643803:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201391.643807:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4d5c87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x46a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.643826:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4d5c87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x46a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.643839:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4d5c87 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x46a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.643847:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efdbf363/0x9383f985bc4d5c87 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x46a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.643865:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.643867:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.643869:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.643875:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.643877:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.643879:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.645345:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002593d32f/0x9383f985bc4d57fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x468:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c546f expref: 511 pid: 13447 timeout: 766 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201391.645372:0:6705:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6705:1875064458273024:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201391.645404:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5caa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x468:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.645417:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5caa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x468:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.645426:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5caa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x468:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.645437:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5caa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x468:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.645446:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5caa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x468:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.645471:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788201391.646312:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3312:x1875064458272384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21672us (24849us total) trans 4294968880 rc 0/0 00000100:00100000:1.0:1788201391.646326:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4336 00010000:00010000:1.0:1788201391.646376:0:13447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d5cb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x463:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.646396:0:13447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d5cb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x463:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.646407:0:13447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d5cb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x463:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.646416:0:13447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d5cb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x463:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201391.646436:0:13447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788201391.647234:0:6703:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788201391.647246:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d5c9c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x469:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201391.647689:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3311:x1875064458271616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22463us (23799us total) trans 4294968882 rc 0/0 00000100:00100000:0.0:1788201391.647713:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4340 00010000:00010000:0.0:1788201391.647749:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201391.647758:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5caa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x468:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.647771:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201391.647777:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5caa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x468:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.647789:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5caa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x468:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.647822:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5caa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x468:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.647830:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5caa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x468:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.647848:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201391.647852:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d5cb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x463:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.647859:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201391.647863:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d5cb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x463:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.647871:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d5cb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x463:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.647881:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d5cb1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x463:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.647890:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d5cb1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x463:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.647904:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.647906:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201391.647908:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788201391.647984:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c2190a80/2, rc 0, transno 4294968878 00000100:00100000:0.0:1788201391.647999:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458271488:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788201391.648012:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c2191180/2, rc 0, transno 4294968877 00000100:00100000:0.0:1788201391.648016:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458272000:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788201391.648026:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c2190000/2, rc 0, transno 4294968879 00000100:00100000:0.0:1788201391.648030:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458271872:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788201391.648038:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c2191500/2, rc 0, transno 4294968880 00000100:00100000:0.0:1788201391.648042:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2191500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458272384:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788201391.648421:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201391.648431:0:13450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1c58db5/0x9383f985bc4d5ca3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x46c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201391.648880:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+18:3311:x1875064458272256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23809us (25045us total) trans 4294968884 rc 0/0 00000100:00100000:2.0:1788201391.648890:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4339 00010000:00010000:0.0:1788201391.649365:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201391.649612:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3311:x1875064458271744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24830us (27841us total) trans 4294968883 rc 0/0 00000100:00100000:3.0:1788201391.649624:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4338 00010000:00010000:3.0:1788201391.649650:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788201391.649726:0:17712:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 3/7 00000020:00080000:3.0:1788201391.649734:0:17712:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e03c531b800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788201391.649740:0:17712:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e03c531d800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788201391.649749:0:17712:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e04f9029800 35604eb4-baf9-45be-a20a-4883a2cd8cf9 192.168.201.30@tcp 7 (0 0 2) 0 0 0 0: 0000000000000000 17179869289 stale:0 00000020:00080000:3.0:1788201391.649755:0:17712:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9e03c1facd40) has exports, disconnecting them 00000020:00080000:3.0:1788201391.649760:0:17712:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e03c531b800), last request at 1788201389 00000020:00000080:3.0:1788201391.649768:0:17712:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d4fd0 00000100:00080000:3.0:1788201391.649779:0:17712:0:(import.c:65:import_set_state_nolock()) ffff9e03c531c800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788201391.649810:0:17712:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e03c531b800): rc 0 00000020:00000080:3.0:1788201391.649821:0:17712:0:(genops.c:906:class_export_put()) final put ffff9e03c531b800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788201391.649841:0:17712:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e03c531d800), last request at 1788201389 00000020:00000080:3.0:1788201391.649851:0:17712:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d4fc9 00000100:00080000:3.0:1788201391.649856:0:17712:0:(import.c:65:import_set_state_nolock()) ffff9e03c5318000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788201391.649864:0:17712:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e03c531d800): rc 0 00000020:00000080:3.0:1788201391.649866:0:17712:0:(genops.c:906:class_export_put()) final put ffff9e03c531d800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788201391.649870:0:17712:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.201.30@tcp (ffff9e04f9029800), last request at 1788201391 00000020:00000080:3.0:1788201391.649874:0:17712:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d4c8f 00000020:00010000:3.0:1788201391.649887:0:17712:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e04f9029800: total 2 00000100:00080000:3.0:1788201391.649891:0:17712:0:(import.c:65:import_set_state_nolock()) ffff9e03c55b0800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788201391.649901:0:17712:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.30@tcp (ffff9e04f9029800): rc 0 00000004:00000080:3.0:1788201391.649908:0:17712:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffad6100d17ae0 00000020:00010000:0.0:1788201391.650044:0:5845:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e04f9029800: total 2 00010000:00010000:0.0:1788201391.650096:0:5845:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e04f9029800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788201391.650135:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3000/0x9383f985bc4d5318 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5365 expref: 3 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.650167:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2200/0x9383f985bc4d5334 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c536c expref: 2 pid: 16722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201391.650181:0:5845:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e04f9029800, canceled 2 locks, left on hash table 0. 00000100:00080000:3.0:1788201391.652051:0:17712:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788201391.652070:0:17712:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e03c2190700 x1875064458271744/t0(0) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201446 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201391.652086:0:17712:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e03c2190e00 x1875064458272256/t0(0) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201446 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201391.652096:0:17712:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e03c2193480 x1875064458271616/t0(0) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201446 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201391.652105:0:17712:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e03c2192680 x1875064458272128/t0(0) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201446 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201391.652113:0:17712:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968873 gen 3 00000100:00100000:3.0:1788201391.652119:0:17712:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e04d1f0d880 x1875064458266112/t4294968874(4294968874) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201446 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788201391.652129:0:17712:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04d1f0d880, transno 4294968874 00000100:00100000:3.0:1788201391.652138:0:17712:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e04f00dd880 x1875064458266240/t4294968875(4294968875) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201446 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788201391.652145:0:17712:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00dd880, transno 4294968875 00000100:00100000:3.0:1788201391.652152:0:17712:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e04f00ddf80 x1875064458266368/t4294968876(4294968876) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201446 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788201391.652159:0:17712:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00ddf80, transno 4294968876 00000100:00100000:3.0:1788201391.652164:0:17712:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e03c2191180 x1875064458272000/t4294968877(4294968877) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201446 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788201391.652170:0:17712:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c2191180, transno 4294968877 00000100:00100000:3.0:1788201391.652175:0:17712:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e03c2190a80 x1875064458271488/t4294968878(4294968878) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201446 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788201391.652180:0:17712:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c2190a80, transno 4294968878 00000100:00100000:3.0:1788201391.652185:0:17712:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e03c2190000 x1875064458271872/t4294968879(4294968879) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201446 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788201391.652191:0:17712:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c2190000, transno 4294968879 00000100:00100000:3.0:1788201391.652196:0:17712:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e03c2191500 x1875064458272384/t4294968880(4294968880) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201446 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788201391.652202:0:17712:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c2191500, transno 4294968880 00000004:00080000:3.0:1788201391.652224:0:17712:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788201391.652311:0:17712:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788201391.652345:0:17712:0:(import.c:65:import_set_state_nolock()) ffff9e04c8365000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788201391.652365:0:17712:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788201391.652368:0:17712:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968877 gen 3 00000100:00100000:3.0:1788201391.652376:0:17712:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e04f00dd500 x1875064458267392/t4294968878(4294968878) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201446 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788201391.652383:0:17712:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00dd500, transno 4294968878 00000100:00100000:3.0:1788201391.652399:0:17712:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e04c12a8380 x1875064458266624/t4294968879(4294968879) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201446 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788201391.652406:0:17712:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04c12a8380, transno 4294968879 00000100:00100000:3.0:1788201391.652413:0:17712:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e04f53e3800 x1875064458267136/t4294968880(4294968880) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201446 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788201391.652421:0:17712:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f53e3800, transno 4294968880 00000100:00100000:3.0:1788201391.652426:0:17712:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e04f00de680 x1875064458267648/t4294968881(4294968881) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201446 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788201391.652433:0:17712:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00de680, transno 4294968881 00000100:00100000:3.0:1788201391.652439:0:17712:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e04f00dce00 x1875064458267904/t4294968882(4294968882) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201446 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788201391.652446:0:17712:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00dce00, transno 4294968882 00000100:00100000:3.0:1788201391.652452:0:17712:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e04f00dca80 x1875064458268032/t4294968883(4294968883) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201446 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788201391.652458:0:17712:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00dca80, transno 4294968883 00000100:00100000:3.0:1788201391.652463:0:17712:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e04f00dc000 x1875064458267776/t4294968884(4294968884) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201446 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788201391.652470:0:17712:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00dc000, transno 4294968884 00000100:00100000:3.0:1788201391.652475:0:17712:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e04f00df800 x1875064458268160/t4294968885(4294968885) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201446 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788201391.652482:0:17712:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00df800, transno 4294968885 00000100:00100000:3.0:1788201391.652488:0:17712:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e04f00de300 x1875064458268928/t4294968886(4294968886) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201446 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788201391.652494:0:17712:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00de300, transno 4294968886 00000100:00100000:3.0:1788201391.652499:0:17712:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e03c1ba3480 x1875064458269824/t4294968887(4294968887) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201446 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788201391.652505:0:17712:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c1ba3480, transno 4294968887 00000100:00100000:3.0:1788201391.652510:0:17712:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e04f00dc700 x1875064458269184/t4294968888(4294968888) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201446 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788201391.652521:0:17712:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00dc700, transno 4294968888 00000100:00100000:3.0:1788201391.652526:0:17712:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e03c1ba2300 x1875064458269568/t4294968889(4294968889) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201446 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788201391.652532:0:17712:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c1ba2300, transno 4294968889 00000100:00100000:3.0:1788201391.652538:0:17712:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e03c1ba1c00 x1875064458269440/t4294968890(4294968890) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201446 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788201391.652544:0:17712:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c1ba1c00, transno 4294968890 00000100:00100000:3.0:1788201391.652550:0:17712:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e03c1ba0a80 x1875064458269696/t4294968891(4294968891) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201446 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788201391.652556:0:17712:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c1ba0a80, transno 4294968891 00000100:00100000:3.0:1788201391.652562:0:17712:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e03c1ba0700 x1875064458269952/t4294968892(4294968892) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201446 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788201391.652568:0:17712:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c1ba0700, transno 4294968892 00000004:00080000:3.0:1788201391.652580:0:17712:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788201391.652640:0:17712:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788201391.652653:0:17712:0:(import.c:65:import_set_state_nolock()) ffff9e03c371f800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788201391.652697:0:17712:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9e03c1facd40) has no exports 00010000:00010000:3.0:1788201391.652769:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201391.652794:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458273536:0@lo:9:umount.0 00000100:00100000:3.0:1788201391.652898:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201391.652950:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458273664:0@lo:9:umount.0 00000100:00100000:3.0:1788201391.652974:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788201391.653073:0:16745:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 15 done 00000100:00100000:3.0:1788201391.653100:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458273536 00000100:00100000:3.0:1788201391.653109:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458273536 00000100:00100000:3.0:1788201391.653158:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458273664 00000100:00100000:3.0:1788201391.653161:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458273664 00000100:00100000:3.0:1788201391.653188:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4343 00000100:00100000:3.0:1788201391.653200:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+17:3309:x1875064458273536:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788201391.653236:0:13445:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d4cce 00000100:00080000:3.0:1788201391.653247:0:13445:0:(import.c:65:import_set_state_nolock()) ffff9e04ff1c7000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788201391.653291:0:13445:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968884 00000100:00100000:3.0:1788201391.653595:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+14:3309:x1875064458273536:12345-0@lo:9:umount.0 Request processed in 396us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201391.653604:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4343 00000100:00100000:3.0:1788201391.653625:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4344 00000100:00100000:3.0:1788201391.653634:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+20:3309:x1875064458273664:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788201391.653649:0:13445:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d4cdc 00000100:00080000:3.0:1788201391.653655:0:13445:0:(import.c:65:import_set_state_nolock()) ffff9e04c6a38000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788201391.653671:0:13445:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968892 00000100:00100000:3.0:1788201391.653787:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+17:3309:x1875064458273664:12345-0@lo:9:umount.0 Request processed in 155us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201391.653794:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4344 00010000:00010000:3.0:1788201391.653826:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788201391.653863:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04c8365000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788201391.653874:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788201391.653876:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788201391.653881:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458273536:0@lo:9:umount.0 00000100:00080000:3.0:1788201391.653893:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e03c371f800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788201391.653900:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788201391.653901:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788201391.653904:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458273664:0@lo:9:umount.0 00000020:00000080:2.0:1788201391.654187:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03c531b800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788201391.654258:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03c531d800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788201391.654280:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e03c531c800 for lustre-MDT0000 00000020:00000080:2.0:1788201391.654285:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e03c5318000 for lustre-MDT0000 00000004:00080000:2.0:1788201391.654493:0:16743:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 6 changes, 4 in progress, 4 in flight, 7 done 00000004:00080000:2.0:1788201391.654517:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c2193480/1, rc -5, transno 0 00000100:00100000:2.0:1788201391.654531:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458271616:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788201391.654543:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c2190700/1, rc -5, transno 0 00000100:00100000:2.0:1788201391.654549:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2190700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458271744:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788201391.654555:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c2190e00/1, rc -5, transno 0 00000100:00100000:2.0:1788201391.654561:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458272256:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201391.656837:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+13:3311:x1875064458272128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 31424us (32705us total) trans 4294968881 rc 0/0 00000100:00100000:1.0:1788201391.656856:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4341 00000020:00080000:3.0:1788201391.657165:0:17712:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9e03c1facd40) has no exports 00010000:00010000:1.0:1788201391.658093:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788201391.660445:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c2192680/1, rc -5, transno 0 00000100:00100000:2.0:1788201391.660531:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458272128:0@lo:6:osp-syn-0-0.0 00000020:00000080:0.0:1788201391.698230:0:5845:0:(genops.c:906:class_export_put()) final put ffff9e04f9029800/35604eb4-baf9-45be-a20a-4883a2cd8cf9 00010000:00010000:2.0:1788201391.702022:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201391.702035:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201391.702038:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788201391.702387:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04f9029800/35604eb4-baf9-45be-a20a-4883a2cd8cf9 for lustre-MDT0000 00000020:00000080:1.0:1788201391.705429:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e03c55b0800 for lustre-MDT0000 00000020:00000080:3.0:1788201391.726283:0:17712:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d4ca4 00000020:00000080:3.0:1788201391.726524:0:17712:0:(genops.c:906:class_export_put()) final put ffff9e04f0041000/lustre-QMT0000_UUID 00000020:01000000:3.0:1788201391.726580:0:17712:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788201391.726805:0:17712:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201391.726829:0:17712:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788201391.726835:0:17712:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9e04f9653380) has no exports 00000020:00000080:2.0:1788201391.727261:0:17712:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d4c9d 00000020:00000080:2.0:1788201391.727270:0:17712:0:(genops.c:906:class_export_put()) final put ffff9e04f98c1000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788201391.727336:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04f0041000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788201391.727673:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04f98c1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788201391.727849:0:17712:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201391.727861:0:17712:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788201391.727865:0:17712:0:(genops.c:906:class_export_put()) final put ffff9e04f0044000/lustre-QMT0000_UUID 00000020:00000080:2.0:1788201391.727868:0:17712:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04f0044000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788201391.727879:0:17712:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1788201391.728134:0:17712:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e04f4d7ed80 - data ffff9e04dd9e7360/ffff9e03c1a1e400 00000020:01000000:2.0:1788201391.728508:0:17712:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e04d1391b40 - data ffff9e04dd9ea0d8/ffff9e03c29bc000 00000100:00080000:2.0:1788201391.775648:0:17712:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788201391.775660:0:17712:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968873 gen 4 00000004:00080000:2.0:1788201391.775692:0:17712:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788201391.775703:0:17712:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788201391.776376:0:16743:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788201391.776382:0:16743:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 13 count 18 00000040:00080000:0.0:1788201391.776395:0:16743:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 4 count 2 00000004:00080000:0.0:1788201391.776443:0:16743:0:(osp_sync.c:1521:osp_sync_thread()) lustre-OST0000-osc-MDT0000: failed to sync object 0x240000400:1128 00000004:00080000:0.0:1788201391.776448:0:16743:0:(osp_sync.c:1521:osp_sync_thread()) lustre-OST0000-osc-MDT0000: failed to sync object 0x240000400:1129 00000004:00080000:0.0:1788201391.776451:0:16743:0:(osp_sync.c:1521:osp_sync_thread()) lustre-OST0000-osc-MDT0000: failed to sync object 0x240000400:1132 00000004:00080000:0.0:1788201391.776454:0:16743:0:(osp_sync.c:1521:osp_sync_thread()) lustre-OST0000-osc-MDT0000: failed to sync object 0x240000400:1123 00000100:00080000:2.0:1788201391.776732:0:17712:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788201391.776736:0:17712:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968877 gen 4 00000004:00080000:2.0:1788201391.776754:0:17712:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788201391.776756:0:17712:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788201391.777107:0:16745:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788201391.777112:0:16745:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 20 count 16 00000040:00080000:0.0:1788201391.777123:0:16745:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 4 count 2 00000020:00000080:1.0:1788201391.801159:0:17712:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d4c65 00000020:00000080:1.0:1788201391.801175:0:17712:0:(genops.c:906:class_export_put()) final put ffff9e04c8366800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788201391.801365:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c8366800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788201391.803126:0:17712:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d4c7a 00000020:00000080:1.0:1788201391.803142:0:17712:0:(genops.c:906:class_export_put()) final put ffff9e03c5130000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788201391.803163:0:17712:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788201391.803171:0:17712:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201391.803183:0:17712:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788201391.803188:0:17712:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9e03c1fa8000) has no exports 00000004:01000000:1.0:1788201391.803448:0:17712:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788201391.803459:0:17712:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d4cd5 00000020:00000080:1.0:1788201391.803466:0:17712:0:(genops.c:906:class_export_put()) final put ffff9e04c6a3b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788201391.803471:0:17712:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788201391.803475:0:17712:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201391.803482:0:17712:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788201391.803485:0:17712:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9e04f9654d40) has no exports 00000020:00000080:1.0:1788201391.803494:0:17712:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d4cc7 00000020:00000080:1.0:1788201391.803498:0:17712:0:(genops.c:906:class_export_put()) final put ffff9e03c3718800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788201391.804090:0:17712:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788201391.804097:0:17712:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788201391.804102:0:17712:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968877 gen 5 00000004:00080000:1.0:1788201391.804109:0:17712:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201391.804112:0:17712:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201391.804151:0:17712:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201391.804161:0:17712:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201391.804169:0:17712:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d4cb9 00000020:00000080:1.0:1788201391.804175:0:17712:0:(genops.c:906:class_export_put()) final put ffff9e03c371d000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788201391.804180:0:17712:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788201391.804184:0:17712:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201391.804187:0:17712:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788201391.804190:0:17712:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff9e04d1c33380) has no exports 00000020:00000080:1.0:1788201391.804194:0:17712:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d4cb2 00000020:00000080:1.0:1788201391.804198:0:17712:0:(genops.c:906:class_export_put()) final put ffff9e04c8362000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788201391.804600:0:17712:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788201391.804604:0:17712:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788201391.804607:0:17712:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968873 gen 5 00000004:00080000:1.0:1788201391.804611:0:17712:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201391.804613:0:17712:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201391.804643:0:17712:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201391.804650:0:17712:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201391.804680:0:17712:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201391.804684:0:17712:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788201391.804860:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03c5130000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1788201391.804868:0:36:0:(genops.c:906:class_export_put()) final put ffff9e04c8364000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201391.804871:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c8364000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788201391.804878:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788201391.805071:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c6a3b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788201391.805077:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03c3718800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788201391.805083:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e03c371f800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788201391.805088:0:36:0:(genops.c:906:class_export_put()) final put ffff9e03c371c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201391.805091:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03c371c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788201391.805094:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788201391.805126:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03c371d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788201391.805131:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c8362000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788201391.805135:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04c8365000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788201391.805139:0:36:0:(genops.c:906:class_export_put()) final put ffff9e03c5133800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201391.805141:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03c5133800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788201391.805145:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201391.805392:0:17712:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d4c81 00000020:00000080:1.0:1788201391.805400:0:17712:0:(genops.c:906:class_export_put()) final put ffff9e03c5132000/lustre-MDD0000_UUID 00000020:01000000:1.0:1788201391.805419:0:17712:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788201391.805423:0:17712:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201391.805429:0:17712:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788201391.805433:0:17712:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9e04d1c34d40) has no exports 00000020:00000080:1.0:1788201391.805456:0:17712:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201391.805460:0:17712:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788201391.805465:0:17712:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d4c88 00000020:00000080:1.0:1788201391.805468:0:17712:0:(genops.c:906:class_export_put()) final put ffff9e03c5132800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788201391.805476:0:17712:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e03c37bf000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788201391.805480:0:17712:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e03c37bf000 3 00000020:01000004:1.0:1788201391.805484:0:17712:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e03c37bf000 from lustre-MDT0000 00000020:00000080:1.0:1788201391.805504:0:17712:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201391.805507:0:17712:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788201391.805510:0:17712:0:(genops.c:906:class_export_put()) final put ffff9e04c8363800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788201391.805512:0:17712:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c8363800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788201391.805519:0:17712:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788201391.805559:0:17712:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1788201391.805564:0:17712:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788201391.805567:0:17712:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788201391.805570:0:17712:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201391.805573:0:17712:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788201391.805581:0:17712:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9e04fae42800 b60c000b-7335-444d-a8dc-1a5956712fb2 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201391.805591:0:17712:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9e04f48cb000 7ad49433-54fa-4e21-b756-859420d95603 192.168.201.30@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201391.805596:0:17712:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9e03c1fab380) has exports, disconnecting them 00000020:00080000:1.0:1788201391.805602:0:17712:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9e04fae42800), last request at 1788201359 00000020:00000080:1.0:1788201391.805625:0:17712:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d4c26 00000020:00010000:1.0:1788201391.805630:0:17712:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e04fae42800: total 2 00000100:00080000:1.0:1788201391.805636:0:17712:0:(import.c:65:import_set_state_nolock()) ffff9e04fae42000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788201391.805775:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03c5132000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788201391.805780:0:36:0:(genops.c:906:class_export_put()) final put ffff9e04c8367000/lustre-MDD0000_UUID 00000020:00000080:0.0:1788201391.805782:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c8367000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788201391.805786:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1788201391.805898:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03c5132800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:1.0:1788201391.805983:0:17712:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e04fae42800): rc 0 00000020:00080000:1.0:1788201391.805988:0:17712:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.201.30@tcp (ffff9e04f48cb000), last request at 1788201350 00000020:00000080:1.0:1788201391.806039:0:17712:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d4c03 00000020:00010000:1.0:1788201391.806043:0:17712:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e04f48cb000: total 0 00000100:00080000:1.0:1788201391.806047:0:17712:0:(import.c:65:import_set_state_nolock()) ffff9e04f48c8800 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1788201391.806400:0:5846:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e04fae42800: total 0 00010000:00010000:2.0:1788201391.806443:0:5846:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e04fae42800, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1788201391.806479:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c507c400/0x9383f985bc4d4da0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d4d99 expref: 9 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.806499:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0501b28400/0x9383f985bc4d4d5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d4d53 expref: 8 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.806512:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c507ca00/0x9383f985bc4d4d3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d4d37 expref: 7 pid: 16711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.806523:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c5064e00/0x9383f985bc4d4d4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d4d45 expref: 6 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.806535:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c507d200/0x9383f985bc4d4d68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d4d61 expref: 5 pid: 16738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.806546:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e04f9ce5a00/0x9383f985bc4d4d76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d4d6f expref: 4 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.806558:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0501b29800/0x9383f985bc4d4d84 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d4d7d expref: 3 pid: 16738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.806572:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c507de00/0x9383f985bc4d4d92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d4d8b expref: 2 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.806581:0:5846:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e04fae42800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1788201391.806599:0:5846:0:(genops.c:906:class_export_put()) final put ffff9e04fae42800/b60c000b-7335-444d-a8dc-1a5956712fb2 00000020:00010000:2.0:1788201391.806612:0:5846:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e04f48cb000: total 1 00010000:00010000:2.0:1788201391.806616:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201391.806630:0:5846:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e04f48cb000, canceled 0 locks, left on hash table 4. 00010000:00010000:2.0:1788201391.806646:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c5065400/0x9383f985bc4d4d22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5262 expref: 7 pid: 16711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.806659:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e04f9ce5800/0x9383f985bc4d4c11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5231 expref: 6 pid: 16711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.806671:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c507dc00/0x9383f985bc4d4c1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c523f expref: 5 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.806685:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c507c000/0x9383f985bc4d4c18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5238 expref: 4 pid: 16713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201391.806847:0:5846:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e04f48cb000, canceled 4 locks, left on hash table 0. 00010000:00010000:2.0:1788201391.806861:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201391.806863:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201391.806865:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788201391.806874:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04fae42800/b60c000b-7335-444d-a8dc-1a5956712fb2 for MGS 00000020:00000080:2.0:1788201391.807001:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04fae42000 for MGS 00000020:00080000:1.0:1788201391.807075:0:17712:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.30@tcp (ffff9e04f48cb000): rc 0 00000020:00000080:1.0:1788201391.807078:0:17712:0:(genops.c:906:class_export_put()) final put ffff9e04f48cb000/7ad49433-54fa-4e21-b756-859420d95603 00010000:00010000:0.0:1788201391.807343:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788201391.807380:0:17712:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9e03c1fab380) has no exports 00000100:00100000:0.0:1788201391.807479:0:16713:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9e03c2aa0200:16713] 2 exiting: rc = 0 00000100:00100000:0.0:1788201391.807600:0:16712:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9e03c2aa1e00:16712] 1 exiting: rc = 0 00000100:00100000:0.0:1788201391.807660:0:16711:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9e03c2aa1800:16711] 0 exiting: rc = 1 00000100:00100000:0.0:1788201391.807737:0:16738:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff9e04d9b95e00:16738] 3 exiting: rc = 0 00000100:00100000:1.0:1788201391.807908:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.807925:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.807933:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.807940:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.807947:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.807955:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.807962:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.807968:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.807974:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.807982:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.807991:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.807998:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808004:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808010:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808016:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808023:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808029:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808035:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808042:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808049:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808056:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808063:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808069:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808076:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808083:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808090:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808098:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808106:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808112:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808119:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808126:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808132:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808139:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808145:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808151:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808157:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808164:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808170:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808177:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808184:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808190:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808196:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808203:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808210:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808216:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808223:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808230:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808237:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808244:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808251:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808258:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808264:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808270:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808278:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808285:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808291:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808340:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808347:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808353:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808362:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808369:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808378:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808384:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.808391:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788201391.809066:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04f48cb000/7ad49433-54fa-4e21-b756-859420d95603 for MGS 00000020:00000080:2.0:1788201391.809118:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04f48c8800 for MGS 20000000:01000000:1.0:1788201391.809630:0:17712:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788201391.809634:0:17712:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1788201391.811855:0:17712:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e04d20fcba0 - data ffff9e04e0769288/ffff9e04fa117400 00000020:01000000:1.0:1788201391.812101:0:17712:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e04f9c94c60 - data ffff9e04ff9f2ca8/ffff9e04f950d400 00000020:00000080:1.0:1788201391.812721:0:17712:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d4bfc 00000020:00000080:1.0:1788201391.812731:0:17712:0:(genops.c:906:class_export_put()) final put ffff9e04ff445800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788201391.812749:0:17712:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e03c37bf000 from MGS, refs=2 00000020:01000004:1.0:1788201391.812753:0:17712:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e03c37bf000 2 00000020:01000004:1.0:1788201391.812757:0:17712:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e03c37bf000 from MGS 00000020:00000080:1.0:1788201391.812788:0:17712:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201391.812797:0:17712:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788201391.812800:0:17712:0:(genops.c:906:class_export_put()) final put ffff9e04d20b7800/MGS 00000020:00000080:1.0:1788201391.812803:0:17712:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04d20b7800/MGS for MGS 00000020:01000000:1.0:1788201391.812819:0:17712:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788201391.812908:0:17712:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788201391.812984:0:17712:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201391.812995:0:17712:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788201391.813003:0:17712:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9e04f902e800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201391.813009:0:17712:0:(genops.c:1574:class_disconnect_exports()) OBD device 17 (ffff9e04f9650000) has exports, disconnecting them 00000020:00080000:1.0:1788201391.813015:0:17712:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9e04f902e800), last request at 1788201359 00000020:00000080:1.0:1788201391.813020:0:17712:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d4d14 00000020:00080000:1.0:1788201391.813034:0:17712:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e04f902e800): rc 0 00000020:00000080:1.0:1788201391.813038:0:17712:0:(genops.c:906:class_export_put()) final put ffff9e04f902e800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788201391.814198:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04ff445800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788201391.814216:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04f902e800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788201391.843861:0:17712:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788201391.843874:0:17712:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788201391.843880:0:17712:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788201391.843890:0:17712:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788201391.844232:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e03c371d800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788201391.844491:0:17712:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201391.844509:0:17712:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788201391.844516:0:17712:0:(genops.c:906:class_export_put()) final put ffff9e03c371c800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788201391.844521:0:17712:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03c371c800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788201391.844536:0:17712:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788201391.844632:0:17712:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e03c37bf000 1 00000020:00000080:1.0:1788201391.844640:0:17712:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d4bee 00000020:00000080:1.0:1788201391.844648:0:17712:0:(genops.c:906:class_export_put()) final put ffff9e04d20b2000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788201391.844693:0:17712:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788201391.844699:0:17712:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201391.844705:0:17712:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788201391.844709:0:17712:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9e03c1fa99c0) has no exports 00000020:00000080:0.0:1788201391.844995:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04d20b2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788201391.869898:0:17712:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201391.869984:0:17712:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788201391.869992:0:17712:0:(genops.c:906:class_export_put()) final put ffff9e03c37be000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788201391.869998:0:17712:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03c37be000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788201391.870013:0:17712:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788201391.870273:0:17712:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e03c37bc000 00000020:01000000:1.0:1788201391.870449:0:17712:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788201391.870455:0:17712:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201391.870462:0:17712:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788201391.870467:0:17712:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9e04eadccd40) has no exports 00000100:00100000:0.0:1788201391.873990:0:17130:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9e03c32a5200:17130] 4 exiting: rc = 0 00000100:00100000:0.0:1788201391.874155:0:16722:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9e03c21f9400:16722] 2 exiting: rc = 0 00000100:00100000:1.0:1788201391.874535:0:16720:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9e03c39fbc00:16720] 0 exiting: rc = 1 00000100:00100000:1.0:1788201391.874683:0:17126:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9e04c120a200:17126] 3 exiting: rc = 0 00000100:00100000:3.0:1788201391.875003:0:16721:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9e03c21f9200:16721] 1 exiting: rc = 0 00000100:00100000:2.0:1788201391.875864:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.875876:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.875882:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.875892:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.875899:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.875909:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876212:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876220:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876227:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876234:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876239:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876245:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876250:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876256:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876262:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876267:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876274:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876280:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876286:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876722:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876731:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876738:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876746:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876752:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876758:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876766:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876772:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876779:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876785:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876794:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876801:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876817:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876826:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876833:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876840:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876847:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876853:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876859:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876866:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876871:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876877:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876883:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876888:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876895:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876901:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.876908:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.877023:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.877031:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.877037:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.877044:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.877050:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.877057:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.877063:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.877070:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.877076:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.877086:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.877092:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.877099:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.877105:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.877111:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.877117:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.877123:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.877129:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.877136:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.882622:0:16724:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9e03c21f8200:16724] 1 exiting: rc = 0 00000100:00100000:2.0:1788201391.883152:0:16723:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9e03c21f8800:16723] 0 exiting: rc = 1 00000100:00100000:0.0:1788201391.883260:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883271:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883278:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883285:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883319:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883328:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883334:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883341:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883347:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883354:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883360:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883366:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883372:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883379:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883387:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883393:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883400:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883406:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883412:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883418:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883423:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883430:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883436:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883443:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883450:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883457:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883463:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883470:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883477:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883483:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883489:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883494:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883500:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883507:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883513:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883518:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883523:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883529:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883535:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883541:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883547:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883553:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883559:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883565:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883572:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883577:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883584:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883601:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883608:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883615:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883622:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883628:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883634:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883640:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883647:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883653:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883659:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883664:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883670:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883676:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883683:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883801:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883821:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.883828:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.884636:0:16728:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9e04c803ca00:16728] 1 exiting: rc = 0 00000100:00100000:1.0:1788201391.884919:0:16727:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9e03c21f9800:16727] 0 exiting: rc = 1 00000100:00100000:0.0:1788201391.885054:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885064:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885071:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885078:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885085:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885092:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885099:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885105:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885111:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885118:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885127:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885133:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885142:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885160:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885184:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885193:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885199:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885207:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885214:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885220:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885228:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885235:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885241:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885247:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885254:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885261:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885284:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885323:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885330:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885338:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885346:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885355:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885362:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885370:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885377:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885384:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885391:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885400:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885413:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885420:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885441:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885462:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885470:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885478:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885485:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885494:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885501:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885507:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885522:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885530:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885539:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885545:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885553:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885560:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885571:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885579:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885586:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885832:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885841:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885849:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885860:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885868:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885882:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.885891:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.902622:0:16729:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9e04c803c600:16729] 0 exiting: rc = 1 00000100:00100000:2.0:1788201391.902941:0:16730:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9e04c6b87e00:16730] 1 exiting: rc = 0 00000100:00100000:0.0:1788201391.903174:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903183:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903189:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903195:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903201:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903208:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903214:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903220:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903226:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903232:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903238:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903244:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903251:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903257:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903264:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903271:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903277:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903284:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903320:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903326:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903333:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903339:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903345:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903351:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903356:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903364:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903370:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903376:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903381:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903388:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903394:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903399:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903405:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903412:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903419:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903425:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903432:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903439:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903446:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903452:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903458:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903465:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903471:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903477:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903483:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903488:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903494:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903500:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903505:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903511:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903516:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903520:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903525:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903531:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903536:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903541:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903547:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903554:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903560:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903565:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903572:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903578:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903583:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.903832:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.905019:0:16731:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9e04de589c00:16731] 0 exiting: rc = 1 00000100:00100000:1.0:1788201391.905272:0:16732:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9e03c1d74c00:16732] 1 exiting: rc = 0 00000100:00100000:0.0:1788201391.905962:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.905971:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.905978:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.905984:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.905991:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.905998:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906004:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906011:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906017:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906024:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906030:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906035:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906042:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906048:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906055:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906062:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906068:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906074:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906080:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906087:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906092:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906098:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906105:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906111:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906117:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906123:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906130:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906136:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906141:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906156:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906162:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906169:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906174:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906180:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906186:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906192:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906198:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906203:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906209:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906214:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906220:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906225:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906231:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906237:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906243:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906248:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906254:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906261:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906267:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906274:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906281:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906287:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906601:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906609:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906615:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906621:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906627:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906633:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906640:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906647:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906653:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906659:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906665:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.906672:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201391.908027:0:16733:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9e03c1d75200:16733] 0 exiting: rc = 1 00000100:00100000:1.0:1788201391.908281:0:16734:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9e03c1d74200:16734] 1 exiting: rc = 0 00000100:00100000:0.0:1788201391.908434:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908443:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908455:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908461:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908469:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908475:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908482:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908488:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908495:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908502:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908508:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908515:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908521:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908527:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908533:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908539:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908544:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908551:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908558:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908565:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908571:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908577:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908584:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908599:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908607:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908613:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908619:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908626:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908632:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908638:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908645:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908650:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908656:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908663:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908670:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908677:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908683:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908700:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908707:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908713:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908720:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908726:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908733:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908740:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908746:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908752:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908758:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908764:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908769:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908775:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908781:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908787:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908793:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908798:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908803:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908819:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908825:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908830:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908837:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908842:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908848:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908855:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908861:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201391.908872:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.910092:0:16735:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9e04c6b86400:16735] 0 exiting: rc = 1 00000100:00100000:2.0:1788201391.910549:0:16736:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9e04c6466800:16736] 1 exiting: rc = 0 00000100:00100000:0.0:1788201391.910991:0:16737:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9e03c2776e00:16737] 2 exiting: rc = 0 00000100:00100000:1.0:1788201391.911186:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911197:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911204:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911212:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911221:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911227:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911234:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911241:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911248:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911263:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911272:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911280:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911286:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911490:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911497:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911504:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911511:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911518:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911525:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911531:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911536:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911543:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911550:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911557:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911564:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911572:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911578:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911586:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911603:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911610:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911618:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911625:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911632:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911655:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911663:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911670:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911676:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911683:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911802:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911820:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911827:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911835:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911841:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911848:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911854:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911861:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911868:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911874:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911881:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911889:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911896:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911902:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911909:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911977:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911984:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911990:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.911997:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.912004:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.912011:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.912016:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.912023:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.912029:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.912035:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201391.912049:0:17712:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788201391.922553:0:17712:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201391.922570:0:17712:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788201391.922577:0:17712:0:(genops.c:906:class_export_put()) final put ffff9e04f976c800/MDS_uuid 00000020:00000080:1.0:1788201391.922583:0:17712:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04f976c800/MDS_uuid for MDS 00000020:01000000:1.0:1788201391.922758:0:17712:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788201391.922992:0:17712:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788201392.015432:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201393.071229:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201394.089927:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201394.917693:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458273792:0@lo:400:kworker.0 00000400:00000100:2.0:1788201394.917766:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875064458273792 offset 0 length 224: 4 00000100:00100000:2.0:1788201394.917848:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875064458274048:0@lo:400:kworker.0 00000400:00000100:2.0:1788201394.917871:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458274048 offset 0 length 224: 4 00000100:00100000:2.0:1788201394.917887:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201394.917892:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458273920:0@lo:400:kworker.0 00000400:00000100:2.0:1788201394.917909:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458273920 offset 0 length 224: 4 00010000:00010000:2.0:1788201395.110677:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788201396.034589:0:6732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294968882 is committed 00000001:00080000:2.0:1788201396.034631:0:6732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294968884 is committed 00000001:00100000:2.0:1788201396.034640:0:6732:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201396.034652:0:6732:0:(genops.c:906:class_export_put()) final put ffff9e04ff1c1000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788201396.035166:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04ff1c1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788201396.035225:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04ff1c7000 for lustre-OST0000 00000001:00080000:3.0:1788201396.038676:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968892 is committed 00000001:00100000:3.0:1788201396.039052:0:7657:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788201396.039065:0:7657:0:(genops.c:906:class_export_put()) final put ffff9e04c6a3b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788201396.039147:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c6a3b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788201396.039396:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04c6a38000 for lustre-OST0001 00000400:00000100:3.0:1788201396.118181:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.30@tcp portal 26 match 1875064442756608 offset 0 length 224: 4 00000100:00100000:3.0:1788201396.118225:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000400:00000100:3.0:1788201396.118261:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.30@tcp portal 12 match 1875064442756736 offset 0 length 224: 4 00000100:00100000:3.0:1788201396.118287:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201396.118522:0:13451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442756864 00000100:00100000:0.0:1788201396.118532:0:13451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442756864 00000100:00100000:0.0:1788201396.118603:0:13451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442756992 00000100:00100000:0.0:1788201396.118607:0:13451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442756992 00000100:00100000:0.0:1788201396.118651:0:13451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 244 00000100:00100000:0.0:1788201396.118662:0:13451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2362:x1875064442756864:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201396.118754:0:13451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2362:x1875064442756864:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 93us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201396.118761:0:13451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 244 00000100:00100000:0.0:1788201396.118779:0:13451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 245 00000100:00100000:0.0:1788201396.118786:0:13451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2361:x1875064442756992:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201396.118814:0:13451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2361:x1875064442756992:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 29us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201396.118820:0:13451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 245 00000100:00080000:3.0:1788201396.121268:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201396.121278:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788201396.138235:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201397.158016:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201398.181596:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201399.205840:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201400.037724:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458274304:0@lo:400:kworker.0 00000400:00000100:1.0:1788201400.037801:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458274304 offset 0 length 224: 4 00000100:00100000:1.0:1788201400.037877:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201400.037885:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2192d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458274176:0@lo:400:kworker.0 00000100:00100000:3.0:1788201400.037895:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2191880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875064458274432:0@lo:400:kworker.0 00000400:00000100:1.0:1788201400.037909:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875064458274176 offset 0 length 224: 4 00000400:00000100:3.0:1788201400.037931:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458274432 offset 0 length 224: 4 00010000:00010000:2.0:1788201400.229692:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1788201401.233503:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.30@tcp portal 26 match 1875064442757120 offset 0 length 224: 4 00000100:00100000:0.0:1788201401.233608:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000400:00000100:0.0:1788201401.233770:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.30@tcp portal 12 match 1875064442757248 offset 0 length 224: 4 00000100:00100000:0.0:1788201401.233800:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201401.234682:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442757376 00000100:00100000:3.0:1788201401.234697:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442757376 00000100:00100000:3.0:1788201401.234846:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442757504 00000100:00100000:3.0:1788201401.234851:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442757504 00000100:00100000:0.0:1788201401.235001:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 246 00000100:00100000:0.0:1788201401.235017:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2360:x1875064442757376:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201401.235126:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2360:x1875064442757376:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 113us (1517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201401.235134:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 246 00000100:00080000:2.0:1788201401.236118:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201401.236128:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201401.236417:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 247 00000100:00100000:3.0:1788201401.236430:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2360:x1875064442757504:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201401.237098:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2360:x1875064442757504:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 88us (2711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201401.237113:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 247 00010000:00010000:1.0:1788201401.254512:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201402.280799:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201403.302650:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201404.326218:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201405.158130:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458274816:0@lo:400:kworker.0 00000400:00000100:1.0:1788201405.158191:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458274816 offset 0 length 224: 4 00000100:00100000:1.0:1788201405.158245:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201405.158252:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458274688:0@lo:400:kworker.0 00000400:00000100:1.0:1788201405.158271:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458274688 offset 0 length 224: 4 00000100:00100000:2.0:1788201405.158360:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458274560:0@lo:400:kworker.0 00000400:00000100:2.0:1788201405.158387:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875064458274560 offset 0 length 224: 4 00010000:00010000:2.0:1788201405.350494:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1788201406.353448:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.30@tcp portal 26 match 1875064442757632 offset 0 length 224: 4 00000100:00100000:0.0:1788201406.353489:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000400:00000100:0.0:1788201406.353549:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.30@tcp portal 12 match 1875064442757760 offset 0 length 224: 4 00000100:00100000:0.0:1788201406.353587:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201406.353898:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442757888 00000100:00100000:1.0:1788201406.353910:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442757888 00000100:00100000:1.0:1788201406.354011:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442758016 00000100:00100000:1.0:1788201406.354015:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442758016 00000100:00080000:3.0:1788201406.354053:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201406.354058:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201406.354090:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 248 00000100:00100000:2.0:1788201406.354113:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2362:x1875064442757888:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201406.354194:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2362:x1875064442757888:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 94us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201406.354202:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 248 00000100:00100000:2.0:1788201406.354223:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 249 00000100:00100000:2.0:1788201406.354229:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2362:x1875064442758016:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201406.354256:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2362:x1875064442758016:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 27us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201406.354262:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 249 00010000:00010000:2.0:1788201406.375167:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201407.397842:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201408.431415:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201409.445480:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788201410.190983:0:18158:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788201410.190988:0:18158:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788201410.191405:0:18158:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e03c5130000 00000020:01000004:3.0:1788201410.191422:0:18158:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788201410.191434:0:18158:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788201410.191496:0:18158:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9e04eadcb380) 00000020:00000080:3.0:1788201410.191516:0:18158:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00000100:00000400:0.0:1788201410.277556:0:3313:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201394/real 1788201394] req@ffff9e04c12aa680 x1875064458273792/t0(0) o400->MGC192.168.201.130@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788201410 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201410.277929:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1ba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458274944:0@lo:400:kworker.0 00000400:00000100:1.0:1788201410.278000:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875064458274944 offset 0 length 224: 4 00000100:00100000:1.0:1788201410.278065:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201410.278072:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1ba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875064458275072:0@lo:400:kworker.0 00000400:00000100:1.0:1788201410.278094:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458275072 offset 0 length 224: 4 00000100:00100000:1.0:1788201410.278129:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1ba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458275200:0@lo:400:kworker.0 00000400:00000100:1.0:1788201410.278148:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458275200 offset 0 length 224: 4 00000100:00000400:3.0:1788201410.279756:0:3311:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201394/real 1788201394] req@ffff9e04c12a8e00 x1875064458273920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201410 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201410.279790:0:3311:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e04c12a8e00 x1875064458273920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201410 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201410.279800:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788201410.279805:0:3311:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788201410.318477:0:3311:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00080000:1.0:1788201410.319021:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201410.319032:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201410.319037:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201410.319045:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 649 00000100:00080000:1.0:1788201410.319054:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e04ff4ba000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:1.0:1788201410.319088:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e03c12d2300 x1875064458275328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201410.319164:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875064458275328:0@lo:38:kworker.0 00000400:00000100:3.0:1788201410.319244:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458275328 offset 0 length 520: 4 00000100:00000400:2.0:1788201410.320881:0:3311:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201394/real 1788201394] req@ffff9e04c12a8380 x1875064458274048/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201410 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201410.320910:0:3311:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e04c12a8380 x1875064458274048/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201410 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201410.320920:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788201410.320923:0:3311:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788201410.320927:0:3311:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00080000:2.0:1788201410.320951:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201410.320955:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201410.320957:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201410.320962:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 649 00000100:00080000:2.0:1788201410.320968:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e04f5751000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1788201410.320998:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e03c1ba1c00 x1875064458275456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201410.321036:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458273920:0@lo:400:kworker.0 00000100:00100000:2.0:1788201410.321044:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875064458274048:0@lo:400:kworker.0 00000100:00100000:3.0:1788201410.321539:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1ba1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875064458275456:0@lo:38:kworker.0 00000400:00000100:3.0:1788201410.321591:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458275456 offset 0 length 520: 4 00100000:10000000:2.0:1788201410.322028:0:18158:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00000100:00100000:0.0:1788201410.336060:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e04c12aa680 x1875064458273792/t0(0) o400->MGC192.168.201.130@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788201410 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201410.336080:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9e04c6711800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788201410.336085:0:3313:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1788201410.349060:0:3313:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.130@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788201410.349069:0:3313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788201410.349082:0:3313:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e04c12aa680 x1875064458273792/t0(0) o400->MGC192.168.201.130@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788201410 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201410.349101:0:3313:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e03c2192d80 x1875064458274176/t0(0) o400->MGC192.168.201.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201416 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201410.349112:0:3313:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e03c12d0380 x1875064458274560/t0(0) o400->MGC192.168.201.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201421 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201410.349135:0:3313:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e03c1ba1500 x1875064458274944/t0(0) o400->MGC192.168.201.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201426 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788201410.349159:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788201410.349163:0:3313:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788201410.349166:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788201410.349169:0:3313:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:3.0:1788201410.349222:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458274560:0@lo:400:kworker.0 00000100:00100000:0.0:1788201410.349257:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1ba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458274944:0@lo:400:kworker.0 00000100:00080000:0.0:1788201410.349333:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) b60c000b-7335-444d-a8dc-1a5956712fb2->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201410.349340:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788201410.349343:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e04c6711800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201410.349349:0:38:0:(import.c:510:import_select_connection()) MGC192.168.201.130@tcp: connect to NID 0@lo last attempt 634 00000100:00080000:0.0:1788201410.349360:0:38:0:(import.c:624:import_select_connection()) MGC192.168.201.130@tcp: import ffff9e04c6711800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1788201410.349977:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e03c2191180 x1875064458275584/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201410.350474:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b60c000b-7335-444d-a8dc-1a5956712fb2:3309:1875064458275584:0@lo:250:kworker.0 00000400:00000100:3.0:1788201410.350550:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875064458275584 offset 0 length 520: 4 00000100:00100000:2.0:1788201410.350758:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2192d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458274176:0@lo:400:kworker.0 00000100:00100000:2.0:1788201410.350769:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458273792:0@lo:400:kworker.0 00100000:10000000:3.0:1788201410.356724:0:18158:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x38:0x0] (8/32) 00100000:10000000:2.0:1788201410.365534:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 436: rc = 0 00100000:10000000:2.0:1788201410.369045:0:18158:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788201410.369242:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 436: rc = 0 00100000:10000000:2.0:1788201410.369457:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 436: rc = 0 00100000:10000000:2.0:1788201410.369573:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 436: rc = 0 00100000:10000000:2.0:1788201410.369679:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 436: rc = 0 00100000:10000000:2.0:1788201410.369780:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 436: rc = 0 00100000:10000000:3.0:1788201410.376881:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 438: rc = 0 00100000:10000000:0.0:1788201410.413083:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 474: rc = 0 00100000:10000000:0.0:1788201410.413201:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 474: rc = 0 00100000:10000000:0.0:1788201410.467922:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 363: rc = 0 00010000:00010000:2.0:1788201410.472248:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788201410.480917:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 363: rc = 0 00100000:10000000:1.0:1788201410.490132:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 363: rc = 0 00100000:10000000:1.0:1788201410.501820:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 363: rc = 0 00100000:10000000:1.0:1788201410.508142:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 363: rc = 0 00100000:10000000:0.0:1788201410.515953:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 363: rc = 0 00100000:10000000:0.0:1788201410.522993:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 363: rc = 0 00100000:10000000:0.0:1788201410.542523:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 363: rc = 0 00100000:10000000:0.0:1788201410.546182:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 363: rc = 0 00100000:10000000:2.0:1788201410.569505:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 363: rc = 0 00100000:10000000:3.0:1788201410.594100:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 363: rc = 0 00100000:10000000:3.0:1788201410.599631:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 363: rc = 0 00100000:10000000:3.0:1788201410.602467:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 595: rc = 0 00100000:10000000:3.0:1788201410.604676:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 595: rc = 0 00100000:10000000:2.0:1788201410.606860:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 595: rc = 0 00100000:10000000:0.0:1788201410.608176:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 595: rc = 0 00100000:10000000:0.0:1788201410.609326:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 595: rc = 0 00100000:10000000:0.0:1788201410.623050:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 595: rc = 0 00100000:10000000:0.0:1788201410.628664:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 595: rc = 0 00100000:10000000:0.0:1788201410.637339:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 595: rc = 0 00100000:10000000:0.0:1788201410.638844:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 595: rc = 0 00100000:10000000:0.0:1788201410.643765:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 595: rc = 0 00100000:10000000:0.0:1788201410.644893:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 595: rc = 0 00100000:10000000:0.0:1788201410.656010:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 595: rc = 0 00100000:10000000:2.0:1788201410.665576:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 595: rc = 0 00100000:10000000:3.0:1788201410.674714:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 595: rc = 0 00100000:10000000:3.0:1788201410.697744:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 595: rc = 0 00100000:10000000:3.0:1788201410.701044:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 595: rc = 0 00100000:10000000:3.0:1788201410.704878:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 595: rc = 0 00100000:10000000:2.0:1788201410.716809:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 595: rc = 0 00100000:10000000:2.0:1788201410.729889:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 595: rc = 0 00100000:10000000:2.0:1788201410.745996:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 595: rc = 0 00100000:10000000:3.0:1788201410.759947:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 595: rc = 0 00100000:10000000:0.0:1788201410.774859:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 595: rc = 0 00100000:10000000:0.0:1788201410.788783:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 595: rc = 0 00100000:10000000:1.0:1788201410.800845:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 595: rc = 0 00100000:10000000:3.0:1788201410.806945:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 595: rc = 0 00100000:10000000:3.0:1788201410.824883:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 595: rc = 0 00100000:10000000:3.0:1788201410.831747:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 595: rc = 0 00100000:10000000:3.0:1788201410.834175:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 595: rc = 0 00100000:10000000:3.0:1788201410.835433:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 595: rc = 0 00100000:10000000:3.0:1788201410.836598:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 595: rc = 0 00100000:10000000:3.0:1788201410.839641:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 595: rc = 0 00100000:10000000:3.0:1788201410.842726:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 595: rc = 0 00100000:10000000:3.0:1788201410.845130:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 590: rc = 0 00100000:10000000:2.0:1788201410.846574:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000bd0:0x1:0x0] under 590: rc = 0 00100000:10000000:2.0:1788201410.849666:0:18158:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788201410.850695:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 359: rc = 0 00100000:10000000:2.0:1788201410.851691:0:18158:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788201410.851771:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 359: rc = 0 00100000:10000000:2.0:1788201410.852862:0:18158:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788201410.852957:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 359: rc = 0 00100000:10000000:2.0:1788201410.855964:0:18158:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788201410.856087:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 475: rc = 0 00100000:10000000:2.0:1788201410.857580:0:18158:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788201410.857686:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 475: rc = 0 00100000:10000000:2.0:1788201410.859621:0:18158:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788201410.859923:0:18158:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 475: rc = 0 00000020:00000080:2.0:1788201410.860473:0:18158:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788201410.860495:0:18158:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788201410.860511:0:18158:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d5cc6 00000020:01000004:2.0:1788201410.860522:0:18158:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788201410.860533:0:18158:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788201410.860540:0:18158:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e03c5130000 from MGS 00000020:01000004:2.0:1788201410.860545:0:18158:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788201410.860559:0:18158:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9e04d1c319c0) 00000020:00000080:2.0:1788201410.860572:0:18158:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788201410.860640:0:18158:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e03c5130000 from MGS, refs=2 00080000:01000000:2.0:1788201410.860645:0:18158:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788201410.860652:0:18158:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d5cd4 00010000:00010000:2.0:1788201410.861047:0:18158:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-2 is initialized 00000040:01000000:0.0:1788201410.894907:0:18158:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788201410.894941:0:18158:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788201410.894945:0:18158:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788201410.906540:0:18159:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788201410.907401:0:18158:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788201410.907564:0:18158:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788201410.928517:0:18158:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788201410.928976:0:18158:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201410.929174:0:18158:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788201410.929180:0:18158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788201410.937703:0:18158:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788201410.937720:0:18158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788201410.940766:0:18158:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788201410.940783:0:18158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788201410.946491:0:18158:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788201410.946531:0:18158:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:0.0:1788201410.946534:0:18158:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.130@tcp:Set MGC reconnect 2 10000000:01000000:0.0:1788201410.946541:0:18158:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.130@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:0.0:1788201410.946548:0:18158:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9e04c6711800 already not connected (conn 6, was 0): CONNECTING 00000100:00100000:0.0:1788201410.946557:0:18158:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00000100:00100000:1.0:1788201410.961571:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201410.961767:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442758144 00000100:00100000:2.0:1788201410.961777:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442758144 00000100:00100000:2.0:1788201410.961838:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 900 00000100:00100000:2.0:1788201410.961844:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:2360:x1875064442758144:12345-192.168.201.30@tcp:63:ll_sa.0 00000020:00080000:2.0:1788201410.961851:0:17128:0:(tgt_handler.c:807:tgt_request_handle()) operation 63 on unconnected OST from 12345-192.168.201.30@tcp 00000100:00100000:2.0:1788201410.961915:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:2360:x1875064442758144:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 70us (354us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788201410.961920:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 900 00000400:00000100:3.0:1788201410.990794:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.30@tcp portal 12 match 1875064442758272 offset 0 length 520: 4 00000100:00100000:1.0:1788201411.474677:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201411.474740:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201411.474918:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442758528 00000100:00100000:0.0:1788201411.474931:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442758528 00000100:00100000:0.0:1788201411.475030:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 250 00000100:00100000:0.0:1788201411.475044:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2362:x1875064442758528:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201411.475148:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2362:x1875064442758528:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 109us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201411.475156:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 250 00000100:00080000:3.0:1788201411.475333:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201411.475519:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442758400 00000100:00100000:2.0:1788201411.475525:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442758400 00000100:00100000:2.0:1788201411.475557:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:2.0:1788201411.475563:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2a19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2362:x1875064442758400:12345-192.168.201.30@tcp:400:kworker.0 00000020:00080000:2.0:1788201411.475572:0:18161:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.30@tcp 00000100:00100000:2.0:1788201411.475613:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2a19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2362:x1875064442758400:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 50us (950us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788201411.475620:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:1.0:1788201411.485608:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201411.485723:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442758656 00000100:00100000:3.0:1788201411.485736:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442758656 00000100:00080000:2.0:1788201411.485871:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201411.485981:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4345 00000100:00100000:3.0:1788201411.485994:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2358:x1875064442758656:12345-192.168.201.30@tcp:9:kworker.0 00000020:00000080:3.0:1788201411.486036:0:13445:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4a608b 00000100:00080000:3.0:1788201411.486046:0:13445:0:(import.c:65:import_set_state_nolock()) ffff9e04ff44e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788201411.486096:0:13445:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968892 00000100:00100000:3.0:1788201411.486727:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35604eb4-baf9-45be-a20a-4883a2cd8cf9+2:2358:x1875064442758656:12345-192.168.201.30@tcp:9:kworker.0 Request processed in 733us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201411.486757:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4345 00010000:00010000:2.0:1788201411.487131:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201411.493662:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201411.512608:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201411.512714:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442758784 00000100:00100000:2.0:1788201411.512896:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442758784 00000100:00100000:2.0:1788201411.512953:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:2.0:1788201411.512963:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2a18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2358:x1875064442758784:12345-192.168.201.30@tcp:250:ptlrpcd_01_01.0 00010000:00080000:2.0:1788201411.512998:0:18163:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 7ad49433-54fa-4e21-b756-859420d95603@192.168.201.30@tcp t0 exp 0000000000000000 cur 686 last 0 00000020:00000080:2.0:1788201411.513029:0:18163:0:(genops.c:1406:class_connect()) connect: client 7ad49433-54fa-4e21-b756-859420d95603, cookie 0x9383f985bc4d5cdb 00000100:00080000:2.0:1788201411.513440:0:18163:0:(import.c:65:import_set_state_nolock()) ffff9e04c8356800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201411.513533:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2a18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+5:2358:x1875064442758784:12345-192.168.201.30@tcp:250:ptlrpcd_01_01.0 Request processed in 570us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201411.513540:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1 00010000:00010000:1.0:1788201412.520220:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201413.139242:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201413.139473:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442758912 00000100:00100000:3.0:1788201413.139487:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442758912 00000100:00100000:3.0:1788201413.139563:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:3.0:1788201413.139577:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2a1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+5:5601:x1875064442758912:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201413.139602:0:18162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201413.139632:0:18162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c2ef3600/0x9383f985bc4d5ce2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c58ac expref: -99 pid: 18162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201413.139670:0:18162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c2ef3600/0x9383f985bc4d5ce2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58ac expref: 6 pid: 18162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201413.139684:0:18162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c2ef3600/0x9383f985bc4d5ce2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58ac expref: 6 pid: 18162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201413.139694:0:18162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2ef3600, rc 0) 00000100:00100000:3.0:1788201413.139775:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2a1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+6:5601:x1875064442758912:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 200us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201413.139783:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:1.0:1788201413.165187:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201413.165699:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442759040 00000100:00100000:2.0:1788201413.165712:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442759040 00000100:00100000:2.0:1788201413.165785:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:2.0:1788201413.165797:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2a19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+6:5601:x1875064442759040:12345-192.168.201.30@tcp:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788201413.165920:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2a19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+6:5601:x1875064442759040:12345-192.168.201.30@tcp:256:ll_cfg_requeue.0 Request processed in 124us (748us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201413.165934:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:0.0:1788201413.184270:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201413.184607:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442759168 00000100:00100000:2.0:1788201413.184622:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442759168 00000100:00100000:2.0:1788201413.184702:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:2.0:1788201413.184716:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2a1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+6:5601:x1875064442759168:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201413.184741:0:18163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201413.184772:0:18163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c1b96200/0x9383f985bc4d5ce9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c58b3 expref: -99 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201413.184808:0:18163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c1b96200/0x9383f985bc4d5ce9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58b3 expref: 7 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201413.184822:0:18163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c1b96200/0x9383f985bc4d5ce9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58b3 expref: 7 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201413.184832:0:18163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c1b96200, rc 0) 00000100:00100000:2.0:1788201413.184910:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2a1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+7:5601:x1875064442759168:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 197us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201413.184918:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:1.0:1788201413.188128:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201413.190384:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442759296 00000100:00100000:0.0:1788201413.190405:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442759296 00000100:00100000:0.0:1788201413.190504:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:0.0:1788201413.190517:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1d50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+7:5601:x1875064442759296:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788201413.192692:0:18167:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788201413.199226:0:18162:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 14 20000000:01000000:3.0:1788201413.240843:0:18168:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788201413.240856:0:18168:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788201413.240859:0:18168:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788201413.240946:0:18168:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788201413.242799:0:18162:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788201413.242925:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1d50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+8:5601:x1875064442759296:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 52401us (54803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201413.242941:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:3.0:1788201413.246032:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201413.246695:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442759424 00000100:00100000:0.0:1788201413.246709:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442759424 00000100:00100000:0.0:1788201413.246786:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:0.0:1788201413.246799:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1d51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+8:5601:x1875064442759424:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201413.247111:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1d51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+8:5601:x1875064442759424:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 Request processed in 314us (1833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201413.247120:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:2.0:1788201413.263912:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201413.264015:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442759552 00000100:00100000:0.0:1788201413.264030:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442759552 00000100:00100000:0.0:1788201413.264102:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:0.0:1788201413.264115:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1d52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+8:5601:x1875064442759552:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201413.264140:0:18162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201413.264178:0:18162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c2cc7200/0x9383f985bc4d5cf0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c58ba expref: -99 pid: 18162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201413.264223:0:18162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c2cc7200/0x9383f985bc4d5cf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58ba expref: 9 pid: 18162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201413.264236:0:18162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c2cc7200/0x9383f985bc4d5cf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58ba expref: 9 pid: 18162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201413.264248:0:18162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc7200, rc 0) 00000100:00100000:0.0:1788201413.264424:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1d52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442759552:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 311us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201413.264433:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:0.0:1788201413.267940:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201413.268492:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442759680 00000100:00100000:3.0:1788201413.268508:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442759680 00000100:00100000:2.0:1788201413.269399:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:2.0:1788201413.269422:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1d50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442759680:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201413.271165:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1d50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442759680:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 1746us (3231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201413.271180:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:3.0:1788201413.274945:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201413.275115:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442759808 00000100:00100000:2.0:1788201413.275129:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442759808 00000100:00100000:2.0:1788201413.275190:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:2.0:1788201413.275213:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1d50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442759808:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201413.276835:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1d50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442759808:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 Request processed in 1614us (1895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201413.276856:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:3.0:1788201413.295211:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201413.295363:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442759936 00000100:00100000:0.0:1788201413.295377:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442759936 00000100:00100000:0.0:1788201413.295450:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:0.0:1788201413.295463:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1d53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442759936:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201413.295495:0:18161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201413.295520:0:18161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c2cc7a00/0x9383f985bc4d5cf7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c58c1 expref: -99 pid: 18161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201413.295558:0:18161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c2cc7a00/0x9383f985bc4d5cf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58c1 expref: 10 pid: 18161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201413.295571:0:18161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c2cc7a00/0x9383f985bc4d5cf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58c1 expref: 10 pid: 18161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201413.295582:0:18161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc7a00, rc 0) 00000100:00100000:0.0:1788201413.295667:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1d53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:5601:x1875064442759936:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 206us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201413.295674:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:0.0:1788201413.298054:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201413.302990:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442760064 00000100:00100000:1.0:1788201413.303010:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442760064 00000100:00100000:1.0:1788201413.303140:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:1.0:1788201413.306797:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1d52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:5601:x1875064442760064:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201413.307205:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1d52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:5601:x1875064442760064:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 447us (9163us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201413.307219:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00010000:00010000:2.0:1788201413.544550:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201414.566183:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201415.397748:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) b60c000b-7335-444d-a8dc-1a5956712fb2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201415.397762:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) b60c000b-7335-444d-a8dc-1a5956712fb2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201415.397766:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201415.397770:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201415.397773:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201415.397777:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788201415.511374:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201415.511445:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201415.511468:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442760192 00000100:00100000:1.0:1788201415.511484:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442760192 00000100:00100000:1.0:1788201415.511577:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:1.0:1788201415.511592:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1d53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442760192:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201415.511703:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1d53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442760192:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 113us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201415.511711:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:2.0:1788201415.511824:0:13442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442760320 00000100:00100000:2.0:1788201415.511836:0:13442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442760320 00000100:00100000:2.0:1788201415.511910:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 251 00000100:00100000:2.0:1788201415.511919:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2359:x1875064442760320:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201415.511973:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2359:x1875064442760320:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 56us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201415.511981:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 251 00000100:00080000:3.0:1788201415.512199:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788201415.590634:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1788201416.428165:0:3310:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201400/real 1788201400] req@ffff9e03c2191880 x1875064458274432/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201416 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201416.428219:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e03c2191880 x1875064458274432/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201416 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201416.428229:0:3310:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff9e04f5751000 already not connected (conn 10, was 9): CONNECTING 00000100:00100000:0.0:1788201416.428248:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2191880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875064458274432:0@lo:400:kworker.0 00000100:00000400:2.0:1788201416.487827:0:3313:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201400/real 1788201400] req@ffff9e03c2191c00 x1875064458274304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201416 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201416.487879:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e03c2191c00 x1875064458274304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201416 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201416.487889:0:3313:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff9e04ff4ba000 already not connected (conn 10, was 9): CONNECTING 00000100:00100000:2.0:1788201416.487915:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458274304:0@lo:400:kworker.0 00000100:00100000:3.0:1788201416.528907:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201416.529177:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442760448 00000100:00100000:1.0:1788201416.529193:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442760448 00000100:00100000:1.0:1788201416.529427:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:1.0:1788201416.529445:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1d52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442760448:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201416.529572:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1d52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442760448:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 132us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201416.529581:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:0.0:1788201416.542429:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201416.543193:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442760576 00000100:00100000:1.0:1788201416.543204:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442760576 00000100:00100000:1.0:1788201416.543255:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 252 00000100:00100000:1.0:1788201416.543266:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2191880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2360:x1875064442760576:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201416.543375:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2191880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2360:x1875064442760576:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 110us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201416.543392:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 252 00000001:00100000:3.0:1788201416.557525:0:7657:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 35604eb4-baf9-45be-a20a-4883a2cd8cf9 00000020:00000080:3.0:1788201416.557537:0:7657:0:(genops.c:906:class_export_put()) final put ffff9e04ff44c800/35604eb4-baf9-45be-a20a-4883a2cd8cf9 00000020:00000080:2.0:1788201416.558501:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04ff44c800/35604eb4-baf9-45be-a20a-4883a2cd8cf9 for lustre-OST0001 00000020:00000080:2.0:1788201416.558571:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04ff44e800 for lustre-OST0001 00010000:00010000:2.0:1788201416.613585:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201417.637571:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201418.661978:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201419.685944:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201420.517524:0:3309:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201410/real 1788201410] req@ffff9e03c2191180 x1875064458275584/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788201420 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201420.517571:0:3309:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e03c2191180 x1875064458275584/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788201420 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201420.517585:0:3309:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201410/real 1788201410] req@ffff9e03c1ba1c00 x1875064458275456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201420 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201420.517597:0:3309:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e03c1ba1c00 x1875064458275456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201420 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201420.517607:0:3309:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201410/real 1788201410] req@ffff9e03c12d2300 x1875064458275328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201420 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201420.517619:0:3309:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e03c12d2300 x1875064458275328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201420 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201420.517642:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04c6711800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201420.517652:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788201420.517677:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b60c000b-7335-444d-a8dc-1a5956712fb2:3309:1875064458275584:0@lo:250:kworker.0 00000100:00080000:0.0:1788201420.517684:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201420.517690:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788201420.517693:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1ba1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875064458275456:0@lo:38:kworker.0 00000100:00080000:0.0:1788201420.517698:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201420.517702:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788201420.517705:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875064458275328:0@lo:38:kworker.0 10000000:01000000:2.0:1788201420.518688:0:18158:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1788201420.518716:0:18158:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c507d800/0x9383f985bc4d4d7d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4d4d84 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201420.518729:0:18158:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c507d800/0x9383f985bc4d4d7d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4d4d84 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201420.518736:0:18158:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788201420.518760:0:18158:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201420.518772:0:18158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c507d800/0x9383f985bc4d4d7d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4d4d84 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.518793:0:18158:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c5064400/0x9383f985bc4d4d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4d4d3e expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201420.518799:0:18158:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c5064400/0x9383f985bc4d4d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4d4d3e expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201420.518805:0:18158:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201420.518808:0:18158:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201420.518812:0:18158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c5064400/0x9383f985bc4d4d37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4d4d3e expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.518829:0:18158:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c507c600/0x9383f985bc4d4d45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4d4d4c expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201420.518837:0:18158:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c507c600/0x9383f985bc4d4d45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4d4d4c expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201420.518842:0:18158:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201420.518846:0:18158:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201420.518849:0:18158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c507c600/0x9383f985bc4d4d45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4d4d4c expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.518858:0:18158:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e0501b28a00/0x9383f985bc4d4d61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4d4d68 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201420.518865:0:18158:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e0501b28a00/0x9383f985bc4d4d61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4d4d68 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201420.518870:0:18158:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201420.518873:0:18158:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201420.518877:0:18158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e0501b28a00/0x9383f985bc4d4d61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4d4d68 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.518887:0:18158:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c5065000/0x9383f985bc4d4d6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4d4d76 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201420.518895:0:18158:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c5065000/0x9383f985bc4d4d6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4d4d76 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201420.518901:0:18158:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201420.518907:0:18158:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201420.518910:0:18158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c5065000/0x9383f985bc4d4d6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4d4d76 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.518919:0:18158:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e0501b29400/0x9383f985bc4d4d99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4d4da0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201420.518926:0:18158:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e0501b29400/0x9383f985bc4d4d99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4d4da0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201420.518935:0:18158:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201420.518947:0:18158:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201420.518950:0:18158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e0501b29400/0x9383f985bc4d4d99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4d4da0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.518963:0:18158:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c507ce00/0x9383f985bc4d4d53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4d4d5a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201420.518969:0:18158:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c507ce00/0x9383f985bc4d4d53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4d4d5a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201420.518973:0:18158:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788201420.518976:0:18158:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201420.518979:0:18158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c507ce00/0x9383f985bc4d4d53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4d4d5a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.518986:0:18158:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c507d600/0x9383f985bc4d4d8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4d4d92 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201420.518992:0:18158:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c507d600/0x9383f985bc4d4d8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4d4d92 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201420.518997:0:18158:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788201420.519001:0:18158:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201420.519005:0:18158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c507d600/0x9383f985bc4d4d8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4d4d92 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788201420.519025:0:18158:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9e04c6711800 already not connected (conn 6, was 0): DISCONN 00000100:00080000:2.0:1788201420.519031:0:18158:0:(import.c:65:import_set_state_nolock()) ffff9e04c6711800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201420.519039:0:18158:0:(import.c:510:import_select_connection()) MGC192.168.201.130@tcp: connect to NID 0@lo last attempt 685 00000100:00080000:2.0:1788201420.519046:0:18158:0:(import.c:589:import_select_connection()) MGC192.168.201.130@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788201420.519052:0:18158:0:(import.c:624:import_select_connection()) MGC192.168.201.130@tcp: import ffff9e04c6711800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1788201420.519204:0:18158:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e03c1ba0a80 x1875064458275712/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201420.519231:0:18158:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:0.0:1788201420.519352:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b60c000b-7335-444d-a8dc-1a5956712fb2:3309:1875064458275712:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788201420.519452:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201420.520761:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458275712 00000100:00100000:2.0:1788201420.520779:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458275712 00000100:00100000:2.0:1788201420.521940:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788201420.521956:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) b60c000b-7335-444d-a8dc-1a5956712fb2->MGS: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1788201420.521957:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1d51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3309:x1875064458275712:12345-0@lo:250:mount.lustre.0 00000100:00080000:1.0:1788201420.521966:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) b60c000b-7335-444d-a8dc-1a5956712fb2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201420.521971:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201420.521975:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201420.521980:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201420.521986:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 685 00000100:00080000:1.0:1788201420.521993:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788201420.522000:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e04ff4ba000 using connection 192.168.201.130@tcp/0@lo 00010000:00080000:2.0:1788201420.522005:0:18162:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from b60c000b-7335-444d-a8dc-1a5956712fb2@0@lo t0 exp 0000000000000000 cur 695 last 0 00000100:00100000:1.0:1788201420.522037:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e03c12d1c00 x1875064458275840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:2.0:1788201420.522051:0:18162:0:(genops.c:1406:class_connect()) connect: client b60c000b-7335-444d-a8dc-1a5956712fb2, cookie 0x9383f985bc4d5cfe 00000100:00080000:1.0:1788201420.522060:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201420.522065:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201420.522067:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201420.522071:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 685 00000100:00080000:1.0:1788201420.522074:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788201420.522079:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e04f5751000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:1.0:1788201420.522092:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e03c12d0000 x1875064458275968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201420.522096:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875064458275840:0@lo:38:kworker.0 00000400:00000100:0.0:1788201420.522159:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458275840 offset 0 length 520: 4 00000100:00100000:0.0:1788201420.522365:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875064458275968:0@lo:38:kworker.0 00000400:00000100:0.0:1788201420.522385:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458275968 offset 0 length 520: 4 00000100:00080000:2.0:1788201420.523358:0:18162:0:(import.c:65:import_set_state_nolock()) ffff9e04c6713800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201420.523467:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1d51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+5:3309:x1875064458275712:12345-0@lo:250:mount.lustre.0 Request processed in 1505us (4006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201420.523479:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788201420.523791:0:3309:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.130@tcp: committing for last_committed 0 gen 5 00000100:00080000:0.0:1788201420.523803:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.130@tcp: connect to target with instance 0 00000100:00080000:0.0:1788201420.523814:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.130@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788201420.523819:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788201420.523823:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04c6711800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788201420.523826:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788201420.523873:0:3309:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788201420.523885:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b60c000b-7335-444d-a8dc-1a5956712fb2:3309:1875064458275712:0@lo:250:mount.lustre.0 00000100:00080000:0.0:1788201420.523941:0:18158:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:0.0:1788201420.523958:0:18158:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788201420.523968:0:18158:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788201420.523987:0:18158:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9e04ff1e4d40) 00000020:00000080:0.0:1788201420.524000:0:18158:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000020:01000000:3.0:1788201420.528142:0:36:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.201.130@tcp 10000000:01000000:3.0:1788201420.528174:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1788201420.528178:0:36:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788201420.528181:0:36:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788201420.528182:0:36:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201420.528184:0:36:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201420.528185:0:36:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201420.528187:0:36:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201420.528188:0:36:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201420.528190:0:36:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201420.528191:0:36:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1788201420.528247:0:36:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1788201420.528253:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:3.0:1788201420.528254:0:36:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788201420.528255:0:36:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788201420.528256:0:36:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201420.528257:0:36:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201420.528258:0:36:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201420.528260:0:36:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201420.528261:0:36:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201420.528262:0:36:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201420.528263:0:36:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1788201420.528329:0:36:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1788201420.528371:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201420.528391:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458276224:0@lo:253:kworker.0 00000100:00100000:3.0:1788201420.528486:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201420.528641:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458276096:0@lo:253:kworker.0 00000100:00100000:2.0:1788201420.528685:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201420.528750:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458276224 00000100:00100000:2.0:1788201420.528758:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458276224 00000100:00100000:2.0:1788201420.528810:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458276096 00000100:00100000:2.0:1788201420.528814:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458276096 00000100:00100000:2.0:1788201420.528844:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788201420.528855:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c296f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+6:3311:x1875064458276224:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1788201420.528899:0:18161:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788201420.528916:0:18161:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788201420.529429:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788201420.529440:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c296e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+6:3313:x1875064458276096:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1788201420.529474:0:18162:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:0.0:1788201420.541496:0:18158:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788201420.541699:0:18158:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788201420.541707:0:18158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788201420.548840:0:18158:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788201420.548862:0:18158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788201420.553269:0:18158:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788201420.553283:0:18158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788201420.553836:0:18158:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201420.554039:0:18158:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788201420.554043:0:18158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788201420.556984:0:18158:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788201420.556998:0:18158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788201420.654143:0:18158:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201420.654425:0:18158:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788201420.654434:0:18158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788201420.664010:0:18158:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788201420.664046:0:18158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788201420.667267:0:18158:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201420.667543:0:18158:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788201420.667549:0:18158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788201420.668937:0:18158:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788201420.668950:0:18158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788201420.671435:0:18158:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201420.673991:0:18158:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788201420.674373:0:18158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788201420.695905:0:18158:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788201420.695926:0:18158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788201420.696274:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201420.696367:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201420.696469:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201420.696512:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442761088 00000100:00100000:3.0:1788201420.696525:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442761088 00000100:00100000:3.0:1788201420.696648:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 253 00000100:00100000:3.0:1788201420.696662:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9658850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2360:x1875064442761088:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201420.696755:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9658850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2360:x1875064442761088:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 94us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201420.696763:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 253 00000100:00080000:3.0:1788201420.696908:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201420.697012:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442760960 00000100:00100000:3.0:1788201420.697016:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442760960 00000100:00100000:3.0:1788201420.697045:0:18175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:3.0:1788201420.697051:0:18175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2358:x1875064442760960:12345-192.168.201.30@tcp:38:kworker.0 00010000:00020000:3.0:1788201420.697073:0:18175:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201420.697404:0:18163:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1788201420.697416:0:18163:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:0.0:1788201420.697731:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442760832 00000100:00100000:0.0:1788201420.697738:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442760832 00000100:00100000:1.0:1788201420.698232:0:18158:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201420.698464:0:18158:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788201420.698469:0:18158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788201420.698793:0:18158:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788201420.698799:0:18158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788201420.700082:0:18186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:1.0:1788201420.700107:0:18186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c296cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442760832:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201420.700236:0:18186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c296cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442760832:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 137us (3969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201420.700245:0:18186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 17 20000000:01000000:0.0:1788201420.705961:0:18161:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788201420.705979:0:18161:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788201420.706015:0:18167:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788201420.706021:0:18167:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788201420.706053:0:18167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e03c2cc7000/0x9383f985bc4d5d0c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.706081:0:18167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e03c2ef3600/0x9383f985bc4d5ce2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58ac expref: 9 pid: 18162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.706092:0:18167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e03c2cc7000/0x9383f985bc4d5d0c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.706153:0:18167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e03c2ef3600/0x9383f985bc4d5ce2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58ac expref: 9 pid: 18162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.706171:0:18167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e03c2ef3600/0x9383f985bc4d5ce2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58ac expref: 9 pid: 18162 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201420.706191:0:18167:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2191180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18167:1875064458276352:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201420.706341:0:18167:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2ff0540 going to sleep for 11 seconds 20000000:01000000:2.0:1788201420.707697:0:18162:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:0.0:1788201420.710420:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201420.733453:0:18175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2358:x1875064442760960:12345-192.168.201.30@tcp:38:kworker.0 Request processed in 36387us (36970us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201420.733480:0:18175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:3.0:1788201420.734430:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201420.734497:0:18167:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2191180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18167:1875064458276352:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201420.734532:0:18167:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e03c2cc7000/0x9383f985bc4d5d0c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201420.735218:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442761216 00000100:00100000:2.0:1788201420.735231:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442761216 00010000:00010000:2.0:1788201420.735278:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e03c2ef3600/0x9383f985bc4d5ce2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58ac expref: 10 pid: 18162 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201420.735354:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1593 00000100:00100000:2.0:1788201420.735367:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442761216:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201420.735386:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201420.735392:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e03c2ef3600/0x9383f985bc4d5ce2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58ac expref: 10 pid: 18162 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.735405:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e03c2ef3600/0x9383f985bc4d5ce2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58ac expref: 10 pid: 18162 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.735443:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c2ef3600/0x9383f985bc4d5ce2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58ac expref: 10 pid: 18162 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.735468:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e03c2cc7000/0x9383f985bc4d5d0c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.735478:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c2cc7000/0x9383f985bc4d5d0c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788201420.735506:0:5844:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.029486887s 00010000:00010000:2.0:1788201420.735512:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03c2cc7000/0x9383f985bc4d5d0c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.735520:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03c2cc7000/0x9383f985bc4d5d0c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.735528:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e03c2cc7000/0x9383f985bc4d5d0c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.735536:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e03c2cc7000/0x9383f985bc4d5d0c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.735542:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201420.735547:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e03c2cc7000/0x9383f985bc4d5d0c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.735555:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e03c2cc7000/0x9383f985bc4d5d0c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.735571:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e03c2cc7000/0x9383f985bc4d5d0c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.735580:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201420.735636:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ad49433-54fa-4e21-b756-859420d95603+9:2359:x1875064442761216:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 272us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201420.735645:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1593 00010000:00010000:2.0:1788201420.735740:0:18167:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e03c2cc7000/0x9383f985bc4d5d0c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.735750:0:18167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e03c2cc7000/0x9383f985bc4d5d0c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.735757:0:18167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c2cc7000/0x9383f985bc4d5d0c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201420.754510:0:18158:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201420.754716:0:18158:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788201420.754722:0:18158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788201420.790393:0:18158:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788201420.790409:0:18158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788201420.791628:0:18158:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788201420.791638:0:18158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788201420.796482:0:18158:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788201420.796514:0:18158:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788201420.796521:0:18158:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788201420.796728:0:18158:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.130@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788201420.797379:0:18158:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.130@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788201420.797384:0:18158:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788201420.797386:0:18158:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788201420.797388:0:18158:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201420.797390:0:18158:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201420.797678:0:18158:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201420.797680:0:18158:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201420.797682:0:18158:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201420.797683:0:18158:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788201420.797686:0:18158:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201420.797687:0:18158:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788201420.797690:0:18158:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788201420.797693:0:18158:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788201420.797694:0:18158:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788201420.797695:0:18158:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201420.797696:0:18158:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201420.797697:0:18158:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201420.797699:0:18158:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201420.797700:0:18158:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201420.797701:0:18158:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788201420.797702:0:18158:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201420.797703:0:18158:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788201420.797733:0:18158:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788201420.797754:0:18158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:18158:1875064458276480:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788201420.797939:0:18158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201420.797985:0:18158:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04feff1240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201420.799972:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458276480 00000100:00100000:1.0:1788201420.799987:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458276480 00000100:00100000:1.0:1788201420.800038:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788201420.800049:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c296f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+7:18158:x1875064458276480:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788201420.800113:0:18163:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788201420.800116:0:18163:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788201420.800120:0:18163:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:1.0:1788201420.800126:0:18163:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788201420.865569:0:18162:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788201420.865585:0:18162:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788201420.867359:0:18167:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788201420.867371:0:18167:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788201420.867402:0:18167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e03c1b97600/0x9383f985bc4d5d13 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.867422:0:18167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c1b97600/0x9383f985bc4d5d13 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788201420.867434:0:18167:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.029486887s 00010000:00010000:2.0:1788201420.867439:0:18167:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03c1b97600/0x9383f985bc4d5d13 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.867445:0:18167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03c1b97600/0x9383f985bc4d5d13 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.867452:0:18167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e03c1b97600/0x9383f985bc4d5d13 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.867459:0:18167:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e03c1b97600/0x9383f985bc4d5d13 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.867469:0:18167:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201420.867474:0:18167:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e03c1b97600/0x9383f985bc4d5d13 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.867481:0:18167:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e03c1b97600/0x9383f985bc4d5d13 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.867493:0:18167:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e03c1b97600/0x9383f985bc4d5d13 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.867500:0:18167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e03c1b97600/0x9383f985bc4d5d13 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.867506:0:18167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c1b97600/0x9383f985bc4d5d13 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201420.879704:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c296f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+7:3311:x1875064458276224:12345-0@lo:253:kworker.0 Request processed in 350840us (351208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201420.879720:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000020:01000004:3.0:1788201420.879950:0:3311:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1788201420.879954:0:3311:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788201420.879956:0:3311:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201420.879958:0:3311:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201420.879959:0:3311:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201420.879960:0:3311:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201420.879962:0:3311:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201420.879964:0:3311:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201420.879966:0:3311:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788201420.879970:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458276224:0@lo:253:kworker.0 00000100:00100000:3.0:1788201420.891247:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c296f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+6:18158:x1875064458276480:12345-0@lo:253:mount.lustre.0 Request processed in 91192us (93300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201420.891260:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788201420.891416:0:18158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:18158:1875064458276480:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788201420.891432:0:18158:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788201420.891436:0:18158:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788201420.891438:0:18158:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788201420.891439:0:18158:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201420.891441:0:18158:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201420.891442:0:18158:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201420.891444:0:18158:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201420.891445:0:18158:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201420.891447:0:18158:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788201420.891449:0:18158:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201420.891450:0:18158:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788201420.891477:0:18158:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e03c5130000 from lustre-MDT0000 10000000:01000000:1.0:1788201420.891508:0:18158:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788201420.891512:0:18158:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788201420.891520:0:18158:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e03c5130000 10000000:01000000:1.0:1788201420.891524:0:18158:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788201420.891529:0:18158:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e03c5130000 10000000:01000000:1.0:1788201420.891532:0:18158:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788201420.891535:0:18158:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9e03c5130000 from 1 10000000:01000000:1.0:1788201420.891538:0:18158:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788201420.891574:0:18158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04c0030000/0x9383f985bc4d5d1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201420.891585:0:18158:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e04c0030000/0x9383f985bc4d5d1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201420.891594:0:18158:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e04c0030000/0x9383f985bc4d5d1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201420.891615:0:18158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:18158:1875064458276608:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201420.891650:0:18158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201420.891726:0:18158:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8073780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201420.892989:0:18186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458276608 00000100:00100000:3.0:1788201420.893001:0:18186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458276608 00000100:00100000:3.0:1788201420.893117:0:18186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788201420.893129:0:18186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c296ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+6:18158:x1875064458276608:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201420.893150:0:18186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201420.893170:0:18186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c2ef2400/0x9383f985bc4d5d21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d5d1a expref: -99 pid: 18186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201420.893196:0:18186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c2ef2400/0x9383f985bc4d5d21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d5d1a expref: 7 pid: 18186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201420.893207:0:18186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c2ef2400/0x9383f985bc4d5d21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d5d1a expref: 7 pid: 18186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201420.893217:0:18186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2ef2400, rc 0) 00000100:00100000:3.0:1788201420.893289:0:18186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c296ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+7:18158:x1875064458276608:12345-0@lo:101:mount.lustre.0 Request processed in 162us (1637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201420.893324:0:18186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788201420.894060:0:18158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:18158:1875064458276608:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201420.894080:0:18158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e04c0030000/0x9383f985bc4d5d1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5d21 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.894091:0:18158:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e04c0030000/0x9383f985bc4d5d1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d5d21 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201420.894111:0:18158:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788201420.894123:0:18158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04c0030000/0x9383f985bc4d5d1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5d21 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.894130:0:18158:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e04c0030000/0x9383f985bc4d5d1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5d21 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201420.894137:0:18158:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788201420.894156:0:18158:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788201420.894162:0:18158:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e03c5130000 10000000:01000000:2.0:1788201420.894165:0:18158:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788201420.894169:0:18158:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788201420.894171:0:18158:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788201420.894197:0:18158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97600/0x9383f985bc4d5d28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.894205:0:18158:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97600/0x9383f985bc4d5d28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.894213:0:18158:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97600/0x9383f985bc4d5d28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201420.894230:0:18158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1ba0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:18158:1875064458276736:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201420.894270:0:18158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201420.895089:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c296e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+6:3313:x1875064458276096:12345-0@lo:253:kworker.0 Request processed in 365646us (366398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201420.895100:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000020:01000004:2.0:1788201420.895377:0:3313:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788201420.895380:0:3313:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788201420.895382:0:3313:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201420.895383:0:3313:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201420.895384:0:3313:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201420.895386:0:3313:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201420.895387:0:3313:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201420.895389:0:3313:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201420.895390:0:3313:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788201420.895394:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458276096:0@lo:253:kworker.0 00000100:00100000:2.0:1788201420.895432:0:18158:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7ca9600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201420.895481:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458276736 00000100:00100000:0.0:1788201420.895489:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458276736 00000100:00100000:0.0:1788201420.895528:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788201420.895536:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c296d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+6:18158:x1875064458276736:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201420.895550:0:18161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201420.895566:0:18161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c2cc6a00/0x9383f985bc4d5d2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d5d28 expref: -99 pid: 18161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.895590:0:18161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c2cc6a00/0x9383f985bc4d5d2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d5d28 expref: 7 pid: 18161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.895600:0:18161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c2cc6a00/0x9383f985bc4d5d2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d5d28 expref: 7 pid: 18161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201420.895614:0:18161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc6a00, rc 0) 00000100:00100000:0.0:1788201420.895660:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c296d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+7:18158:x1875064458276736:12345-0@lo:101:mount.lustre.0 Request processed in 125us (1389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201420.895667:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788201420.895754:0:18158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1ba0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:18158:1875064458276736:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201420.895790:0:18158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97600/0x9383f985bc4d5d28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5d2f expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201420.895807:0:18158:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97600/0x9383f985bc4d5d28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d5d2f expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201420.895867:0:18158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1ba0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:18158:1875064458276864:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201420.895895:0:18158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201420.896162:0:18158:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7ca9600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201420.896405:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458276864 00000100:00100000:1.0:1788201420.896410:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458276864 00000100:00100000:0.0:1788201420.896471:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788201420.896481:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c296e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+7:18158:x1875064458276864:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201420.896906:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c296e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+8:18158:x1875064458276864:12345-0@lo:501:mount.lustre.0 Request processed in 426us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201420.896914:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788201420.897057:0:18158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1ba0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:18158:1875064458276864:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201420.897095:0:18158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1ba0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:18158:1875064458276992:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201420.897142:0:18158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201420.897170:0:18158:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7ca9600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201420.897980:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458276992 00000100:00100000:0.0:1788201420.897987:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458276992 00000100:00100000:0.0:1788201420.898019:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788201420.898027:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c296d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+8:18158:x1875064458276992:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201420.906449:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c296d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+8:18158:x1875064458276992:12345-0@lo:503:mount.lustre.0 Request processed in 8415us (9300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201420.906464:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788201420.906547:0:18158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1ba0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:18158:1875064458276992:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201420.911452:0:18193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:18193:1875064458277120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201420.911550:0:18193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201420.911644:0:18193:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c543a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201420.911693:0:18186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458277120 00000100:00100000:1.0:1788201420.911701:0:18186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458277120 00000100:00100000:1.0:1788201420.911989:0:18186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788201420.911999:0:18186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c296c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+8:18193:x1875064458277120:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201420.915431:0:18186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c296c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+8:18193:x1875064458277120:12345-0@lo:502:llog_process_th.0 Request processed in 3426us (3873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201420.915447:0:18186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788201420.915752:0:18193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:18193:1875064458277120:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788201420.915955:0:18193:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201420.915967:0:18193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201420.915969:0:18193:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788201420.915974:0:18193:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788201420.915976:0:18193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201420.915991:0:18193:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9e04d1c30000) 00000020:00000080:2.0:1788201420.916015:0:18193:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788201420.916019:0:18193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788201420.916099:0:18193:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788201420.916105:0:18193:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d5d3d 00000020:00000080:2.0:1788201420.916470:0:18193:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788201420.916477:0:18193:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201420.916480:0:18193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201420.916482:0:18193:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788201420.916484:0:18193:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201420.916488:0:18193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201420.916489:0:18193:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788201420.916492:0:18193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201420.916500:0:18193:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9e04d1c34d40) 00000020:00000080:2.0:1788201420.916511:0:18193:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788201420.916515:0:18193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788201420.916517:0:18193:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788201420.916519:0:18193:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788201420.916525:0:18193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788201420.916571:0:18193:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e03c5130000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788201420.916584:0:18193:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9e04d1c33380) 00000020:00000080:2.0:1788201420.916593:0:18193:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788201420.916645:0:18193:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788201420.916651:0:18193:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9383f985bc4d5d52 00000020:00000080:2.0:1788201420.916754:0:18193:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788201420.917108:0:18193:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788201420.917116:0:18193:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9383f985bc4d5d59 00080000:01000000:2.0:1788201420.917122:0:18193:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788201420.917127:0:18193:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d5d60 00010000:00010000:2.0:1788201420.999578:0:18193:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-3 is initialized 00000001:00080000:2.0:1788201421.000860:0:18193:0:(tgt_lastrcvd.c:1749:tgt_clients_data_init()) RCVRNG CLIENT uuid: 35604eb4-baf9-45be-a20a-4883a2cd8cf9 idx: 0 lr: 12884901940 srv lr: 17179869184 lx: 0 gen 2 00000001:00000004:2.0:1788201421.000909:0:18193:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 5, last_transno is 17179869184 00000001:00080000:2.0:1788201421.001762:0:18193:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1788201421.001910:0:18193:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04d0405780: xid 1875064442752640, transno 17179869289, client gen 2, slot idx 0 00000001:00080000:2.0:1788201421.001933:0:18193:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04d0405180: xid 1875064442752256, transno 17179869288, client gen 2, slot idx 1 00000001:00080000:2.0:1788201421.001943:0:18193:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04d0405cc0: xid 1875064442704256, transno 12884901935, client gen 2, slot idx 2 00000001:00080000:2.0:1788201421.001954:0:18193:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04d0405000: xid 1875064442705152, transno 12884901936, client gen 2, slot idx 3 00000001:00080000:2.0:1788201421.001963:0:18193:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04d0405240: xid 1875064442705536, transno 12884901937, client gen 2, slot idx 4 00000001:00080000:2.0:1788201421.001975:0:18193:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04c640d0c0: xid 1875064442705920, transno 12884901938, client gen 2, slot idx 5 00000001:00080000:2.0:1788201421.001986:0:18193:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04d1c0b3c0: xid 1875064442706176, transno 12884901939, client gen 2, slot idx 6 00000001:00080000:2.0:1788201421.001997:0:18193:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04d1c0bc00: xid 1875064442706432, transno 12884901940, client gen 2, slot idx 7 00000020:00000080:2.0:1788201421.002585:0:18193:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9e03c2640000) 00000020:00000080:2.0:1788201421.002608:0:18193:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788201421.002683:0:18193:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788201421.002689:0:18193:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d5d75 00000020:00000080:2.0:1788201421.003243:0:18193:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788201421.019673:0:18193:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9383f985bc4d5d7c 00000020:00000080:2.0:1788201421.020449:0:18193:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788201421.020461:0:18193:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201421.020467:0:18193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201421.020469:0:18193:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788201421.020473:0:18193:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201421.020479:0:18193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201421.020480:0:18193:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788201421.020484:0:18193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788201421.020521:0:18193:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788201421.020538:0:18193:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201421.020541:0:18193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201421.020543:0:18193:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788201421.020545:0:18193:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788201421.020548:0:18193:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #10 00000020:01000000:2.0:1788201421.020550:0:18193:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201421.020551:0:18193:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201421.020553:0:18193:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788201421.020555:0:18193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201421.020556:0:18193:0:(obd_config.c:1561:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788201421.020559:0:18193:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788201421.020562:0:18193:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788201421.020565:0:18193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201421.020566:0:18193:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788201421.020569:0:18193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788201421.020574:0:18193:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.130@tcp to nid 0x20000c0a8c982 (192.168.201.130@tcp) 00000020:01000000:2.0:1788201421.020601:0:18193:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788201421.020604:0:18193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201421.020619:0:18193:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9e03c2644d40) 00000020:00000080:2.0:1788201421.020637:0:18193:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788201421.020641:0:18193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788201421.020696:0:18193:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788201421.020702:0:18193:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788201421.020708:0:18193:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d5d8a 00010000:00080000:2.0:1788201421.020752:0:18193:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e04f976e000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.130@tcp at head 00010000:00010000:2.0:1788201421.021109:0:18193:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788201421.022969:0:18193:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788201421.023023:0:18193:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788201421.038919:0:18193:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 3, last_idx 4 00000040:00080000:1.0:1788201421.040095:0:18193:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201421.041165:0:18193:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].5, 64 off8512 00000040:00080000:1.0:1788201421.041567:0:18193:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 64 off8256 00000040:00080000:3.0:1788201421.042559:0:18198:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 5 synced_idx: 0 lgh_last_idx: 5 00000040:00080000:3.0:1788201421.042565:0:18198:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 4 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788201421.057584:0:18193:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788201421.057676:0:18193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788201421.057725:0:18193:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788201421.057748:0:18193:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9383f985bc4d5d91 00000100:00080000:0.0:1788201421.057761:0:18193:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788201421.057767:0:18193:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e04f976e000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1788201421.057821:0:18193:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e03c2190a80 x1875064458277248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201421.057915:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458277248:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788201421.057990:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788201421.058082:0:18193:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788201421.058153:0:18193:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201421.058157:0:18193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201421.058160:0:18193:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788201421.058163:0:18193:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788201421.058166:0:18193:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1788201421.058167:0:18193:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201421.058169:0:18193:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201421.058171:0:18193:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788201421.058173:0:18193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201421.058175:0:18193:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788201421.058177:0:18193:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788201421.058192:0:18193:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788201421.058196:0:18193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201421.058198:0:18193:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788201421.058202:0:18193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788201421.058206:0:18193:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.130@tcp to nid 0x20000c0a8c982 (192.168.201.130@tcp) 00000020:01000000:1.0:1788201421.058231:0:18193:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788201421.058234:0:18193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201421.058246:0:18193:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9e04f9650000) 00000020:00000080:1.0:1788201421.058264:0:18193:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1788201421.058270:0:18193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788201421.058402:0:18193:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788201421.058409:0:18193:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788201421.058417:0:18193:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d5d9f 00010000:00080000:1.0:1788201421.058452:0:18193:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e03c55b1800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.130@tcp at head 00000100:00100000:0.0:1788201421.058513:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458277248 00000100:00100000:0.0:1788201421.058522:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458277248 00000100:00100000:0.0:1788201421.058553:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4346 00000100:00100000:0.0:1788201421.058559:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3309:x1875064458277248:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1788201421.058583:0:13444:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 696 last 0 00000020:00000080:0.0:1788201421.058609:0:13444:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9383f985bc4d5da6 00002000:00100000:0.0:1788201421.058622:0:13444:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9e04fae40800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788201421.058626:0:13444:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788201421.058629:0:13444:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00010000:1.0:1788201421.058651:0:18193:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-4 is initialized 00000040:01000000:1.0:1788201421.058798:0:18193:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788201421.058821:0:18193:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00002000:00080000:0.0:1788201421.058866:0:13444:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788201421.058891:0:13444:0:(import.c:65:import_set_state_nolock()) ffff9e04fae45800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201421.058954:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3309:x1875064458277248:12345-0@lo:8:llog_process_th.0 Request processed in 393us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201421.058961:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4346 00000100:00100000:3.0:1788201421.059280:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201421.059289:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788201421.059342:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788201421.059349:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788201421.059351:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04f976e000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788201421.059360:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788201421.059366:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458277248:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788201421.060562:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458277376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201421.060651:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201421.060690:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2190380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458277888:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201421.060715:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201421.060780:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2191500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458277632:0@lo:6:osp-syn-0-0.0 00000100:00080000:2.0:1788201421.060874:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201421.060880:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201421.060882:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201421.060886:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788201421.060917:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2192300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458277760:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201421.064066:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201421.068870:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458278144:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201421.068946:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201421.069008:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458277888 00000100:00100000:0.0:1788201421.069018:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458277888 00000100:00100000:2.0:1788201421.069041:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458277632 00000100:00100000:2.0:1788201421.069045:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458277632 00000100:00100000:0.0:1788201421.069081:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4347 00000100:00100000:0.0:1788201421.069090:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3313:x1875064458277632:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201421.069122:0:10484:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1092 count 1 00000100:00100000:3.0:1788201421.069462:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788201421.069471:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458277504:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201421.069500:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201421.069524:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458278016:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201421.069540:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3313:x1875064458277632:12345-0@lo:6:osp-syn-0-0.0 Request processed in 450us (5482us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201421.069543:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788201421.069643:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c2191500, transno 0 00000004:00080000:3.0:1788201421.069650:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c2191500/1, rc -2, transno 0 00000100:00100000:3.0:1788201421.069663:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2191500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458277632:0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1788201421.069774:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201421.069791:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458278144 00000100:00100000:3.0:1788201421.069796:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458278144 00000100:00100000:2.0:1788201421.071999:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4348 00000100:00100000:2.0:1788201421.072028:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3311:x1875064458277888:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201421.072065:0:12363:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1127 count 1 00000100:00100000:1.0:1788201421.074426:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458278400:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201421.074497:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201421.074723:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458277376 00000100:00100000:1.0:1788201421.074732:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458277376 00000100:00100000:1.0:1788201421.074776:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788201421.074785:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3311:x1875064458277376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201421.074823:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524746752 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1788201421.074872:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3311:x1875064458277376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (14220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201421.074880:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788201421.074885:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4347 00000100:00100000:0.0:1788201421.074906:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458277504 00000100:00100000:0.0:1788201421.074910:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458277504 00000100:00100000:0.0:1788201421.074933:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458278016 00000100:00100000:0.0:1788201421.074936:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458278016 00000100:00100000:0.0:1788201421.074951:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458278400 00000100:00100000:0.0:1788201421.074953:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458278400 00000100:00100000:0.0:1788201421.074980:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4349 00000100:00100000:1.0:1788201421.074986:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4350 00000100:00100000:0.0:1788201421.074987:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3313:x1875064458277504:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201421.074993:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+10:3313:x1875064458278016:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201421.075005:0:10484:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1090 count 1 00002000:00080000:1.0:1788201421.075005:0:13450:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1128 count 1 00000100:00100000:3.0:1788201421.075104:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4351 00000100:00100000:3.0:1788201421.075114:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+10:3311:x1875064458278400:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201421.075126:0:13445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1131 count 1 00000100:00100000:0.0:1788201421.075349:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3313:x1875064458277504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 362us (5847us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201421.075359:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4349 00000100:00100000:0.0:1788201421.075374:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4352 00000100:00100000:0.0:1788201421.075382:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3313:x1875064458278144:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201421.075394:0:10484:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1129 count 1 00000100:00100000:2.0:1788201421.075916:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3311:x1875064458277888:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3170us (14466us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201421.075928:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4348 00000100:00100000:2.0:1788201421.075972:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201421.076005:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2193800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458278272:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201421.076037:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201421.076073:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458277760 00000100:00100000:2.0:1788201421.076079:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458277760 00000100:00100000:2.0:1788201421.076103:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458278272 00000100:00100000:2.0:1788201421.076107:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458278272 00000100:00100000:2.0:1788201421.076128:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4353 00000100:00100000:2.0:1788201421.076135:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:3310:x1875064458277760:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201421.076149:0:13443:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1122 count 1 00000100:00100000:3.0:1788201421.079933:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+10:3311:x1875064458278400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4809us (5423us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201421.079950:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4351 00000100:00100000:3.0:1788201421.079991:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4354 00000100:00100000:3.0:1788201421.080004:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+9:3310:x1875064458278272:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201421.080033:0:13445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1130 count 1 00000100:00100000:1.0:1788201421.080577:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+9:3313:x1875064458278016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5581us (11029us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201421.080586:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4350 00000004:00080000:1.0:1788201421.080647:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c2190380, transno 0 00000004:00080000:1.0:1788201421.080655:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c2190380/1, rc -2, transno 0 00000100:00100000:1.0:1788201421.080662:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2190380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458277888:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788201421.080672:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c2192a00, transno 0 00000004:00080000:1.0:1788201421.080675:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c2192a00/1, rc -2, transno 0 00000100:00100000:1.0:1788201421.080679:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458278400:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201421.080701:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458277376:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788201421.081347:0:18193:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 3, last_idx 4 00000040:00080000:1.0:1788201421.081603:0:18193:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788201421.081999:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+8:3310:x1875064458278272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1996us (5957us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201421.082008:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4354 00000004:00080000:3.0:1788201421.082057:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c2190000, transno 0 00000004:00080000:3.0:1788201421.082062:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c2190000/1, rc -2, transno 0 00000100:00100000:3.0:1788201421.082067:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458277504:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788201421.082075:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c2190a80, transno 0 00000004:00080000:3.0:1788201421.082077:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c2190a80/1, rc -2, transno 0 00000100:00100000:3.0:1788201421.082080:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458278016:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201421.084318:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3313:x1875064458278144:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8907us (15341us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201421.084331:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4352 00000004:00080000:1.0:1788201421.085680:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c2193800, transno 0 00000004:00080000:1.0:1788201421.085691:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c2193800/1, rc -2, transno 0 00000100:00100000:1.0:1788201421.085699:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2193800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458278272:0@lo:6:osp-syn-0-0.0 00000040:00080000:1.0:1788201421.085764:0:18193:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].5, 64 off8512 00000040:00080000:1.0:1788201421.085897:0:18193:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x16:0x0].1, 64 off8256 00000004:00080000:3.0:1788201421.086120:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c2191180, transno 0 00000004:00080000:3.0:1788201421.086124:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c2191180/1, rc -2, transno 0 00000100:00100000:3.0:1788201421.086129:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458278144:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788201421.087459:0:18198:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 3 in progress, 1 in flight, 5 done 00000100:00100000:3.0:1788201421.087698:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201421.087720:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458278528:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201421.087793:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201421.087843:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458278528 00000100:00100000:3.0:1788201421.087850:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458278528 00000100:00100000:3.0:1788201421.087896:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4355 00000100:00100000:3.0:1788201421.087905:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3313:x1875064458278528:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201421.087934:0:13438:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1123 count 1 00000100:00100000:2.0:1788201421.088611:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:3310:x1875064458277760:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12474us (12636us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201421.088621:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4353 00000004:00080000:1.0:1788201421.088714:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c2192300, transno 0 00000004:00080000:1.0:1788201421.088720:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c2192300/1, rc -2, transno 0 00000100:00100000:1.0:1788201421.088726:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2192300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458277760:0@lo:6:osp-syn-0-0.0 00000040:00080000:0.0:1788201421.088895:0:18200:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 5 synced_idx: 0 lgh_last_idx: 5 00000040:00080000:0.0:1788201421.088900:0:18200:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 4 of catalog [0x1:0x5:0x0] 00000100:00100000:3.0:1788201421.090471:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3313:x1875064458278528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2561us (2673us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201421.090483:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4355 00000100:00100000:3.0:1788201421.090673:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458278784:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201421.090706:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201421.090749:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458278784 00000100:00100000:3.0:1788201421.090755:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458278784 00000020:00000080:1.0:1788201421.091689:0:18193:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201421.091701:0:18193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788201421.091735:0:18193:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788201421.091754:0:18193:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9383f985bc4d5dad 00000100:00080000:1.0:1788201421.091763:0:18193:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788201421.091768:0:18193:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e03c55b1800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:1.0:1788201421.091794:0:18193:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e03c12d3b80 x1875064458278912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201421.091815:0:18193:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788201421.091854:0:18193:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201421.091859:0:18193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201421.091861:0:18193:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788201421.091863:0:18193:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201421.091867:0:18193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201421.091869:0:18193:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788201421.091872:0:18193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788201421.091874:0:18193:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788201421.091876:0:18193:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201421.091878:0:18193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201421.091880:0:18193:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788201421.091882:0:18193:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201421.091884:0:18193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201421.091885:0:18193:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788201421.091889:0:18193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788201421.091914:0:18193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:18193:1875064458279040:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201421.091965:0:18193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201421.091988:0:18193:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8073540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201421.092069:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201421.092079:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458278656:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201421.092111:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201421.093686:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458279040 00000100:00100000:2.0:1788201421.093696:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458279040 00000100:00100000:2.0:1788201421.093752:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788201421.093762:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c296dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+8:18193:x1875064458279040:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201421.093950:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458278656 00000100:00100000:3.0:1788201421.093955:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458278656 00000100:00100000:3.0:1788201421.093975:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4356 00000100:00100000:3.0:1788201421.093981:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+7:3310:x1875064458278784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201421.094002:0:13449:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1133 count 1 00000100:00100000:2.0:1788201421.094054:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c296dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+8:18193:x1875064458279040:12345-0@lo:502:llog_process_th.0 Request processed in 293us (2087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201421.094065:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788201421.094108:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4357 00000100:00100000:2.0:1788201421.094116:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3312:x1875064458278656:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201421.094128:0:13440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1132 count 1 00000100:00100000:2.0:1788201421.094371:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3312:x1875064458278656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 255us (2258us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201421.094371:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+7:3310:x1875064458278784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 389us (3664us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201421.094378:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4356 00000100:00100000:3.0:1788201421.094529:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458278912:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788201421.094565:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788201421.094617:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04c12a8a80, transno 0 00000004:00080000:3.0:1788201421.094624:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04c12a8a80/1, rc -2, transno 0 00000100:00100000:3.0:1788201421.094629:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458278784:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201421.094798:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201421.094807:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458279168:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201421.094833:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201421.094861:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458278912 00000100:00100000:3.0:1788201421.094865:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458278912 00000100:00100000:1.0:1788201421.094968:0:18193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:18193:1875064458279040:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201421.094998:0:18193:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201421.095005:0:18193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201421.095008:0:18193:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788201421.095014:0:18193:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000100:00100000:1.0:1788201421.096373:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458279168 00000100:00100000:1.0:1788201421.096384:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458279168 00000100:00100000:2.0:1788201421.096981:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4357 00000004:00080000:2.0:1788201421.097046:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04c12ab480, transno 0 00000004:00080000:2.0:1788201421.097053:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04c12ab480/1, rc -2, transno 0 00000100:00100000:2.0:1788201421.097059:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458278656:0@lo:6:osp-syn-0-0.0 00000020:01000000:0.0:1788201421.097352:0:18158:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1788201421.097379:0:18158:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788201421.097393:0:18158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97600/0x9383f985bc4d5d28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5d2f expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201421.097404:0:18158:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97600/0x9383f985bc4d5d28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5d2f expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201421.097414:0:18158:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e03c5130000 from 1 10000000:01000000:0.0:1788201421.097416:0:18158:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788201421.097454:0:18158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6000/0x9383f985bc4d5db4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201421.097463:0:18158:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6000/0x9383f985bc4d5db4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201421.097479:0:18158:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6000/0x9383f985bc4d5db4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201421.097501:0:18158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2193b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:18158:1875064458279296:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788201421.097562:0:18158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201421.097599:0:18158:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f577d480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201421.097970:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458279296 00000100:00100000:2.0:1788201421.097977:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458279296 00000100:00100000:2.0:1788201421.098027:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788201421.098037:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c8ed7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+8:18158:x1875064458279296:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201421.098052:0:18161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201421.098066:0:18161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c1b96600/0x9383f985bc4d5dbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d5db4 expref: -99 pid: 18161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.098088:0:18161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c1b96600/0x9383f985bc4d5dbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d5db4 expref: 9 pid: 18161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.098098:0:18161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c1b96600/0x9383f985bc4d5dbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d5db4 expref: 9 pid: 18161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.098107:0:18161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c1b96600, rc 0) 00000100:00100000:2.0:1788201421.098145:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c8ed7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+9:18158:x1875064458279296:12345-0@lo:101:mount.lustre.0 Request processed in 109us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201421.098155:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788201421.099275:0:18158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2193b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:18158:1875064458279296:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201421.099336:0:18158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6000/0x9383f985bc4d5db4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5dbb expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201421.099348:0:18158:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6000/0x9383f985bc4d5db4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d5dbb expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201421.099860:0:18158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2193b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:18158:1875064458279424:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788201421.099910:0:18158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201421.099937:0:18158:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f577d480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201421.100512:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4358 00000100:00100000:3.0:1788201421.100521:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:3309:x1875064458278912:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1788201421.100551:0:13450:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 696 last 0 00000020:00000080:3.0:1788201421.100582:0:13450:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9383f985bc4d5dc2 00002000:00100000:3.0:1788201421.100597:0:13450:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9e04f5757000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788201421.100601:0:13450:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788201421.100604:0:13450:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788201421.100824:0:13450:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788201421.100848:0:13450:0:(import.c:65:import_set_state_nolock()) ffff9e04f5755000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201421.100904:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3309:x1875064458278912:12345-0@lo:8:llog_process_th.0 Request processed in 382us (6336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201421.100911:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4358 00000100:00100000:3.0:1788201421.100950:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201421.100957:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788201421.100964:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788201421.100968:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788201421.100971:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e03c55b1800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788201421.100984:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788201421.100989:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458278912:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788201421.101082:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458279808:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201421.101107:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201421.101124:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458280320:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201421.101142:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201421.101158:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788201421.101162:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458279936:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201421.101177:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201421.101328:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458280448:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788201421.101347:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201421.101435:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458279424 00000100:00100000:2.0:1788201421.101442:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458279424 00000100:00100000:2.0:1788201421.101480:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788201421.101487:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c8ed5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+9:18158:x1875064458279424:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788201421.101504:0:18163:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788201421.101527:0:18163:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788201421.101531:0:18163:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788201421.101534:0:18163:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 16 00000100:00100000:2.0:1788201421.101621:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c8ed5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+9:18158:x1875064458279424:12345-0@lo:256:mount.lustre.0 Request processed in 134us (1710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201421.101629:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788201421.101665:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458279552:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201421.105728:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458279808 00000100:00100000:0.0:1788201421.105743:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458279808 00000100:00100000:0.0:1788201421.105809:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458280320 00000100:00100000:0.0:1788201421.105813:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458280320 00000100:00100000:0.0:1788201421.105831:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458279936 00000100:00100000:0.0:1788201421.105834:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458279936 00000100:00100000:0.0:1788201421.105847:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458280448 00000100:00100000:0.0:1788201421.105850:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458280448 00000100:00100000:0.0:1788201421.105874:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4359 00000100:00100000:0.0:1788201421.105885:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875064458279168:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201421.105919:0:6703:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1134 count 1 00010000:00010000:0.0:1788201421.105947:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f0ecd86/0x9383f985bc4d5dc9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x46e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201421.105973:0:6703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001687b5b9/0x9383f985bc4d58d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x46e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5548 expref: 510 pid: 13440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201421.105983:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46e:0x0].0x0 since=32s v=(0 0) 00010000:00010000:0.0:1788201421.105989:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201421.105994:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f0ecd86/0x9383f985bc4d5dc9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x46e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201421.106029:0:6703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001687b5b9/0x9383f985bc4d58d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x46e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5548 expref: 510 pid: 13440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201421.106045:0:6703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001687b5b9/0x9383f985bc4d58d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x46e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5548 expref: 510 pid: 13440 timeout: 796 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201421.106061:0:6703:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2193100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6703:1875064458280576:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201421.106143:0:6703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f577d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201421.106275:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4360 00000100:00100000:3.0:1788201421.106285:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+9:3310:x1875064458279808:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788201421.106330:0:13448:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1128 count 1 00000100:00100000:3.0:1788201421.106764:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+9:3310:x1875064458279808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 479us (5652us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201421.106772:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4360 00000100:00100000:3.0:1788201421.106793:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4361 00000100:00100000:3.0:1788201421.106801:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+8:3310:x1875064458280320:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788201421.106816:0:13448:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1132 count 1 00000100:00100000:3.0:1788201421.107020:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+8:3310:x1875064458280320:12345-0@lo:6:osp-syn-1-0.0 Request processed in 219us (5875us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201421.107026:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4361 00000100:00100000:3.0:1788201421.107040:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4362 00000100:00100000:3.0:1788201421.107046:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+7:3310:x1875064458279936:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788201421.107057:0:13448:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1129 count 1 00000100:00100000:2.0:1788201421.107168:0:13451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4363 00000100:00100000:2.0:1788201421.107177:0:13451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+7:3310:x1875064458280448:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201421.107191:0:13451:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1133 count 1 00000100:00100000:0.0:1788201421.107289:0:18158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2193b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:18158:1875064458279424:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788201421.107510:0:13451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+7:3310:x1875064458280448:12345-0@lo:6:osp-syn-1-0.0 Request processed in 334us (6160us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201421.107516:0:13451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4363 00000100:00100000:2.0:1788201421.107539:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201421.107569:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458280064:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201421.107593:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201421.107611:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788201421.107616:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458279680:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201421.107631:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201421.107645:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458280192:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201421.107659:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201421.107681:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458279552 00000100:00100000:2.0:1788201421.107686:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458279552 00000100:00100000:2.0:1788201421.107708:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458280064 00000100:00100000:2.0:1788201421.107710:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458280064 00000100:00100000:2.0:1788201421.107723:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458279680 00000100:00100000:2.0:1788201421.107725:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458279680 00000100:00100000:2.0:1788201421.107736:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458280192 00000100:00100000:2.0:1788201421.107739:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458280192 00000100:00100000:2.0:1788201421.107752:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4364 00000100:00100000:2.0:1788201421.107757:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:3312:x1875064458279552:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201421.107769:0:13444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1122 count 1 10000000:01000000:0.0:1788201421.108012:0:18158:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788201421.108029:0:18158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6000/0x9383f985bc4d5db4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5dbb expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201421.108039:0:18158:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6000/0x9383f985bc4d5db4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5dbb expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201421.108053:0:18158:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e03c5130000 from 1 10000000:01000000:0.0:1788201421.108056:0:18158:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201421.108088:0:18158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d5dd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201421.108096:0:18158:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d5dd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201421.108105:0:18158:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d5dd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201421.108121:0:18158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2193b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:18158:1875064458280704:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788201421.108153:0:18158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201421.108178:0:18158:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f577d480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201421.108492:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:3312:x1875064458279552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 734us (951us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201421.108499:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4364 00000100:00100000:2.0:1788201421.108516:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4365 00000100:00100000:2.0:1788201421.108524:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3312:x1875064458280064:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201421.108537:0:13444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1130 count 1 00000100:00100000:2.0:1788201421.108738:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3312:x1875064458280064:12345-0@lo:6:osp-syn-1-0.0 Request processed in 216us (1143us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201421.108744:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4365 00000100:00100000:2.0:1788201421.108757:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4366 00000100:00100000:2.0:1788201421.108763:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3312:x1875064458279680:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201421.108773:0:13444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1127 count 1 00000100:00100000:2.0:1788201421.109103:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3312:x1875064458279680:12345-0@lo:6:osp-syn-1-0.0 Request processed in 339us (1468us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201421.109109:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4366 00000100:00100000:2.0:1788201421.109123:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4367 00000100:00100000:2.0:1788201421.109130:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:3312:x1875064458280192:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201421.109141:0:13444:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1131 count 1 00000100:00100000:2.0:1788201421.109389:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:3312:x1875064458280192:12345-0@lo:6:osp-syn-1-0.0 Request processed in 259us (1727us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201421.109396:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4367 00000100:00100000:2.0:1788201421.109452:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458280704 00000100:00100000:2.0:1788201421.109459:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458280704 00000100:00100000:2.0:1788201421.109490:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788201421.109497:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c8ed4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+9:18158:x1875064458280704:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201421.109506:0:18161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201421.109522:0:18161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c1b97200/0x9383f985bc4d5dd7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d5dd0 expref: -99 pid: 18161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.109544:0:18161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c1b97200/0x9383f985bc4d5dd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d5dd0 expref: 10 pid: 18161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.109555:0:18161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c1b97200/0x9383f985bc4d5dd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d5dd0 expref: 10 pid: 18161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.109565:0:18161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c1b97200, rc 0) 00000100:00100000:2.0:1788201421.109591:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c8ed4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+10:18158:x1875064458280704:12345-0@lo:101:mount.lustre.0 Request processed in 95us (1438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201421.109597:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000004:00080000:2.0:1788201421.110201:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04c12aad80, transno 0 00000004:00080000:2.0:1788201421.110208:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04c12aad80/1, rc -2, transno 0 00000100:00100000:2.0:1788201421.110224:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458279680:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788201421.110234:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00dea00, transno 0 00000004:00080000:2.0:1788201421.110238:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00dea00/1, rc -2, transno 0 00000100:00100000:2.0:1788201421.110241:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458280192:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788201421.110249:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04c12a8e00, transno 0 00000004:00080000:2.0:1788201421.110252:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04c12a8e00/1, rc -2, transno 0 00000100:00100000:2.0:1788201421.110256:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458279552:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788201421.110263:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00dc380, transno 0 00000004:00080000:2.0:1788201421.110265:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00dc380/1, rc -2, transno 0 00000100:00100000:2.0:1788201421.110268:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458280064:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788201421.110602:0:18200:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 4 in progress, 4 in flight, 4 done 00000100:00100000:2.0:1788201421.110679:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1ba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458280832:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201421.110717:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201421.110745:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201421.110751:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1ba3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458280960:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201421.110771:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201421.110991:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458280832 00000100:00100000:2.0:1788201421.110997:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458280832 00000100:00100000:2.0:1788201421.111029:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458280960 00000100:00100000:2.0:1788201421.111032:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458280960 00000100:00100000:2.0:1788201421.111052:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4368 00000100:00100000:2.0:1788201421.111059:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3312:x1875064458280832:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201421.111078:0:13438:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1134 count 1 00000100:00100000:2.0:1788201421.111373:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3312:x1875064458280832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 313us (655us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201421.111380:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4368 00000100:00100000:3.0:1788201421.111420:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+8:3310:x1875064458279936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4373us (10240us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201421.111428:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4362 00000100:00100000:3.0:1788201421.111446:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4369 00000100:00100000:3.0:1788201421.111454:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+7:3312:x1875064458280960:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788201421.111467:0:13448:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1135 count 1 00000100:00100000:3.0:1788201421.111678:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+7:3312:x1875064458280960:12345-0@lo:6:osp-syn-1-0.0 Request processed in 224us (905us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201421.111685:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4369 00000004:00080000:2.0:1788201421.111787:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c1ba3800, transno 0 00000004:00080000:2.0:1788201421.111792:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c1ba3800/1, rc -2, transno 0 00000100:00100000:2.0:1788201421.111853:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1ba3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458280960:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788201421.111864:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c1ba2a00, transno 0 00000004:00080000:2.0:1788201421.111867:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c1ba2a00/1, rc -2, transno 0 00000100:00100000:2.0:1788201421.111871:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1ba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458280832:0@lo:6:osp-syn-1-0.0 00000100:00080000:1.0:1788201421.111967:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201421.111973:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201421.111976:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201421.111980:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000004:00080000:1.0:1788201421.112008:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04c12a9f80, transno 0 00000004:00080000:1.0:1788201421.112012:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04c12a9f80/1, rc -2, transno 0 00000100:00100000:1.0:1788201421.112017:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458278528:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201421.112022:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201421.112032:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1ba3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458281344:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201421.112037:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201421.112044:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1ba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458281472:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201421.112066:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201421.112171:0:18158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2193b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:18158:1875064458280704:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201421.112268:0:18158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d5dd0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5dd7 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201421.112281:0:18158:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d5dd0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d5dd7 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201421.112362:0:18158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2193b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:18158:1875064458281600:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201421.112392:0:18158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201421.112419:0:18158:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f577d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201421.113027:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1ba3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458281216:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788201421.113061:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201421.113262:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1ba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458281088:0@lo:6:osp-syn-1-0.0 00000100:00080000:0.0:1788201421.120760:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201421.128964:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458281344 00000100:00100000:2.0:1788201421.128983:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458281344 00000100:00100000:2.0:1788201421.129020:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458281600 00000100:00100000:2.0:1788201421.129024:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458281600 00000100:00100000:2.0:1788201421.129086:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788201421.129096:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c8ed6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+10:18158:x1875064458281600:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201421.132546:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458281216 00000100:00100000:1.0:1788201421.132564:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458281216 00000100:00100000:1.0:1788201421.132649:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4370 00000100:00100000:1.0:1788201421.132661:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3311:x1875064458281216:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788201421.132697:0:12363:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1123 count 1 00000100:00100000:2.0:1788201421.133206:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c8ed6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+10:18158:x1875064458281600:12345-0@lo:501:mount.lustre.0 Request processed in 4108us (20809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201421.133217:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788201421.133228:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3311:x1875064458281216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 570us (20166us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201421.133234:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4370 00000100:00100000:2.0:1788201421.133349:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201421.133370:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788201421.133414:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c1ba3100, transno 0 00000004:00080000:2.0:1788201421.133414:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00df480, transno 0 00000004:00080000:1.0:1788201421.133421:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c1ba3100/1, rc -2, transno 0 00000004:00080000:2.0:1788201421.133421:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00df480/1, rc -2, transno 0 00000100:00100000:1.0:1788201421.133432:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1ba3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458281216:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201421.133432:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458279936:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788201421.133442:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00dd180, transno 0 00000004:00080000:2.0:1788201421.133445:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00dd180/1, rc -2, transno 0 00000100:00100000:2.0:1788201421.133448:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458280448:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201421.133452:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458281088 00000100:00100000:1.0:1788201421.133455:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458281088 00000004:00080000:2.0:1788201421.133456:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04c12a8700, transno 0 00000004:00080000:2.0:1788201421.133459:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04c12a8700/1, rc -2, transno 0 00000100:00100000:2.0:1788201421.133462:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458279808:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788201421.133469:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f00ded80, transno 0 00000004:00080000:2.0:1788201421.133472:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f00ded80/1, rc -2, transno 0 00000100:00100000:2.0:1788201421.133475:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458280320:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788201421.133479:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4371 00000100:00100000:1.0:1788201421.133485:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+7:3310:x1875064458281088:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788201421.133500:0:13448:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1136 count 1 00000100:00100000:2.0:1788201421.133510:0:13526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442761344 00000100:00100000:2.0:1788201421.133513:0:13526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442761344 00010000:00010000:2.0:1788201421.133535:0:13526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001687b5b9/0x9383f985bc4d58d6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x46e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5548 expref: 511 pid: 13440 timeout: 796 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201421.133561:0:13526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1594 00000100:00100000:2.0:1788201421.133568:0:13526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2359:x1875064442761344:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201421.133577:0:13526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201421.133582:0:13526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001687b5b9/0x9383f985bc4d58d6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x46e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5548 expref: 511 pid: 13440 timeout: 796 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.133595:0:13526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001687b5b9/0x9383f985bc4d58d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x46e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5548 expref: 511 pid: 13440 timeout: 796 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.133620:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201421.133625:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201421.133630:0:13526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009f0ecd86/0x9383f985bc4d5dc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.133641:0:13526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f0ecd86/0x9383f985bc4d5dc9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x46e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.133659:0:13526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201421.133698:0:13526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2359:x1875064442761344:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 129us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201421.133701:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+7:3310:x1875064458281088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 216us (330us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201421.133705:0:13526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1594 00000100:00100000:1.0:1788201421.133707:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4371 00000004:00080000:2.0:1788201421.133830:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c1ba3b80, transno 0 00000004:00080000:2.0:1788201421.133835:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c1ba3b80/1, rc -2, transno 0 00000100:00100000:2.0:1788201421.133839:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1ba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458281088:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788201421.133909:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001687b5b9/0x9383f985bc4d58d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x46e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5548 expref: 510 pid: 13440 timeout: 796 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201421.133923:0:6703:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2193100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6703:1875064458280576:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201421.133941:0:6703:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009f0ecd86/0x9383f985bc4d5dc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.133951:0:6703:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009f0ecd86/0x9383f985bc4d5dc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.133959:0:6703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f0ecd86/0x9383f985bc4d5dc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.133969:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f0ecd86/0x9383f985bc4d5dc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.133977:0:6703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f0ecd86/0x9383f985bc4d5dc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x46e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.134001:0:6703:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201421.134068:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201421.134075:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f0ecd86/0x9383f985bc4d5dc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x46e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.134088:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201421.134093:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f0ecd86/0x9383f985bc4d5dc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x46e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.134102:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f0ecd86/0x9383f985bc4d5dc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x46e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.134113:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f0ecd86/0x9383f985bc4d5dc9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x46e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.134122:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f0ecd86/0x9383f985bc4d5dc9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x46e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.134140:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201421.134142:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201421.134143:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201421.134488:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201421.134528:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458281472 00000100:00100000:2.0:1788201421.134534:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458281472 00000100:00100000:2.0:1788201421.134563:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4372 00000100:00100000:2.0:1788201421.134570:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+7:3312:x1875064458281472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788201421.134590:0:13445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1125 count 1 00000100:00100000:2.0:1788201421.134826:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+7:3312:x1875064458281472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 256us (338us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201421.134834:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4372 00000004:00080000:2.0:1788201421.134867:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c1ba2a00, transno 0 00000004:00080000:2.0:1788201421.134871:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c1ba2a00/1, rc -2, transno 0 00000100:00100000:2.0:1788201421.134876:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1ba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458281472:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788201421.135002:0:18200:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 1 in progress, 1 in flight, 7 done 00000040:00080000:2.0:1788201421.135068:0:18200:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 21 count 3 00000040:00080000:2.0:1788201421.135097:0:18200:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1788201421.135101:0:18200:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x16:0x0] at index 5 of catalog [0x1:0x5:0x0] 00000004:00080000:2.0:1788201421.135132:0:18200:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788201421.135182:0:18200:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 696392886893ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788201421.135209:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1ba3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458281728:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201421.135248:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201421.138684:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201421.138703:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458281984:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201421.138946:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201421.139019:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458282112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201421.139047:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201421.141043:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458281728 00000100:00100000:0.0:1788201421.141058:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458281728 00000100:00100000:0.0:1788201421.141160:0:18158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2193b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:18158:1875064458281600:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201421.141226:0:18158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2193b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:18158:1875064458282240:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201421.141323:0:18158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201421.141365:0:18158:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f577d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201421.141418:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458281984 00000100:00100000:0.0:1788201421.141423:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458281984 00000100:00100000:0.0:1788201421.141443:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4373 00000100:00100000:0.0:1788201421.141452:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f965a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3310:x1875064458281728:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788201421.141480:0:13439:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1126 count 1 00000100:00100000:3.0:1788201421.142398:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4374 00000100:00100000:3.0:1788201421.142412:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3313:x1875064458281984:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201421.142432:0:13442:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1136 count 1 00010000:00010000:3.0:1788201421.142475:0:13442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d5dde lrc: 3/0,1 mode: --/PW res: [0x240000400:0x470:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.142497:0:13442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000066520edc/0x9383f985bc4d58f9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x470:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5564 expref: 509 pid: 13440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.142506:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x470:0x0].0x0 since=32s v=(0 0) 00010000:00010000:3.0:1788201421.142510:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x470:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201421.142514:0:13442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d5dde lrc: 4/0,1 mode: --/PW res: [0x240000400:0x470:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.142545:0:13442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000066520edc/0x9383f985bc4d58f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x470:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5564 expref: 509 pid: 13440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.142558:0:13442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000066520edc/0x9383f985bc4d58f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x470:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5564 expref: 509 pid: 13440 timeout: 796 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201421.142577:0:13442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:13442:1875064458282368:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201421.142650:0:13442:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201421.143275:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f965a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3310:x1875064458281728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1822us (8025us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201421.143285:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4373 00000100:00100000:1.0:1788201421.144484:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201421.144497:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458282752:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201421.144537:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201421.144567:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458282752 00000100:00100000:1.0:1788201421.144574:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458282752 00000100:00100000:1.0:1788201421.144612:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4375 00000100:00100000:1.0:1788201421.144620:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+9:3313:x1875064458282752:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201421.144643:0:13446:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1126 count 1 00010000:00010000:1.0:1788201421.144665:0:13446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5de5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x466:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.144684:0:13446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e08abbd/0x9383f985bc4d5bc3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x466:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5897 expref: 509 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.144693:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x466:0x0].0x0 since=31s v=(0 0) 00010000:00010000:1.0:1788201421.144697:0:13446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x466:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201421.144701:0:13446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5de5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x466:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.144726:0:13446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e08abbd/0x9383f985bc4d5bc3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x466:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5897 expref: 509 pid: 12363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.144737:0:13446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e08abbd/0x9383f985bc4d5bc3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x466:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5897 expref: 509 pid: 12363 timeout: 796 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201421.144748:0:13446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0007480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:13446:1875064458282880:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201421.144924:0:13446:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8073540 going to sleep for 11 seconds 00000040:00080000:1.0:1788201421.144940:0:18198:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 20 count 7 00000040:00080000:1.0:1788201421.144984:0:18198:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1788201421.144988:0:18198:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 5 of catalog [0x1:0x2:0x0] 00000004:00080000:1.0:1788201421.145028:0:18198:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788201421.145211:0:18198:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 696402916200ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788201421.145520:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458282496:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201421.145554:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788201421.145591:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c1ba3100, transno 0 00000004:00080000:2.0:1788201421.145598:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c1ba3100/1, rc -2, transno 0 00000100:00100000:2.0:1788201421.145607:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1ba3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458281728:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788201421.145618:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788201421.145623:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458281856:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201421.145645:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201421.145661:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458282624:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201421.145679:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201421.148276:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458282112 00000100:00100000:3.0:1788201421.148288:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458282112 00000100:00100000:3.0:1788201421.148368:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788201421.148377:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875064458282112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201421.148415:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 36241408 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201421.148490:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875064458282112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (9441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201421.148497:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788201421.148622:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458282112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201421.152786:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458282496 00000100:00100000:2.0:1788201421.152852:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458282496 00000100:00100000:2.0:1788201421.152905:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458281856 00000100:00100000:2.0:1788201421.152909:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458281856 00000100:00100000:2.0:1788201421.152940:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458282624 00000100:00100000:2.0:1788201421.152944:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458282624 00000100:00100000:2.0:1788201421.152970:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4376 00000100:00100000:2.0:1788201421.152981:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3310:x1875064458282496:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201421.153049:0:10484:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1124 count 1 00010000:00010000:2.0:1788201421.153078:0:10484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d5dec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x464:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.153101:0:10484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e5cf63c8/0x9383f985bc4d5b37 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x464:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c587b expref: 509 pid: 13444 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.153110:0:10484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x464:0x0].0x0 since=32s v=(0 0) 00010000:00010000:2.0:1788201421.153115:0:10484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x464:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201421.153120:0:10484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d5dec lrc: 4/0,1 mode: --/PW res: [0x240000400:0x464:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.153156:0:10484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e5cf63c8/0x9383f985bc4d5b37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x464:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c587b expref: 509 pid: 13444 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.153170:0:10484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e5cf63c8/0x9383f985bc4d5b37 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x464:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c587b expref: 509 pid: 13444 timeout: 796 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201421.153190:0:10484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10484:1875064458283008:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201421.153277:0:10484:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c5e34180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201421.153449:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4377 00000100:00100000:0.0:1788201421.153460:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3310:x1875064458281856:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201421.153475:0:13441:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1135 count 1 00010000:00010000:0.0:1788201421.153489:0:13441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d5df3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x46f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201421.153501:0:13441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004e4d980a/0x9383f985bc4d58dd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x46f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5556 expref: 509 pid: 13440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201421.153508:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46f:0x0].0x0 since=32s v=(0 0) 00010000:00010000:0.0:1788201421.153511:0:13441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201421.153514:0:13441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d5df3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x46f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201421.153536:0:13441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004e4d980a/0x9383f985bc4d58dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x46f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5556 expref: 509 pid: 13440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201421.153545:0:13441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004e4d980a/0x9383f985bc4d58dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x46f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5556 expref: 509 pid: 13440 timeout: 796 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201421.153554:0:13441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2190e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:13441:1875064458283136:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201421.153582:0:13441:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f577d840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201421.153659:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4378 00000100:00100000:1.0:1788201421.153668:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+12:3310:x1875064458282624:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201421.153682:0:13448:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1125 count 1 00010000:00010000:1.0:1788201421.153694:0:13448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d5dfa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x465:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.153705:0:13448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c8e357f/0x9383f985bc4d5b7d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x465:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5889 expref: 509 pid: 13440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.153712:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x465:0x0].0x0 since=32s v=(0 0) 00010000:00010000:1.0:1788201421.153715:0:13448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x465:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201421.153718:0:13448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d5dfa lrc: 4/0,1 mode: --/PW res: [0x240000400:0x465:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.153737:0:13448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000c8e357f/0x9383f985bc4d5b7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x465:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5889 expref: 509 pid: 13440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.153746:0:13448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000c8e357f/0x9383f985bc4d5b7d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x465:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5889 expref: 509 pid: 13440 timeout: 796 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201421.153755:0:13448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0006a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:13448:1875064458283264:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788201421.153799:0:13448:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8073780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201421.155384:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201421.155470:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201421.155593:0:13446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0007480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:13446:1875064458282880:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788201421.155621:0:13446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5de5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x466:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201421.155704:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442761472 00000100:00100000:3.0:1788201421.155710:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442761472 00010000:00010000:3.0:1788201421.155739:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000066520edc/0x9383f985bc4d58f9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x470:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5564 expref: 510 pid: 13440 timeout: 796 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201421.155764:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442761600 00000100:00100000:3.0:1788201421.155767:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442761600 00010000:00010000:3.0:1788201421.155795:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e08abbd/0x9383f985bc4d5bc3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x466:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5897 expref: 511 pid: 12363 timeout: 796 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201421.155818:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1595 00000100:00100000:3.0:1788201421.155827:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2190700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2359:x1875064442761472:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201421.155840:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201421.155846:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000066520edc/0x9383f985bc4d58f9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x470:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5564 expref: 511 pid: 13440 timeout: 796 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.155861:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000066520edc/0x9383f985bc4d58f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x470:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5564 expref: 511 pid: 13440 timeout: 796 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.155884:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x470:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201421.155888:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x470:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201421.155893:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d5dde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x470:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.155902:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d5dde lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x470:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.155920:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201421.155964:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2190700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+511:2359:x1875064442761472:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 138us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201421.155972:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1595 00000100:00100000:3.0:1788201421.155991:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1596 00000100:00100000:3.0:1788201421.155998:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2193480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+510:2359:x1875064442761600:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201421.156006:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201421.156010:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e08abbd/0x9383f985bc4d5bc3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x466:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5897 expref: 510 pid: 12363 timeout: 796 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.156020:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e08abbd/0x9383f985bc4d5bc3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x466:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5897 expref: 510 pid: 12363 timeout: 796 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.156037:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e08abbd/0x9383f985bc4d5bc3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x466:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5897 expref: 510 pid: 12363 timeout: 796 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.156048:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x466:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201421.156052:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x466:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201421.156056:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5de5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x466:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.156064:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5de5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x466:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.156078:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201421.156096:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2193480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2359:x1875064442761600:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 98us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201421.156102:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1596 00000100:00100000:3.0:1788201421.156136:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458282240 00000100:00100000:3.0:1788201421.156140:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458282240 00000100:00100000:3.0:1788201421.156163:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788201421.156169:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c8ed6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+10:18158:x1875064458282240:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201421.156407:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c8ed6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+10:18158:x1875064458282240:12345-0@lo:503:mount.lustre.0 Request processed in 237us (15083us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201421.156414:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1788201421.156493:0:13442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066520edc/0x9383f985bc4d58f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x470:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5564 expref: 508 pid: 13440 timeout: 796 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201421.156509:0:13442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:13442:1875064458282368:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201421.156523:0:13442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d5dde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x470:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.156531:0:13442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d5dde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x470:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.156538:0:13442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d5dde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x470:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.156547:0:13442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d5dde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x470:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.156554:0:13442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d5dde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x470:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.156570:0:13442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201421.157149:0:13446:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5de5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x466:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.157159:0:13446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5de5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x466:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.157168:0:13446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5de5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x466:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.157175:0:13446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5de5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x466:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.157190:0:13446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788201421.157578:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201421.157585:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d5dde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x470:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.157593:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201421.157597:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d5dde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x470:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.157605:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d5dde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x470:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.157624:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d5dde lrc: 1/0,0 mode: --/PW res: [0x240000400:0x470:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.157631:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d5dde lrc: 0/0,0 mode: --/PW res: [0x240000400:0x470:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.157648:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201421.157650:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5de5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x466:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.157655:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201421.157658:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5de5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x466:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.157664:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5de5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x466:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.157671:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5de5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x466:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.157677:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d5de5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x466:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.157687:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201421.157688:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201421.157690:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201421.158211:0:18158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2193b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:18158:1875064458282240:0@lo:503:mount.lustre.0 00010000:00010000:2.0:1788201421.158536:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201421.158994:0:18203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0007480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:18203:1875064458283392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201421.159061:0:18203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201421.159104:0:18203:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8073e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201421.159531:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458283392 00000100:00100000:2.0:1788201421.159538:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458283392 00000100:00100000:2.0:1788201421.159575:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788201421.159583:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c8ed6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+10:18203:x1875064458283392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201421.160040:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201421.160063:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201421.160097:0:10484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10484:1875064458283008:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201421.160119:0:10484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d5dec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x464:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201421.160151:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442761728 00000100:00100000:3.0:1788201421.160155:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442761728 00010000:00010000:3.0:1788201421.160172:0:7646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e5cf63c8/0x9383f985bc4d5b37 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x464:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c587b expref: 508 pid: 13444 timeout: 796 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201421.160190:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442761856 00000100:00100000:3.0:1788201421.160192:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442761856 00010000:00010000:3.0:1788201421.160201:0:7646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004e4d980a/0x9383f985bc4d58dd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x46f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5556 expref: 509 pid: 13440 timeout: 796 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201421.160217:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1597 00000100:00100000:2.0:1788201421.162045:0:13526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1598 00000100:00100000:2.0:1788201421.162066:0:13526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8090050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2360:x1875064442761856:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201421.162085:0:13526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201421.162094:0:13526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004e4d980a/0x9383f985bc4d58dd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x46f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5556 expref: 509 pid: 13440 timeout: 796 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.162111:0:13526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004e4d980a/0x9383f985bc4d58dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x46f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5556 expref: 509 pid: 13440 timeout: 796 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.162140:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201421.162146:0:13526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201421.162152:0:13526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d5df3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.162162:0:13526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d5df3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x46f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.162188:0:13526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201421.162241:0:13526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8090050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+509:2360:x1875064442761856:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 181us (2176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201421.162248:0:13526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1598 00000100:00100000:3.0:1788201421.165045:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+508:2360:x1875064442761728:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201421.165067:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201421.165077:0:7646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e5cf63c8/0x9383f985bc4d5b37 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x464:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c587b expref: 508 pid: 13444 timeout: 796 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.165097:0:7646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e5cf63c8/0x9383f985bc4d5b37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x464:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c587b expref: 508 pid: 13444 timeout: 796 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.165120:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5cf63c8/0x9383f985bc4d5b37 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x464:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c587b expref: 508 pid: 13444 timeout: 796 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.165187:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x464:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201421.165193:0:7646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x464:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201421.165199:0:7646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d5dec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x464:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.165209:0:7646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d5dec lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x464:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.165235:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201421.165280:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+507:2360:x1875064442761728:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 252us (5241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201421.165290:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1597 00010000:00010000:3.0:1788201421.165468:0:10484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d5dec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x464:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.165478:0:10484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d5dec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x464:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.165487:0:10484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d5dec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x464:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201421.165495:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1788201421.165496:0:10484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d5dec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x464:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.165514:0:10484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201421.165827:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442761984 00000100:00100000:3.0:1788201421.165835:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442761984 00010000:00010000:3.0:1788201421.165858:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000c8e357f/0x9383f985bc4d5b7d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x465:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5889 expref: 507 pid: 13440 timeout: 796 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201421.165893:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1599 00000100:00100000:3.0:1788201421.165902:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+507:2360:x1875064442761984:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201421.165910:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201421.165914:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000c8e357f/0x9383f985bc4d5b7d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x465:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5889 expref: 507 pid: 13440 timeout: 796 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.165924:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000c8e357f/0x9383f985bc4d5b7d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x465:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5889 expref: 507 pid: 13440 timeout: 796 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.165938:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x465:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201421.165941:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x465:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201421.165946:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d5dfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x465:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.165955:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d5dfa lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x465:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.165969:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201421.165994:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+507:2360:x1875064442761984:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 93us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201421.166001:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1599 00000100:00100000:3.0:1788201421.166251:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4379 00000100:00100000:3.0:1788201421.166260:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1875064458281344:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788201421.166285:0:6706:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1124 count 1 00010000:00010000:0.0:1788201421.166441:0:13441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e4d980a/0x9383f985bc4d58dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x46f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5556 expref: 506 pid: 13440 timeout: 796 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201421.166455:0:13441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2190e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:13441:1875064458283136:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201421.166480:0:13441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d5df3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201421.166490:0:13441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d5df3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201421.166497:0:13441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d5df3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201421.166511:0:13441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d5df3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201421.166518:0:13441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d5df3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x46f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201421.166543:0:13441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788201421.167084:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1875064458281344:12345-0@lo:6:osp-syn-1-0.0 Request processed in 824us (55016us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201421.167093:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4379 00000100:00100000:3.0:1788201421.168434:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c8ed6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+10:18203:x1875064458283392:12345-0@lo:502:llog_process_th.0 Request processed in 8846us (9367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201421.168447:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:1.0:1788201421.168734:0:13448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c8e357f/0x9383f985bc4d5b7d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x465:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5889 expref: 505 pid: 13440 timeout: 796 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201421.168752:0:13448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0006a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:13448:1875064458283264:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201421.168869:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201421.168878:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d5dec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x464:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.168887:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201421.168891:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d5dec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x464:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.168901:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d5dec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x464:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.168920:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d5dec lrc: 1/0,0 mode: --/PW res: [0x240000400:0x464:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.168929:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d5dec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x464:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.168945:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201421.168950:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d5df3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x46f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.168962:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201421.168965:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d5df3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x46f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.168973:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d5df3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x46f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.168982:0:13448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d5dfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x465:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.168982:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d5df3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x46f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.168990:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d5df3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x46f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.168994:0:13448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d5dfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x465:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.169000:0:13448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d5dfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x465:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.169004:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201421.169006:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201421.169008:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201421.169010:0:13448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d5dfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x465:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.169017:0:13448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d5dfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x465:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.169040:0:13448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201421.169107:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201421.169112:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d5dfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x465:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.169119:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201421.169123:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d5dfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x465:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.169130:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d5dfa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x465:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.169140:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d5dfa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x465:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.169147:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d5dfa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x465:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.169159:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201421.169161:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201421.169163:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788201421.169741:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c1ba3800, transno 0 00000004:00080000:2.0:1788201421.169749:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c1ba3800/1, rc -2, transno 0 00000100:00100000:2.0:1788201421.169760:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1ba3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458281344:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788201421.169779:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788201421.170194:0:18200:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 4, last_idx 5 00000040:00080000:2.0:1788201421.170231:0:18200:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x12:0x0] at index 4 of catalog [0x1:0x5:0x0] 00000100:00100000:0.0:1788201421.170240:0:18203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0007480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:18203:1875064458283392:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788201421.170274:0:18203:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201421.170284:0:18203:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201421.170286:0:18203:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788201421.170319:0:18203:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e03c5130000 00000020:00000080:0.0:1788201421.170323:0:18203:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788201421.170331:0:18203:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201421.170334:0:18203:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201421.170335:0:18203:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788201421.170338:0:18203:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201421.170341:0:18203:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201421.170342:0:18203:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788201421.170346:0:18203:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e03c5130000 00000020:00000080:0.0:1788201421.170348:0:18203:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788201421.170434:0:18203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2190e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:18203:1875064458283520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201421.170497:0:18203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201421.170533:0:18203:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f577d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201421.170554:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458283520 00000100:00100000:0.0:1788201421.170561:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458283520 00000100:00100000:0.0:1788201421.170601:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788201421.170610:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c8ed7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+10:18203:x1875064458283520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201421.171960:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c8ed7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+10:18203:x1875064458283520:12345-0@lo:502:llog_process_th.0 Request processed in 1347us (1460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201421.171973:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788201421.172054:0:18203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2190e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:18203:1875064458283520:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788201421.172085:0:18203:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201421.172092:0:18203:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201421.172094:0:18203:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788201421.172099:0:18203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788201421.172237:0:18158:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1788201421.172258:0:18158:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788201421.172273:0:18158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d5dd0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5dd7 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201421.172283:0:18158:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d5dd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5dd7 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201421.172355:0:18158:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788201421.172359:0:18158:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e03c5130000 10000000:01000000:0.0:1788201421.172361:0:18158:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e03c5130000 10000000:01000000:0.0:1788201421.172366:0:18158:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788201421.172372:0:18158:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e03c5130000 from 1 10000000:01000000:0.0:1788201421.172374:0:18158:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788201421.172402:0:18158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7800/0x9383f985bc4d5e01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201421.172411:0:18158:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7800/0x9383f985bc4d5e01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201421.172425:0:18158:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7800/0x9383f985bc4d5e01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201421.172443:0:18158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2190e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:18158:1875064458283648:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788201421.172478:0:18158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201421.172516:0:18158:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f577d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201421.172812:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458283648 00000100:00100000:2.0:1788201421.172819:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458283648 00000100:00100000:2.0:1788201421.172902:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788201421.172911:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c8ed4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+10:18158:x1875064458283648:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201421.172925:0:18162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201421.172937:0:18162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c1b96000/0x9383f985bc4d5e08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d5e01 expref: -99 pid: 18162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.172960:0:18162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c1b96000/0x9383f985bc4d5e08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d5e01 expref: 11 pid: 18162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.172970:0:18162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c1b96000/0x9383f985bc4d5e08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d5e01 expref: 11 pid: 18162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.172979:0:18162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c1b96000, rc 0) 00000100:00100000:2.0:1788201421.173016:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c8ed4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+11:18158:x1875064458283648:12345-0@lo:101:mount.lustre.0 Request processed in 107us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201421.173022:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788201421.173921:0:18158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2190e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:18158:1875064458283648:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201421.173939:0:18158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7800/0x9383f985bc4d5e01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5e08 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201421.173949:0:18158:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7800/0x9383f985bc4d5e01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d5e08 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201421.174004:0:18158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2190e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:18158:1875064458283776:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201421.174040:0:18158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201421.175379:0:18158:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f577d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201421.176119:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458283776 00000100:00100000:3.0:1788201421.176129:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458283776 00000100:00100000:3.0:1788201421.176186:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788201421.176196:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c648fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+11:18158:x1875064458283776:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201421.176681:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c648fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+11:18158:x1875064458283776:12345-0@lo:501:mount.lustre.0 Request processed in 485us (2637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201421.176690:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788201421.176859:0:18158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2190e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:18158:1875064458283776:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201421.176911:0:18158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2190e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:18158:1875064458283904:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201421.176970:0:18158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201421.176996:0:18158:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f577d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201421.177144:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458283904 00000100:00100000:3.0:1788201421.177149:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458283904 00000100:00100000:3.0:1788201421.177358:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788201421.177369:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c648d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+11:18158:x1875064458283904:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201421.179944:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c648d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+11:18158:x1875064458283904:12345-0@lo:503:mount.lustre.0 Request processed in 2569us (2967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201421.179958:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788201421.185400:0:18158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2190e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:18158:1875064458283904:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201421.192020:0:18206:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2190e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:18206:1875064458284032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201421.192103:0:18206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201421.192139:0:18186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458284032 00000100:00100000:0.0:1788201421.192146:0:18186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458284032 00000100:00100000:0.0:1788201421.192186:0:18186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788201421.192195:0:18186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c648d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+11:18206:x1875064458284032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201421.192521:0:18186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c648d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+11:18206:x1875064458284032:12345-0@lo:502:llog_process_th.0 Request processed in 326us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201421.192530:0:18186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788201421.192587:0:18206:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1c26780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201421.192610:0:18206:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2190e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:18206:1875064458284032:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788201421.192672:0:18206:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788201421.192686:0:18206:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9e04ff1e3380) 00000020:00000080:0.0:1788201421.192709:0:18206:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1788201421.195124:0:18206:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e03c5130000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788201421.195131:0:18206:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e03c5130000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788201421.195135:0:18206:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e03c5130000 4 00010000:00080000:0.0:1788201421.195173:0:18206:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e04fae23800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.130@tcp at head 00010000:00010000:0.0:1788201421.206049:0:18206:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-5 is initialized 00000020:00000080:0.0:1788201421.206159:0:18206:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788201421.206198:0:18206:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788201421.206210:0:18206:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9383f985bc4d5e16 00000100:00080000:0.0:1788201421.206221:0:18206:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788201421.206227:0:18206:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e04fae23800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1788201421.206262:0:18206:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e03c2190e00 x1875064458284160/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201421.206283:0:18206:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788201421.206520:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875064458284160:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788201421.206593:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201421.206905:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458284160 00000100:00100000:0.0:1788201421.206912:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458284160 00000100:00100000:0.0:1788201421.206950:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788201421.206957:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1875064458284160:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788201421.207017:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1875064458284160:12345-0@lo:38:llog_process_th.0 Request processed in 58us (422us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788201421.207024:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788201421.207065:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788201421.207073:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04fae23800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201421.207077:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788201421.207081:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875064458284160:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788201421.212460:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201421.212471:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201421.212475:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201421.212478:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788201421.213530:0:18206:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0006a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:18206:1875064458284288:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201421.213609:0:18206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201421.213644:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458284288 00000100:00100000:1.0:1788201421.213650:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458284288 00000100:00100000:1.0:1788201421.213693:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788201421.213701:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c648c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+11:18206:x1875064458284288:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201421.215074:0:18206:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2fd9f00 going to sleep for 11 seconds 00000004:00080000:2.0:1788201421.217513:0:18184:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788201421.226158:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c648c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+11:18206:x1875064458284288:12345-0@lo:502:llog_process_th.0 Request processed in 12444us (12536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201421.226173:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788201421.229658:0:18206:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0006a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:18206:1875064458284288:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788201421.229706:0:18206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788201421.231368:0:18158:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788201421.231406:0:18158:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788201421.231426:0:18158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7800/0x9383f985bc4d5e01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5e08 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201421.231438:0:18158:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7800/0x9383f985bc4d5e01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5e08 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788201421.231496:0:18158:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788201421.231499:0:18158:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788201421.231500:0:18158:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201421.231502:0:18158:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201421.231503:0:18158:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201421.231504:0:18158:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201421.231506:0:18158:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201421.231507:0:18158:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788201421.231509:0:18158:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201421.231510:0:18158:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788201421.231514:0:18158:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788201421.231517:0:18158:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788201421.231518:0:18158:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788201421.231519:0:18158:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201421.231520:0:18158:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201421.231522:0:18158:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201421.231524:0:18158:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201421.231525:0:18158:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201421.231525:0:18158:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788201421.231527:0:18158:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201421.231528:0:18158:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788201421.231555:0:18158:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788201421.231575:0:18158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2190e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:18158:1875064458284416:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788201421.231645:0:18158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201421.231682:0:18158:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8073000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201421.231712:0:18186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458284416 00000100:00100000:0.0:1788201421.231719:0:18186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458284416 00000100:00100000:0.0:1788201421.231763:0:18186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788201421.231953:0:18186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c648f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+11:18158:x1875064458284416:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788201421.232054:0:18186:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788201421.232072:0:18186:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788201421.244684:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3310:x1875064458279168:12345-0@lo:6:osp-syn-0-0.0 Request processed in 138795us (149843us total) trans 4294968885 rc 0/0 00000100:00100000:2.0:1788201421.244698:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4359 00000001:00100000:2.0:1788201421.245891:0:6732:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788201421.245914:0:6732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294968885 is committed 00000004:00080000:2.0:1788201421.245968:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04c12a8a80/2, rc 0, transno 4294968885 00000100:00100000:2.0:1788201421.245977:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458279168:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788201421.270007:0:18184:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788201421.286277:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3310:x1875064458282496:12345-0@lo:6:osp-syn-0-0.0 Request processed in 133290us (140713us total) trans 4294968887 rc 0/0 00000100:00100000:3.0:1788201421.286330:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4376 00000100:00100000:3.0:1788201421.286397:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3313:x1875064458281984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 143990us (147452us total) trans 4294968888 rc 0/0 00000100:00100000:3.0:1788201421.286404:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4374 00000001:00080000:3.0:1788201421.286429:0:6732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294968889 is committed 00000001:00080000:3.0:1788201421.286446:0:6732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294968890 is committed 00000100:00100000:3.0:1788201421.286493:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968885 gen 2 00000004:00080000:3.0:1788201421.286498:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04c12a8a80, transno 4294968885 00000100:00100000:3.0:1788201421.286512:0:3310:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9e03c12d2300 x1875064458282496/t4294968887(4294968887) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788201476 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788201421.286525:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c12d2300/2, rc 0, transno 4294968887 00000100:00100000:3.0:1788201421.286530:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458282496:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788201421.286552:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c12d1880/2, rc 0, transno 4294968888 00000100:00100000:3.0:1788201421.286555:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458281984:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201421.288969:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+7:3313:x1875064458282752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 144340us (144423us total) trans 4294968886 rc 0/0 00000100:00100000:1.0:1788201421.288983:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4375 00000100:00100000:1.0:1788201421.289050:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3310:x1875064458281856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 135592us (143403us total) trans 4294968889 rc 0/0 00000100:00100000:1.0:1788201421.289057:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4377 00000100:00100000:1.0:1788201421.289095:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458282624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 135429us (143415us total) trans 4294968890 rc 0/0 00000100:00100000:1.0:1788201421.289101:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4378 00000004:00080000:3.0:1788201421.292833:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04f0004a80, transno 4294968886 00000100:00100000:3.0:1788201421.292854:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968890 gen 2 00000004:00080000:3.0:1788201421.292859:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c12d2300, transno 4294968887 00000004:00080000:3.0:1788201421.292862:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c12d1880, transno 4294968888 00000004:00080000:3.0:1788201421.292868:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04f0004a80/2, rc 0, transno 4294968886 00000100:00100000:3.0:1788201421.292877:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458282752:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788201421.292908:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c12d2d80, transno 4294968889 00000004:00080000:3.0:1788201421.292911:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c12d2d80/2, rc 0, transno 4294968889 00000100:00100000:3.0:1788201421.292915:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458281856:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788201421.292923:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e03c12d3b80, transno 4294968890 00000004:00080000:3.0:1788201421.292925:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e03c12d3b80/2, rc 0, transno 4294968890 00000100:00100000:3.0:1788201421.292928:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458282624:0@lo:6:osp-syn-0-0.0 00000040:00080000:3.0:1788201421.293400:0:18198:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 4, last_idx 5 00000040:00080000:3.0:1788201421.293522:0:18198:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x10:0x0] at index 4 of catalog [0x1:0x2:0x0] 00000004:00080000:3.0:1788201421.293556:0:18198:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 5 done 20000000:01000000:3.0:1788201421.318175:0:18186:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788201421.318252:0:18186:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788201421.318382:0:18167:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788201421.318387:0:18167:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788201421.318415:0:18167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e03c1b97e00/0x9383f985bc4d5e1d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.318434:0:18167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e03c1b96600/0x9383f985bc4d5dbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d5db4 expref: 11 pid: 18161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.318442:0:18167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e03c1b97e00/0x9383f985bc4d5e1d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.318490:0:18167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e03c1b96600/0x9383f985bc4d5dbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9383f985bc4d5db4 expref: 11 pid: 18161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.318506:0:18167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e03c1b96600/0x9383f985bc4d5dbb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9383f985bc4d5db4 expref: 11 pid: 18161 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201421.318521:0:18167:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12aaa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18167:1875064458284544:0@lo:104: 00000100:00100000:2.0:1788201421.318591:0:18167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201421.318641:0:18167:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c5e34600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201421.318994:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458284544 00000100:00100000:1.0:1788201421.319003:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458284544 00000100:00100000:1.0:1788201421.319048:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788201421.319059:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b60c000b-7335-444d-a8dc-1a5956712fb2+3:18167:x1875064458284544:12345-0@lo:104: 00010000:00010000:1.0:1788201421.319073:0:8463:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6000/0x9383f985bc4d5db4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9383f985bc4d5dbb expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201421.319142:0:8463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201421.319149:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b60c000b-7335-444d-a8dc-1a5956712fb2+3:18167:x1875064458284544:12345-0@lo:104: Request processed in 92us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201421.319156:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788201421.319233:0:18167:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12aaa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18167:1875064458284544:0@lo:104: 00010000:00010000:3.0:1788201421.319254:0:18167:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e03c1b97e00/0x9383f985bc4d5e1d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.319405:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201421.319412:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6000/0x9383f985bc4d5db4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9383f985bc4d5dbb expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.319421:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6000 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1788201421.319425:0:7645:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6000/0x9383f985bc4d5db4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9383f985bc4d5dbb expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.319433:0:7645:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6000/0x9383f985bc4d5db4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9383f985bc4d5dbb expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201421.319441:0:7645:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6000/0x9383f985bc4d5db4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9383f985bc4d5dbb expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201421.319447:0:7645:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201421.319482:0:7645:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6000/0x9383f985bc4d5db4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9383f985bc4d5dbb expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.319488:0:7645:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201421.319520:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6000/0x9383f985bc4d5db4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9383f985bc4d5dbb expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.319527:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6000/0x9383f985bc4d5db4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9383f985bc4d5dbb expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.319541:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201421.319543:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201421.319544:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201421.319559:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458284672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201421.319594:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201421.319649:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458284672 00000100:00100000:3.0:1788201421.319654:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458284672 00010000:00010000:3.0:1788201421.319675:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e03c1b96600/0x9383f985bc4d5dbb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9383f985bc4d5db4 expref: 12 pid: 18161 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201421.319697:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1600 00000100:00100000:3.0:1788201421.319704:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b60c000b-7335-444d-a8dc-1a5956712fb2+12:3313:x1875064458284672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201421.319714:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201421.319719:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e03c1b96600/0x9383f985bc4d5dbb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9383f985bc4d5db4 expref: 12 pid: 18161 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.319730:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e03c1b96600/0x9383f985bc4d5dbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9383f985bc4d5db4 expref: 12 pid: 18161 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.319744:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c1b96600/0x9383f985bc4d5dbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9383f985bc4d5db4 expref: 12 pid: 18161 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.319756:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e03c1b97e00/0x9383f985bc4d5e1d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.319763:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c1b97e00/0x9383f985bc4d5e1d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788201421.319776:0:8524:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.029486887s 00010000:00010000:3.0:1788201421.319781:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03c1b97e00/0x9383f985bc4d5e1d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.319788:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03c1b97e00/0x9383f985bc4d5e1d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.319810:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e03c1b97e00/0x9383f985bc4d5e1d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.319817:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e03c1b97e00/0x9383f985bc4d5e1d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.319822:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201421.319826:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e03c1b97e00/0x9383f985bc4d5e1d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.319834:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e03c1b97e00/0x9383f985bc4d5e1d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.319847:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e03c1b97e00/0x9383f985bc4d5e1d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.319856:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201421.319886:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b60c000b-7335-444d-a8dc-1a5956712fb2+11:3313:x1875064458284672:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201421.319893:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1600 00000100:00100000:3.0:1788201421.319925:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458284672:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201421.319943:0:18167:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e03c1b97e00/0x9383f985bc4d5e1d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.319950:0:18167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e03c1b97e00/0x9383f985bc4d5e1d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201421.319956:0:18167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c1b97e00/0x9383f985bc4d5e1d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201421.421217:0:18186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c648f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+10:18158:x1875064458284416:12345-0@lo:253:mount.lustre.0 Request processed in 189258us (189561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201421.421233:0:18186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788201421.421419:0:18158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2190e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:18158:1875064458284416:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788201421.421436:0:18158:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788201421.421440:0:18158:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788201421.421442:0:18158:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788201421.421443:0:18158:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201421.421445:0:18158:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201421.421446:0:18158:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201421.421448:0:18158:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201421.421450:0:18158:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201421.421451:0:18158:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788201421.421452:0:18158:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201421.421454:0:18158:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788201421.421473:0:18158:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788201421.429730:0:18158:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788201421.431277:0:18158:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788201421.431717:0:18158:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788201421.433478:0:18158:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788201421.433806:0:18158:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788201421.433973:0:18158:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788201421.439169:0:18158:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788201421.439391:0:18158:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788201421.439632:0:18158:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788201421.440333:0:18158:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788201421.440607:0:18158:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788201421.440761:0:18158:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000040:01000000:3.0:1788201421.488699:0:18158:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788201421.489403:0:18213:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788201421.491241:0:18213:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1788201421.492004:0:18212:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1788201421.492010:0:18212:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:3.0:1788201421.495220:0:18213:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000bd0:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788201421.495343:0:18213:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788201421.495348:0:18213:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1788201421.498985:0:18158:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788201421.499125:0:18158:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788201421.499885:0:18158:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788201421.499897:0:18158:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788201421.500067:0:18158:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201421.502959:0:18158:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788201421.504157:0:18158:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788201421.504686:0:18158:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788201421.505054:0:18158:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788201421.508038:0:18158:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x39:0x0] (8/8/4) registered 00010000:00080000:3.0:1788201421.513681:0:18158:0:(ldlm_lib.c:3054:target_recovery_init()) RECOVERY: service lustre-MDT0000, 1 recoverable clients, last_transno 17179869289 00010000:00080000:0.0:1788201421.514852:0:18214:0:(ldlm_lib.c:2854:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 18214 00010000:02000000:0.0:1788201421.514908:0:18214:0:(ldlm_lib.c:2336:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00000020:01000004:3.0:1788201421.517128:0:18158:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788201421.517154:0:18158:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.130@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788201421.517169:0:18158:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788201421.517233:0:18158:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00080000:1.0:1788201421.531908:0:18214:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 1 abort 0 expired 0 00010000:00080000:1.0:1788201421.531918:0:18214:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 1 abort 0 expired 0 00000001:00100000:3.0:1788201421.642602:0:7657:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788201421.738388:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201421.916274:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201421.916442:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442762112 00000100:00100000:0.0:1788201421.916460:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442762112 00000100:00100000:0.0:1788201421.916539:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 38 00000100:00100000:0.0:1788201421.916553:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c648f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442762112:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201421.916581:0:18163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201421.916611:0:18163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c2cc7400/0x9383f985bc4d5e24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c58cf expref: -99 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201421.916649:0:18163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c2cc7400/0x9383f985bc4d5e24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58cf expref: 10 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201421.916665:0:18163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c2cc7400/0x9383f985bc4d5e24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58cf expref: 10 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201421.916675:0:18163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc7400, rc 0) 00000100:00100000:0.0:1788201421.916759:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c648f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:5601:x1875064442762112:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 210us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201421.916767:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 38 00000100:00100000:0.0:1788201421.925487:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201421.925897:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442762240 00000100:00100000:3.0:1788201421.925913:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442762240 00000100:00100000:3.0:1788201421.925972:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:3.0:1788201421.925984:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c648dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:5601:x1875064442762240:12345-192.168.201.30@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788201421.926013:0:18161:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1788201421.926031:0:18161:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788201421.926035:0:18161:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1788201421.926038:0:18161:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1788201421.926051:0:18161:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 17 00000100:00100000:3.0:1788201421.927943:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c648dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:5601:x1875064442762240:12345-192.168.201.30@tcp:256:ll_cfg_requeue.0 Request processed in 1952us (2463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201421.927957:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:3.0:1788201421.951506:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201421.951617:0:18175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442762368 00000100:00100000:2.0:1788201421.951632:0:18175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442762368 00000100:00100000:2.0:1788201421.951713:0:18175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:2.0:1788201421.951722:0:18175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2358:x1875064442762368:12345-192.168.201.30@tcp:38:ll_cfg_requeue.0 00010000:00080000:2.0:1788201421.951756:0:18175:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '35604eb4-baf9-45be-a20a-4883a2cd8cf9' at ffff9e04c3667800, cookie 0x9383f985bc4d5d67 00010000:00080000:2.0:1788201421.951762:0:18175:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp recovering/t17179869197 exp ffff9e04c3667800 cur 697 last 1788201421 00010000:02000400:2.0:1788201421.951777:0:18175:0:(ldlm_lib.c:2037:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 1 client reconnects 00010000:00080000:2.0:1788201421.957029:0:18175:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1788201421.957076:0:18175:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type 77, return 77 00000100:00080000:2.0:1788201421.957349:0:18175:0:(import.c:65:import_set_state_nolock()) ffff9e04ff1c1800 : changing import state from RECOVER to FULL 00010000:00080000:3.0:1788201421.957424:0:18214:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 1 abort 0 expired 0 00010000:00080000:3.0:1788201421.957437:0:18214:0:(ldlm_lib.c:2684:replay_request_or_update()) Waiting for transno 17179869290 00000020:00080000:3.0:1788201421.957445:0:18214:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201421.957448:0:18214:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 0, req_transno: 0, next_transno: 17179869290 00000020:00080000:3.0:1788201421.957452:0:18214:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201421.957455:0:18214:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 0, req_transno: 0, next_transno: 17179869290 00000100:00100000:2.0:1788201421.957495:0:18175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2358:x1875064442762368:12345-192.168.201.30@tcp:38:ll_cfg_requeue.0 Request processed in 5769us (5999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201421.957510:0:18175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:1.0:1788201421.961828:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201421.961931:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442762496 00000100:00100000:3.0:1788201421.961944:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442762496 00000100:00100000:3.0:1788201421.962022:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:3.0:1788201421.962036:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2358:x1875064442762496:12345-192.168.201.30@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1788201421.962078:0:18173:0:(ldlm_lib.c:3188:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9e04f0006a00 x1875064442762496/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:542/0 lens 328/0 e 0 to 0 dl 1788201432 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201421.962106:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2358:x1875064442762496:12345-192.168.201.30@tcp:101:ldlm_lock_repla.0 Request processed in 74us (295us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201421.962115:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3 00000020:00080000:2.0:1788201421.962201:0:18214:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788201421.962206:0:18214:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 1, connected: 1, completed: 1, queue_len: 0, req_transno: 0, next_transno: 17179869290 00010000:00080000:2.0:1788201421.962210:0:18214:0:(ldlm_lib.c:2263:check_for_next_transno()) waking for completed recovery 00000020:00080000:2.0:1788201421.962214:0:18214:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788201421.962222:0:18214:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788201421.962225:0:18214:0:(ldlm_lib.c:2283:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788201421.962232:0:18214:0:(ldlm_lib.c:2889:target_recovery_thread()) @@@ processing lock from 192.168.201.30@tcp: req@ffff9e04f0006a00 x1875064442762496/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:542/0 lens 328/0 e 0 to 0 dl 1788201432 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788201421.962256:0:18214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201421.962334:0:18214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d5e2b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5365 expref: -99 pid: 18214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.962367:0:18214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d5e2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5365 expref: 7 pid: 18214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.962387:0:18214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d5e2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5365 expref: 7 pid: 18214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201421.962405:0:18214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c1b97800, rc 0) 00010000:00080000:2.0:1788201421.962487:0:18214:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788201421.962501:0:18214:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1788201421.965466:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201421.965771:0:18175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442762624 00000100:00100000:2.0:1788201421.965785:0:18175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442762624 00000100:00100000:2.0:1788201421.965860:0:18175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:2.0:1788201421.965873:0:18175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2358:x1875064442762624:12345-192.168.201.30@tcp:400:ptlrpcd_rcv.0 00010000:00080000:2.0:1788201421.965903:0:18175:0:(ldlm_lib.c:3138:target_queue_recovery_request()) @@@ queue final req req@ffff9e04f00dc000 x1875064442762624/t0(0) o400->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:542/0 lens 224/0 e 0 to 0 dl 1788201432 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201421.965927:0:18175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2358:x1875064442762624:12345-192.168.201.30@tcp:400:ptlrpcd_rcv.0 Request processed in 57us (488us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201421.965935:0:18175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00010000:00080000:0.0:1788201421.965993:0:18214:0:(ldlm_lib.c:2286:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1788201421.966362:0:18214:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 5, last_transno is 21474836480 00000001:00080000:0.0:1788201422.031382:0:18214:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:0.0:1788201422.031469:0:18214:0:(ldlm_lib.c:1997:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:0.0:1788201422.031492:0:18214:0:(ldlm_lib.c:2941:target_recovery_thread()) @@@ processing final ping from 192.168.201.30@tcp: req@ffff9e04f00dc000 x1875064442762624/t0(0) o400->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:542/0 lens 224/0 e 0 to 0 dl 1788201432 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1788201422.031629:0:18214:0:(ldlm_lib.c:1869:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:01, of 1 clients 1 recovered and 0 were evicted. 00000001:00100000:2.0:1788201422.035230:0:18184:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 35604eb4-baf9-45be-a20a-4883a2cd8cf9 00000100:00100000:3.0:1788201422.040850:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201422.040907:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201422.040964:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442758144 00000100:00100000:3.0:1788201422.040979:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442758144 00000100:00100000:3.0:1788201422.041040:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442760704 00000100:00100000:3.0:1788201422.041043:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442760704 00000100:00100000:3.0:1788201422.041068:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 901 00000100:00100000:3.0:1788201422.041080:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2360:x1875064442758144:12345-192.168.201.30@tcp:63:ll_sa.0 00000020:00080000:3.0:1788201422.041134:0:6715:0:(tgt_handler.c:3159:tgt_check_resent()) @@@ no reply for RESENT req req@ffff9e04f00df800 x1875064442758144/t0(0) o63->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:543/0 lens 664/4320 e 0 to 0 dl 1788201433 ref 1 fl Interpret:/202/0 rc 0/0 job:'ll_sa.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788201422.041150:0:6715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201422.041189:0:6715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3a00/0x9383f985bc4d5e32 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c58a5 expref: -99 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201422.041590:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 902 00000100:00100000:3.0:1788201422.041599:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:0:x1875064442760704:12345-192.168.201.30@tcp:63:ll_sa.0 00010000:00010000:3.0:1788201422.041619:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201422.041634:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d5e39 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c58c8 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201422.047811:0:6715:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4278us 00000004:00010000:1.0:1788201422.086155:0:6715:0:(mdt_handler.c:4971:mdt_intent_fixup_resent()) @@@ no existing lock with rhandle 0x4605c7c97e1c58a5 req@ffff9e04f00df800 x1875064442758144/t0(0) o63->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:543/0 lens 664/4320 e 0 to 0 dl 1788201433 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_sa.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788201422.086211:0:6715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-116, rc=-116) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3a00/0x9383f985bc4d5e32 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58a5 expref: 10 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.086211:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d5e40 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.086229:0:6715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x402:0x0].0x0 (ffff9e04d9f56100) 00010000:00010000:3.0:1788201422.086230:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d5e40 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.086232:0:6715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201422.086237:0:6715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3a00/0x9383f985bc4d5e32 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58a5 expref: 10 pid: 6715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.086247:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d5e40 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.086258:0:6715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2ef3a00, rc -116) 00000100:00100000:1.0:1788201422.087761:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:2360:x1875064442758144:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 46671us (46917us total) trans 0 rc -116/-116 00000100:00100000:1.0:1788201422.087778:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 901 00010000:00010000:3.0:1788201422.090685:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5e47 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x40a:0x0].0x1f05a8ec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.090718:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5e47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x1f05a8ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.090733:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5e47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x1f05a8ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.092614:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d5e40 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.092632:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d5e40 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.092639:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d5e40 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.092646:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201422.092651:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d5e40 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.092660:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d5e40 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.092679:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e04d9f56900) 00010000:00010000:3.0:1788201422.092682:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201422.092687:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d5e40 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.092694:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3c00/0x9383f985bc4d5e40 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.092710:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5e47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x1f05a8ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.092716:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5e47 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x1f05a8ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.092721:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5e47 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x1f05a8ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.092726:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201422.092728:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5e47 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x1f05a8ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.092734:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5e47 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x40a:0x0].0x1f05a8ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.092741:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x1f05a8ec (ffff9e04d9f56f00) 00010000:00010000:3.0:1788201422.092743:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201422.092746:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5e47 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x40a:0x0].0x1f05a8ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.092751:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef3e00/0x9383f985bc4d5e47 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x40a:0x0].0x1f05a8ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.092806:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d5e39 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58c8 expref: 8 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.092817:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x40a:0x0].0x0 (ffff9e04d9f56900) 00010000:00010000:3.0:1788201422.092819:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201422.093551:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef2600/0x9383f985bc4d5e39 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x40a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58c8 expref: 8 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.093570:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2ef2600, rc -2) 00000100:00100000:3.0:1788201422.093671:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:0:x1875064442760704:12345-192.168.201.30@tcp:63:ll_sa.0 Request processed in 52070us (52761us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201422.093681:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 902 00000004:00000080:2.0:1788201422.115859:0:18214:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffad6104233e10 00100000:10000000:2.0:1788201422.115880:0:18214:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:2.0:1788201422.119535:0:18201:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x470:0x0] 00000100:00100000:2.0:1788201422.119608:0:18201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18201:1875064458284800:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788201422.119699:0:18201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201422.119738:0:18201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341d3c0 going to sleep for 50 seconds 00000100:00100000:2.0:1788201422.119764:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458284800 00000100:00100000:2.0:1788201422.119772:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458284800 00000100:00100000:2.0:1788201422.119829:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4380 00000100:00100000:2.0:1788201422.119839:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:18201:x1875064458284800:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788201422.119878:0:13445:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1153 -> diff = -17 00002000:02000040:2.0:1788201422.119884:0:13445:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:1137 to 0x280000400:1153) 00000004:00080000:1.0:1788201422.120496:0:18199:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x470:0x0] 00000100:00100000:1.0:1788201422.120531:0:18199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0005180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18199:1875064458284928:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788201422.120586:0:18199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201422.120608:0:18199:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2fd9d80 going to sleep for 50 seconds 00000100:00100000:0.0:1788201422.121660:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458284928 00000100:00100000:0.0:1788201422.121674:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458284928 00000100:00100000:0.0:1788201422.121737:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4381 00000100:00100000:0.0:1788201422.121748:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:18199:x1875064458284928:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788201422.122246:0:13439:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1153 -> diff = -17 00002000:02000040:0.0:1788201422.122253:0:13439:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:1137 to 0x240000400:1153) 00002000:00010000:2.0:1788201422.131063:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x481:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201422.131084:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d5e4e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x481:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.131107:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x481:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1788201422.131113:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x481:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201422.131122:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d5e4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x481:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.131147:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d5e4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x481:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.131160:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d5e4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x481:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.131184:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d5e4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x481:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.131766:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201422.137418:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201422.137436:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d5e4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x481:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.137453:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201422.137459:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d5e4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x481:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.137472:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d5e4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x481:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.137499:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d5e4e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x481:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.137508:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d5e4e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x481:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.137532:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201422.137534:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201422.137536:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201422.142837:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x480:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201422.142854:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f025b68e/0x9383f985bc4d5e55 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x480:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.142875:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x480:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1788201422.142881:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x480:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201422.142889:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f025b68e/0x9383f985bc4d5e55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x480:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.142906:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f025b68e/0x9383f985bc4d5e55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x480:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.142920:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f025b68e/0x9383f985bc4d5e55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x480:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.142928:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f025b68e/0x9383f985bc4d5e55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x480:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.142956:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201422.142977:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201422.142985:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f025b68e/0x9383f985bc4d5e55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x480:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.142993:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201422.142998:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f025b68e/0x9383f985bc4d5e55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x480:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.143008:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f025b68e/0x9383f985bc4d5e55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x480:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.143028:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f025b68e/0x9383f985bc4d5e55 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x480:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.143037:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f025b68e/0x9383f985bc4d5e55 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x480:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.143056:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201422.143058:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201422.143060:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201422.143449:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x47f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201422.143456:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040097fff/0x9383f985bc4d5e5c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x47f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.143464:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x47f:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1788201422.143467:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x47f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201422.143471:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040097fff/0x9383f985bc4d5e5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x47f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.143485:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040097fff/0x9383f985bc4d5e5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x47f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.143493:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040097fff/0x9383f985bc4d5e5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x47f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.143500:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040097fff/0x9383f985bc4d5e5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x47f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.143519:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201422.143801:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x47e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201422.143806:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075aceb8e/0x9383f985bc4d5e63 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x47e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.143814:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x47e:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1788201422.143816:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x47e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201422.143820:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075aceb8e/0x9383f985bc4d5e63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x47e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.143828:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075aceb8e/0x9383f985bc4d5e63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x47e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.143835:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075aceb8e/0x9383f985bc4d5e63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x47e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.143846:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075aceb8e/0x9383f985bc4d5e63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x47e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.143862:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788201422.143872:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201422.143877:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040097fff/0x9383f985bc4d5e5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x47f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.143884:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201422.143888:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040097fff/0x9383f985bc4d5e5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x47f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.143895:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040097fff/0x9383f985bc4d5e5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x47f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.143906:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040097fff/0x9383f985bc4d5e5c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x47f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.143912:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040097fff/0x9383f985bc4d5e5c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x47f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.143926:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201422.143928:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075aceb8e/0x9383f985bc4d5e63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x47e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.143939:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201422.143942:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075aceb8e/0x9383f985bc4d5e63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x47e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.143948:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075aceb8e/0x9383f985bc4d5e63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x47e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.143956:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075aceb8e/0x9383f985bc4d5e63 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x47e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.143962:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075aceb8e/0x9383f985bc4d5e63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x47e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.143970:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201422.143971:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201422.143973:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201422.144244:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201422.144270:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x47d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201422.144275:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d5e6a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x47d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.144313:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x47d:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1788201422.144317:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x47d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201422.144321:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d5e6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x47d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.144331:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d5e6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x47d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.144340:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d5e6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x47d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.144347:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d5e6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x47d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.144364:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201422.144462:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201422.144470:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d5e6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x47d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.144478:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201422.144482:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d5e6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x47d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.144490:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d5e6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x47d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.144503:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d5e6a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x47d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.144510:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7da9776/0x9383f985bc4d5e6a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x47d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.144525:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201422.144527:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201422.144528:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201422.144662:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x47c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201422.144668:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d65ba541/0x9383f985bc4d5e71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x47c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.144677:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x47c:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1788201422.144681:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x47c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201422.144685:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d65ba541/0x9383f985bc4d5e71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x47c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.144695:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d65ba541/0x9383f985bc4d5e71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x47c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.144704:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d65ba541/0x9383f985bc4d5e71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x47c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.144713:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d65ba541/0x9383f985bc4d5e71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x47c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.144742:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201422.144761:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201422.144766:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d65ba541/0x9383f985bc4d5e71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x47c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.144774:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201422.144777:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d65ba541/0x9383f985bc4d5e71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x47c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.144785:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d65ba541/0x9383f985bc4d5e71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x47c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.144795:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d65ba541/0x9383f985bc4d5e71 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x47c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.144803:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d65ba541/0x9383f985bc4d5e71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x47c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.144816:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201422.144817:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201422.144819:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201422.145080:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x47b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201422.145086:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c30a815/0x9383f985bc4d5e78 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x47b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.145095:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x47b:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1788201422.145098:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x47b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201422.145103:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c30a815/0x9383f985bc4d5e78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x47b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.145113:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c30a815/0x9383f985bc4d5e78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x47b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.145122:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c30a815/0x9383f985bc4d5e78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x47b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.145130:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c30a815/0x9383f985bc4d5e78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x47b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.145151:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201422.146336:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201422.146349:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c30a815/0x9383f985bc4d5e78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x47b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.146361:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201422.146366:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c30a815/0x9383f985bc4d5e78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x47b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.146376:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c30a815/0x9383f985bc4d5e78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x47b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.146466:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c30a815/0x9383f985bc4d5e78 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x47b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.146476:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c30a815/0x9383f985bc4d5e78 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x47b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.146505:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201422.146508:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201422.146510:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201422.148097:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x47a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201422.148112:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d5e7f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x47a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.148129:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x47a:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1788201422.148136:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x47a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201422.148142:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d5e7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x47a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.148157:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d5e7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x47a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.148169:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d5e7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x47a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.148177:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d5e7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x47a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.148202:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201422.148512:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201422.148522:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d5e7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x47a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.148532:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201422.148537:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d5e7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x47a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.148547:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d5e7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x47a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.148567:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d5e7f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x47a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.148575:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d928e625/0x9383f985bc4d5e7f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x47a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.148596:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201422.148598:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201422.148600:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201422.148721:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x479:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201422.148728:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d5e86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x479:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.148737:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x479:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1788201422.148740:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x479:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201422.148745:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d5e86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x479:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.148756:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d5e86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x479:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.148764:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d5e86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x479:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.148773:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d5e86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x479:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.148797:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201422.149374:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201422.149381:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d5e86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x479:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.149390:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201422.149393:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d5e86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x479:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.149407:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d5e86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x479:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.149421:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d5e86 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x479:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.149429:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000897fe451/0x9383f985bc4d5e86 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x479:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.149447:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201422.149448:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201422.149450:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201422.149578:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x478:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201422.149584:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b289fa11/0x9383f985bc4d5e8d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x478:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.149593:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x478:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1788201422.149595:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x478:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201422.149599:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b289fa11/0x9383f985bc4d5e8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x478:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.149608:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b289fa11/0x9383f985bc4d5e8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x478:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.149615:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b289fa11/0x9383f985bc4d5e8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x478:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.149622:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b289fa11/0x9383f985bc4d5e8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x478:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.150212:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201422.150688:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x477:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201422.150696:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d5e94 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x477:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.150709:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x477:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1788201422.150713:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x477:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201422.150718:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d5e94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x477:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.150731:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d5e94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x477:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.150741:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d5e94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x477:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.150750:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d5e94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x477:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201422.153172:0:13439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x481:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201422.153194:0:13439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000231b93c9/0x9383f985bc4d5e9b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x481:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.153216:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x481:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1788201422.153221:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x481:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201422.153228:0:13439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000231b93c9/0x9383f985bc4d5e9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x481:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.153250:0:13439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000231b93c9/0x9383f985bc4d5e9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x481:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.153263:0:13439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000231b93c9/0x9383f985bc4d5e9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x481:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.153271:0:13439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000231b93c9/0x9383f985bc4d5e9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x481:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.154981:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201422.155000:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b289fa11/0x9383f985bc4d5e8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x478:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.155017:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bdc00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201422.155023:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b289fa11/0x9383f985bc4d5e8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x478:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.155035:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b289fa11/0x9383f985bc4d5e8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x478:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.155060:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b289fa11/0x9383f985bc4d5e8d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x478:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.157576:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b289fa11/0x9383f985bc4d5e8d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x478:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.157640:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201422.157646:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d5e94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x477:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.157654:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bd600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201422.157659:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d5e94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x477:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.157670:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d5e94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x477:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.157691:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d5e94 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x477:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.157698:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201422.157702:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000231b93c9/0x9383f985bc4d5e9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x481:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.157709:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201422.157712:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000231b93c9/0x9383f985bc4d5e9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x481:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.157724:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000231b93c9/0x9383f985bc4d5e9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x481:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.157733:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000231b93c9/0x9383f985bc4d5e9b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x481:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.157740:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201422.157741:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201422.157745:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201422.162802:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788201422.162838:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de2b048b/0x9383f985bc4d5e94 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x477:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201422.163749:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x476:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201422.163758:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8637c64/0x9383f985bc4d5ea2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x476:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.163776:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x476:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1788201422.163781:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x476:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201422.163788:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8637c64/0x9383f985bc4d5ea2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x476:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.163804:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8637c64/0x9383f985bc4d5ea2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x476:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.163815:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8637c64/0x9383f985bc4d5ea2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x476:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.163914:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8637c64/0x9383f985bc4d5ea2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x476:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.165739:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201422.165753:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8637c64/0x9383f985bc4d5ea2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x476:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.165768:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201422.165773:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8637c64/0x9383f985bc4d5ea2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x476:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.165785:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8637c64/0x9383f985bc4d5ea2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x476:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.165810:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8637c64/0x9383f985bc4d5ea2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x476:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.166049:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201422.166052:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201422.166055:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201422.166083:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201422.166389:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788201422.166400:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8637c64/0x9383f985bc4d5ea2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x476:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.166477:0:13439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788201422.166486:0:13439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000231b93c9/0x9383f985bc4d5e9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x481:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201422.166996:0:13439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x480:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00002000:00010000:3.0:1788201422.166996:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x475:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201422.167005:0:13439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d5ea9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x480:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.167006:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd191276/0x9383f985bc4d5eb0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x475:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.167020:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x480:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1788201422.167020:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x475:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1788201422.167025:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x480:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201422.167025:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x475:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201422.167033:0:13439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d5ea9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x480:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.167033:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd191276/0x9383f985bc4d5eb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x475:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.167050:0:13439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d5ea9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x480:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.167050:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd191276/0x9383f985bc4d5eb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x475:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.167066:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd191276/0x9383f985bc4d5eb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x475:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.167543:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd191276/0x9383f985bc4d5eb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x475:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.167598:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201422.167605:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd191276/0x9383f985bc4d5eb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x475:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.167614:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bcc00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201422.167620:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd191276/0x9383f985bc4d5eb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x475:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.167628:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd191276/0x9383f985bc4d5eb0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x475:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.167646:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd191276/0x9383f985bc4d5eb0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x475:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.167655:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201422.167657:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201422.167659:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201422.167732:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788201422.167737:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd191276/0x9383f985bc4d5eb0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x475:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201422.168376:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x474:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201422.168384:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010ae58ae/0x9383f985bc4d5eb7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x474:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.168395:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x474:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1788201422.168400:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x474:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201422.168405:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010ae58ae/0x9383f985bc4d5eb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x474:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.168417:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010ae58ae/0x9383f985bc4d5eb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x474:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.168427:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010ae58ae/0x9383f985bc4d5eb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x474:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.168440:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010ae58ae/0x9383f985bc4d5eb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x474:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.168586:0:13439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d5ea9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x480:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.168595:0:13439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d5ea9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x480:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.168951:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201422.168959:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010ae58ae/0x9383f985bc4d5eb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x474:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.168967:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bca00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201422.168971:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010ae58ae/0x9383f985bc4d5eb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x474:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.168980:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010ae58ae/0x9383f985bc4d5eb7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x474:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.168995:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010ae58ae/0x9383f985bc4d5eb7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x474:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.169004:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201422.169006:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d5ea9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x480:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.169012:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201422.169015:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d5ea9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x480:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.169021:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d5ea9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x480:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.169030:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d5ea9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x480:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.169036:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201422.169038:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201422.169039:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201422.169203:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788201422.169211:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010ae58ae/0x9383f985bc4d5eb7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x474:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201422.169745:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x473:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201422.169752:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a3bf8dd/0x9383f985bc4d5ebe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x473:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.169763:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x473:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1788201422.169768:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x473:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201422.169773:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a3bf8dd/0x9383f985bc4d5ebe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x473:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.169784:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a3bf8dd/0x9383f985bc4d5ebe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x473:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.169792:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a3bf8dd/0x9383f985bc4d5ebe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x473:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.169799:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a3bf8dd/0x9383f985bc4d5ebe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x473:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.169999:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201422.170014:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201422.170020:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a3bf8dd/0x9383f985bc4d5ebe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x473:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.170028:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bda00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201422.170032:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a3bf8dd/0x9383f985bc4d5ebe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x473:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.170040:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a3bf8dd/0x9383f985bc4d5ebe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x473:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.170053:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a3bf8dd/0x9383f985bc4d5ebe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x473:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.170061:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a3bf8dd/0x9383f985bc4d5ebe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x473:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.170085:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201422.170087:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201422.170089:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201422.170485:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x472:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201422.170491:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000232c8587/0x9383f985bc4d5ec5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x472:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.170499:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x472:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1788201422.170503:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x472:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201422.170507:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000232c8587/0x9383f985bc4d5ec5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x472:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.170515:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000232c8587/0x9383f985bc4d5ec5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x472:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.170522:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000232c8587/0x9383f985bc4d5ec5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x472:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.170529:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000232c8587/0x9383f985bc4d5ec5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x472:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.170546:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201422.170819:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x471:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201422.170908:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000700c6050/0x9383f985bc4d5ecc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x471:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.170916:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x471:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1788201422.170918:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x471:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201422.170922:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000700c6050/0x9383f985bc4d5ecc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x471:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.170930:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000700c6050/0x9383f985bc4d5ecc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x471:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.170938:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000700c6050/0x9383f985bc4d5ecc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x471:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.170945:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000700c6050/0x9383f985bc4d5ecc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x471:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.170960:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788201422.170970:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201422.170974:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000232c8587/0x9383f985bc4d5ec5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x472:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.170981:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bd800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201422.170984:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000232c8587/0x9383f985bc4d5ec5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x472:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.170992:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000232c8587/0x9383f985bc4d5ec5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x472:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.171003:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000232c8587/0x9383f985bc4d5ec5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x472:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.171009:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000232c8587/0x9383f985bc4d5ec5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x472:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.171024:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201422.171027:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000700c6050/0x9383f985bc4d5ecc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x471:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.171037:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201422.171040:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000700c6050/0x9383f985bc4d5ecc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x471:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.171046:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000700c6050/0x9383f985bc4d5ecc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x471:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.171054:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000700c6050/0x9383f985bc4d5ecc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x471:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.171062:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000700c6050/0x9383f985bc4d5ecc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x471:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.171072:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201422.171073:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201422.171075:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788201422.171529:0:13445:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:1136 00000100:00100000:3.0:1788201422.171653:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:18201:x1875064458284800:12345-0@lo:5:osp-pre-1-0.0 Request processed in 51810us (51949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201422.171663:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4380 00010000:00010000:1.0:1788201422.171764:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201422.171771:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201422.173633:0:13439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788201422.173654:0:13439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006165ca28/0x9383f985bc4d5ea9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x480:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.173712:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201422.174365:0:18201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18201:1875064458284800:0@lo:5:osp-pre-1-0.0 00002000:00010000:0.0:1788201422.174738:0:13439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x47f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201422.174749:0:13439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000153b56b9/0x9383f985bc4d5ed3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x47f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.174766:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x47f:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1788201422.174771:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x47f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201422.174777:0:13439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000153b56b9/0x9383f985bc4d5ed3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x47f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.174794:0:13439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000153b56b9/0x9383f985bc4d5ed3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x47f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.174806:0:13439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000153b56b9/0x9383f985bc4d5ed3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x47f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.174814:0:13439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000153b56b9/0x9383f985bc4d5ed3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x47f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.174835:0:13439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1788201422.175552:0:18201:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x481:0x0] from OST, last_created [0x280000400:0x481:0x0]last_used is [0x280000400:0x470:0x0] 00000100:00100000:2.0:1788201422.175629:0:18201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18201:1875064458285056:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788201422.175714:0:18201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201422.175762:0:18201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341d3c0 going to sleep for 50 seconds 00000100:00100000:3.0:1788201422.175940:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458285056 00000100:00100000:3.0:1788201422.175951:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458285056 00000100:00100000:3.0:1788201422.176020:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4382 00000100:00100000:3.0:1788201422.176032:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:18201:x1875064458285056:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788201422.176102:0:13444:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1154 00002000:00010000:0.0:1788201422.176761:0:13439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x47e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201422.176771:0:13439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f0ecd86/0x9383f985bc4d5eda lrc: 3/0,1 mode: --/PW res: [0x240000400:0x47e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.176789:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x47e:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1788201422.176794:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x47e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201422.176803:0:13439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f0ecd86/0x9383f985bc4d5eda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x47e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.176819:0:13439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f0ecd86/0x9383f985bc4d5eda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x47e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.176831:0:13439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f0ecd86/0x9383f985bc4d5eda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x47e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.176847:0:13439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f0ecd86/0x9383f985bc4d5eda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x47e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.176876:0:13439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788201422.179766:0:13439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x47d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201422.179782:0:13439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0ebfad4/0x9383f985bc4d5ee1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x47d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.179805:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x47d:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1788201422.179810:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x47d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201422.179818:0:13439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0ebfad4/0x9383f985bc4d5ee1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x47d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.179835:0:13439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0ebfad4/0x9383f985bc4d5ee1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x47d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.179847:0:13439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0ebfad4/0x9383f985bc4d5ee1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x47d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.179854:0:13439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0ebfad4/0x9383f985bc4d5ee1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x47d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.179881:0:13439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788201422.181071:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201422.181086:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000153b56b9/0x9383f985bc4d5ed3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x47f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.181106:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201422.181111:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000153b56b9/0x9383f985bc4d5ed3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x47f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.181121:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000153b56b9/0x9383f985bc4d5ed3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x47f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.181146:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000153b56b9/0x9383f985bc4d5ed3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x47f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.181153:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000153b56b9/0x9383f985bc4d5ed3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x47f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.181180:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201422.181184:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f0ecd86/0x9383f985bc4d5eda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x47e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.181190:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201422.181193:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f0ecd86/0x9383f985bc4d5eda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x47e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.181201:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f0ecd86/0x9383f985bc4d5eda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x47e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.181211:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f0ecd86/0x9383f985bc4d5eda lrc: 1/0,0 mode: --/PW res: [0x240000400:0x47e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.181219:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f0ecd86/0x9383f985bc4d5eda lrc: 0/0,0 mode: --/PW res: [0x240000400:0x47e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.181232:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201422.181236:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0ebfad4/0x9383f985bc4d5ee1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x47d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.181242:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201422.181245:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0ebfad4/0x9383f985bc4d5ee1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x47d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.181252:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0ebfad4/0x9383f985bc4d5ee1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x47d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.181441:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201422.181807:0:13439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x47c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201422.181817:0:13439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e4d980a/0x9383f985bc4d5ee8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x47c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.182138:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x47c:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1788201422.182143:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x47c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201422.182150:0:13439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e4d980a/0x9383f985bc4d5ee8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x47c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.182562:0:13439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e4d980a/0x9383f985bc4d5ee8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x47c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.182572:0:13439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e4d980a/0x9383f985bc4d5ee8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x47c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.182580:0:13439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e4d980a/0x9383f985bc4d5ee8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x47c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.182890:0:13439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201422.183336:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0ebfad4/0x9383f985bc4d5ee1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x47d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.183348:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0ebfad4/0x9383f985bc4d5ee1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x47d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.183372:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201422.183376:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e4d980a/0x9383f985bc4d5ee8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x47c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.183383:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff128200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201422.183388:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e4d980a/0x9383f985bc4d5ee8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x47c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.183399:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e4d980a/0x9383f985bc4d5ee8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x47c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.183412:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e4d980a/0x9383f985bc4d5ee8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x47c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.183418:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e4d980a/0x9383f985bc4d5ee8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x47c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.183431:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201422.183433:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201422.183435:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201422.183445:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201422.183776:0:13439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x47b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201422.183783:0:13439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066520edc/0x9383f985bc4d5eef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x47b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.183794:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x47b:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1788201422.183798:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x47b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201422.183803:0:13439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066520edc/0x9383f985bc4d5eef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x47b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.183813:0:13439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066520edc/0x9383f985bc4d5eef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x47b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.183825:0:13439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066520edc/0x9383f985bc4d5eef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x47b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.183833:0:13439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066520edc/0x9383f985bc4d5eef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x47b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.183859:0:13439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201422.183885:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201422.183891:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066520edc/0x9383f985bc4d5eef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x47b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.183898:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201422.183902:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066520edc/0x9383f985bc4d5eef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x47b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.183910:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066520edc/0x9383f985bc4d5eef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x47b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.183920:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066520edc/0x9383f985bc4d5eef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x47b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.183928:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066520edc/0x9383f985bc4d5eef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x47b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.183939:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201422.183940:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201422.183941:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201422.185807:0:13439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x47a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201422.185823:0:13439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001687b5b9/0x9383f985bc4d5ef6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x47a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.185844:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x47a:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1788201422.185849:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x47a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201422.185857:0:13439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001687b5b9/0x9383f985bc4d5ef6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x47a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.185872:0:13439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001687b5b9/0x9383f985bc4d5ef6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x47a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.185884:0:13439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001687b5b9/0x9383f985bc4d5ef6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x47a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.185893:0:13439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001687b5b9/0x9383f985bc4d5ef6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x47a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.187491:0:13439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788201422.187916:0:13439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x479:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201422.187927:0:13439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008eb4b04a/0x9383f985bc4d5efd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x479:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.187945:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x479:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1788201422.187950:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x479:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201422.187957:0:13439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008eb4b04a/0x9383f985bc4d5efd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x479:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.187972:0:13439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008eb4b04a/0x9383f985bc4d5efd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x479:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.187984:0:13439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008eb4b04a/0x9383f985bc4d5efd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x479:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.187993:0:13439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008eb4b04a/0x9383f985bc4d5efd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x479:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.188018:0:13439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788201422.190767:0:13439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x478:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201422.190785:0:13439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c33f0faa/0x9383f985bc4d5f04 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x478:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.190806:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x478:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1788201422.190812:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x478:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201422.190867:0:13439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c33f0faa/0x9383f985bc4d5f04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x478:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.190887:0:13439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c33f0faa/0x9383f985bc4d5f04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x478:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.190898:0:13439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c33f0faa/0x9383f985bc4d5f04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x478:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.190907:0:13439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c33f0faa/0x9383f985bc4d5f04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x478:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.190921:0:13439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788201422.191753:0:13439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x477:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201422.191762:0:13439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0264c4b/0x9383f985bc4d5f0b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x477:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.191772:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x477:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1788201422.191776:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x477:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201422.191781:0:13439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0264c4b/0x9383f985bc4d5f0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x477:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.191794:0:13439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0264c4b/0x9383f985bc4d5f0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x477:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.191803:0:13439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0264c4b/0x9383f985bc4d5f0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x477:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.191812:0:13439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0264c4b/0x9383f985bc4d5f0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x477:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.191833:0:13439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788201422.192151:0:13439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x476:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201422.193207:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788201422.193220:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001687b5b9/0x9383f985bc4d5ef6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x47a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.193235:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff128400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201422.193242:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001687b5b9/0x9383f985bc4d5ef6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x47a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.193493:0:13439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7f7118e/0x9383f985bc4d5f12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x476:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.193506:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x476:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1788201422.193510:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x476:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201422.193516:0:13439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7f7118e/0x9383f985bc4d5f12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x476:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.193530:0:13439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7f7118e/0x9383f985bc4d5f12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x476:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.193541:0:13439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7f7118e/0x9383f985bc4d5f12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x476:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.193548:0:13439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7f7118e/0x9383f985bc4d5f12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x476:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.193560:0:13439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788201422.194074:0:13439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x475:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201422.194082:0:13439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f50aee85/0x9383f985bc4d5f19 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x475:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.194091:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x475:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1788201422.194095:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x475:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201422.194100:0:13439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f50aee85/0x9383f985bc4d5f19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x475:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.194109:0:13439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f50aee85/0x9383f985bc4d5f19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x475:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.194115:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001687b5b9/0x9383f985bc4d5ef6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x47a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.194117:0:13439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f50aee85/0x9383f985bc4d5f19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x475:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.194125:0:13439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f50aee85/0x9383f985bc4d5f19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x475:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.194133:0:13439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1788201422.194139:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001687b5b9/0x9383f985bc4d5ef6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x47a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.194149:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001687b5b9/0x9383f985bc4d5ef6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x47a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.194171:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788201422.194176:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008eb4b04a/0x9383f985bc4d5efd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x479:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.194195:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201422.194199:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008eb4b04a/0x9383f985bc4d5efd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x479:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.194207:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008eb4b04a/0x9383f985bc4d5efd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x479:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.194218:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008eb4b04a/0x9383f985bc4d5efd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x479:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.194226:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008eb4b04a/0x9383f985bc4d5efd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x479:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.194246:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788201422.194250:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c33f0faa/0x9383f985bc4d5f04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x478:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.194257:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff128600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201422.194408:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c33f0faa/0x9383f985bc4d5f04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x478:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.194418:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c33f0faa/0x9383f985bc4d5f04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x478:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.194430:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c33f0faa/0x9383f985bc4d5f04 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x478:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.194437:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c33f0faa/0x9383f985bc4d5f04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x478:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.194449:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788201422.194454:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0264c4b/0x9383f985bc4d5f0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x477:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.194460:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201422.194463:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0264c4b/0x9383f985bc4d5f0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x477:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.194477:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0264c4b/0x9383f985bc4d5f0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x477:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.194487:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0264c4b/0x9383f985bc4d5f0b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x477:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.194494:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0264c4b/0x9383f985bc4d5f0b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x477:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.194506:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201422.194510:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7f7118e/0x9383f985bc4d5f12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x476:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.194516:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201422.194519:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7f7118e/0x9383f985bc4d5f12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x476:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.194527:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7f7118e/0x9383f985bc4d5f12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x476:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.194536:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7f7118e/0x9383f985bc4d5f12 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x476:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.194544:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7f7118e/0x9383f985bc4d5f12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x476:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.194561:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201422.194565:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f50aee85/0x9383f985bc4d5f19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x475:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.194571:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201422.194574:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f50aee85/0x9383f985bc4d5f19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x475:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.194581:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f50aee85/0x9383f985bc4d5f19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x475:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.194591:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f50aee85/0x9383f985bc4d5f19 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x475:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.194598:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f50aee85/0x9383f985bc4d5f19 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x475:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.194609:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201422.194611:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201422.194613:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201422.197433:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201422.197552:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201422.198515:0:13439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x474:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201422.198530:0:13439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e9d4bc7/0x9383f985bc4d5f20 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x474:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.198553:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x474:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1788201422.198559:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x474:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201422.198566:0:13439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e9d4bc7/0x9383f985bc4d5f20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x474:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.198584:0:13439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e9d4bc7/0x9383f985bc4d5f20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x474:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.198603:0:13439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e9d4bc7/0x9383f985bc4d5f20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x474:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.198612:0:13439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e9d4bc7/0x9383f985bc4d5f20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x474:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.198636:0:13439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201422.200024:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:18201:x1875064458285056:12345-0@lo:5:osp-pre-1-0.0 Request processed in 23986us (24302us total) trans 4294968893 rc 0/0 00000100:00100000:3.0:1788201422.200038:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4382 00000100:00100000:3.0:1788201422.200115:0:18201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18201:1875064458285056:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788201422.200134:0:18201:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x481:0x0]-[0x280000400:0x4a1:0x0] 00010000:00010000:2.0:1788201422.200352:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201422.200362:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e9d4bc7/0x9383f985bc4d5f20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x474:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.200375:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201422.200381:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e9d4bc7/0x9383f985bc4d5f20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x474:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.200393:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e9d4bc7/0x9383f985bc4d5f20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x474:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.200418:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e9d4bc7/0x9383f985bc4d5f20 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x474:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.200426:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e9d4bc7/0x9383f985bc4d5f20 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x474:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.200453:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201422.200455:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201422.200457:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201422.200754:0:13439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x473:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201422.200763:0:13439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9ed0269/0x9383f985bc4d5f27 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x473:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.200776:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x473:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1788201422.200782:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x473:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201422.200789:0:13439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9ed0269/0x9383f985bc4d5f27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x473:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.200802:0:13439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9ed0269/0x9383f985bc4d5f27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x473:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.200812:0:13439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9ed0269/0x9383f985bc4d5f27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x473:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.200820:0:13439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9ed0269/0x9383f985bc4d5f27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x473:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.202587:0:13439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201422.202588:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201422.202602:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9ed0269/0x9383f985bc4d5f27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x473:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.202617:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff128a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201422.202623:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9ed0269/0x9383f985bc4d5f27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x473:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.202635:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9ed0269/0x9383f985bc4d5f27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x473:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.202659:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9ed0269/0x9383f985bc4d5f27 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x473:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.202667:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9ed0269/0x9383f985bc4d5f27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x473:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.203076:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201422.203080:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201422.203082:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201422.203750:0:13439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x472:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201422.203761:0:13439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d5f2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x472:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.203777:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x472:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1788201422.203782:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x472:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201422.203789:0:13439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d5f2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x472:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.203803:0:13439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d5f2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x472:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.203813:0:13439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d5f2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x472:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.203821:0:13439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d5f2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x472:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.203848:0:13439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201422.204176:0:13439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x471:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201422.204182:0:13439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d5f35 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x471:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.204190:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x471:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1788201422.204193:0:13439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x471:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201422.204197:0:13439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d5f35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x471:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.204206:0:13439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d5f35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x471:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.204214:0:13439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d5f35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x471:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.204222:0:13439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d5f35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x471:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.204244:0:13439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788201422.204329:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201422.204338:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d5f2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x472:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.204347:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bce00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201422.204352:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d5f2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x472:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.204361:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d5f2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x472:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.204379:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d5f2e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x472:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.204399:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d5f2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x472:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.204422:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201422.204426:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d5f35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x471:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.204433:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201422.204436:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d5f35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x471:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.204450:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d5f35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x471:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.204460:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d5f35 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x471:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.204468:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d5f35 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x471:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.204479:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201422.204480:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201422.204482:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788201422.204599:0:13439:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:1136 00000100:00100000:3.0:1788201422.204741:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:18199:x1875064458284928:12345-0@lo:5:osp-pre-0-0.0 Request processed in 82988us (84147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201422.204752:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4381 00000100:00100000:0.0:1788201422.204835:0:18199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0005180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18199:1875064458284928:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788201422.204855:0:18199:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x481:0x0] from OST, last_created [0x240000400:0x481:0x0]last_used is [0x240000400:0x470:0x0] 00000100:00100000:0.0:1788201422.204920:0:18199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2193b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18199:1875064458285184:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788201422.204968:0:18199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201422.205005:0:18199:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2fab300 going to sleep for 50 seconds 00010000:00010000:2.0:1788201422.205047:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201422.205790:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458285184 00000100:00100000:3.0:1788201422.205801:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458285184 00000100:00100000:3.0:1788201422.205902:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4383 00000100:00100000:3.0:1788201422.205913:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2191880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:18199:x1875064458285184:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788201422.205978:0:13450:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1154 00000100:00100000:3.0:1788201422.220159:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2191880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:18199:x1875064458285184:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14226us (15170us total) trans 4294968891 rc 0/0 00000100:00100000:3.0:1788201422.220178:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4383 00000100:00100000:1.0:1788201422.220845:0:18199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2193b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18199:1875064458285184:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788201422.220866:0:18199:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x481:0x0]-[0x240000400:0x4a1:0x0] 10000000:01000000:0.0:1788201422.245437:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788201422.245448:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e03c5130000 from 17 10000000:01000000:0.0:1788201422.245455:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788201422.245516:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04ff128a00/0x9383f985bc4d5f3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.245531:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e04ff128a00/0x9383f985bc4d5f3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.245549:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e04ff128a00/0x9383f985bc4d5f3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201422.245583:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2191c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458285312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201422.245670:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201422.245724:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2fab240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201422.245995:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458285312 00000100:00100000:1.0:1788201422.246005:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458285312 00000100:00100000:1.0:1788201422.246150:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788201422.246162:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c648e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+10:5855:x1875064458285312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201422.246192:0:18162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201422.246211:0:18162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e04c0030a00/0x9383f985bc4d5f43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d5f3c expref: -99 pid: 18162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.246242:0:18162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e04c0030a00/0x9383f985bc4d5f43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d5f3c expref: 11 pid: 18162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.246255:0:18162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e04c0030a00/0x9383f985bc4d5f43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d5f3c expref: 11 pid: 18162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.246277:0:18162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0030a00, rc 0) 00000100:00100000:1.0:1788201422.246429:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c648e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+11:5855:x1875064458285312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 267us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201422.246437:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788201422.246546:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2191c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458285312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201422.246566:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e04ff128a00/0x9383f985bc4d5f3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5f43 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.246576:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e04ff128a00/0x9383f985bc4d5f3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d5f43 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201422.246642:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458285440:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788201422.246682:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201422.253469:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201422.255581:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458285440 00000100:00100000:3.0:1788201422.255600:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458285440 00000100:00100000:3.0:1788201422.255693:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788201422.255704:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c648cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+11:5855:x1875064458285440:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788201422.255743:0:18163:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788201422.255768:0:18163:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788201422.255771:0:18163:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 17 00000100:00100000:3.0:1788201422.255994:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c648cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+11:5855:x1875064458285440:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 291us (9310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201422.256003:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788201422.261122:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458285440:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788201422.261350:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788201422.261365:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04ff128a00/0x9383f985bc4d5f3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5f43 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.261379:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e04ff128a00/0x9383f985bc4d5f3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5f43 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201422.261460:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788201422.261464:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e04c6b8b800 from 42 10000000:01000000:2.0:1788201422.261467:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788201422.261515:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c1b96600/0x9383f985bc4d5f4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.261525:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c1b96600/0x9383f985bc4d5f4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.261536:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c1b96600/0x9383f985bc4d5f4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201422.261562:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458285568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201422.261641:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201422.261692:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201422.262474:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458285568 00000100:00100000:2.0:1788201422.262484:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458285568 00000100:00100000:2.0:1788201422.262545:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788201422.262556:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c648c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+11:5855:x1875064458285568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201422.262579:0:18163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201422.262600:0:18163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c1b96a00/0x9383f985bc4d5f51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d5f4a expref: -99 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.262631:0:18163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c1b96a00/0x9383f985bc4d5f51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d5f4a expref: 12 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.262643:0:18163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c1b96a00/0x9383f985bc4d5f51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d5f4a expref: 12 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.262653:0:18163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c1b96a00, rc 0) 00000100:00100000:2.0:1788201422.262726:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c648c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+12:5855:x1875064458285568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201422.262735:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788201422.263353:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458285568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201422.263376:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c1b96600/0x9383f985bc4d5f4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5f51 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.263465:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c1b96600/0x9383f985bc4d5f4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d5f51 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201422.263557:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2192d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458285696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201422.263606:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201422.263648:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2fab780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201422.269677:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458285696 00000100:00100000:1.0:1788201422.269700:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458285696 00000100:00100000:1.0:1788201422.269908:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788201422.269921:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c32e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+12:5855:x1875064458285696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201422.271966:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c32e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+12:5855:x1875064458285696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2037us (8348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201422.271983:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788201422.284435:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2192d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458285696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201422.284618:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458285824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201422.284728:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201422.284781:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f44c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201422.285185:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458285824 00000100:00100000:2.0:1788201422.285194:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458285824 00000100:00100000:2.0:1788201422.285262:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788201422.285274:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c32e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+12:5855:x1875064458285824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201422.285868:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c32e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+12:5855:x1875064458285824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 594us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201422.285878:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788201422.286096:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458285824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788201422.287406:0:18245:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 42 00000020:01000000:2.0:1788201422.287636:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 42-41 (rc=0) 10000000:01000000:2.0:1788201422.287661:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788201422.287676:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c1b96600/0x9383f985bc4d5f4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5f51 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.287688:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c1b96600/0x9383f985bc4d5f4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5f51 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201422.287699:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788201422.287703:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1788201422.287706:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788201422.287752:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97000/0x9383f985bc4d5f58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.287761:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97000/0x9383f985bc4d5f58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.287772:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97000/0x9383f985bc4d5f58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201422.287801:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458285952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201422.287881:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201422.287932:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341db40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201422.289987:0:18186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458285952 00000100:00100000:3.0:1788201422.290006:0:18186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458285952 00000100:00100000:3.0:1788201422.290089:0:18186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788201422.290102:0:18186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c32e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+12:5855:x1875064458285952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201422.290127:0:18186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201422.290151:0:18186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c32bc000/0x9383f985bc4d5f5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d5f58 expref: -99 pid: 18186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.290195:0:18186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c32bc000/0x9383f985bc4d5f5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d5f58 expref: 13 pid: 18186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.290208:0:18186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c32bc000/0x9383f985bc4d5f5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d5f58 expref: 13 pid: 18186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.290219:0:18186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bc000, rc 0) 00000100:00100000:3.0:1788201422.290822:0:18186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c32e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+13:5855:x1875064458285952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 719us (2937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201422.290833:0:18186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788201422.291526:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458285952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201422.291557:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97000/0x9383f985bc4d5f58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5f5f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.291571:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97000/0x9383f985bc4d5f58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d5f5f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201422.291664:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458286080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201422.291714:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201422.291759:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341db40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201422.292420:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458286080 00000100:00100000:3.0:1788201422.292431:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458286080 00000100:00100000:3.0:1788201422.292488:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788201422.292499:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c32e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+13:5855:x1875064458286080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201422.293046:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c32e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+13:5855:x1875064458286080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 548us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201422.293055:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788201422.293150:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458286080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201422.293217:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458286208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201422.293259:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201422.293318:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341db40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201422.293710:0:18186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458286208 00000100:00100000:3.0:1788201422.293716:0:18186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458286208 00000100:00100000:3.0:1788201422.293755:0:18186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788201422.293762:0:18186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c32eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+13:5855:x1875064458286208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201422.319630:0:18186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c32eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+13:5855:x1875064458286208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 25853us (26356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201422.319649:0:18186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788201422.321048:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458286208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788201422.322930:0:18247:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 11 00000020:01000000:0.0:1788201422.323142:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1788201422.323246:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788201422.323261:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97000/0x9383f985bc4d5f58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5f5f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.323289:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97000/0x9383f985bc4d5f58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5f5f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201422.323317:0:5855:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788201422.323320:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e04c6b8b800 from 7 10000000:01000000:0.0:1788201422.323323:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201422.323374:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04ff129400/0x9383f985bc4d5f66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.323453:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e04ff129400/0x9383f985bc4d5f66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.323468:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e04ff129400/0x9383f985bc4d5f66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201422.323500:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2192d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458286336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201422.323585:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201422.323636:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2fabcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201422.324579:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458286336 00000100:00100000:1.0:1788201422.324590:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458286336 00000100:00100000:1.0:1788201422.324654:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788201422.324665:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c32ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+13:5855:x1875064458286336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201422.324685:0:18163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201422.324704:0:18163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e04c0031a00/0x9383f985bc4d5f6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d5f66 expref: -99 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.324733:0:18163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e04c0031a00/0x9383f985bc4d5f6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d5f66 expref: 14 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.324744:0:18163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e04c0031a00/0x9383f985bc4d5f6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d5f66 expref: 14 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.324753:0:18163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031a00, rc 0) 00000100:00100000:1.0:1788201422.324816:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c32ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+14:5855:x1875064458286336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201422.324822:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788201422.324876:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2192d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458286336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201422.324893:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e04ff129400/0x9383f985bc4d5f66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5f6d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.324906:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e04ff129400/0x9383f985bc4d5f66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d5f6d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201422.324976:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0004e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458286464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201422.325005:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201422.325026:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458286464 00000100:00100000:1.0:1788201422.325029:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458286464 00000100:00100000:1.0:1788201422.325050:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788201422.325056:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c32ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+14:5855:x1875064458286464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201422.325380:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c32ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+14:5855:x1875064458286464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 322us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201422.325388:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788201422.327474:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2fd9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201422.327522:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0004e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458286464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201422.327600:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2191c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458286592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201422.327681:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201422.327716:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2fabf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201422.327789:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458286592 00000100:00100000:2.0:1788201422.327797:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458286592 00000100:00100000:2.0:1788201422.327853:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788201422.327862:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c32eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+14:5855:x1875064458286592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201422.328172:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c32eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+14:5855:x1875064458286592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 310us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201422.328181:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788201422.328243:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2191c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458286592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788201422.330790:0:18248:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788201422.331142:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788201422.331248:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788201422.331264:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04ff129400/0x9383f985bc4d5f66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5f6d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.331287:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e04ff129400/0x9383f985bc4d5f66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5f6d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201422.331326:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788201422.331329:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e04f9036000 from 42 10000000:01000000:0.0:1788201422.331333:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788201422.331486:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04ff129600/0x9383f985bc4d5f74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.331496:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e04ff129600/0x9383f985bc4d5f74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.331510:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e04ff129600/0x9383f985bc4d5f74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201422.331545:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2191c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458286720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201422.331634:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201422.331683:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2fabf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201422.331935:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458286720 00000100:00100000:3.0:1788201422.331945:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458286720 00000100:00100000:3.0:1788201422.332005:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788201422.332015:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c32e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+14:5855:x1875064458286720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201422.332035:0:18161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201422.332054:0:18161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c32bd800/0x9383f985bc4d5f7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d5f74 expref: -99 pid: 18161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.332083:0:18161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c32bd800/0x9383f985bc4d5f7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d5f74 expref: 15 pid: 18161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.332095:0:18161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c32bd800/0x9383f985bc4d5f7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d5f74 expref: 15 pid: 18161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.332105:0:18161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bd800, rc 0) 00000100:00100000:3.0:1788201422.332159:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c32e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+15:5855:x1875064458286720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201422.332167:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788201422.332236:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2191c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458286720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201422.332253:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e04ff129600/0x9383f985bc4d5f74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5f7b expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.332343:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e04ff129600/0x9383f985bc4d5f74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d5f7b expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201422.332416:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458286848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201422.332447:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201422.332476:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f44000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201422.332544:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458286848 00000100:00100000:0.0:1788201422.332549:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458286848 00000100:00100000:0.0:1788201422.332579:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788201422.332586:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c32e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+15:5855:x1875064458286848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201422.332916:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c32e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+15:5855:x1875064458286848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 329us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201422.332923:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788201422.334556:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458286848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201422.334626:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458286976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201422.334708:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201422.334751:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f44000 going to sleep for 11 seconds 00000100:00100000:2.0:1788201422.335246:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458286976 00000100:00100000:2.0:1788201422.335255:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458286976 00000100:00100000:2.0:1788201422.335337:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788201422.335349:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+15:5855:x1875064458286976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201422.335721:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+15:5855:x1875064458286976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 373us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201422.335731:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788201422.336141:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458286976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201422.339049:0:18249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 42 00000020:01000000:3.0:1788201422.339233:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 42-41 (rc=0) 10000000:01000000:3.0:1788201422.339272:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788201422.339326:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04ff129600/0x9383f985bc4d5f74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5f7b expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.339341:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e04ff129600/0x9383f985bc4d5f74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5f7b expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201422.339353:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788201422.339357:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1788201422.339360:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788201422.339412:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c32bda00/0x9383f985bc4d5f82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.339422:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c32bda00/0x9383f985bc4d5f82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.339435:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c32bda00/0x9383f985bc4d5f82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201422.339469:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458287104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201422.339558:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201422.339607:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f44000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201422.342984:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458287104 00000100:00100000:1.0:1788201422.343004:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458287104 00000100:00100000:1.0:1788201422.343078:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788201422.343089:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+15:5855:x1875064458287104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201422.343113:0:18162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201422.343136:0:18162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e04c0031400/0x9383f985bc4d5f89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d5f82 expref: -99 pid: 18162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.343172:0:18162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e04c0031400/0x9383f985bc4d5f89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d5f82 expref: 16 pid: 18162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.343425:0:18162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e04c0031400/0x9383f985bc4d5f89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d5f82 expref: 16 pid: 18162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.343444:0:18162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031400, rc 0) 00000100:00100000:1.0:1788201422.343551:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+16:5855:x1875064458287104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 462us (3991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201422.343558:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788201422.343670:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458287104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201422.343694:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c32bda00/0x9383f985bc4d5f82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5f89 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.343706:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c32bda00/0x9383f985bc4d5f82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d5f89 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201422.343802:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458287232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201422.343843:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201422.343880:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f44000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201422.343939:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458287232 00000100:00100000:1.0:1788201422.343944:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458287232 00000100:00100000:1.0:1788201422.344004:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788201422.344011:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+16:5855:x1875064458287232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201422.344684:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+16:5855:x1875064458287232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 671us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201422.344693:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788201422.347982:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458287232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201422.348069:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458287360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201422.348163:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201422.348361:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f44000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201422.348387:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458287360 00000100:00100000:3.0:1788201422.348396:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458287360 00000100:00100000:3.0:1788201422.348455:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788201422.348466:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+16:5855:x1875064458287360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00000400:3.0:1788201422.373746:0:3313:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201405/real 1788201405] req@ffff9e03c12d0e00 x1875064458274688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201421 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201422.373792:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e03c12d0e00 x1875064458274688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201421 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201422.373801:0:3313:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff9e04ff4ba000 already not connected (conn 11, was 9): CONNECTING 00000100:00000400:3.0:1788201422.373809:0:3313:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201405/real 1788201405] req@ffff9e03c12d2a00 x1875064458274816/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201421 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201422.373820:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e03c12d2a00 x1875064458274816/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201421 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201422.373831:0:3313:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff9e04f5751000 already not connected (conn 11, was 9): CONNECTING 00000100:00100000:3.0:1788201422.373852:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458274688:0@lo:400:kworker.0 00000100:00100000:3.0:1788201422.373859:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458274816:0@lo:400:kworker.0 00000100:00100000:3.0:1788201422.388899:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458287360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201422.388927:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+16:5855:x1875064458287360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 40352us (40654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201422.388959:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000040:00080000:0.0:1788201422.394337:0:18251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 14 00000020:01000000:3.0:1788201422.394522:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1788201422.394562:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788201422.394577:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c32bda00/0x9383f985bc4d5f82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5f89 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.394591:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c32bda00/0x9383f985bc4d5f82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5f89 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201422.394603:0:5855:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788201422.394606:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9e04c6718000 from 1 10000000:01000000:3.0:1788201422.394609:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788201422.394669:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c32bca00/0x9383f985bc4d5f90 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.394679:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c32bca00/0x9383f985bc4d5f90 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.394693:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c32bca00/0x9383f985bc4d5f90 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201422.394727:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458287488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201422.394819:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201422.394884:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f44000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201422.394954:0:18186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458287488 00000100:00100000:0.0:1788201422.394966:0:18186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458287488 00000100:00100000:0.0:1788201422.395142:0:18186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788201422.395154:0:18186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+16:5855:x1875064458287488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201422.395239:0:18186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201422.395261:0:18186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e04ff129200/0x9383f985bc4d5f97 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d5f90 expref: -99 pid: 18186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.395353:0:18186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e04ff129200/0x9383f985bc4d5f97 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d5f90 expref: 17 pid: 18186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.395366:0:18186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e04ff129200/0x9383f985bc4d5f97 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d5f90 expref: 17 pid: 18186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201422.395375:0:18186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04ff129200, rc 0) 00000100:00100000:0.0:1788201422.395462:0:18186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+17:5855:x1875064458287488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 310us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201422.395471:0:18186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788201422.395535:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458287488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201422.395558:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c32bca00/0x9383f985bc4d5f90 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5f97 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.395568:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c32bca00/0x9383f985bc4d5f90 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d5f97 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201422.395592:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788201422.395596:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c32bca00/0x9383f985bc4d5f90 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5f97 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.395604:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c32bca00/0x9383f985bc4d5f90 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5f97 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201422.395611:0:5855:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788201422.395615:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e04f9036000 from 7 10000000:01000000:1.0:1788201422.395617:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788201422.395640:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04c0031800/0x9383f985bc4d5f9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.395648:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e04c0031800/0x9383f985bc4d5f9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.395656:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e04c0031800/0x9383f985bc4d5f9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201422.395672:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0005f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458287616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201422.395714:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201422.395756:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2fd9840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201422.395881:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458287616 00000100:00100000:2.0:1788201422.395888:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458287616 00000100:00100000:2.0:1788201422.395945:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788201422.395955:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+17:5855:x1875064458287616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201422.395969:0:18161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201422.395984:0:18161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c131ee00/0x9383f985bc4d5fa5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d5f9e expref: -99 pid: 18161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.396006:0:18161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c131ee00/0x9383f985bc4d5fa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d5f9e expref: 18 pid: 18161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.396015:0:18161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c131ee00/0x9383f985bc4d5fa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d5f9e expref: 18 pid: 18161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.396024:0:18161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c131ee00, rc 0) 00000100:00100000:2.0:1788201422.396569:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+18:5855:x1875064458287616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 613us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201422.396577:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788201422.396682:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0005f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458287616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201422.396697:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e04c0031800/0x9383f985bc4d5f9e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5fa5 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.396707:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e04c0031800/0x9383f985bc4d5f9e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d5fa5 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201422.396774:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0005f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458287744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201422.396807:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201422.396834:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2fd9840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201422.396883:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458287744 00000100:00100000:0.0:1788201422.396889:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458287744 00000100:00100000:0.0:1788201422.396925:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788201422.396932:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+18:5855:x1875064458287744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201422.397424:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+18:5855:x1875064458287744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 491us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201422.397432:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788201422.397516:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0005f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458287744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201422.397554:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0005f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458287872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201422.397599:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201422.397626:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2fd9840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201422.397678:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458287872 00000100:00100000:0.0:1788201422.397682:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458287872 00000100:00100000:0.0:1788201422.397713:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788201422.397720:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+18:5855:x1875064458287872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201422.397872:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+18:5855:x1875064458287872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201422.397879:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788201422.398145:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0005f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458287872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201422.409224:0:18252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788201422.409560:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788201422.409592:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788201422.409606:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04c0031800/0x9383f985bc4d5f9e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5fa5 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.409620:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e04c0031800/0x9383f985bc4d5f9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5fa5 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201422.409631:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788201422.409644:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9e04c6718000 from 1 10000000:01000000:2.0:1788201422.409648:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788201422.409702:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c131f200/0x9383f985bc4d5fac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.409713:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c131f200/0x9383f985bc4d5fac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.409726:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c131f200/0x9383f985bc4d5fac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201422.409760:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458288000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201422.409849:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201422.409903:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201422.410317:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458288000 00000100:00100000:1.0:1788201422.410328:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458288000 00000100:00100000:1.0:1788201422.410389:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788201422.410402:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+18:5855:x1875064458288000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201422.410424:0:18162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201422.410441:0:18162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e04c0031000/0x9383f985bc4d5fb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d5fac expref: -99 pid: 18162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.410473:0:18162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e04c0031000/0x9383f985bc4d5fb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d5fac expref: 19 pid: 18162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.410485:0:18162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e04c0031000/0x9383f985bc4d5fb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d5fac expref: 19 pid: 18162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201422.410495:0:18162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031000, rc 0) 00000100:00100000:1.0:1788201422.410548:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:5855:x1875064458288000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201422.410554:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788201422.410754:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458288000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201422.410772:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c131f200/0x9383f985bc4d5fac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5fb3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.410782:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c131f200/0x9383f985bc4d5fac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d5fb3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201422.410852:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458288128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201422.410887:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201422.410915:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201422.410931:0:18186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458288128 00000100:00100000:2.0:1788201422.410935:0:18186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458288128 00000100:00100000:2.0:1788201422.410973:0:18186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788201422.410981:0:18186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:5855:x1875064458288128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201422.411347:0:18186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:5855:x1875064458288128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 366us (458us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201422.411355:0:18186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788201422.411392:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458288128:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788201422.411424:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788201422.411432:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c131f200/0x9383f985bc4d5fac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5fb3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201422.411440:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c131f200/0x9383f985bc4d5fac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5fb3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201422.759436:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201423.783837:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201424.815202:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788201425.264391:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201425.264398:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201425.264401:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201425.264404:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201425.264430:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788201425.264434:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201425.264438:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e04fae23800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201425.264451:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e04fae23800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1788201425.264475:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e04c12a8700 x1875064458288640/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201425.264564:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458288384:0@lo:400:kworker.0 00000100:00100000:2.0:1788201425.264640:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201425.264699:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201425.264706:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458288256:0@lo:400:kworker.0 00000100:00100000:2.0:1788201425.264738:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201425.264765:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201425.264773:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458288512:0@lo:400:kworker.0 00000100:00100000:2.0:1788201425.264800:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201425.264829:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458288384 00000100:00100000:2.0:1788201425.264836:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458288384 00000100:00100000:2.0:1788201425.264887:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458288512 00000100:00100000:2.0:1788201425.264890:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458288512 00000100:00100000:2.0:1788201425.264914:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788201425.264923:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3311:x1875064458288384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201425.264979:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3311:x1875064458288384:12345-0@lo:400:kworker.0 Request processed in 57us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201425.264987:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788201425.265003:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788201425.265010:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3313:x1875064458288512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201425.265043:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3313:x1875064458288512:12345-0@lo:400:kworker.0 Request processed in 33us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201425.265048:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788201425.265098:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458288512:0@lo:400:kworker.0 00000100:00100000:2.0:1788201425.265124:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458288384:0@lo:400:kworker.0 00000100:00080000:0.0:1788201425.265929:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201425.265935:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201425.269957:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875064458288640:0@lo:38:kworker.0 00000100:00100000:1.0:1788201425.270038:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201425.270105:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458288256 00000100:00100000:1.0:1788201425.270113:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458288256 00000100:00100000:1.0:1788201425.270166:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788201425.270175:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458288256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201425.270246:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458288256:12345-0@lo:400:kworker.0 Request processed in 72us (5507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201425.270254:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788201425.270331:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458288256:0@lo:400:kworker.0 00000100:00100000:3.0:1788201425.272549:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458288640 00000100:00100000:3.0:1788201425.272562:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458288640 00000100:00100000:3.0:1788201425.272619:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788201425.272626:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1875064458288640:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788201425.272656:0:18176:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 700 last 0 00000020:00000080:3.0:1788201425.272739:0:18176:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9383f985bc4d5fba 00000004:00100000:3.0:1788201425.272755:0:18176:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788201425.272889:0:18176:0:(import.c:65:import_set_state_nolock()) ffff9e03c1e1a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201425.275202:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875064458288640:12345-0@lo:38:kworker.0 Request processed in 2568us (5157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201425.275219:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788201425.284047:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 5 00000100:00080000:0.0:1788201425.284062:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788201425.284069:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788201425.284072:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04fae23800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788201425.284082:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875064458288640:0@lo:38:kworker.0 00000100:00100000:3.0:1788201425.809807:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201425.809845:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201425.809873:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201425.809914:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442763136 00000100:00100000:3.0:1788201425.809923:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442763136 00000100:00100000:3.0:1788201425.809988:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 256 00000100:00100000:3.0:1788201425.810000:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2359:x1875064442763136:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201425.810075:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2359:x1875064442763136:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 76us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201425.810082:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 256 00000100:00100000:3.0:1788201425.810105:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442763008 00000100:00100000:3.0:1788201425.810109:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442763008 00000100:00100000:3.0:1788201425.810139:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:3.0:1788201425.810146:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2359:x1875064442763008:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201425.810177:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2359:x1875064442763008:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 32us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201425.810183:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00080000:3.0:1788201425.810199:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201425.810204:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201425.811579:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442762880 00000100:00100000:1.0:1788201425.811591:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442762880 00000100:00100000:1.0:1788201425.811643:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00100000:1.0:1788201425.811652:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2a19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442762880:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201425.811713:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2a19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442762880:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 61us (1915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201425.811720:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 64 00010000:00010000:3.0:1788201425.835725:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201426.157647:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458288768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201426.157814:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201426.157900:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458288768 00000100:00100000:2.0:1788201426.157909:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458288768 00000100:00100000:2.0:1788201426.157968:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788201426.157980:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875064458288768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201426.158033:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 36110336 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201426.158086:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875064458288768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201426.158094:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788201426.158157:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458288768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201426.159476:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201426.159503:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458288896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201426.159574:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201426.160851:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458288896 00000100:00100000:0.0:1788201426.160866:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458288896 00000100:00100000:0.0:1788201426.160938:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788201426.160948:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875064458288896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201426.160995:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1788201426.161077:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875064458288896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (1503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201426.161084:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788201426.161207:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458288896:0@lo:13:osp-pre-0-0.0 00000100:00000400:0.0:1788201426.267504:0:3312:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201410/real 1788201410] req@ffff9e03c1ba2300 x1875064458275200/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201426 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000400:3.0:1788201426.268279:0:3310:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201410/real 1788201410] req@ffff9e03c1ba3480 x1875064458275072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201426 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201426.268369:0:3312:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e03c1ba2300 x1875064458275200/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201426 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201426.269636:0:3312:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff9e04f5751000 already not connected (conn 11, was 9): CONNECTING 00000100:00100000:0.0:1788201426.269672:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1ba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458275200:0@lo:400:kworker.0 00000100:00100000:3.0:1788201426.277689:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e03c1ba3480 x1875064458275072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201426 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201426.277708:0:3310:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff9e04ff4ba000 already not connected (conn 11, was 9): CONNECTING 00000100:00100000:3.0:1788201426.277731:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1ba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875064458275072:0@lo:400:kworker.0 00010000:00010000:0.0:1788201426.880261:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788201426.889770:0:6732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294968891 is committed 00000001:00080000:3.0:1788201426.890767:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968893 is committed 00000001:02000400:2.0:1788201427.266080:0:18465:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788201427.941539:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201428.972193:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201429.989487:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788201430.760249:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201430.760256:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201430.760259:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201430.760263:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788201430.760369:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458289280:0@lo:400:kworker.0 00000100:00100000:2.0:1788201430.760441:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201430.760587:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458289024:0@lo:400:kworker.0 00000100:00100000:3.0:1788201430.760625:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201430.760660:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458289280 00000100:00100000:3.0:1788201430.760668:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458289280 00000100:00100000:3.0:1788201430.760726:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788201430.760734:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458289280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201430.760784:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458289280:12345-0@lo:400:kworker.0 Request processed in 51us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201430.760791:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788201430.760814:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458289024 00000100:00100000:3.0:1788201430.760817:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458289024 00000100:00100000:3.0:1788201430.760841:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788201430.760848:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2a18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458289024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201430.760881:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2a18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458289024:12345-0@lo:400:kworker.0 Request processed in 34us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201430.760887:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1788201430.760915:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201430.761011:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875064458289408:0@lo:400:kworker.0 00000100:00100000:0.0:1788201430.761047:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201430.761150:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458289152:0@lo:400:kworker.0 00000100:00100000:1.0:1788201430.761179:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201430.761586:0:18175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458289408 00000100:00100000:3.0:1788201430.761592:0:18175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458289408 00000100:00100000:3.0:1788201430.761634:0:18175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788201430.761642:0:18175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875064458289408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201430.761682:0:18175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875064458289408:12345-0@lo:400:kworker.0 Request processed in 41us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201430.761688:0:18175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788201430.761920:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968893 gen 2 00000100:00100000:2.0:1788201430.761939:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458289280:0@lo:400:kworker.0 00000100:00100000:0.0:1788201430.768116:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458289152 00000100:00100000:0.0:1788201430.768141:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458289152 00000100:00100000:0.0:1788201430.768231:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788201430.768245:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458289152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201430.768392:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458289152:12345-0@lo:400:kworker.0 Request processed in 151us (7210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201430.768400:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00080000:2.0:1788201430.768727:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201430.768895:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458289024:0@lo:400:kworker.0 00000100:00100000:0.0:1788201430.776923:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875064458289408:0@lo:400:kworker.0 00000100:00100000:1.0:1788201430.777035:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968891 gen 2 00000100:00100000:1.0:1788201430.777050:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458289152:0@lo:400:kworker.0 00000100:00100000:3.0:1788201430.928640:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201430.928688:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201430.928801:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201430.928837:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442763392 00000100:00100000:2.0:1788201430.929033:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442763520 00000100:00100000:2.0:1788201430.929044:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442763520 00000100:00100000:2.0:1788201430.929112:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 259 00000100:00100000:2.0:1788201430.929143:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2360:x1875064442763520:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201430.929219:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2360:x1875064442763520:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 78us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201430.929227:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 259 00000100:00080000:2.0:1788201430.929252:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201430.929738:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442763392 00000100:00100000:3.0:1788201430.929807:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:3.0:1788201430.929817:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442763392:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201430.930071:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442763392:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 253us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201430.930079:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:0.0:1788201430.930236:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442763264 00000100:00100000:0.0:1788201430.930242:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442763264 00000100:00100000:0.0:1788201430.930285:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 66 00000100:00100000:0.0:1788201430.930317:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2a1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442763264:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201430.930350:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2a1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442763264:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 59us (1722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201430.930357:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 66 00000100:00080000:2.0:1788201430.930985:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788201431.019663:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201431.270104:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201431.270148:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458289536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201431.270250:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201431.270391:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458289536 00000100:00100000:3.0:1788201431.270402:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458289536 00000100:00100000:3.0:1788201431.270480:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788201431.270492:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458289536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201431.270543:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 36110336 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201431.270601:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458289536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201431.270609:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788201431.270928:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458289536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201431.271175:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0005880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458289664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201431.271215:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201431.271477:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458289664 00000100:00100000:1.0:1788201431.271484:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458289664 00000100:00100000:1.0:1788201431.271525:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788201431.271533:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458289664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201431.271562:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1788201431.271610:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458289664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201431.271618:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788201431.271692:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0005880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458289664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201431.527780:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201431.527909:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442763648 00000100:00100000:1.0:1788201431.527920:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442763648 00000100:00100000:1.0:1788201431.527987:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:1.0:1788201431.527998:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:18160:x1875064442763648:12345-192.168.201.30@tcp:41:lfs.0 00000004:00000024:1.0:1788201431.528055:0:18173:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788201431.528157:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:18160:x1875064442763648:12345-192.168.201.30@tcp:41:lfs.0 Request processed in 160us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201431.528166:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:1.0:1788201431.537238:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201431.537421:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442763776 00000100:00100000:2.0:1788201431.537433:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442763776 00000100:00100000:2.0:1788201431.537502:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 186 00000100:00100000:2.0:1788201431.537513:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:18160:x1875064442763776:12345-192.168.201.30@tcp:13:lfs.0 00002000:00000024:2.0:1788201431.537540:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1788201431.537623:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:18160:x1875064442763776:12345-192.168.201.30@tcp:13:lfs.0 Request processed in 111us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201431.537631:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 186 00000100:00100000:2.0:1788201431.542904:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201431.543014:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442763904 00000100:00100000:1.0:1788201431.543024:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442763904 00000100:00100000:1.0:1788201431.543072:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4384 00000100:00100000:1.0:1788201431.543080:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:2358:x1875064442763904:12345-192.168.201.30@tcp:8:lfs.0 00010000:00080000:1.0:1788201431.543115:0:13447:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp t0 exp 0000000000000000 cur 706 last 0 00000020:00000080:1.0:1788201431.543157:0:13447:0:(genops.c:1406:class_connect()) connect: client 35604eb4-baf9-45be-a20a-4883a2cd8cf9, cookie 0x9383f985bc4d5fc1 00002000:00100000:1.0:1788201431.543171:0:13447:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 35604eb4-baf9-45be-a20a-4883a2cd8cf9/ffff9e04fae26800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 488505344 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788201431.543182:0:13447:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 77, return 77 00002000:00080000:1.0:1788201431.543613:0:13447:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788201431.543647:0:13447:0:(import.c:65:import_set_state_nolock()) ffff9e04fae25800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201431.543728:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2358:x1875064442763904:12345-192.168.201.30@tcp:8:lfs.0 Request processed in 647us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201431.543737:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4384 00000100:00100000:3.0:1788201431.545638:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201431.545812:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442764032 00000100:00100000:2.0:1788201431.545823:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442764032 00000100:00100000:2.0:1788201431.545913:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 187 00000100:00100000:2.0:1788201431.545924:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:18160:x1875064442764032:12345-192.168.201.30@tcp:13:lfs.0 00002000:00000024:2.0:1788201431.545955:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 39518208 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201431.546034:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:18160:x1875064442764032:12345-192.168.201.30@tcp:13:lfs.0 Request processed in 112us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201431.546042:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 187 00000100:00080000:0.0:1788201431.546183:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:2.0:1788201431.947937:0:7657:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 35604eb4-baf9-45be-a20a-4883a2cd8cf9 00010000:00010000:3.0:1788201432.037623:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201433.066780:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201434.085605:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201435.133534:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201435.558761:0:3309:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201420/real 1788201420] req@ffff9e03c12d0000 x1875064458275968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201435 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201435.558807:0:3309:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e03c12d0000 x1875064458275968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201435 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201435.558819:0:3309:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201420/real 1788201420] req@ffff9e03c12d1c00 x1875064458275840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201435 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201435.558833:0:3309:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e03c12d1c00 x1875064458275840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201435 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201435.558857:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201435.558879:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788201435.558885:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875064458275968:0@lo:38:kworker.0 00000100:00080000:0.0:1788201435.558892:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201435.558898:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788201435.558901:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875064458275840:0@lo:38:kworker.0 00000100:00080000:0.0:1788201435.559009:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201435.559014:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201435.559017:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201435.559023:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 695 00000100:00080000:0.0:1788201435.559030:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788201435.559038:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e04ff4ba000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1788201435.559073:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e03c2192680 x1875064458289920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201435.559088:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201435.559091:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201435.559094:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201435.559097:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 695 00000100:00080000:0.0:1788201435.559100:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788201435.559103:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e04f5751000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1788201435.559116:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e03c2190700 x1875064458290048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201435.559181:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2192300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458290432:0@lo:400:kworker.0 00000100:00100000:0.0:1788201435.559264:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201435.559345:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201435.559351:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2191f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458289792:0@lo:400:kworker.0 00000100:00100000:0.0:1788201435.559381:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201435.559414:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458290176:0@lo:400:kworker.0 00000100:00100000:0.0:1788201435.559457:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201435.559481:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201435.559488:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2193100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458290304:0@lo:400:kworker.0 00000100:00100000:0.0:1788201435.559510:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201435.559544:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458290176 00000100:00100000:0.0:1788201435.559553:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458290176 00000100:00100000:0.0:1788201435.559611:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458290304 00000100:00100000:0.0:1788201435.559614:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458290304 00000100:00100000:0.0:1788201435.559641:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788201435.559656:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458290176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201435.559723:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458290176:12345-0@lo:400:kworker.0 Request processed in 72us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201435.559731:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788201435.559752:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788201435.559759:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2191500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458290304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201435.559790:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2191500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458290304:12345-0@lo:400:kworker.0 Request processed in 31us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201435.559796:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00080000:0.0:1788201435.559814:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201435.559819:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201435.559854:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2193100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458290304:0@lo:400:kworker.0 00000100:00100000:0.0:1788201435.559865:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458290176:0@lo:400:kworker.0 00000100:00100000:0.0:1788201435.559885:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875064458289920:0@lo:38:kworker.0 00000100:00100000:0.0:1788201435.559913:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201435.559934:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2190700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875064458290048:0@lo:38:kworker.0 00000100:00100000:0.0:1788201435.559956:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201435.560064:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458290432 00000100:00100000:1.0:1788201435.560072:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458290432 00000100:00100000:1.0:1788201435.560103:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458289920 00000100:00100000:1.0:1788201435.560105:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458289920 00000100:00100000:1.0:1788201435.560114:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458290048 00000100:00100000:1.0:1788201435.560117:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458290048 00000100:00100000:1.0:1788201435.560140:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201435.560148:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458290432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201435.560524:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458290432:12345-0@lo:400:kworker.0 Request processed in 376us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201435.560532:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201435.560550:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788201435.560554:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875064458289920:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788201435.560583:0:18173:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 710 last 0 00000020:00000080:1.0:1788201435.560630:0:18173:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9383f985bc4d5fc8 00000004:00100000:1.0:1788201435.560650:0:18173:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788201435.560688:0:18173:0:(import.c:65:import_set_state_nolock()) ffff9e04fae21000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201435.560796:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2192300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458290432:0@lo:400:kworker.0 00000100:00100000:1.0:1788201435.560797:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875064458289920:12345-0@lo:38:kworker.0 Request processed in 237us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201435.560811:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788201435.560828:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788201435.560833:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875064458290048:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788201435.560847:0:18173:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 710 last 0 00000020:00000080:1.0:1788201435.560875:0:18173:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9383f985bc4d5fcf 00000004:00100000:1.0:1788201435.560881:0:18173:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788201435.560899:0:18173:0:(import.c:65:import_set_state_nolock()) ffff9e04c6b8b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201435.560927:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875064458290048:12345-0@lo:38:kworker.0 Request processed in 92us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201435.560993:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788201435.561026:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 5 00000100:00100000:3.0:1788201435.561130:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458289792 00000100:00100000:3.0:1788201435.561138:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458289792 00000100:00100000:3.0:1788201435.561193:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788201435.561201:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2a19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3312:x1875064458289792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201435.561247:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2a19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3312:x1875064458289792:12345-0@lo:400:kworker.0 Request processed in 47us (1864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201435.561254:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1788201435.564251:0:3309:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9e03c2192680 x1875064458289920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201455 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788201435.564357:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1788201435.564366:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201435.564398:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2191f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458289792:0@lo:400:kworker.0 00000100:02000000:1.0:1788201435.564597:0:3309:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788201435.574405:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875064458289920:0@lo:38:kworker.0 00000100:00080000:1.0:1788201435.574679:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 5 00000100:00080000:1.0:1788201435.580196:0:3309:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9e03c2190700 x1875064458290048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201455 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788201435.580212:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1788201435.580218:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788201435.580223:0:3309:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788201435.580230:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2190700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875064458290048:0@lo:38:kworker.0 00000100:00100000:2.0:1788201436.048687:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201436.048733:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201436.048771:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201436.048820:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201436.048855:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442764416 00000100:00100000:2.0:1788201436.048866:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442764416 00000100:00100000:1.0:1788201436.049022:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442764288 00000100:00100000:1.0:1788201436.049026:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442764288 00000100:00100000:1.0:1788201436.049075:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:1.0:1788201436.049087:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2362:x1875064442764288:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201436.049162:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2362:x1875064442764288:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 78us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201436.049170:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00080000:1.0:1788201436.049214:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201436.049219:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201436.049235:0:13451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442764544 00000100:00100000:1.0:1788201436.049238:0:13451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442764544 00000100:00100000:1.0:1788201436.049270:0:13451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 262 00000100:00100000:1.0:1788201436.049278:0:13451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2362:x1875064442764416:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201436.049337:0:13451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2362:x1875064442764416:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 60us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201436.049344:0:13451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 262 00000100:00100000:1.0:1788201436.049359:0:13451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 263 00000100:00100000:1.0:1788201436.049366:0:13451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2362:x1875064442764544:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201436.049390:0:13451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2362:x1875064442764544:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201436.049396:0:13451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 263 00000100:00080000:1.0:1788201436.049412:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201436.049536:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442764160 00000100:00100000:0.0:1788201436.049542:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442764160 00000100:00100000:0.0:1788201436.049582:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 68 00000100:00100000:0.0:1788201436.049589:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2a1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442764160:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201436.049619:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2a1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442764160:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 31us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201436.049624:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 68 00010000:00010000:2.0:1788201436.134840:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201436.389644:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458290560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201436.389732:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201436.390563:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458290560 00000100:00100000:1.0:1788201436.390573:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458290560 00000100:00100000:1.0:1788201436.390640:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788201436.390650:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458290560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201436.390688:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1788201436.390763:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458290560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201436.390770:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788201436.390876:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458290560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201436.391109:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458290688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201436.391146:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201436.391423:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458290688 00000100:00100000:3.0:1788201436.391429:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458290688 00000100:00100000:3.0:1788201436.391481:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788201436.391490:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458290688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201436.391515:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 39518208 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201436.391563:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458290688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201436.391570:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788201436.391642:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458290688:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788201437.157558:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201438.062638:0:18764:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:3.0:1788201438.181464:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201439.213966:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201440.224677:0:18812:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:1.0:1788201440.229520:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201440.998612:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458291200:0@lo:400:kworker.0 00000100:00100000:2.0:1788201440.998689:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458290944:0@lo:400:kworker.0 00000100:00100000:3.0:1788201440.998698:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201440.998774:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458290816:0@lo:400:kworker.0 00000100:00100000:1.0:1788201440.998948:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458291200 00000100:00100000:1.0:1788201440.998965:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458291200 00000100:00100000:1.0:1788201440.999031:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788201440.999041:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458291200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201441.011675:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201441.011762:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458291456:0@lo:400:kworker.0 00000100:00100000:2.0:1788201441.011829:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201441.011875:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201441.011883:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458291072:0@lo:400:kworker.0 00000100:00100000:2.0:1788201441.011902:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201441.011938:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458290944 00000100:00100000:2.0:1788201441.011945:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458290944 00000100:00100000:2.0:1788201441.011998:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458291456 00000100:00100000:2.0:1788201441.012002:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458291456 00000100:00100000:2.0:1788201441.012017:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458291072 00000100:00100000:2.0:1788201441.012019:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458291072 00000100:00100000:2.0:1788201441.012038:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788201441.012047:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458290944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201441.012105:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458290944:12345-0@lo:400:kworker.0 Request processed in 58us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201441.012113:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788201441.012131:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788201441.012136:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458291456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201441.012164:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458291456:12345-0@lo:400:kworker.0 Request processed in 28us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201441.012171:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788201441.012183:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788201441.012190:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458291072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201441.012215:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458291072:12345-0@lo:400:kworker.0 Request processed in 27us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201441.012221:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788201441.012264:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458291072:0@lo:400:kworker.0 00000100:00100000:2.0:1788201441.012312:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458290944:0@lo:400:kworker.0 00000100:00100000:2.0:1788201441.012324:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458291456:0@lo:400:kworker.0 00000100:00080000:2.0:1788201441.012486:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201441.012491:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201441.013224:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201441.013432:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458291328:0@lo:400:kworker.0 00000100:00100000:0.0:1788201441.013478:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201441.013519:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458291328 00000100:00100000:0.0:1788201441.013527:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458291328 00000100:00100000:0.0:1788201441.013594:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788201441.013603:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458291328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201441.013650:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458291328:12345-0@lo:400:kworker.0 Request processed in 47us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201441.013657:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:0.0:1788201441.013678:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201441.013703:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458291328:0@lo:400:kworker.0 00000100:00100000:2.0:1788201441.014697:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458290816 00000100:00100000:2.0:1788201441.014705:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458290816 00000100:00100000:2.0:1788201441.014755:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788201441.014765:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1d50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458290816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201441.015341:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1d50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458290816:12345-0@lo:400:kworker.0 Request processed in 576us (2118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201441.015350:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788201441.015390:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458290816:0@lo:400:kworker.0 00000100:00100000:1.0:1788201441.016901:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458291200:12345-0@lo:400:kworker.0 Request processed in 17854us (18200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201441.016918:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788201441.016968:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458291200:0@lo:400:kworker.0 00000100:00100000:1.0:1788201441.169556:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201441.169604:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201441.169639:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201441.169674:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201441.169712:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442765056 00000100:00100000:1.0:1788201441.169721:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442765056 00000100:00100000:1.0:1788201441.169793:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442764928 00000100:00100000:1.0:1788201441.169807:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442764928 00000100:00100000:0.0:1788201441.169813:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442764672 00000100:00100000:0.0:1788201441.169817:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442764672 00000100:00100000:1.0:1788201441.169835:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 266 00000100:00100000:1.0:1788201441.169845:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2361:x1875064442765056:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201441.169855:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:0.0:1788201441.169861:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1d51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2361:x1875064442764672:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201441.169910:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1d51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2361:x1875064442764672:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 49us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201441.169920:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00080000:0.0:1788201441.169961:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201441.169965:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201441.169996:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 267 00000100:00100000:0.0:1788201441.170008:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2361:x1875064442764928:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201441.170084:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442764800 00000100:00100000:3.0:1788201441.170089:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442764800 00000100:00100000:3.0:1788201441.170130:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:3.0:1788201441.170139:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2361:x1875064442764800:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201441.174626:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2361:x1875064442765056:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 4763us (5002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201441.174645:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 266 00000100:00080000:1.0:1788201441.175575:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201441.181710:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2361:x1875064442764928:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 11685us (12018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201441.181730:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 267 00000100:00100000:3.0:1788201441.182560:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2361:x1875064442764800:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 12416us (13007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201441.182572:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00010000:00010000:3.0:1788201441.253512:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201441.510883:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458291584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201441.510963:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201441.511172:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458291712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201441.511197:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201441.511281:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458291584 00000100:00100000:1.0:1788201441.511289:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458291584 00000100:00100000:1.0:1788201441.511363:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458291712 00000100:00100000:1.0:1788201441.511366:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458291712 00000100:00100000:1.0:1788201441.511380:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788201441.511388:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0004e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458291584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201441.511422:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 39518208 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201441.511730:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788201441.511740:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458291712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201441.511767:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1788201441.511804:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458291712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201441.511811:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788201441.511855:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458291712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201441.512049:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0004e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458291584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 661us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201441.512056:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788201441.512092:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458291584:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788201442.277716:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201442.348423:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201442.348693:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442765184 00000100:00100000:2.0:1788201442.348708:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442765184 00000100:00100000:2.0:1788201442.348783:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:2.0:1788201442.348795:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:18624:x1875064442765184:12345-192.168.201.30@tcp:41:lfs.0 00000004:00000024:2.0:1788201442.348872:0:18173:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788201442.348979:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:18624:x1875064442765184:12345-192.168.201.30@tcp:41:lfs.0 Request processed in 185us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201442.348987:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:2.0:1788201442.364124:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201442.370454:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442765312 00000100:00100000:1.0:1788201442.370478:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442765312 00000100:00100000:1.0:1788201442.370647:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 192 00000100:00100000:1.0:1788201442.370662:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0004a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:18624:x1875064442765312:12345-192.168.201.30@tcp:13:lfs.0 00002000:00000024:1.0:1788201442.370709:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1788201442.370843:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0004a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:18624:x1875064442765312:12345-192.168.201.30@tcp:13:lfs.0 Request processed in 184us (6733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201442.373034:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 192 00000100:00100000:3.0:1788201442.377606:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201442.378471:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442765440 00000100:00100000:2.0:1788201442.378486:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442765440 00000100:00100000:2.0:1788201442.378601:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 193 00000100:00100000:2.0:1788201442.378614:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:18624:x1875064442765440:12345-192.168.201.30@tcp:13:lfs.0 00002000:00000024:2.0:1788201442.378648:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 39518208 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201442.378749:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:18624:x1875064442765440:12345-192.168.201.30@tcp:13:lfs.0 Request processed in 136us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201442.378757:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 193 00010000:00010000:1.0:1788201443.301758:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201444.325538:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201445.357874:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201446.119670:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458292224:0@lo:400:kworker.0 00000100:00100000:1.0:1788201446.119788:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201446.119861:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788201446.119877:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458291840:0@lo:400:kworker.0 00000100:00100000:1.0:1788201446.120196:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201446.120232:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458292352:0@lo:400:kworker.0 00000100:00100000:1.0:1788201446.120256:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201446.120288:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458291968:0@lo:400:kworker.0 00000100:00100000:1.0:1788201446.120492:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201446.120648:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458292480:0@lo:400:kworker.0 00000100:00100000:1.0:1788201446.120675:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201446.120801:0:18186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458291840 00000100:00100000:0.0:1788201446.120812:0:18186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458291840 00000100:00100000:0.0:1788201446.121033:0:18186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788201446.121045:0:18186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1d52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458291840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201446.121129:0:18186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1d52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458291840:12345-0@lo:400:kworker.0 Request processed in 87us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201446.121138:0:18186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788201446.123072:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458292224 00000100:00100000:0.0:1788201446.123091:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458292224 00000100:00100000:0.0:1788201446.123163:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458292352 00000100:00100000:0.0:1788201446.123167:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458292352 00000100:00100000:0.0:1788201446.123197:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788201446.123208:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458292224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201446.123347:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458292224:12345-0@lo:400:kworker.0 Request processed in 140us (3559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201446.123355:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788201446.123377:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788201446.123384:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458292352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201446.123417:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458292352:12345-0@lo:400:kworker.0 Request processed in 34us (3159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201446.123423:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788201446.123455:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458292096:0@lo:400:kworker.0 00000100:00100000:0.0:1788201446.123630:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458291840:0@lo:400:kworker.0 00000100:00100000:0.0:1788201446.123652:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458292352:0@lo:400:kworker.0 00000100:00100000:0.0:1788201446.123663:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458292224:0@lo:400:kworker.0 00000100:00080000:0.0:1788201446.132460:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201446.132477:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201446.141374:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201446.141606:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458291968 00000100:00100000:3.0:1788201446.141620:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458291968 00000100:00100000:3.0:1788201446.141696:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458292480 00000100:00100000:3.0:1788201446.141701:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458292480 00000100:00100000:3.0:1788201446.141724:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788201446.141735:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c6bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458291968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201446.141859:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c6bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458291968:12345-0@lo:400:kworker.0 Request processed in 125us (21365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201446.141877:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788201446.141900:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788201446.141908:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458292480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201446.141941:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458292480:12345-0@lo:400:kworker.0 Request processed in 34us (21265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201446.141947:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788201446.141968:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201446.148021:0:18175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458292096 00000100:00100000:1.0:1788201446.148041:0:18175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458292096 00000100:00100000:1.0:1788201446.148137:0:18175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788201446.148152:0:18175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458292096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201446.148271:0:18175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458292096:12345-0@lo:400:kworker.0 Request processed in 123us (6908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201446.148280:0:18175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788201446.151228:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458291968:0@lo:400:kworker.0 00000100:00100000:1.0:1788201446.151275:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458292480:0@lo:400:kworker.0 00000100:00080000:1.0:1788201446.151470:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201446.151510:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458292096:0@lo:400:kworker.0 00000100:00100000:3.0:1788201446.292535:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201446.292587:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201446.292615:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201446.292664:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201446.292704:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442765568 00000100:00100000:3.0:1788201446.292719:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442765568 00000100:00100000:3.0:1788201446.292796:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 72 00000100:00100000:3.0:1788201446.292809:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1d50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442765568:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201446.293093:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1d50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442765568:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 286us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201446.293101:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 72 00000100:00100000:3.0:1788201446.293147:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442765824 00000100:00100000:3.0:1788201446.293151:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442765824 00000100:00100000:3.0:1788201446.293199:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442765952 00000100:00100000:3.0:1788201446.293203:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442765952 00000100:00100000:3.0:1788201446.293234:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 270 00000100:00100000:3.0:1788201446.293240:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2359:x1875064442765824:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201446.293275:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2359:x1875064442765824:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 36us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201446.293282:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 270 00000100:00100000:3.0:1788201446.293332:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 271 00000100:00100000:3.0:1788201446.293339:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2359:x1875064442765952:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201446.293364:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2359:x1875064442765952:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 27us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201446.293369:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 271 00000100:00100000:3.0:1788201446.293389:0:18175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442765696 00000100:00100000:3.0:1788201446.293394:0:18175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442765696 00000100:00100000:3.0:1788201446.293438:0:18175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:3.0:1788201446.293445:0:18175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2359:x1875064442765696:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201446.293478:0:18175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2359:x1875064442765696:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 33us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201446.293485:0:18175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00080000:3.0:1788201446.298340:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201446.298359:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201446.298364:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788201446.374099:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201446.629585:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458292608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201446.629685:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201446.631198:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458292608 00000100:00100000:3.0:1788201446.631224:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458292608 00000100:00100000:3.0:1788201446.631332:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788201446.631345:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458292608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201446.631398:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 39518208 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201446.631510:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458292608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 168us (1825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201446.631522:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788201446.631701:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458292608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201446.641249:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201446.641286:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458292736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201446.641481:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201446.641610:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458292736 00000100:00100000:1.0:1788201446.641623:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458292736 00000100:00100000:1.0:1788201446.641687:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788201446.641699:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458292736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201446.641760:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1788201446.641819:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458292736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201446.641826:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788201446.641909:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458292736:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788201447.400138:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201448.429639:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201449.445665:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201450.469539:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201450.664091:0:19008:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 110a: DNE: create striped dir, fail MDT1 ========================================================== 14:37:28 (1788201448) 00000100:00100000:1.0:1788201451.239177:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458293120:0@lo:400:kworker.0 00000100:00100000:1.0:1788201451.239259:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201451.239349:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788201451.239356:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458292992:0@lo:400:kworker.0 00000100:00100000:1.0:1788201451.239386:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201451.239409:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875064458293504:0@lo:400:kworker.0 00000100:00100000:1.0:1788201451.239432:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201451.239471:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458293120 00000100:00100000:1.0:1788201451.239478:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458293120 00000100:00100000:1.0:1788201451.239530:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458292992 00000100:00100000:1.0:1788201451.239533:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458292992 00000100:00100000:1.0:1788201451.239548:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458293504 00000100:00100000:1.0:1788201451.239551:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458293504 00000100:00100000:1.0:1788201451.239565:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788201451.239574:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458293120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201451.239636:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458293120:12345-0@lo:400:kworker.0 Request processed in 62us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201451.239643:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788201451.239663:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788201451.239669:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875064458292992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201451.239700:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875064458292992:12345-0@lo:400:kworker.0 Request processed in 31us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201451.239705:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788201451.239716:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788201451.239722:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875064458293504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201451.239750:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875064458293504:12345-0@lo:400:kworker.0 Request processed in 28us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201451.239756:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788201451.239814:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458292992:0@lo:400:kworker.0 00000100:00100000:1.0:1788201451.239826:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875064458293504:0@lo:400:kworker.0 00000100:00100000:1.0:1788201451.239834:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458293120:0@lo:400:kworker.0 00000100:00100000:3.0:1788201451.240031:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458292864:0@lo:400:kworker.0 00000100:00100000:3.0:1788201451.240073:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201451.240106:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458293376:0@lo:400:kworker.0 00000100:00100000:3.0:1788201451.240132:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201451.240160:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201451.240167:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458293248:0@lo:400:kworker.0 00000100:00100000:3.0:1788201451.240189:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788201451.240222:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201451.240235:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458293376 00000100:00100000:3.0:1788201451.240238:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458293376 00000100:00100000:3.0:1788201451.240269:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458293248 00000100:00100000:3.0:1788201451.240271:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458293248 00000100:00100000:3.0:1788201451.240290:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788201451.240318:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458293376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201451.240357:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458293376:12345-0@lo:400:kworker.0 Request processed in 41us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201451.240362:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788201451.240375:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788201451.240381:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458293248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201451.240409:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458293248:12345-0@lo:400:kworker.0 Request processed in 28us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201451.240416:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00080000:3.0:1788201451.240433:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201451.240436:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201451.240453:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458293248:0@lo:400:kworker.0 00000100:00100000:3.0:1788201451.240461:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458293376:0@lo:400:kworker.0 00000100:00100000:0.0:1788201451.240578:0:18186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458292864 00000100:00100000:0.0:1788201451.240583:0:18186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458292864 00000100:00100000:0.0:1788201451.240621:0:18186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788201451.240629:0:18186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1d50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458292864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201451.240679:0:18186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1d50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458292864:12345-0@lo:400:kworker.0 Request processed in 51us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201451.240684:0:18186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788201451.240759:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458292864:0@lo:400:kworker.0 00000100:00100000:0.0:1788201451.417119:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201451.420109:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201451.420141:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201451.420177:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201451.420215:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442766336 00000100:00100000:0.0:1788201451.420226:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442766336 00000100:00100000:0.0:1788201451.420319:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442766464 00000100:00100000:0.0:1788201451.420323:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442766464 00000100:00100000:0.0:1788201451.420355:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 274 00000100:00100000:0.0:1788201451.420364:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2362:x1875064442766336:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201451.420432:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2362:x1875064442766336:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 69us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201451.420439:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 274 00000100:00100000:0.0:1788201451.420455:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 275 00000100:00100000:0.0:1788201451.420461:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2362:x1875064442766464:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201451.420486:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2362:x1875064442766464:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201451.420492:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 275 00000100:00080000:0.0:1788201451.420508:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201451.420512:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201451.420646:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442766208 00000100:00100000:0.0:1788201451.420652:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442766208 00000100:00100000:0.0:1788201451.420689:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:0.0:1788201451.420697:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2362:x1875064442766208:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201451.420730:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2362:x1875064442766208:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 33us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201451.420748:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00080000:0.0:1788201451.420795:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201451.421186:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442766080 00000100:00100000:1.0:1788201451.421192:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442766080 00000100:00100000:1.0:1788201451.421237:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 74 00000100:00100000:1.0:1788201451.421246:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1d53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442766080:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201451.421399:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1d53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442766080:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 154us (4289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201451.421407:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 74 00010000:00010000:1.0:1788201451.493833:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201451.761050:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458293632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201451.761137:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201451.761195:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458293632 00000100:00100000:1.0:1788201451.761203:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458293632 00000100:00100000:1.0:1788201451.761251:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788201451.761261:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458293632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201451.761322:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1788201451.761372:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458293632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201451.761379:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788201451.761431:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458293632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201451.761605:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201451.761615:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458293760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201451.761647:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201451.761678:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458293760 00000100:00100000:3.0:1788201451.761682:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458293760 00000100:00100000:3.0:1788201451.761710:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788201451.761718:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458293760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201451.761758:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 39518208 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201451.761806:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458293760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201451.761812:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788201451.761843:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458293760:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1788201452.109684:0:19056:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_110a needs >= 2 MDTs 00010000:00010000:1.0:1788201452.517711:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201453.542413:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201454.115644:0:19104:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 110b: DNE: create striped dir, fail MDT1 and client ========================================================== 14:37:32 (1788201452) 00010000:00010000:1.0:1788201454.565649:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201455.590789:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201456.027710:0:19152:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_110b needs >= 2 MDTs 00000100:00100000:3.0:1788201456.357975:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2190700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458293888:0@lo:400:kworker.0 00000100:00100000:3.0:1788201456.358085:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201456.358334:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458294016:0@lo:400:kworker.0 00000100:00100000:2.0:1788201456.358392:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201456.358594:0:18175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458294016 00000100:00100000:3.0:1788201456.358603:0:18175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458294016 00000100:00100000:3.0:1788201456.358712:0:18175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788201456.358725:0:18175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458294016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201456.358858:0:18186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458293888 00000100:00100000:1.0:1788201456.358865:0:18186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458293888 00000100:00100000:1.0:1788201456.358914:0:18186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788201456.358922:0:18186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1d52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458293888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201456.358981:0:18186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1d52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458293888:12345-0@lo:400:kworker.0 Request processed in 60us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201456.358995:0:18186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788201456.359320:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2193b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458294144:0@lo:400:kworker.0 00000100:00100000:0.0:1788201456.359375:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201456.359412:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201456.359426:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c12d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875064458294528:0@lo:400:kworker.0 00000100:00100000:0.0:1788201456.359461:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201456.359492:0:18176:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788201456.359502:0:18176:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788201456.359705:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458294144 00000100:00100000:0.0:1788201456.359711:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458294144 00000100:00100000:0.0:1788201456.359738:0:18176:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788201456.359745:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458294528 00000100:00100000:0.0:1788201456.359748:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458294528 00000100:00100000:0.0:1788201456.359762:0:18176:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788201456.359770:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788201456.359777:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458294144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201456.359821:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458294144:12345-0@lo:400:kworker.0 Request processed in 45us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201456.359828:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788201456.359844:0:18176:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788201456.359851:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788201456.359856:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875064458294528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201456.359885:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875064458294528:12345-0@lo:400:kworker.0 Request processed in 28us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201456.359891:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788201456.359933:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c12d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875064458294528:0@lo:400:kworker.0 00000100:00100000:0.0:1788201456.359945:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2193b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458294144:0@lo:400:kworker.0 00000100:00100000:1.0:1788201456.360178:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458294272:0@lo:400:kworker.0 00000100:00100000:1.0:1788201456.360216:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201456.360250:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201456.360256:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2192d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458294400:0@lo:400:kworker.0 00000100:00100000:1.0:1788201456.360279:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201456.360336:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458294272 00000100:00100000:1.0:1788201456.360341:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458294272 00000100:00100000:1.0:1788201456.360375:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458294400 00000100:00100000:1.0:1788201456.360379:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458294400 00000100:00100000:1.0:1788201456.360404:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788201456.360412:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458294272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201456.360453:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458294272:12345-0@lo:400:kworker.0 Request processed in 42us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201456.360459:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788201456.360473:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788201456.360480:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458294400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201456.360510:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458294400:12345-0@lo:400:kworker.0 Request processed in 31us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201456.360516:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788201456.360549:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2192d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458294400:0@lo:400:kworker.0 00000100:00100000:1.0:1788201456.360562:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458294272:0@lo:400:kworker.0 00000100:00100000:3.0:1788201456.360905:0:18175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458294016:12345-0@lo:400:kworker.0 Request processed in 2181us (2510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201456.360914:0:18175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1788201456.360940:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201456.360945:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201456.360948:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201456.360981:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2190700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458293888:0@lo:400:kworker.0 00000100:00100000:2.0:1788201456.361096:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458294016:0@lo:400:kworker.0 00000100:00100000:0.0:1788201456.531602:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201456.531660:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201456.531714:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201456.531752:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201456.531823:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442766848 00000100:00100000:0.0:1788201456.531838:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442766848 00000100:00100000:0.0:1788201456.531925:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442766976 00000100:00100000:0.0:1788201456.531929:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442766976 00000100:00100000:0.0:1788201456.531954:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 278 00000100:00100000:0.0:1788201456.531966:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2359:x1875064442766848:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201456.532061:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2359:x1875064442766848:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 96us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201456.532069:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 278 00000100:00100000:0.0:1788201456.532093:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 279 00000100:00100000:0.0:1788201456.532099:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2359:x1875064442766976:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201456.532125:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2359:x1875064442766976:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 27us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201456.532132:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 279 00000100:00080000:3.0:1788201456.532743:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201456.532750:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201456.532770:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442766720 00000100:00100000:3.0:1788201456.532776:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442766720 00000100:00100000:3.0:1788201456.532842:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:3.0:1788201456.532851:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2359:x1875064442766720:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201456.532922:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2359:x1875064442766720:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 72us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201456.532930:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:2.0:1788201456.533119:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442766592 00000100:00100000:2.0:1788201456.533125:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442766592 00000100:00100000:2.0:1788201456.533162:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 76 00000100:00100000:2.0:1788201456.533170:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1d53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442766592:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201456.533201:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1d53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442766592:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 33us (1631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201456.533208:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 76 00000100:00080000:0.0:1788201456.533588:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788201456.614110:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201456.869777:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458294784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201456.870028:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201456.870192:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458294784 00000100:00100000:1.0:1788201456.870206:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458294784 00000100:00100000:1.0:1788201456.870317:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788201456.870330:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c12d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458294784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201456.870384:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1788201456.870460:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c12d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458294784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201456.870468:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788201456.870555:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458294784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201456.871620:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201456.871646:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458294656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201456.871732:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201456.871845:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458294656 00000100:00100000:2.0:1788201456.871855:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458294656 00000100:00100000:2.0:1788201456.871909:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788201456.871919:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458294656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201456.871961:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 39518208 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201456.881818:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458294656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9884us (10069us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201456.881840:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788201456.882028:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458294656:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788201457.637554:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201457.824514:0:19202:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 110c: DNE: create striped dir, fail MDT2 ========================================================== 14:37:36 (1788201456) 00010000:00010000:1.0:1788201458.661893:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201459.654809:0:19250:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_110c needs >= 2 MDTs 00010000:00010000:3.0:1788201459.698358:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201460.712068:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201461.477815:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2193b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458295296:0@lo:400:kworker.0 00000100:00100000:0.0:1788201461.477916:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201461.477989:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788201461.477998:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2190700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458294912:0@lo:400:kworker.0 00000100:00100000:0.0:1788201461.478032:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201461.478056:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458295424:0@lo:400:kworker.0 00000100:00100000:0.0:1788201461.478078:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201461.478119:0:18186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458294912 00000100:00100000:0.0:1788201461.478127:0:18186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458294912 00000100:00100000:0.0:1788201461.478181:0:18186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788201461.478192:0:18186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1d52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458294912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201461.478269:0:18186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1d52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458294912:12345-0@lo:400:kworker.0 Request processed in 78us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201461.478276:0:18186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788201461.478430:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2190700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458294912:0@lo:400:kworker.0 00000100:00100000:3.0:1788201461.478542:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458295296 00000100:00100000:3.0:1788201461.478548:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458295296 00000100:00100000:3.0:1788201461.478609:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458295424 00000100:00100000:3.0:1788201461.478612:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458295424 00000100:00100000:3.0:1788201461.478636:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788201461.478643:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458295296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201461.478688:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458295296:12345-0@lo:400:kworker.0 Request processed in 46us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201461.478693:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788201461.478708:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788201461.478713:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458295424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201461.478742:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458295424:12345-0@lo:400:kworker.0 Request processed in 29us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201461.478748:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788201461.478796:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458295424:0@lo:400:kworker.0 00000100:00100000:3.0:1788201461.478806:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2193b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458295296:0@lo:400:kworker.0 00000100:00080000:0.0:1788201461.478856:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201461.478861:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201461.479179:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458295040:0@lo:400:kworker.0 00000100:00100000:2.0:1788201461.479227:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201461.479326:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458295552:0@lo:400:kworker.0 00000100:00100000:2.0:1788201461.479351:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201461.479554:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201461.479562:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2192d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458295168:0@lo:400:kworker.0 00000100:00100000:2.0:1788201461.479588:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201461.479659:0:18175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458295040 00000100:00100000:3.0:1788201461.479665:0:18175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458295040 00000100:00100000:3.0:1788201461.479714:0:18175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458295552 00000100:00100000:3.0:1788201461.479717:0:18175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458295552 00000100:00100000:3.0:1788201461.479740:0:18175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788201461.479749:0:18175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458295040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201461.479791:0:18175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458295040:12345-0@lo:400:kworker.0 Request processed in 43us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201461.479798:0:18175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788201461.479813:0:18175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788201461.479819:0:18175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458295552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201461.479847:0:18175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458295552:12345-0@lo:400:kworker.0 Request processed in 28us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201461.479852:0:18175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788201461.479906:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201461.479982:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458295040:0@lo:400:kworker.0 00000100:00100000:2.0:1788201461.479992:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458295552:0@lo:400:kworker.0 00000100:00100000:3.0:1788201461.480375:0:18175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458295168 00000100:00100000:3.0:1788201461.480381:0:18175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458295168 00000100:00100000:3.0:1788201461.480420:0:18175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788201461.480426:0:18175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458295168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201461.480470:0:18175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458295168:12345-0@lo:400:kworker.0 Request processed in 44us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201461.480476:0:18175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788201461.480504:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2192d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458295168:0@lo:400:kworker.0 00000100:00080000:1.0:1788201461.480549:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1788201461.635805:0:19298:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 110d: DNE: create striped dir, fail MDT2 and client ========================================================== 14:37:39 (1788201459) 00000100:00100000:1.0:1788201461.658796:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201461.658847:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201461.658883:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201461.658919:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201461.658943:0:19164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442767232 00000100:00100000:1.0:1788201461.658955:0:19164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442767232 00000100:00100000:3.0:1788201461.658984:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442767360 00000100:00100000:3.0:1788201461.658990:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442767360 00000100:00100000:3.0:1788201461.659026:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442767488 00000100:00100000:3.0:1788201461.659028:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442767488 00000100:00100000:1.0:1788201461.659033:0:19164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:1.0:1788201461.659044:0:19164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2359:x1875064442767232:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201461.659054:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 282 00000100:00100000:3.0:1788201461.659060:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5484e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2359:x1875064442767360:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201461.659139:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5484e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2359:x1875064442767360:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 76us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201461.659144:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442767104 00000100:00100000:3.0:1788201461.659148:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 282 00000100:00100000:2.0:1788201461.659152:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442767104 00000100:00100000:2.0:1788201461.659191:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 78 00000100:00100000:2.0:1788201461.659199:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1d51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442767104:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201461.659241:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 283 00000100:00100000:3.0:1788201461.659250:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2359:x1875064442767488:12345-192.168.201.30@tcp:400:kworker.0 00000100:00080000:0.0:1788201461.660230:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201461.660238:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201461.660242:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201461.668000:0:19164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2359:x1875064442767232:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 8936us (9094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201461.668023:0:19164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:2.0:1788201461.668147:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1d51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442767104:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 8944us (9357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201461.668160:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 78 00000100:00100000:3.0:1788201461.671526:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2359:x1875064442767488:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 12258us (12586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201461.671544:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 283 00010000:00010000:1.0:1788201461.735749:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201461.989845:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201461.989879:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458295680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201461.989978:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201461.990320:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458295680 00000100:00100000:0.0:1788201461.990332:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458295680 00000100:00100000:0.0:1788201461.990390:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788201461.990401:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458295680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201461.990452:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1788201461.990532:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458295680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201461.990540:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788201461.990659:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458295680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201461.990941:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201461.990955:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458295808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201461.990993:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201461.991070:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458295808 00000100:00100000:2.0:1788201461.991076:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458295808 00000100:00100000:2.0:1788201461.991117:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788201461.991125:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458295808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201461.991148:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 39518208 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201461.991193:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458295808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201461.991200:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788201461.991272:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458295808:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788201462.758554:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201463.445573:0:19346:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_110d needs >= 2 MDTs 00010000:00010000:1.0:1788201463.781790:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201464.814919:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201465.565007:0:19395:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 110e: DNE: create striped dir, uncommit on MDT2, fail client/MDT1/MDT2 ========================================================== 14:37:43 (1788201463) 00010000:00010000:3.0:1788201465.829803:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201466.599139:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458295936:0@lo:400:kworker.0 00000100:00100000:1.0:1788201466.599218:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201466.599477:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458296320:0@lo:400:kworker.0 00000100:00100000:2.0:1788201466.599526:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201466.599681:0:18186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458295936 00000100:00100000:0.0:1788201466.599691:0:18186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458295936 00000100:00100000:0.0:1788201466.599748:0:18186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788201466.599760:0:18186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c296cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458295936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201466.599958:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458296064:0@lo:400:kworker.0 00000100:00100000:3.0:1788201466.599994:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201466.600016:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458296576:0@lo:400:kworker.0 00000100:00100000:3.0:1788201466.600040:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201466.600063:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201466.600068:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458296192:0@lo:400:kworker.0 00000100:00100000:3.0:1788201466.600089:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201466.600118:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458296064 00000100:00100000:3.0:1788201466.600123:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458296064 00000100:00100000:3.0:1788201466.600162:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458296576 00000100:00100000:3.0:1788201466.600166:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458296576 00000100:00100000:3.0:1788201466.600179:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458296192 00000100:00100000:3.0:1788201466.600181:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458296192 00000100:00100000:3.0:1788201466.600196:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788201466.600202:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458296064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201466.600241:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458296064:12345-0@lo:400:kworker.0 Request processed in 39us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201466.600248:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788201466.600264:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788201466.600269:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458296576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201466.600313:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458296576:12345-0@lo:400:kworker.0 Request processed in 24us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201466.600319:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788201466.600331:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788201466.600337:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458296192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201466.600364:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458296192:12345-0@lo:400:kworker.0 Request processed in 28us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201466.600371:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788201466.600415:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458296192:0@lo:400:kworker.0 00000100:00100000:3.0:1788201466.600429:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458296064:0@lo:400:kworker.0 00000100:00100000:3.0:1788201466.600436:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458296576:0@lo:400:kworker.0 00000100:00100000:2.0:1788201466.600501:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201466.600520:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458296448:0@lo:400:kworker.0 00000100:00100000:2.0:1788201466.600560:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201466.600714:0:18186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c296cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458295936:12345-0@lo:400:kworker.0 Request processed in 957us (1495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201466.600722:0:18186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788201466.600757:0:13442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458296320 00000100:00100000:0.0:1788201466.600762:0:13442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458296320 00000100:00100000:0.0:1788201466.600797:0:13442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458296448 00000100:00100000:0.0:1788201466.600801:0:13442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458296448 00000100:00100000:0.0:1788201466.600825:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788201466.600831:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458296320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201466.600869:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458296320:12345-0@lo:400:kworker.0 Request processed in 38us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201466.600874:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788201466.600885:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788201466.600891:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458296448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201466.600918:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458296448:12345-0@lo:400:kworker.0 Request processed in 28us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201466.600923:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00080000:0.0:1788201466.600944:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201466.600948:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201466.600950:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201466.600970:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458296448:0@lo:400:kworker.0 00000100:00100000:0.0:1788201466.600981:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458296320:0@lo:400:kworker.0 00000100:00100000:1.0:1788201466.601130:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458295936:0@lo:400:kworker.0 00000100:00100000:3.0:1788201466.778744:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201466.778784:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201466.778815:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201466.778845:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442767872 00000100:00100000:3.0:1788201466.778855:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442767872 00000100:00100000:3.0:1788201466.778915:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 286 00000100:00100000:3.0:1788201466.778926:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2360:x1875064442767872:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201466.779004:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2360:x1875064442767872:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 80us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201466.779012:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 286 00000100:00080000:3.0:1788201466.779035:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201466.779139:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442767744 00000100:00100000:3.0:1788201466.779144:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442767744 00000100:00100000:3.0:1788201466.779178:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:3.0:1788201466.779185:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442767744:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201466.779274:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442767744:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 88us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201466.779281:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00080000:3.0:1788201466.779324:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201466.782847:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201466.782882:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442768000 00000100:00100000:2.0:1788201466.782892:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442768000 00000100:00100000:2.0:1788201466.782963:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4385 00000100:00100000:2.0:1788201466.782972:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2358:x1875064442768000:12345-192.168.201.30@tcp:9:kworker.0 00000020:00000080:2.0:1788201466.783001:0:13446:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d5fc1 00000100:00080000:2.0:1788201466.783009:0:13446:0:(import.c:65:import_set_state_nolock()) ffff9e04fae25800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788201466.783045:0:13446:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968893 00000100:00100000:2.0:1788201466.783400:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35604eb4-baf9-45be-a20a-4883a2cd8cf9+2:2358:x1875064442768000:12345-192.168.201.30@tcp:9:kworker.0 Request processed in 427us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201466.783408:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4385 00000100:00080000:2.0:1788201466.783429:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788201466.783443:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201466.783812:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442767616 00000100:00100000:0.0:1788201466.783819:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442767616 00000100:00100000:0.0:1788201466.783860:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 80 00000100:00100000:0.0:1788201466.783869:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c296f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442767616:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201466.783907:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c296f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442767616:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 40us (5175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201466.783914:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 80 00010000:00010000:2.0:1788201466.861226:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201467.112785:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201467.112814:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1ba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458296704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201467.112890:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201467.112990:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458296704 00000100:00100000:0.0:1788201467.113005:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458296704 00000100:00100000:0.0:1788201467.113086:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788201467.113098:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458296704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201467.113152:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1788201467.113244:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458296704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201467.113252:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788201467.113389:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1ba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458296704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201467.118320:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458296832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201467.118415:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201467.118486:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458296832 00000100:00100000:3.0:1788201467.118495:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458296832 00000100:00100000:3.0:1788201467.118566:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788201467.118576:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458296832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201467.118628:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 36110336 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201467.118676:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458296832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201467.118683:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788201467.118732:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458296832:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1788201467.323411:0:19443:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_110e needs >= 2 MDTs 00000001:00100000:2.0:1788201467.715256:0:7657:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 35604eb4-baf9-45be-a20a-4883a2cd8cf9 00000020:00000080:2.0:1788201467.715269:0:7657:0:(genops.c:906:class_export_put()) final put ffff9e04fae26800/35604eb4-baf9-45be-a20a-4883a2cd8cf9 00000020:00000080:0.0:1788201467.717787:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04fae26800/35604eb4-baf9-45be-a20a-4883a2cd8cf9 for lustre-OST0001 00000020:00000080:0.0:1788201467.717889:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04fae25800 for lustre-OST0001 00010000:00010000:3.0:1788201467.878291:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201468.908135:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201469.398828:0:19492:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_110f skipping excluded test 110f 00010000:00010000:2.0:1788201469.926988:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201470.952022:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201471.066507:0:19540:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 110g: DNE: create striped dir, uncommit on MDT1, fail client/MDT1/MDT2 ========================================================== 14:37:49 (1788201469) 00000100:00100000:2.0:1788201471.726563:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1ba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458297088:0@lo:400:kworker.0 00000100:00100000:2.0:1788201471.726664:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201471.726737:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1ba3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458297600:0@lo:400:kworker.0 00000100:00100000:2.0:1788201471.726763:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201471.726796:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201471.726803:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1ba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458297216:0@lo:400:kworker.0 00000100:00100000:2.0:1788201471.726832:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201471.727070:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458297344:0@lo:400:kworker.0 00000100:00100000:0.0:1788201471.727110:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201471.727164:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788201471.727170:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1ba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458296960:0@lo:400:kworker.0 00000100:00100000:0.0:1788201471.727204:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201471.727230:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1ba1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458297472:0@lo:400:kworker.0 00000100:00100000:0.0:1788201471.727255:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201471.727330:0:18175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458297088 00000100:00100000:0.0:1788201471.727340:0:18175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458297088 00000100:00100000:0.0:1788201471.727407:0:18175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458297600 00000100:00100000:0.0:1788201471.727411:0:18175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458297600 00000100:00100000:0.0:1788201471.727440:0:18175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458297216 00000100:00100000:0.0:1788201471.727443:0:18175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458297216 00000100:00100000:0.0:1788201471.727462:0:18175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788201471.727472:0:18175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458297088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201471.727710:0:18175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458297088:12345-0@lo:400:kworker.0 Request processed in 238us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201471.727719:0:18175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788201471.727742:0:18175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788201471.727749:0:18175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458297600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201471.727782:0:18175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458297600:12345-0@lo:400:kworker.0 Request processed in 34us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201471.727789:0:18175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788201471.727801:0:18175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788201471.727807:0:18175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458297216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201471.727837:0:18175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458297216:12345-0@lo:400:kworker.0 Request processed in 30us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201471.727842:0:18175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788201471.727862:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458296960 00000100:00100000:0.0:1788201471.727866:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458296960 00000100:00100000:0.0:1788201471.727891:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788201471.727897:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c296f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458296960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201471.727929:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c296f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458296960:12345-0@lo:400:kworker.0 Request processed in 32us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201471.727935:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1788201471.727963:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201471.727999:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1ba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458296960:0@lo:400:kworker.0 00000100:00100000:0.0:1788201471.728033:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1ba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458297216:0@lo:400:kworker.0 00000100:00100000:0.0:1788201471.728043:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1ba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458297088:0@lo:400:kworker.0 00000100:00100000:0.0:1788201471.728052:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1ba3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458297600:0@lo:400:kworker.0 00000100:00100000:3.0:1788201471.728361:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458297344 00000100:00100000:3.0:1788201471.728366:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458297344 00000100:00100000:3.0:1788201471.728404:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458297472 00000100:00100000:3.0:1788201471.728408:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458297472 00000100:00100000:3.0:1788201471.728445:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788201471.728454:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458297344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201471.728514:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458297344:12345-0@lo:400:kworker.0 Request processed in 56us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201471.728521:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788201471.728549:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788201471.728556:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458297472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201471.728589:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458297472:12345-0@lo:400:kworker.0 Request processed in 34us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201471.728595:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788201471.728635:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1ba1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458297472:0@lo:400:kworker.0 00000100:00100000:3.0:1788201471.728649:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458297344:0@lo:400:kworker.0 00000100:00080000:0.0:1788201471.729053:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201471.729059:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201471.915949:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201471.916006:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201471.916048:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201471.916116:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442768384 00000100:00100000:3.0:1788201471.916130:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442768384 00000100:00100000:3.0:1788201471.916233:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 289 00000100:00100000:3.0:1788201471.916248:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1a71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2360:x1875064442768384:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201471.916256:0:18175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442768256 00000100:00100000:1.0:1788201471.916262:0:18175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442768256 00000100:00100000:1.0:1788201471.916344:0:18175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:1.0:1788201471.916353:0:18175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442768256:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201471.916465:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442768128 00000100:00100000:0.0:1788201471.916470:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442768128 00000100:00100000:0.0:1788201471.916508:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 82 00000100:00100000:0.0:1788201471.916515:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c296ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442768128:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201471.916579:0:18175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442768256:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 227us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201471.916586:0:18175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00080000:1.0:1788201471.920765:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201471.920784:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201471.922846:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1a71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2360:x1875064442768384:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 6583us (6820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201471.922867:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 289 00000100:00100000:0.0:1788201471.924848:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c296ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442768128:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 8320us (8903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201471.924864:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 82 00010000:00010000:1.0:1788201471.973778:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201472.232926:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201472.232959:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458297728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201472.233052:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201472.233104:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201472.233114:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458297856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201472.233155:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201472.233191:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458297728 00000100:00100000:0.0:1788201472.233200:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458297728 00000100:00100000:0.0:1788201472.233256:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458297856 00000100:00100000:0.0:1788201472.233259:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458297856 00000100:00100000:0.0:1788201472.233278:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788201472.233288:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458297728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201472.233374:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 36110336 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201472.233443:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458297728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201472.233454:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788201472.233476:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788201472.233484:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458297856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201472.233507:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1788201472.233543:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458297856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201472.233550:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788201472.233604:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458297856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201472.233643:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458297728:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1788201472.973554:0:19589:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_110g needs >= 2 MDTs 00010000:00010000:2.0:1788201472.998552:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201474.023424:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201475.045686:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201475.112227:0:19637:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 111a: DNE: unlink striped dir, fail MDT1 ========================================================== 14:37:53 (1788201473) 00010000:00010000:2.0:1788201476.073733:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201476.835076:0:19685:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_111a needs >= 2 MDTs 00000100:00100000:3.0:1788201476.838558:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458298112:0@lo:400:kworker.0 00000100:00100000:3.0:1788201476.838655:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201476.838720:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458298624:0@lo:400:kworker.0 00000100:00100000:3.0:1788201476.838745:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201476.838777:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201476.838782:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458298240:0@lo:400:kworker.0 00000100:00100000:3.0:1788201476.838802:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201476.838836:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458298112 00000100:00100000:3.0:1788201476.838846:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458298112 00000100:00100000:3.0:1788201476.838907:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458298624 00000100:00100000:3.0:1788201476.838911:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458298624 00000100:00100000:3.0:1788201476.838925:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458298240 00000100:00100000:3.0:1788201476.838928:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458298240 00000100:00100000:3.0:1788201476.838946:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788201476.838954:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458298112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201476.839013:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458298112:12345-0@lo:400:kworker.0 Request processed in 58us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201476.839020:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788201476.839039:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788201476.839044:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458298624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201476.839066:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458298624:12345-0@lo:400:kworker.0 Request processed in 23us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201476.839072:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788201476.839080:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788201476.839086:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458298240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201476.839107:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458298240:12345-0@lo:400:kworker.0 Request processed in 22us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201476.839112:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788201476.839158:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458298240:0@lo:400:kworker.0 00000100:00100000:3.0:1788201476.839169:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458298112:0@lo:400:kworker.0 00000100:00100000:3.0:1788201476.839178:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458298624:0@lo:400:kworker.0 00000100:00100000:2.0:1788201476.839350:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458298368:0@lo:400:kworker.0 00000100:00100000:2.0:1788201476.839391:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201476.839420:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788201476.839427:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458297984:0@lo:400:kworker.0 00000100:00100000:2.0:1788201476.839459:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201476.839485:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458298496:0@lo:400:kworker.0 00000100:00100000:2.0:1788201476.839509:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201476.839538:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458297984 00000100:00100000:2.0:1788201476.839543:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458297984 00000100:00100000:2.0:1788201476.839575:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788201476.839582:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c296d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458297984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201476.839617:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c296d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458297984:12345-0@lo:400:kworker.0 Request processed in 36us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201476.839624:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788201476.839659:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458298368 00000100:00100000:2.0:1788201476.839664:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458298368 00000100:00100000:2.0:1788201476.839691:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458298496 00000100:00100000:2.0:1788201476.839694:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458298496 00000100:00100000:2.0:1788201476.839717:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788201476.839724:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458298368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201476.839755:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458298368:12345-0@lo:400:kworker.0 Request processed in 32us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201476.839762:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788201476.839773:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788201476.839778:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0501b36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458298496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201476.839804:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0501b36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458298496:12345-0@lo:400:kworker.0 Request processed in 26us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201476.839810:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788201476.839857:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458297984:0@lo:400:kworker.0 00000100:00100000:2.0:1788201476.839870:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458298496:0@lo:400:kworker.0 00000100:00100000:2.0:1788201476.839879:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458298368:0@lo:400:kworker.0 00000100:00080000:1.0:1788201476.839974:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201476.839980:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201476.839983:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201477.024786:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201477.024834:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201477.024861:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201477.024994:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442768512 00000100:00100000:3.0:1788201477.025008:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442768512 00000100:00100000:3.0:1788201477.025345:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 84 00000100:00100000:3.0:1788201477.025359:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c296e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442768512:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201477.025459:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c296e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442768512:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 103us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201477.025468:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 84 00000100:00100000:0.0:1788201477.027444:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442768640 00000100:00100000:0.0:1788201477.027460:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442768640 00000100:00100000:0.0:1788201477.027540:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 37 00000100:00100000:0.0:1788201477.027551:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d80f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2362:x1875064442768640:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201477.027635:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d80f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2362:x1875064442768640:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 86us (2773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201477.027644:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 37 00000100:00100000:0.0:1788201477.027673:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442768768 00000100:00100000:0.0:1788201477.027678:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442768768 00000100:00100000:0.0:1788201477.027712:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 292 00000100:00100000:0.0:1788201477.027719:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0501b34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2362:x1875064442768768:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201477.027750:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0501b34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2362:x1875064442768768:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 31us (2916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201477.027757:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 292 00000100:00080000:0.0:1788201477.027776:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201477.027781:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788201477.093664:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201477.350679:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201477.350715:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458298752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201477.350834:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201477.351439:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201477.351574:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d80f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458298880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201477.351629:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201477.351943:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458298752 00000100:00100000:0.0:1788201477.351955:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458298752 00000100:00100000:0.0:1788201477.352033:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458298880 00000100:00100000:0.0:1788201477.352038:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458298880 00000100:00100000:0.0:1788201477.352057:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788201477.352068:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d094e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458298752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201477.352119:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1788201477.352213:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d094e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458298752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (1371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201477.352221:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788201477.352531:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788201477.352542:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d80f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458298880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201477.352571:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 36110336 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201477.352604:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d80f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458298880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201477.352616:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788201477.352854:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d80f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458298880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201477.352903:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458298752:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788201478.119685:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201478.496019:0:19735:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 111b: DNE: unlink striped dir, fail MDT2 ========================================================== 14:37:57 (1788201477) 00010000:00010000:2.0:1788201479.141821:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201480.028089:0:19783:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_111b needs >= 2 MDTs 00010000:00010000:3.0:1788201480.176257:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201481.189665:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201481.957566:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458299136:0@lo:400:kworker.0 00000100:00100000:3.0:1788201481.957669:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201481.957751:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458299648:0@lo:400:kworker.0 00000100:00100000:3.0:1788201481.957776:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201481.957811:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201481.957818:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458299264:0@lo:400:kworker.0 00000100:00100000:3.0:1788201481.957841:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201481.957880:0:18175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458299136 00000100:00100000:3.0:1788201481.957888:0:18175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458299136 00000100:00100000:3.0:1788201481.957953:0:18175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458299648 00000100:00100000:3.0:1788201481.957957:0:18175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458299648 00000100:00100000:3.0:1788201481.957973:0:18175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458299264 00000100:00100000:3.0:1788201481.957976:0:18175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458299264 00000100:00100000:3.0:1788201481.957993:0:18175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788201481.958002:0:18175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458299136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201481.958069:0:18175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458299136:12345-0@lo:400:kworker.0 Request processed in 66us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201481.958076:0:18175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788201481.958107:0:18175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201481.958114:0:18175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458299648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201481.958142:0:18175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458299648:12345-0@lo:400:kworker.0 Request processed in 29us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201481.958148:0:18175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201481.958160:0:18175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788201481.958166:0:18175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458299264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201481.958193:0:18175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458299264:12345-0@lo:400:kworker.0 Request processed in 27us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201481.958199:0:18175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788201481.958253:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458299264:0@lo:400:kworker.0 00000100:00100000:3.0:1788201481.958265:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458299136:0@lo:400:kworker.0 00000100:00100000:3.0:1788201481.958274:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458299648:0@lo:400:kworker.0 00000100:00100000:2.0:1788201481.959354:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458299008:0@lo:400:kworker.0 00000100:00100000:2.0:1788201481.959441:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201481.959485:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458299520:0@lo:400:kworker.0 00000100:00100000:2.0:1788201481.959515:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201481.959548:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201481.959556:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458299392:0@lo:400:kworker.0 00000100:00100000:2.0:1788201481.959581:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201481.959619:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458299520 00000100:00100000:2.0:1788201481.959628:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458299520 00000100:00100000:2.0:1788201481.959677:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458299392 00000100:00100000:2.0:1788201481.959794:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458299392 00000100:00100000:2.0:1788201481.959827:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788201481.959837:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d80f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458299520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201481.959896:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d80f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458299520:12345-0@lo:400:kworker.0 Request processed in 60us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201481.959903:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788201481.959920:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1788201481.959926:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d80f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458299392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201481.959950:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d80f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458299392:12345-0@lo:400:kworker.0 Request processed in 24us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201481.959956:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1788201481.960006:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458299392:0@lo:400:kworker.0 00000100:00100000:2.0:1788201481.960017:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458299520:0@lo:400:kworker.0 00000100:00080000:0.0:1788201481.961087:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201481.961098:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201481.961102:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201481.961599:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458299008 00000100:00100000:3.0:1788201481.961612:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458299008 00000100:00100000:3.0:1788201481.961686:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788201481.961696:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c296e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458299008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201481.961816:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c296e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458299008:12345-0@lo:400:kworker.0 Request processed in 122us (2374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201481.961824:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788201481.961997:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458299008:0@lo:400:kworker.0 00000001:02000400:2.0:1788201482.079993:0:19831:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 111c: DNE: unlink striped dir, uncommit on MDT1, fail client/MDT1/MDT2 ========================================================== 14:38:00 (1788201480) 00000100:00100000:2.0:1788201482.143669:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201482.143758:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201482.143802:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201482.143887:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442769152 00000100:00100000:1.0:1788201482.143902:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442769152 00000100:00100000:1.0:1788201482.143995:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 295 00000100:00100000:1.0:1788201482.144009:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4ded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2361:x1875064442769152:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201482.144134:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4ded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2361:x1875064442769152:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 128us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201482.144144:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 295 00000100:00100000:3.0:1788201482.145591:0:18175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442769024 00000100:00100000:3.0:1788201482.145606:0:18175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442769024 00000100:00100000:3.0:1788201482.145672:0:18175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00100000:3.0:1788201482.145682:0:18175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2361:x1875064442769024:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201482.145771:0:18175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2361:x1875064442769024:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 90us (1968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201482.145779:0:18175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00080000:2.0:1788201482.145875:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201482.145881:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201482.152574:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442768896 00000100:00100000:0.0:1788201482.152596:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442768896 00000100:00100000:0.0:1788201482.154283:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 86 00000100:00100000:0.0:1788201482.154331:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c296d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2361:x1875064442768896:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201482.154447:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c296d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2361:x1875064442768896:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 129us (10794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201482.154455:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 86 00010000:00010000:3.0:1788201482.214568:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201482.470691:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3449180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458299776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201482.470789:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201482.470894:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458299776 00000100:00100000:0.0:1788201482.470902:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458299776 00000100:00100000:0.0:1788201482.470957:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788201482.470966:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458299776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201482.471007:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1788201482.471067:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458299776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201482.471075:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788201482.471172:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3449180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458299776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201482.471945:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458299904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201482.471994:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201482.472081:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458299904 00000100:00100000:1.0:1788201482.472087:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458299904 00000100:00100000:1.0:1788201482.472126:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788201482.472134:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458299904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201482.472167:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 36110336 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201482.472226:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458299904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201482.472243:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788201482.472277:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458299904:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788201483.242242:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201483.789046:0:19879:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_111c needs >= 2 MDTs 00010000:00010000:2.0:1788201484.261804:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201485.271653:0:19927:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 111d: DNE: unlink striped dir, uncommit on MDT2, fail client/MDT1/MDT2 ========================================================== 14:38:03 (1788201483) 00010000:00010000:0.0:1788201485.285855:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201486.328054:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201486.711595:0:19976:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_111d needs >= 2 MDTs 00000100:00100000:0.0:1788201487.077623:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f4dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458300032:0@lo:400:kworker.0 00000100:00100000:0.0:1788201487.077729:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201487.077845:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458300032 00000100:00100000:3.0:1788201487.077857:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458300032 00000100:00100000:3.0:1788201487.077932:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788201487.077952:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c296c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458300032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201487.078423:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c56f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458300160:0@lo:400:kworker.0 00000100:00100000:1.0:1788201487.078469:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201487.078568:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201487.078575:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c56f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458300288:0@lo:400:kworker.0 00000100:00100000:1.0:1788201487.078603:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201487.078640:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458300160 00000100:00100000:1.0:1788201487.078646:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458300160 00000100:00100000:1.0:1788201487.078694:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458300288 00000100:00100000:1.0:1788201487.078698:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458300288 00000100:00100000:1.0:1788201487.078721:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788201487.078728:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458300160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201487.078776:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458300160:12345-0@lo:400:kworker.0 Request processed in 47us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201487.078785:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788201487.078805:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788201487.078811:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458300288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201487.078840:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458300288:12345-0@lo:400:kworker.0 Request processed in 30us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201487.078846:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1788201487.078867:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201487.078910:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c56f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458300288:0@lo:400:kworker.0 00000100:00100000:1.0:1788201487.078921:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c56f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458300160:0@lo:400:kworker.0 00000100:00100000:2.0:1788201487.079465:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201487.079476:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c56f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875064458300672:0@lo:400:kworker.0 00000100:00100000:2.0:1788201487.079519:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201487.079821:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c56f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458300416:0@lo:400:kworker.0 00000100:00100000:1.0:1788201487.079858:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201487.079890:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201487.079896:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c56f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458300544:0@lo:400:kworker.0 00000100:00100000:1.0:1788201487.079916:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201487.079958:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458300416 00000100:00100000:1.0:1788201487.079964:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458300416 00000100:00100000:1.0:1788201487.080012:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458300544 00000100:00100000:1.0:1788201487.080016:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458300544 00000100:00100000:1.0:1788201487.080354:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788201487.080366:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458300416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201487.080424:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458300416:12345-0@lo:400:kworker.0 Request processed in 61us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201487.080430:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788201487.080442:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788201487.080446:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458300544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201487.080466:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458300544:12345-0@lo:400:kworker.0 Request processed in 21us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201487.080470:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00080000:1.0:1788201487.080495:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201487.080499:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201487.080528:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c56f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458300544:0@lo:400:kworker.0 00000100:00100000:1.0:1788201487.080538:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c56f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458300416:0@lo:400:kworker.0 00000100:00100000:1.0:1788201487.080559:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458300672 00000100:00100000:1.0:1788201487.080561:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458300672 00000100:00100000:1.0:1788201487.080581:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788201487.080584:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875064458300672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201487.080614:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875064458300672:12345-0@lo:400:kworker.0 Request processed in 29us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201487.080618:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788201487.080639:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c56f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875064458300672:0@lo:400:kworker.0 00000100:00100000:3.0:1788201487.080756:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c296c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458300032:12345-0@lo:400:kworker.0 Request processed in 2805us (3026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201487.080765:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788201487.080857:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f4dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458300032:0@lo:400:kworker.0 00000100:00100000:2.0:1788201487.252537:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201487.252605:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201487.252654:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201487.252779:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442769280 00000100:00100000:3.0:1788201487.252794:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442769280 00000100:00100000:3.0:1788201487.252867:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 88 00000100:00100000:3.0:1788201487.252880:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c296dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442769280:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201487.252998:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c296dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442769280:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 121us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201487.253007:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 88 00000100:00100000:0.0:1788201487.253550:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442769536 00000100:00100000:0.0:1788201487.253558:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442769536 00000100:00100000:0.0:1788201487.253630:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 298 00000100:00100000:0.0:1788201487.253639:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2362:x1875064442769536:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201487.253678:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2362:x1875064442769536:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 41us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201487.253684:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 298 00000100:00080000:2.0:1788201487.253746:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201487.254231:0:19164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442769408 00000100:00100000:1.0:1788201487.254239:0:19164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442769408 00000100:00100000:1.0:1788201487.254348:0:19164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:1.0:1788201487.254359:0:19164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2362:x1875064442769408:12345-192.168.201.30@tcp:400:kworker.0 00000100:00080000:2.0:1788201487.254633:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201487.254686:0:19164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2362:x1875064442769408:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 328us (2029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201487.254694:0:19164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 45 00010000:00010000:2.0:1788201487.333759:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201487.589900:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201487.589937:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458300928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201487.590031:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201487.590157:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458300928 00000100:00100000:0.0:1788201487.590168:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458300928 00000100:00100000:0.0:1788201487.590239:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788201487.590251:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458300928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201487.590335:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1788201487.590401:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458300928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201487.590411:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788201487.590470:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458300928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201487.591429:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458300800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201487.591487:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201487.591601:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458300800 00000100:00100000:0.0:1788201487.591609:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458300800 00000100:00100000:0.0:1788201487.591659:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788201487.591668:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5484000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458300800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201487.591805:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 36110336 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201487.591860:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5484000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458300800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 192us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201487.591867:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788201487.591950:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458300800:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788201488.360259:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201488.843561:0:20024:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 111e: DNE: unlink striped dir, uncommit on MDT2, fail MDT1/MDT2 ========================================================== 14:38:07 (1788201487) 00010000:00010000:1.0:1788201489.381796:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201490.411077:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201490.511835:0:20072:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_111e needs >= 2 MDTs 00010000:00010000:3.0:1788201491.429821:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201492.197775:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f9855f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458301312:0@lo:400:kworker.0 00000100:00100000:1.0:1788201492.197845:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201492.197909:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788201492.197915:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458301184:0@lo:400:kworker.0 00000100:00100000:1.0:1788201492.197943:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201492.197980:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c33f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875064458301696:0@lo:400:kworker.0 00000100:00100000:1.0:1788201492.198001:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201492.198036:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458301312 00000100:00100000:1.0:1788201492.198042:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458301312 00000100:00100000:1.0:1788201492.198107:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458301184 00000100:00100000:1.0:1788201492.198112:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458301184 00000100:00100000:1.0:1788201492.198140:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458301696 00000100:00100000:1.0:1788201492.198143:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458301696 00000100:00100000:1.0:1788201492.198161:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788201492.198381:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458301312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201492.198504:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f9856680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458301440:0@lo:400:kworker.0 00000100:00100000:2.0:1788201492.198546:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201492.198575:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788201492.198582:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458301056:0@lo:400:kworker.0 00000100:00100000:2.0:1788201492.198609:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201492.198632:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c33f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458301568:0@lo:400:kworker.0 00000100:00100000:2.0:1788201492.198651:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788201492.198674:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201492.198686:0:18186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458301056 00000100:00100000:2.0:1788201492.198689:0:18186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458301056 00000100:00100000:2.0:1788201492.198718:0:18186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788201492.198724:0:18186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c8ed7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458301056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201492.198758:0:18186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c8ed7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458301056:12345-0@lo:400:kworker.0 Request processed in 34us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201492.198766:0:18186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788201492.198798:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458301440 00000100:00100000:2.0:1788201492.198802:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458301440 00000100:00100000:2.0:1788201492.198830:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458301568 00000100:00100000:2.0:1788201492.198833:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458301568 00000100:00100000:2.0:1788201492.198856:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1788201492.198863:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f965ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458301440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201492.198894:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f965ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458301440:12345-0@lo:400:kworker.0 Request processed in 32us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201492.198900:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1788201492.199049:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1788201492.199056:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458301568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201492.199101:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458301568:12345-0@lo:400:kworker.0 Request processed in 45us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201492.199107:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00080000:2.0:1788201492.199132:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201492.199136:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201492.199159:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458301056:0@lo:400:kworker.0 00000100:00100000:1.0:1788201492.199254:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458301312:12345-0@lo:400:kworker.0 Request processed in 1084us (1408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201492.199262:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788201492.199280:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788201492.199287:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875064458301184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201492.199338:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875064458301184:12345-0@lo:400:kworker.0 Request processed in 52us (1393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201492.199345:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788201492.199356:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788201492.199362:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2202300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875064458301696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201492.199385:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2202300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875064458301696:12345-0@lo:400:kworker.0 Request processed in 24us (1384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201492.199391:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788201492.200032:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c33f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458301568:0@lo:400:kworker.0 00000100:00100000:2.0:1788201492.200054:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f9856680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458301440:0@lo:400:kworker.0 00000100:00100000:3.0:1788201492.200787:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f9855f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458301312:0@lo:400:kworker.0 00000100:00100000:3.0:1788201492.200809:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458301184:0@lo:400:kworker.0 00000100:00100000:3.0:1788201492.200820:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c33f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875064458301696:0@lo:400:kworker.0 00000100:00100000:0.0:1788201492.381514:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201492.382520:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201492.382568:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442769664 00000100:00100000:0.0:1788201492.382579:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442769664 00000100:00100000:0.0:1788201492.382656:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 90 00000100:00100000:0.0:1788201492.382667:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c8ed5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2361:x1875064442769664:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201492.382740:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c8ed5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2361:x1875064442769664:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 75us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201492.382747:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 90 00000100:00100000:0.0:1788201492.382781:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442769792 00000100:00100000:0.0:1788201492.382786:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442769792 00000100:00100000:0.0:1788201492.382827:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:0.0:1788201492.382836:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2362:x1875064442769792:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201492.395537:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2362:x1875064442769792:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 12690us (13009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201492.395554:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00080000:0.0:1788201492.395604:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201492.397121:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201492.398487:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442769920 00000100:00100000:0.0:1788201492.398501:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442769920 00000100:00100000:0.0:1788201492.398615:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 301 00000100:00100000:0.0:1788201492.398627:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2200700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2361:x1875064442769920:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201492.398700:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2200700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2361:x1875064442769920:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 77us (1587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201492.398708:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 301 00000100:00080000:2.0:1788201492.398808:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1788201492.433866:0:20120:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 111f: DNE: unlink striped dir, uncommit on MDT1, fail MDT1/MDT2 ========================================================== 14:38:10 (1788201490) 00010000:00010000:3.0:1788201492.457179:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201492.710136:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201492.711444:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458301824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201492.711540:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201492.714068:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458301824 00000100:00100000:3.0:1788201492.714080:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458301824 00000100:00100000:3.0:1788201492.714134:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788201492.714145:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458301824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201492.714189:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1788201492.714272:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458301824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (2731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201492.714279:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788201492.714348:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458301824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201492.715174:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458301952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201492.715221:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201492.715290:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458301952 00000100:00100000:3.0:1788201492.715321:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458301952 00000100:00100000:3.0:1788201492.715353:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788201492.715361:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458301952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201492.715418:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 36110336 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201492.715797:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458301952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 435us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201492.715805:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788201492.716983:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458301952:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788201493.477728:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201494.512718:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201494.684922:0:20169:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_111f needs >= 2 MDTs 00010000:00010000:3.0:1788201495.525630:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201496.552793:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201496.602475:0:20217:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 111g: DNE: unlink striped dir, fail MDT1/MDT2 ========================================================== 14:38:14 (1788201494) 00000100:00100000:3.0:1788201497.319888:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458302208:0@lo:400:kworker.0 00000100:00100000:3.0:1788201497.319967:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201497.320266:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458302720:0@lo:400:kworker.0 00000100:00100000:3.0:1788201497.320331:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201497.320364:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201497.320371:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458302336:0@lo:400:kworker.0 00000100:00100000:3.0:1788201497.320395:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201497.320492:0:19164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458302208 00000100:00100000:0.0:1788201497.320501:0:19164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458302208 00000100:00100000:0.0:1788201497.320565:0:19164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458302720 00000100:00100000:0.0:1788201497.320569:0:19164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458302720 00000100:00100000:0.0:1788201497.320583:0:19164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458302336 00000100:00100000:0.0:1788201497.320585:0:19164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458302336 00000100:00100000:0.0:1788201497.320599:0:19164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788201497.320608:0:19164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458302208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201497.320667:0:19164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458302208:12345-0@lo:400:kworker.0 Request processed in 59us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201497.320674:0:19164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788201497.320692:0:19164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788201497.320698:0:19164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458302720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201497.320728:0:19164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458302720:12345-0@lo:400:kworker.0 Request processed in 31us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201497.320734:0:19164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788201497.320745:0:19164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788201497.320750:0:19164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458302336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201497.320777:0:19164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458302336:12345-0@lo:400:kworker.0 Request processed in 26us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201497.320783:0:19164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788201497.320923:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458302464:0@lo:400:kworker.0 00000100:00100000:2.0:1788201497.320958:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201497.321005:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788201497.321012:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458302080:0@lo:400:kworker.0 00000100:00100000:2.0:1788201497.321040:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201497.321062:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458302592:0@lo:400:kworker.0 00000100:00100000:2.0:1788201497.321080:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201497.321105:0:18186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458302080 00000100:00100000:2.0:1788201497.321119:0:18186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458302080 00000100:00100000:2.0:1788201497.321149:0:18186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788201497.321155:0:18186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c8ed4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458302080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201497.321192:0:18186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c8ed4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458302080:12345-0@lo:400:kworker.0 Request processed in 37us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201497.321198:0:18186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788201497.321226:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458302464 00000100:00100000:2.0:1788201497.321229:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458302464 00000100:00100000:2.0:1788201497.321254:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458302592 00000100:00100000:2.0:1788201497.321257:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458302592 00000100:00100000:2.0:1788201497.321276:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788201497.321283:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458302464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201497.321339:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458302464:12345-0@lo:400:kworker.0 Request processed in 56us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201497.321345:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788201497.321358:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788201497.321364:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458302592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201497.321392:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458302592:12345-0@lo:400:kworker.0 Request processed in 29us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201497.321398:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788201497.321442:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458302080:0@lo:400:kworker.0 00000100:00100000:2.0:1788201497.321454:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458302592:0@lo:400:kworker.0 00000100:00100000:2.0:1788201497.321463:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458302464:0@lo:400:kworker.0 00000100:00080000:3.0:1788201497.324340:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201497.324351:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201497.324355:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201497.324412:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458302336:0@lo:400:kworker.0 00000100:00100000:3.0:1788201497.324430:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458302208:0@lo:400:kworker.0 00000100:00100000:3.0:1788201497.324442:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458302720:0@lo:400:kworker.0 00000100:00100000:3.0:1788201497.496459:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201497.496533:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201497.496666:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442770304 00000100:00100000:2.0:1788201497.496678:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442770304 00000100:00100000:2.0:1788201497.496755:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 304 00000100:00100000:2.0:1788201497.496766:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2359:x1875064442770304:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201497.496861:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2359:x1875064442770304:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 97us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201497.496880:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 304 00000100:00080000:3.0:1788201497.497352:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201497.497516:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442770048 00000100:00100000:0.0:1788201497.497522:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442770048 00000100:00100000:0.0:1788201497.497574:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 92 00000100:00100000:0.0:1788201497.497582:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c8ed6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442770048:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201497.497628:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c8ed6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442770048:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 46us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201497.497635:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 92 00000100:00100000:3.0:1788201497.498053:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201497.498217:0:19164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442770176 00000100:00100000:0.0:1788201497.498222:0:19164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442770176 00000100:00100000:0.0:1788201497.498277:0:19164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:0.0:1788201497.498285:0:19164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442770176:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201497.498354:0:19164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442770176:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 70us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201497.498361:0:19164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00080000:3.0:1788201497.498612:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788201497.574210:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201497.829561:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201497.829583:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458302848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201497.829647:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201497.829691:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458302848 00000100:00100000:3.0:1788201497.829697:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458302848 00000100:00100000:3.0:1788201497.829739:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788201497.829747:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458302848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201497.829779:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 36110336 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201497.829818:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458302848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201497.829825:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788201497.829881:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458302848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201497.829995:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201497.830005:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c33f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458302976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201497.830041:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201497.830429:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458302976 00000100:00100000:3.0:1788201497.830433:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458302976 00000100:00100000:3.0:1788201497.830466:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788201497.830474:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458302976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201497.830495:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1788201497.830540:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458302976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201497.830546:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788201497.830620:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c33f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458302976:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788201498.473935:0:20265:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_111g needs >= 2 MDTs 00010000:00010000:3.0:1788201498.597856:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201499.621549:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201500.650132:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201500.659864:0:20314:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 112a: DNE: cross MDT rename, fail MDT1 ========================================================== 14:38:18 (1788201498) 00010000:00010000:3.0:1788201501.669542:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201502.438496:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458303360:0@lo:400:kworker.0 00000100:00100000:1.0:1788201502.438570:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201502.438624:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788201502.438631:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458303232:0@lo:400:kworker.0 00000100:00100000:1.0:1788201502.438654:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201502.438679:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875064458303744:0@lo:400:kworker.0 00000100:00100000:1.0:1788201502.438702:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201502.438732:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458303360 00000100:00100000:1.0:1788201502.438739:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458303360 00000100:00100000:3.0:1788201502.439029:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458303488:0@lo:400:kworker.0 00000100:00100000:3.0:1788201502.439064:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201502.439234:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458303104:0@lo:400:kworker.0 00000100:00100000:0.0:1788201502.439274:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201502.439404:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458303232 00000100:00100000:1.0:1788201502.439409:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458303232 00000100:00100000:1.0:1788201502.439427:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458303744 00000100:00100000:1.0:1788201502.439430:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458303744 00000100:00100000:1.0:1788201502.439448:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788201502.439456:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458303360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201502.439519:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458303360:12345-0@lo:400:kworker.0 Request processed in 64us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201502.439526:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788201502.439544:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788201502.439550:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875064458303232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201502.439578:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875064458303232:12345-0@lo:400:kworker.0 Request processed in 28us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201502.439583:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788201502.439594:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788201502.439599:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875064458303744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201502.439622:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875064458303744:12345-0@lo:400:kworker.0 Request processed in 23us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201502.439627:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788201502.439668:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458303232:0@lo:400:kworker.0 00000100:00100000:1.0:1788201502.439680:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875064458303744:0@lo:400:kworker.0 00000100:00100000:1.0:1788201502.439688:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458303360:0@lo:400:kworker.0 00000100:00100000:1.0:1788201502.440374:0:18186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458303104 00000100:00100000:1.0:1788201502.440380:0:18186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458303104 00000100:00080000:3.0:1788201502.441186:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201502.441201:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458303488 00000100:00100000:3.0:1788201502.441207:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458303488 00000100:00100000:3.0:1788201502.441268:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788201502.441277:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458303488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201502.441373:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458303488:12345-0@lo:400:kworker.0 Request processed in 97us (2307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201502.441380:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788201502.441420:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458303488:0@lo:400:kworker.0 00000100:00080000:2.0:1788201502.442918:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201502.443063:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458303616:0@lo:400:kworker.0 00000100:00100000:0.0:1788201502.443124:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201502.443244:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458303616 00000100:00100000:2.0:1788201502.443252:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458303616 00000100:00100000:2.0:1788201502.443318:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1788201502.443328:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458303616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201502.443384:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458303616:12345-0@lo:400:kworker.0 Request processed in 58us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201502.443391:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00080000:2.0:1788201502.443409:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201502.445192:0:18186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788201502.445210:0:18186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c8ed6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458303104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201502.445313:0:18186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c8ed6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458303104:12345-0@lo:400:kworker.0 Request processed in 91us (6018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201502.445321:0:18186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788201502.445994:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458303104:0@lo:400:kworker.0 00000100:00100000:1.0:1788201502.446014:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458303616:0@lo:400:kworker.0 00000001:02000400:0.0:1788201502.472040:0:20362:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_112a needs >= 4 MDTs 00000100:00100000:1.0:1788201502.619821:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201502.619868:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201502.619911:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201502.619943:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442770560 00000100:00100000:1.0:1788201502.619953:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442770560 00000100:00100000:1.0:1788201502.620019:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:1.0:1788201502.620030:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442770560:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201502.620108:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442770560:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 80us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201502.620115:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:2.0:1788201502.620184:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442770688 00000100:00100000:2.0:1788201502.620189:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442770688 00000100:00100000:2.0:1788201502.620232:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 307 00000100:00100000:2.0:1788201502.620240:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2360:x1875064442770688:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201502.620273:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2360:x1875064442770688:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 34us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201502.620280:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 307 00000100:00080000:2.0:1788201502.620323:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201502.620328:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201502.620435:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442770432 00000100:00100000:3.0:1788201502.620441:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442770432 00000100:00100000:3.0:1788201502.620478:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94 00000100:00100000:3.0:1788201502.620487:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c8ed6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442770432:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201502.620517:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c8ed6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442770432:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 32us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201502.620524:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94 00010000:00010000:3.0:1788201502.695014:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201502.951376:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201502.951403:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458303872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201502.951482:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201502.951604:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458303872 00000100:00100000:3.0:1788201502.951613:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458303872 00000100:00100000:3.0:1788201502.951672:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788201502.951681:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458303872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201502.951720:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 36110336 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201502.951800:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458303872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201502.951808:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788201502.951951:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458303872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201502.958058:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201502.958082:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c33f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458304000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201502.958153:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201502.958518:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458304000 00000100:00100000:2.0:1788201502.958527:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458304000 00000100:00100000:2.0:1788201502.958585:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788201502.958595:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458304000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201502.958640:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1788201502.958698:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458304000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201502.958706:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788201502.960432:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c33f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458304000:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788201503.718922:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201504.742465:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201504.769609:0:20410:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 112b: DNE: cross MDT rename, fail MDT2 ========================================================== 14:38:23 (1788201503) 00010000:00010000:3.0:1788201505.768270:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201506.490328:0:20458:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_112b needs >= 4 MDTs 00010000:00010000:1.0:1788201506.791970:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201507.559525:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458304384:0@lo:400:kworker.0 00000100:00100000:0.0:1788201507.559640:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201507.559735:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788201507.559743:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458304256:0@lo:400:kworker.0 00000100:00100000:0.0:1788201507.559773:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201507.559806:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875064458304768:0@lo:400:kworker.0 00000100:00100000:0.0:1788201507.559832:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201507.559873:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458304384 00000100:00100000:0.0:1788201507.559883:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458304384 00000100:00100000:0.0:1788201507.559952:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458304256 00000100:00100000:0.0:1788201507.559956:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458304256 00000100:00100000:0.0:1788201507.559976:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458304768 00000100:00100000:0.0:1788201507.559979:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458304768 00000100:00100000:0.0:1788201507.559997:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788201507.560007:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458304384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201507.560092:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458304384:12345-0@lo:400:kworker.0 Request processed in 86us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201507.560101:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788201507.560124:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788201507.560131:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875064458304256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201507.560161:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875064458304256:12345-0@lo:400:kworker.0 Request processed in 31us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201507.560168:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788201507.560182:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788201507.560188:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875064458304768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201507.560217:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875064458304768:12345-0@lo:400:kworker.0 Request processed in 29us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201507.560223:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1788201507.560243:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201507.560283:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458304256:0@lo:400:kworker.0 00000100:00100000:0.0:1788201507.560331:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875064458304768:0@lo:400:kworker.0 00000100:00100000:0.0:1788201507.560343:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458304384:0@lo:400:kworker.0 00000100:00100000:3.0:1788201507.560808:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3449180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458304512:0@lo:400:kworker.0 00000100:00100000:3.0:1788201507.560856:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201507.560902:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788201507.560910:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458304128:0@lo:400:kworker.0 00000100:00100000:3.0:1788201507.560944:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201507.560969:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458304640:0@lo:400:kworker.0 00000100:00100000:3.0:1788201507.560993:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201507.561030:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458304512 00000100:00100000:3.0:1788201507.561036:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458304512 00000100:00100000:3.0:1788201507.561095:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458304640 00000100:00100000:3.0:1788201507.561099:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458304640 00000100:00100000:3.0:1788201507.561136:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788201507.561144:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458304512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201507.561195:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458304512:12345-0@lo:400:kworker.0 Request processed in 52us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201507.561201:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788201507.561215:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788201507.561222:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458304640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201507.561251:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458304640:12345-0@lo:400:kworker.0 Request processed in 29us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201507.561257:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00080000:3.0:1788201507.561282:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201507.561286:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201507.561355:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458304640:0@lo:400:kworker.0 00000100:00100000:3.0:1788201507.561366:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3449180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458304512:0@lo:400:kworker.0 00000100:00100000:1.0:1788201507.562396:0:18186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458304128 00000100:00100000:1.0:1788201507.562405:0:18186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458304128 00000100:00100000:1.0:1788201507.562461:0:18186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788201507.562470:0:18186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c8ed7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458304128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201507.562553:0:18186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c8ed7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458304128:12345-0@lo:400:kworker.0 Request processed in 85us (1607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201507.562560:0:18186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788201507.565591:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458304128:0@lo:400:kworker.0 00000100:00100000:0.0:1788201507.741662:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201507.741714:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201507.741764:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201507.741877:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442770816 00000100:00100000:3.0:1788201507.741890:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442770816 00000100:00100000:3.0:1788201507.741963:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 96 00000100:00100000:3.0:1788201507.741975:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c8ed4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442770816:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201507.742071:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c8ed4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442770816:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 99us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201507.742081:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 96 00000100:00100000:1.0:1788201507.742387:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442771072 00000100:00100000:1.0:1788201507.742393:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442771072 00000100:00100000:1.0:1788201507.742455:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 310 00000100:00100000:1.0:1788201507.742464:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2359:x1875064442771072:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201507.742508:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2359:x1875064442771072:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 46us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201507.742516:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 310 00000100:00080000:3.0:1788201507.743411:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201507.743899:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442770944 00000100:00100000:2.0:1788201507.743910:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442770944 00000100:00100000:2.0:1788201507.744447:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00100000:2.0:1788201507.744461:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2359:x1875064442770944:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201507.744570:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2359:x1875064442770944:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 112us (2804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201507.744579:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00080000:3.0:1788201507.745130:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788201507.813508:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201508.069550:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201508.069584:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458304896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201508.069696:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201508.069762:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458304896 00000100:00100000:0.0:1788201508.069771:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458304896 00000100:00100000:0.0:1788201508.069848:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788201508.069859:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458304896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201508.070157:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 36110336 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201508.070221:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458304896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 363us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201508.070229:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788201508.070320:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458304896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201508.078984:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201508.079015:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c33f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458305024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201508.079119:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201508.079196:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458305024 00000100:00100000:2.0:1788201508.079208:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458305024 00000100:00100000:2.0:1788201508.079285:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788201508.079344:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1a71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458305024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201508.079396:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1788201508.079451:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1a71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458305024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201508.079460:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788201508.079519:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c33f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458305024:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788201508.575155:0:20507:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 112c: DNE: cross MDT rename, fail MDT3 ========================================================== 14:38:26 (1788201506) 00010000:00010000:1.0:1788201508.838087:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201509.861580:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201510.269536:0:20555:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_112c needs >= 4 MDTs 00010000:00010000:2.0:1788201510.885550:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201511.920793:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201512.082001:0:20603:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 112d: DNE: cross MDT rename, fail MDT4 ========================================================== 14:38:30 (1788201510) 00000100:00100000:3.0:1788201512.677691:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458305536:0@lo:400:kworker.0 00000100:00100000:3.0:1788201512.677806:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201512.677887:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788201512.677894:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458305152:0@lo:400:kworker.0 00000100:00100000:3.0:1788201512.677929:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201512.677962:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458305664:0@lo:400:kworker.0 00000100:00100000:0.0:1788201512.678090:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458305280:0@lo:400:kworker.0 00000100:00100000:0.0:1788201512.678135:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201512.678157:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458305792:0@lo:400:kworker.0 00000100:00100000:0.0:1788201512.678179:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201512.678199:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201512.678205:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f000d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458305408:0@lo:400:kworker.0 00000100:00100000:0.0:1788201512.678228:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201512.678258:0:19164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458305280 00000100:00100000:0.0:1788201512.678267:0:19164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458305280 00000100:00100000:0.0:1788201512.678356:0:19164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458305792 00000100:00100000:0.0:1788201512.678360:0:19164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458305792 00000100:00100000:0.0:1788201512.678375:0:19164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458305408 00000100:00100000:0.0:1788201512.678378:0:19164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458305408 00000100:00100000:0.0:1788201512.678396:0:19164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788201512.678406:0:19164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458305280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201512.678471:0:19164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458305280:12345-0@lo:400:kworker.0 Request processed in 65us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201512.678479:0:19164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788201512.678504:0:19164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788201512.678511:0:19164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458305792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201512.678539:0:19164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458305792:12345-0@lo:400:kworker.0 Request processed in 29us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201512.678627:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201512.678662:0:18186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458305152 00000100:00100000:3.0:1788201512.678665:0:18186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458305152 00000100:00100000:1.0:1788201512.678671:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458305536 00000100:00100000:1.0:1788201512.678675:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458305536 00000100:00100000:2.0:1788201512.678756:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458305664 00000100:00100000:2.0:1788201512.678760:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458305664 00000100:00100000:0.0:1788201512.678796:0:19164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788201512.678811:0:19164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788201512.678816:0:19164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458305408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201512.678846:0:19164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458305408:12345-0@lo:400:kworker.0 Request processed in 30us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201512.678851:0:19164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1788201512.678875:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201512.678879:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201512.678882:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201512.679236:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458305408:0@lo:400:kworker.0 00000100:00100000:0.0:1788201512.679340:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458305280:0@lo:400:kworker.0 00000100:00100000:0.0:1788201512.679353:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458305792:0@lo:400:kworker.0 00000100:00100000:3.0:1788201512.681912:0:18186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788201512.681940:0:18186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c648fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458305152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201512.682054:0:18186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c648fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458305152:12345-0@lo:400:kworker.0 Request processed in 129us (4123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201512.682062:0:18186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788201512.682565:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458305152:0@lo:400:kworker.0 00000100:00100000:1.0:1788201512.684876:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1788201512.684905:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458305536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201512.686647:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458305536:12345-0@lo:400:kworker.0 Request processed in 1750us (8832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201512.686661:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1788201512.686701:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1788201512.686728:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458305664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201512.686801:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458305664:12345-0@lo:400:kworker.0 Request processed in 93us (8815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201512.686808:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788201512.686952:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458305664:0@lo:400:kworker.0 00000100:00100000:0.0:1788201512.686968:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f000f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458305536:0@lo:400:kworker.0 00000100:00100000:1.0:1788201512.864444:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201512.864492:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201512.864543:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201512.864611:0:13442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442771456 00000100:00100000:2.0:1788201512.864626:0:13442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442771456 00000100:00100000:2.0:1788201512.864721:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 313 00000100:00100000:2.0:1788201512.864735:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2362:x1875064442771456:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201512.864833:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2362:x1875064442771456:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 101us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201512.864841:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 313 00000100:00080000:1.0:1788201512.865204:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201512.867434:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442771200 00000100:00100000:0.0:1788201512.867453:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442771200 00000100:00100000:0.0:1788201512.867528:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 98 00000100:00100000:0.0:1788201512.867540:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c648d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442771200:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201512.867646:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c648d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442771200:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 108us (3216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201512.867654:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 98 00000100:00100000:0.0:1788201512.867713:0:19164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442771328 00000100:00100000:0.0:1788201512.867718:0:19164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442771328 00000100:00100000:0.0:1788201512.867766:0:19164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00100000:0.0:1788201512.867773:0:19164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2362:x1875064442771328:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201512.867809:0:19164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2362:x1875064442771328:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 37us (3266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201512.867815:0:19164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00080000:0.0:1788201512.867833:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788201512.938620:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201513.189458:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201513.189492:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458305920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201513.189602:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201513.189663:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458305920 00000100:00100000:2.0:1788201513.189672:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458305920 00000100:00100000:2.0:1788201513.189740:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788201513.189751:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458305920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201513.189797:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1788201513.189849:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458305920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201513.189857:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788201513.189911:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458305920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201513.191263:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458306048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201513.191361:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201513.191447:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458306048 00000100:00100000:3.0:1788201513.191455:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458306048 00000100:00100000:3.0:1788201513.191500:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788201513.191510:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458306048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201513.191546:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 36110336 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201513.191706:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458306048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201513.193746:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458306048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2230us (2377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201513.193760:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000001:02000400:1.0:1788201513.692883:0:20651:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_112d needs >= 4 MDTs 00010000:00010000:2.0:1788201513.957672:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201514.985541:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201515.233086:0:20700:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 112e: DNE: cross MDT rename, fail MDT1 and MDT2 ========================================================== 14:38:33 (1788201513) 00010000:00010000:3.0:1788201516.007847:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201516.772827:0:20749:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_112e needs >= 4 MDTs 00010000:00010000:2.0:1788201517.037100:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201517.801476:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458306176:0@lo:400:kworker.0 00000100:00100000:0.0:1788201517.801557:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201517.801634:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d80f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458306688:0@lo:400:kworker.0 00000100:00100000:0.0:1788201517.801664:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201517.801690:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201517.801696:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d80f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458306560:0@lo:400:kworker.0 00000100:00100000:0.0:1788201517.801715:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201517.801791:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0501b34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458306432:0@lo:400:kworker.0 00000100:00100000:1.0:1788201517.801833:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201517.801863:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788201517.801869:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0501b36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458306304:0@lo:400:kworker.0 00000100:00100000:1.0:1788201517.801891:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201517.801910:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875064458306816:0@lo:400:kworker.0 00000100:00100000:1.0:1788201517.801950:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201517.801995:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458306688 00000100:00100000:1.0:1788201517.802002:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458306688 00000100:00100000:1.0:1788201517.802052:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458306560 00000100:00100000:1.0:1788201517.802055:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458306560 00000100:00100000:1.0:1788201517.802076:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1788201517.802085:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458306688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201517.802136:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458306688:12345-0@lo:400:kworker.0 Request processed in 53us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201517.802142:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1788201517.802158:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1788201517.802165:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458306560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201517.802195:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458306560:12345-0@lo:400:kworker.0 Request processed in 30us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201517.802201:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1788201517.802219:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458306432 00000100:00100000:1.0:1788201517.802223:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458306432 00000100:00100000:1.0:1788201517.802247:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458306304 00000100:00100000:1.0:1788201517.802250:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458306304 00000100:00100000:1.0:1788201517.802262:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458306816 00000100:00100000:1.0:1788201517.802264:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458306816 00000100:00100000:1.0:1788201517.802276:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788201517.802282:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458306432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201517.802340:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458306432:12345-0@lo:400:kworker.0 Request processed in 58us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201517.802347:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788201517.802358:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788201517.802364:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875064458306304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201517.802389:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875064458306304:12345-0@lo:400:kworker.0 Request processed in 26us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201517.802395:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788201517.802408:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788201517.802413:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875064458306816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201517.802434:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875064458306816:12345-0@lo:400:kworker.0 Request processed in 22us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201517.802439:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1788201517.802456:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201517.802460:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201517.802462:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201517.802496:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0501b36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458306304:0@lo:400:kworker.0 00000100:00100000:1.0:1788201517.802505:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875064458306816:0@lo:400:kworker.0 00000100:00100000:1.0:1788201517.802513:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0501b34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458306432:0@lo:400:kworker.0 00000100:00100000:1.0:1788201517.802554:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d80f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458306560:0@lo:400:kworker.0 00000100:00100000:1.0:1788201517.802564:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d80f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458306688:0@lo:400:kworker.0 00000100:00100000:2.0:1788201517.803139:0:18186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458306176 00000100:00100000:2.0:1788201517.803145:0:18186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458306176 00000100:00100000:2.0:1788201517.803185:0:18186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788201517.803193:0:18186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c648d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458306176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201517.803247:0:18186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c648d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458306176:12345-0@lo:400:kworker.0 Request processed in 56us (1690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201517.803254:0:18186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788201517.805574:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458306176:0@lo:400:kworker.0 00000100:00100000:1.0:1788201517.975492:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201517.975742:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201517.975785:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201517.975896:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442771840 00000100:00100000:2.0:1788201517.975927:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442771840 00000100:00100000:3.0:1788201517.975930:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442771712 00000100:00100000:3.0:1788201517.975937:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442771712 00000100:00100000:2.0:1788201517.976007:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 316 00000100:00100000:2.0:1788201517.976016:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2361:x1875064442771840:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201517.976043:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442771584 00000100:00100000:0.0:1788201517.976050:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442771584 00000100:00100000:2.0:1788201517.976092:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2361:x1875064442771840:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 73us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201517.976099:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 316 00000100:00100000:0.0:1788201517.976329:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 100 00000100:00100000:0.0:1788201517.976341:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c648c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2361:x1875064442771584:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201517.976380:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c648c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2361:x1875064442771584:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 43us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201517.976819:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:3.0:1788201517.976828:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2361:x1875064442771712:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201517.976868:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2361:x1875064442771712:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 41us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201517.976877:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:0.0:1788201517.976994:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 100 00000100:00080000:1.0:1788201517.979195:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201517.979209:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788201518.053668:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201518.309606:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3449180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458306944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201518.309691:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201518.309845:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458306944 00000100:00100000:0.0:1788201518.309854:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458306944 00000100:00100000:0.0:1788201518.309900:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788201518.309910:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458306944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201518.309946:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 36110336 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201518.310004:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458306944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201518.310017:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788201518.310063:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3449180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458306944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201518.311363:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201518.311384:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3449180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458307072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201518.311420:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201518.311449:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458307072 00000100:00100000:0.0:1788201518.311454:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458307072 00000100:00100000:0.0:1788201518.311480:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788201518.311485:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458307072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201518.311509:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1788201518.311536:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458307072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201518.311540:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788201518.311568:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3449180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458307072:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788201518.375440:0:20797:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 112f: DNE: cross MDT rename, fail MDT1 and MDT3 ========================================================== 14:38:36 (1788201516) 00010000:00010000:3.0:1788201519.082424:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201519.773971:0:20845:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_112f needs >= 4 MDTs 00010000:00010000:2.0:1788201520.101549:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201521.127425:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201521.604419:0:20894:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 112g: DNE: cross MDT rename, fail MDT1 and MDT4 ========================================================== 14:38:40 (1788201520) 00010000:00010000:3.0:1788201522.151251:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201522.918646:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458307328:0@lo:400:kworker.0 00000100:00100000:2.0:1788201522.918745:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201522.918828:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458307840:0@lo:400:kworker.0 00000100:00100000:1.0:1788201522.918962:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458307584:0@lo:400:kworker.0 00000100:00100000:1.0:1788201522.919004:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201522.919044:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788201522.919050:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458307200:0@lo:400:kworker.0 00000100:00100000:1.0:1788201522.919087:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201522.919113:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458307712:0@lo:400:kworker.0 00000100:00100000:1.0:1788201522.919137:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201522.919171:0:18175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458307328 00000100:00100000:1.0:1788201522.919180:0:18175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458307328 00000100:00100000:1.0:1788201522.919262:0:18175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788201522.919275:0:18175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458307328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201522.919372:0:18175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458307328:12345-0@lo:400:kworker.0 Request processed in 100us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201522.919381:0:18175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788201522.919410:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458307584 00000100:00100000:1.0:1788201522.919427:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458307584 00000100:00100000:1.0:1788201522.919456:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458307712 00000100:00100000:1.0:1788201522.919459:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458307712 00000100:00100000:1.0:1788201522.919483:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1788201522.919490:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458307584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201522.919539:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458307584:12345-0@lo:400:kworker.0 Request processed in 40us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201522.919546:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1788201522.919559:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1788201522.919566:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f000fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458307712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201522.919597:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f000fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458307712:12345-0@lo:400:kworker.0 Request processed in 33us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201522.919603:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1788201522.919622:0:18186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458307200 00000100:00100000:1.0:1788201522.919626:0:18186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458307200 00000100:00100000:1.0:1788201522.919655:0:18186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788201522.919662:0:18186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c648f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458307200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201522.919693:0:18186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c648f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458307200:12345-0@lo:400:kworker.0 Request processed in 32us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201522.919700:0:18186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:1.0:1788201522.919733:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201522.919738:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201522.919741:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201522.919789:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458307200:0@lo:400:kworker.0 00000100:00100000:1.0:1788201522.919805:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458307712:0@lo:400:kworker.0 00000100:00100000:1.0:1788201522.919814:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458307584:0@lo:400:kworker.0 00000100:00100000:0.0:1788201522.920208:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458307456:0@lo:400:kworker.0 00000100:00100000:0.0:1788201522.920254:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201522.920311:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458307456 00000100:00100000:0.0:1788201522.920317:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458307456 00000100:00100000:0.0:1788201522.920357:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788201522.920364:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3449180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458307456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201522.920405:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3449180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458307456:12345-0@lo:400:kworker.0 Request processed in 41us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201522.920423:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1788201522.920448:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201522.920468:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458307456:0@lo:400:kworker.0 00000100:00100000:2.0:1788201522.920964:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201522.921016:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458307328:0@lo:400:kworker.0 00000100:00100000:0.0:1788201522.921383:0:18175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458307840 00000100:00100000:0.0:1788201522.921389:0:18175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458307840 00000100:00100000:0.0:1788201522.921931:0:18175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788201522.921943:0:18175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458307840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201522.922031:0:18175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458307840:12345-0@lo:400:kworker.0 Request processed in 92us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201522.922039:0:18175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788201522.922249:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458307840:0@lo:400:kworker.0 00000100:00100000:1.0:1788201523.098442:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201523.098474:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201523.098517:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201523.098558:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442772096 00000100:00100000:1.0:1788201523.098569:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442772096 00000100:00100000:1.0:1788201523.098638:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 73 00000100:00100000:1.0:1788201523.098649:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d80f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2362:x1875064442772096:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201523.098729:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d80f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2362:x1875064442772096:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 81us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201523.098737:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 73 00000100:00080000:1.0:1788201523.098758:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201523.098915:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442771968 00000100:00100000:2.0:1788201523.098920:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442771968 00000100:00100000:2.0:1788201523.098960:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 102 00000100:00100000:2.0:1788201523.098970:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c648f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442771968:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201523.099006:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c648f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442771968:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 37us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201523.099013:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 102 00000100:00100000:0.0:1788201523.101911:0:13451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442772224 00000100:00100000:0.0:1788201523.101934:0:13451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442772224 00000100:00100000:0.0:1788201523.102019:0:13451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 319 00000100:00100000:0.0:1788201523.102029:0:13451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2362:x1875064442772224:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201523.102103:0:13451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2362:x1875064442772224:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 77us (3628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201523.102110:0:13451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 319 00000100:00080000:1.0:1788201523.102266:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788201523.175043:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201523.250617:0:20942:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_112g needs >= 4 MDTs 00000100:00100000:1.0:1788201523.429714:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f4ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458307968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201523.429787:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201523.429956:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458307968 00000100:00100000:0.0:1788201523.429965:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458307968 00000100:00100000:0.0:1788201523.430019:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788201523.430028:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d80f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458307968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201523.430062:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1788201523.430132:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d80f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458307968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201523.430138:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788201523.430254:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f4ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458307968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201523.430682:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458308096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201523.430716:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201523.430765:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458308096 00000100:00100000:0.0:1788201523.430769:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458308096 00000100:00100000:0.0:1788201523.430806:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788201523.430812:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0501b34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458308096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201523.430834:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 36110336 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201523.430979:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0501b34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458308096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 165us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201523.430986:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788201523.431033:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458308096:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788201524.197629:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201525.206234:0:20990:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 112h: DNE: cross MDT rename, fail MDT2 and MDT3 ========================================================== 14:38:43 (1788201523) 00010000:00010000:0.0:1788201525.221629:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201526.250596:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201527.023290:0:21038:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_112h needs >= 4 MDTs 00010000:00010000:1.0:1788201527.269629:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201528.037771:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f4dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458308224:0@lo:400:kworker.0 00000100:00100000:2.0:1788201528.037854:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201528.038058:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458308736:0@lo:400:kworker.0 00000100:00100000:2.0:1788201528.038090:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201528.038122:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201528.038128:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458308608:0@lo:400:kworker.0 00000100:00100000:1.0:1788201528.038638:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458308480:0@lo:400:kworker.0 00000100:00100000:2.0:1788201528.038693:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201528.038749:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f4ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458308352:0@lo:400:kworker.0 00000100:00100000:0.0:1788201528.040801:0:18186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458308224 00000100:00100000:0.0:1788201528.040813:0:18186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458308224 00000100:00100000:0.0:1788201528.040880:0:18186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788201528.040890:0:18186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c648dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458308224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201528.041755:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201528.041846:0:18175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458308480 00000100:00100000:1.0:1788201528.041851:0:18175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458308480 00000100:00100000:1.0:1788201528.041906:0:18175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788201528.041915:0:18175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0501b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458308480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201528.041967:0:18175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0501b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458308480:12345-0@lo:400:kworker.0 Request processed in 54us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201528.041974:0:18175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1788201528.041997:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201528.042034:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458308480:0@lo:400:kworker.0 00000100:00100000:1.0:1788201528.042071:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458308736 00000100:00100000:1.0:1788201528.042076:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458308736 00000100:00100000:1.0:1788201528.042104:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458308608 00000100:00100000:1.0:1788201528.042108:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458308608 00000100:00100000:1.0:1788201528.042129:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788201528.042135:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458308736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201528.042170:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458308736:12345-0@lo:400:kworker.0 Request processed in 35us (4079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201528.042176:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788201528.042188:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788201528.042194:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5484e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458308608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201528.042221:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5484e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458308608:12345-0@lo:400:kworker.0 Request processed in 27us (3527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201528.042239:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00080000:1.0:1788201528.042256:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201528.042259:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201528.044089:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458308608:0@lo:400:kworker.0 00000100:00100000:2.0:1788201528.044108:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458308736:0@lo:400:kworker.0 00000100:00100000:3.0:1788201528.044638:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201528.044666:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458308864:0@lo:400:kworker.0 00000100:00100000:3.0:1788201528.044695:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201528.044795:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458308352 00000100:00100000:1.0:1788201528.044801:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458308352 00000100:00100000:1.0:1788201528.044860:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458308864 00000100:00100000:1.0:1788201528.044863:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458308864 00000100:00100000:1.0:1788201528.044884:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788201528.044909:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458308352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201528.044975:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458308352:12345-0@lo:400:kworker.0 Request processed in 83us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201528.044982:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788201528.044999:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788201528.045005:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458308864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201528.045033:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458308864:12345-0@lo:400:kworker.0 Request processed in 28us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201528.045039:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788201528.045519:0:18186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c648dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458308224:12345-0@lo:400:kworker.0 Request processed in 4628us (7663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201528.045529:0:18186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:3.0:1788201528.045605:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201528.045630:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f4ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458308352:0@lo:400:kworker.0 00000100:00100000:3.0:1788201528.045639:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458308864:0@lo:400:kworker.0 00000100:00100000:1.0:1788201528.045775:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f4dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458308224:0@lo:400:kworker.0 00000100:00100000:1.0:1788201528.215391:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201528.215431:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201528.215482:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201528.215620:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442772352 00000100:00100000:2.0:1788201528.215631:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442772352 00000100:00100000:2.0:1788201528.215691:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 104 00000100:00100000:2.0:1788201528.215702:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c648e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442772352:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201528.215776:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c648e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442772352:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 76us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201528.215784:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 104 00000100:00100000:3.0:1788201528.217387:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442772608 00000100:00100000:3.0:1788201528.217399:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442772608 00000100:00100000:3.0:1788201528.217484:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 322 00000100:00100000:3.0:1788201528.217494:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c23d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2359:x1875064442772608:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201528.217561:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c23d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2359:x1875064442772608:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 69us (2078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201528.217568:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 322 00000100:00080000:2.0:1788201528.218056:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201528.218137:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442772480 00000100:00100000:0.0:1788201528.218142:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442772480 00000100:00100000:0.0:1788201528.218196:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 77 00000100:00100000:0.0:1788201528.218203:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c23d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2359:x1875064442772480:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201528.218245:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c23d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2359:x1875064442772480:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 43us (2865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201528.218251:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 77 00000100:00080000:2.0:1788201528.218328:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788201528.294412:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201528.550153:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458308992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201528.550248:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201528.550352:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458308992 00000100:00100000:2.0:1788201528.550362:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458308992 00000100:00100000:2.0:1788201528.550420:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788201528.550441:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5487800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458308992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201528.550487:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 36110336 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201528.550536:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5487800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458308992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201528.550544:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788201528.550600:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458308992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201528.550823:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201528.550834:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458309120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201528.550869:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201528.550901:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458309120 00000100:00100000:0.0:1788201528.550905:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458309120 00000100:00100000:0.0:1788201528.550936:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788201528.550943:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458309120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201528.550968:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1788201528.551004:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458309120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201528.551011:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788201528.551048:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458309120:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788201529.202330:0:21087:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 112i: DNE: cross MDT rename, fail MDT2 and MDT4 ========================================================== 14:38:47 (1788201527) 00010000:00010000:2.0:1788201529.326475:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201530.343534:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201530.741849:0:21135:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_112i needs >= 4 MDTs 00010000:00010000:0.0:1788201531.365544:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201532.390745:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201532.682157:0:21183:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 112j: DNE: cross MDT rename, fail MDT3 and MDT4 ========================================================== 14:38:51 (1788201531) 00000100:00100000:3.0:1788201533.158908:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458309504:0@lo:400:kworker.0 00000100:00100000:2.0:1788201533.158934:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458309632:0@lo:400:kworker.0 00000100:00100000:1.0:1788201533.159003:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458309376:0@lo:400:kworker.0 00000100:00100000:0.0:1788201533.159062:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458309248:0@lo:400:kworker.0 00000100:00100000:2.0:1788201533.161314:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201533.161448:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458309632 00000100:00100000:2.0:1788201533.161663:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458309632 00000100:00100000:2.0:1788201533.161727:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788201533.161738:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458309632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201533.161801:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458309632:12345-0@lo:400:kworker.0 Request processed in 66us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201533.161807:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00080000:2.0:1788201533.161905:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201533.161942:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458309632:0@lo:400:kworker.0 00000100:00100000:1.0:1788201533.164762:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201533.164812:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458309888:0@lo:400:kworker.0 00000100:00100000:1.0:1788201533.164854:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201533.164912:0:19164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458309376 00000100:00100000:1.0:1788201533.164918:0:19164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458309376 00000100:00100000:1.0:1788201533.164968:0:19164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458309888 00000100:00100000:1.0:1788201533.164972:0:19164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458309888 00000100:00100000:1.0:1788201533.164993:0:19164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788201533.165001:0:19164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c23d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458309376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201533.165055:0:19164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c23d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458309376:12345-0@lo:400:kworker.0 Request processed in 55us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201533.165062:0:19164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788201533.165078:0:19164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788201533.165085:0:19164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458309888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201533.165111:0:19164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458309888:12345-0@lo:400:kworker.0 Request processed in 28us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201533.165117:0:19164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1788201533.165134:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201533.165174:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458309376:0@lo:400:kworker.0 00000100:00100000:1.0:1788201533.165186:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458309888:0@lo:400:kworker.0 00000100:00100000:3.0:1788201533.165600:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201533.165651:0:19164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458309504 00000100:00100000:2.0:1788201533.165656:0:19164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458309504 00000100:00100000:2.0:1788201533.165700:0:19164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788201533.165707:0:19164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458309504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201533.165751:0:19164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458309504:12345-0@lo:400:kworker.0 Request processed in 45us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201533.165758:0:19164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1788201533.165817:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201533.166141:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458309504:0@lo:400:kworker.0 00000100:00100000:0.0:1788201533.167552:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201533.167608:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458309760:0@lo:400:kworker.0 00000100:00100000:0.0:1788201533.167650:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201533.167733:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458309248 00000100:00100000:1.0:1788201533.167740:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458309248 00000100:00100000:1.0:1788201533.167792:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788201533.167800:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c648cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458309248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201533.167853:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c648cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458309248:12345-0@lo:400:kworker.0 Request processed in 53us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201533.167860:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788201533.168333:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458309248:0@lo:400:kworker.0 00000100:00100000:2.0:1788201533.169145:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458309760 00000100:00100000:2.0:1788201533.169166:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458309760 00000100:00080000:3.0:1788201533.169290:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201533.169434:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1788201533.169444:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458309760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201533.169518:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458309760:12345-0@lo:400:kworker.0 Request processed in 76us (1866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201533.169525:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788201533.169615:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458309760:0@lo:400:kworker.0 00000100:00100000:2.0:1788201533.334253:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201533.334374:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201533.334413:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201533.334489:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442772736 00000100:00100000:0.0:1788201533.334497:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442772992 00000100:00100000:3.0:1788201533.334499:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442772736 00000100:00100000:0.0:1788201533.334501:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442772992 00000100:00100000:0.0:1788201533.334552:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 325 00000100:00100000:3.0:1788201533.334552:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 106 00000100:00100000:0.0:1788201533.334561:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2362:x1875064442772992:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201533.334561:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c648c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442772736:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201533.334634:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2362:x1875064442772992:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 75us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201533.334642:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 325 00000100:00100000:1.0:1788201533.334648:0:18175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442772864 00000100:00100000:1.0:1788201533.334652:0:18175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442772864 00000100:00100000:1.0:1788201533.334683:0:18175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 81 00000100:00100000:1.0:1788201533.334691:0:18175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2362:x1875064442772864:12345-192.168.201.30@tcp:400:kworker.0 00000100:00080000:2.0:1788201533.334752:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201533.334757:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201533.339127:0:18175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2362:x1875064442772864:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 4411us (4859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201533.339143:0:18175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 81 00000100:00100000:2.0:1788201533.341905:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c648c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442772736:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 7333us (7519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201533.341923:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 106 00010000:00010000:1.0:1788201533.413875:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201533.669997:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458310016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201533.670084:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201533.670322:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c6630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458310144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201533.670369:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201533.670440:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458310016 00000100:00100000:2.0:1788201533.670448:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458310016 00000100:00100000:2.0:1788201533.670496:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788201533.670508:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458310016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201533.670548:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1788201533.670600:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458310016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201533.670608:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788201533.670627:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458310144 00000100:00100000:2.0:1788201533.670630:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458310144 00000100:00100000:2.0:1788201533.670649:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788201533.670656:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458310144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201533.670678:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 36110336 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201533.671115:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458310144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 459us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201533.671122:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788201533.671166:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458310016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201533.671234:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c6630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458310144:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1788201534.311735:0:21231:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_112j needs >= 4 MDTs 00010000:00010000:1.0:1788201534.445670:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201535.462540:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201535.953944:0:21280:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 112k: DNE: cross MDT rename, fail MDT1,MDT2,MDT3 ========================================================== 14:38:54 (1788201534) 00010000:00010000:1.0:1788201536.486147:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201537.509833:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201537.552452:0:21328:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_112k needs >= 4 MDTs 00000100:00100000:0.0:1788201538.277670:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458310272:0@lo:400:kworker.0 00000100:00100000:0.0:1788201538.277762:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201538.277814:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458310784:0@lo:400:kworker.0 00000100:00100000:0.0:1788201538.277841:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201538.277867:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201538.277874:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458310656:0@lo:400:kworker.0 00000100:00100000:0.0:1788201538.277897:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201538.277910:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458310528:0@lo:400:kworker.0 00000100:00100000:0.0:1788201538.277943:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458310784 00000100:00100000:0.0:1788201538.277954:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458310784 00000100:00100000:2.0:1788201538.277991:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201538.278022:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458310656 00000100:00100000:0.0:1788201538.278028:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458310656 00000100:00100000:2.0:1788201538.278048:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788201538.278058:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1788201538.278072:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458310784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201538.278074:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458310400:0@lo:400:kworker.0 00000100:00100000:2.0:1788201538.278545:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201538.278720:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875064458310912:0@lo:400:kworker.0 00000100:00100000:2.0:1788201538.279189:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201538.279405:0:19164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458310528 00000100:00100000:3.0:1788201538.279413:0:19164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458310528 00000100:00100000:3.0:1788201538.279455:0:19164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458310400 00000100:00100000:3.0:1788201538.279458:0:19164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458310400 00000100:00100000:3.0:1788201538.279483:0:19164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458310912 00000100:00100000:3.0:1788201538.279486:0:19164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458310912 00000100:00100000:3.0:1788201538.279503:0:19164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788201538.279511:0:19164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c6632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458310528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201538.279581:0:19164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c6632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458310528:12345-0@lo:400:kworker.0 Request processed in 70us (1590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201538.279598:0:19164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788201538.279625:0:19164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788201538.279631:0:19164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c6630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875064458310400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201538.279673:0:19164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c6630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875064458310400:12345-0@lo:400:kworker.0 Request processed in 43us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201538.279679:0:19164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788201538.279689:0:19164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788201538.279695:0:19164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c6630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875064458310912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201538.279717:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458310272 00000100:00100000:1.0:1788201538.279721:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458310272 00000100:00100000:3.0:1788201538.279722:0:19164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c6630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875064458310912:12345-0@lo:400:kworker.0 Request processed in 27us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201538.279727:0:19164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788201538.279780:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458310400:0@lo:400:kworker.0 00000100:00100000:3.0:1788201538.279793:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875064458310912:0@lo:400:kworker.0 00000100:00100000:3.0:1788201538.279804:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458310528:0@lo:400:kworker.0 00000100:00100000:1.0:1788201538.279817:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788201538.279824:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c32e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458310272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201538.279850:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788201538.279858:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458310656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201538.279859:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c32e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458310272:12345-0@lo:400:kworker.0 Request processed in 37us (2099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201538.279864:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788201538.279888:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458310656:12345-0@lo:400:kworker.0 Request processed in 32us (1992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201538.279895:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788201538.279924:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458310656:0@lo:400:kworker.0 00000100:00100000:1.0:1788201538.279935:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458310272:0@lo:400:kworker.0 00000100:00100000:1.0:1788201538.279950:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458310784:0@lo:400:kworker.0 00000100:00080000:2.0:1788201538.279962:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201538.279974:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201538.279978:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201538.280072:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458310784:12345-0@lo:400:kworker.0 Request processed in 78us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201538.280081:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788201538.452541:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201538.453789:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201538.453831:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201538.453889:0:19164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442773248 00000100:00100000:0.0:1788201538.453898:0:19164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442773248 00000100:00100000:0.0:1788201538.453979:0:19164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 85 00000100:00100000:0.0:1788201538.453989:0:19164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2362:x1875064442773248:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201538.454061:0:19164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2362:x1875064442773248:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 74us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201538.454068:0:19164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 85 00000100:00080000:1.0:1788201538.454238:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201538.454324:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442773376 00000100:00100000:3.0:1788201538.454328:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442773376 00000100:00100000:3.0:1788201538.454422:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 328 00000100:00100000:3.0:1788201538.454429:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2362:x1875064442773376:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201538.454467:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2362:x1875064442773376:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 39us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201538.454474:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 328 00000100:00100000:2.0:1788201538.460087:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442773120 00000100:00100000:2.0:1788201538.460104:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442773120 00000100:00100000:2.0:1788201538.460185:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 108 00000100:00100000:2.0:1788201538.460194:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c32e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442773120:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201538.460504:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c32e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442773120:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 310us (7971us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201538.460511:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 108 00000100:00080000:1.0:1788201538.461154:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788201538.533570:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201538.789653:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458311040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201538.789731:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201538.789871:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201538.789881:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458311168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201538.789911:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201538.789988:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458311040 00000100:00100000:0.0:1788201538.789996:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458311040 00000100:00100000:0.0:1788201538.790056:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458311168 00000100:00100000:0.0:1788201538.790060:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458311168 00000100:00100000:0.0:1788201538.790079:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788201538.790087:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458311040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201538.790121:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1788201538.790183:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458311040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201538.790190:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788201538.790206:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788201538.790213:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4dea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458311168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201538.790230:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 36110336 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201538.790274:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4dea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458311168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201538.790281:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788201538.790360:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458311168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201538.790396:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458311040:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788201539.389965:0:21376:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 112l: DNE: cross MDT rename, fail MDT1,MDT2,MDT4 ========================================================== 14:38:57 (1788201537) 00010000:00010000:0.0:1788201539.558686:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201540.585999:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201541.197744:0:21424:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_112l needs >= 4 MDTs 00010000:00010000:2.0:1788201541.607684:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201542.632551:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201543.046899:0:21473:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 112m: DNE: cross MDT rename, fail MDT1,MDT3,MDT4 ========================================================== 14:39:01 (1788201541) 00000100:00100000:1.0:1788201543.397641:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458311552:0@lo:400:kworker.0 00000100:00100000:1.0:1788201543.397720:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201543.397784:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788201543.397791:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458311424:0@lo:400:kworker.0 00000100:00100000:1.0:1788201543.397812:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201543.397834:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875064458311936:0@lo:400:kworker.0 00000100:00100000:1.0:1788201543.397854:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201543.397886:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458311552 00000100:00100000:1.0:1788201543.397893:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458311552 00000100:00100000:1.0:1788201543.397961:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458311424 00000100:00100000:1.0:1788201543.397964:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458311424 00000100:00100000:1.0:1788201543.397980:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458311936 00000100:00100000:1.0:1788201543.397983:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458311936 00000100:00100000:1.0:1788201543.397995:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788201543.398003:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458311552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201543.398055:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458311552:12345-0@lo:400:kworker.0 Request processed in 52us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201543.398061:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788201543.398076:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788201543.398081:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875064458311424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201543.398109:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875064458311424:12345-0@lo:400:kworker.0 Request processed in 28us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201543.398116:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788201543.398126:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788201543.398132:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875064458311936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201543.398155:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875064458311936:12345-0@lo:400:kworker.0 Request processed in 24us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201543.398161:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1788201543.398191:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201543.398222:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458311424:0@lo:400:kworker.0 00000100:00100000:1.0:1788201543.398232:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875064458311936:0@lo:400:kworker.0 00000100:00100000:1.0:1788201543.398240:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458311552:0@lo:400:kworker.0 00000100:00100000:3.0:1788201543.398513:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458311680:0@lo:400:kworker.0 00000100:00100000:3.0:1788201543.398548:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201543.398591:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788201543.398598:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458311296:0@lo:400:kworker.0 00000100:00100000:3.0:1788201543.398626:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201543.398652:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458311808:0@lo:400:kworker.0 00000100:00100000:3.0:1788201543.398671:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201543.398701:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458311680 00000100:00100000:3.0:1788201543.398705:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458311680 00000100:00100000:3.0:1788201543.398735:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458311808 00000100:00100000:3.0:1788201543.398738:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458311808 00000100:00100000:3.0:1788201543.398759:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1788201543.398765:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458311680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201543.398800:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458311680:12345-0@lo:400:kworker.0 Request processed in 34us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201543.398806:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1788201543.398817:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1788201543.398823:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458311808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201543.398850:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458311808:12345-0@lo:400:kworker.0 Request processed in 27us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201543.398855:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00080000:3.0:1788201543.398874:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201543.398877:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201543.398894:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458311808:0@lo:400:kworker.0 00000100:00100000:3.0:1788201543.398904:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458311680:0@lo:400:kworker.0 00000100:00100000:1.0:1788201543.399496:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458311296 00000100:00100000:1.0:1788201543.399502:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458311296 00000100:00100000:1.0:1788201543.399544:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788201543.399551:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c32e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458311296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201543.399615:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c32e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458311296:12345-0@lo:400:kworker.0 Request processed in 65us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201543.399621:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788201543.399744:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458311296:0@lo:400:kworker.0 00000100:00100000:0.0:1788201543.574356:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201543.574409:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201543.574447:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201543.574549:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442773504 00000100:00100000:2.0:1788201543.574556:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442773632 00000100:00100000:3.0:1788201543.574559:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442773504 00000100:00100000:2.0:1788201543.574563:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442773632 00000100:00100000:3.0:1788201543.574625:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 110 00000100:00100000:2.0:1788201543.574633:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 89 00000100:00100000:3.0:1788201543.574639:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c32e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442773504:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201543.574646:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2359:x1875064442773632:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201543.574716:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2359:x1875064442773632:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 75us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201543.574723:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 89 00000100:00100000:1.0:1788201543.574908:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442773760 00000100:00100000:1.0:1788201543.574913:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442773760 00000100:00100000:1.0:1788201543.574945:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 331 00000100:00100000:1.0:1788201543.574952:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2359:x1875064442773760:12345-192.168.201.30@tcp:400:kworker.0 00000100:00080000:0.0:1788201543.575007:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201543.575012:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201543.579908:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c32e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442773504:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 5263us (5552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201543.579923:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 110 00000100:00100000:1.0:1788201543.580585:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2359:x1875064442773760:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 5337us (5879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201543.580599:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 331 00010000:00010000:1.0:1788201543.655590:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201543.909530:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458312064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201543.909612:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201543.909747:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201543.909762:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f4de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458312192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201543.909795:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201543.909834:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458312064 00000100:00100000:2.0:1788201543.909842:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458312064 00000100:00100000:2.0:1788201543.909887:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458312192 00000100:00100000:2.0:1788201543.909890:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458312192 00000100:00100000:2.0:1788201543.909907:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788201543.909914:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458312064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201543.909966:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1788201543.910126:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788201543.910151:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4e76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458312192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201543.910201:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 36110336 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201543.910344:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4e76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458312192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 205us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201543.910353:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788201543.910431:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f4de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458312192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201543.918481:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458312064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5250us (5552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201543.918505:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788201543.922587:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458312064:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788201544.679174:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201544.812555:0:21521:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_112m needs >= 4 MDTs 00010000:00010000:2.0:1788201545.701585:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201546.732751:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201546.882170:0:21569:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 112n: DNE: cross MDT rename, fail MDT2,MDT3,MDT4 ========================================================== 14:39:05 (1788201545) 00010000:00010000:1.0:1788201547.750053:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201548.524271:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458312320:0@lo:400:kworker.0 00000100:00100000:0.0:1788201548.525424:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201548.525473:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458312832:0@lo:400:kworker.0 00000100:00100000:0.0:1788201548.525502:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201548.525528:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201548.525534:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458312704:0@lo:400:kworker.0 00000100:00100000:0.0:1788201548.525553:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201548.525581:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458312448:0@lo:400:kworker.0 00000100:00100000:0.0:1788201548.525605:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201548.525622:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458312960:0@lo:400:kworker.0 00000100:00100000:0.0:1788201548.525640:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201548.525658:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201548.525663:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458312576:0@lo:400:kworker.0 00000100:00100000:0.0:1788201548.525681:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201548.525709:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458312320 00000100:00100000:0.0:1788201548.525715:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458312320 00000100:00100000:0.0:1788201548.525758:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788201548.525767:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c32eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458312320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201548.525815:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c32eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458312320:12345-0@lo:400:kworker.0 Request processed in 49us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201548.525823:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788201548.525853:0:18175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458312448 00000100:00100000:0.0:1788201548.525856:0:18175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458312448 00000100:00100000:0.0:1788201548.525886:0:18175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458312960 00000100:00100000:0.0:1788201548.525889:0:18175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458312960 00000100:00100000:0.0:1788201548.525900:0:18175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458312576 00000100:00100000:0.0:1788201548.525902:0:18175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458312576 00000100:00100000:0.0:1788201548.525914:0:18175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788201548.525920:0:18175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0006d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458312448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201548.525954:0:18175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0006d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875064458312448:12345-0@lo:400:kworker.0 Request processed in 33us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201548.525961:0:18175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788201548.526413:0:13442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458312832 00000100:00100000:2.0:1788201548.526419:0:13442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458312832 00000100:00100000:3.0:1788201548.526444:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458312704 00000100:00100000:3.0:1788201548.526450:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458312704 00000100:00100000:2.0:1788201548.526462:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1788201548.526472:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458312832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201548.526484:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788201548.526494:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458312704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201548.526518:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458312832:12345-0@lo:400:kworker.0 Request processed in 48us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201548.526527:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788201548.526541:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458312704:12345-0@lo:400:kworker.0 Request processed in 49us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201548.526549:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788201548.526556:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788201548.526566:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458312960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201548.526604:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458312960:12345-0@lo:400:kworker.0 Request processed in 39us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201548.526610:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788201548.526628:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788201548.526635:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458312576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201548.526667:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458312576:12345-0@lo:400:kworker.0 Request processed in 33us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201548.526673:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788201548.529578:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458312704:0@lo:400:kworker.0 00000100:00100000:0.0:1788201548.529593:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458312320:0@lo:400:kworker.0 00000100:00100000:0.0:1788201548.529605:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458312832:0@lo:400:kworker.0 00000100:00080000:0.0:1788201548.529636:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201548.529641:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201548.529644:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201548.529661:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458312576:0@lo:400:kworker.0 00000100:00100000:0.0:1788201548.529673:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458312448:0@lo:400:kworker.0 00000100:00100000:0.0:1788201548.529684:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458312960:0@lo:400:kworker.0 00000001:02000400:2.0:1788201548.595782:0:21617:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_112n needs >= 4 MDTs 00000100:00100000:0.0:1788201548.695494:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201548.695543:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201548.695584:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201548.695617:0:19164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442774016 00000100:00100000:0.0:1788201548.695626:0:19164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442774016 00000100:00100000:3.0:1788201548.695634:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442774144 00000100:00100000:3.0:1788201548.695641:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442774144 00000100:00100000:0.0:1788201548.695700:0:19164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93 00000100:00100000:3.0:1788201548.695705:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 334 00000100:00100000:0.0:1788201548.695716:0:19164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442774016:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201548.695721:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2360:x1875064442774144:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201548.695799:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442773888 00000100:00100000:1.0:1788201548.695805:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442773888 00000100:00100000:1.0:1788201548.695837:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 112 00000100:00100000:1.0:1788201548.695845:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c32ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442773888:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201548.695908:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2360:x1875064442774144:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 192us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201548.695916:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 334 00000100:00100000:0.0:1788201548.698786:0:19164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442774016:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 3064us (3190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201548.698800:0:19164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93 00000100:00080000:0.0:1788201548.698837:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201548.698844:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201548.698933:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c32ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442773888:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 3086us (3446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201548.698944:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 112 00010000:00010000:2.0:1788201548.773515:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201549.029545:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788201549.029569:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458313216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201549.029647:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201549.029693:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458313088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201549.029717:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201549.030127:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458313216 00000100:00100000:3.0:1788201549.030136:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458313216 00000100:00100000:3.0:1788201549.030188:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458313088 00000100:00100000:3.0:1788201549.030192:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458313088 00000100:00100000:3.0:1788201549.030209:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788201549.030217:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458313216:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201549.030225:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788201549.030232:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458313088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201549.030252:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00002000:00000024:3.0:1788201549.030252:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 36110336 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201549.030346:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458313088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201549.030354:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788201549.031026:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458313216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 808us (1377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201549.031034:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788201549.034177:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d1f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458313216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201549.034199:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458313088:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788201549.797463:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201550.441599:0:21666:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 115: failover for create/unlink striped directory ========================================================== 14:39:09 (1788201549) 00010000:00010000:1.0:1788201550.821562:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201551.846481:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201552.104236:0:21714:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_115 needs >= 2 MDTs 00010000:00010000:3.0:1788201552.869615:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201553.599268:0:21762:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 116a: large update log master MDT recovery ========================================================== 14:39:12 (1788201552) 00000100:00100000:2.0:1788201553.637575:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458313600:0@lo:400:kworker.0 00000100:00100000:2.0:1788201553.637647:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201553.637704:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201553.637710:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458313728:0@lo:400:kworker.0 00000100:00100000:2.0:1788201553.637736:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201553.637779:0:18175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458313600 00000100:00100000:2.0:1788201553.637786:0:18175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458313600 00000100:00100000:2.0:1788201553.637847:0:18175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788201553.637857:0:18175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c49f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458313600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201553.637922:0:18175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c49f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458313600:12345-0@lo:400:kworker.0 Request processed in 67us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201553.637930:0:18175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788201553.637954:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458313728 00000100:00100000:2.0:1788201553.637958:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458313728 00000100:00100000:0.0:1788201553.638123:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458313344:0@lo:400:kworker.0 00000100:00100000:0.0:1788201553.638162:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201553.638185:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458313856:0@lo:400:kworker.0 00000100:00100000:0.0:1788201553.638205:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201553.638224:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788201553.638229:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875064458313472:0@lo:400:kworker.0 00000100:00100000:0.0:1788201553.638248:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201553.638262:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c49f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875064458313984:0@lo:400:kworker.0 00000100:00100000:0.0:1788201553.638279:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201553.638326:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458313344 00000100:00100000:0.0:1788201553.638330:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458313344 00000100:00100000:0.0:1788201553.638361:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788201553.638368:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c32ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458313344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201553.638402:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c32ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458313344:12345-0@lo:400:kworker.0 Request processed in 35us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201553.638409:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788201553.638437:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458313856 00000100:00100000:0.0:1788201553.638441:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458313856 00000100:00100000:0.0:1788201553.638467:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1788201553.638474:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0007b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458313856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201553.638504:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0007b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458313856:12345-0@lo:400:kworker.0 Request processed in 31us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201553.638510:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1788201553.638526:0:19164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458313472 00000100:00100000:0.0:1788201553.638529:0:19164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458313472 00000100:00100000:0.0:1788201553.638551:0:19164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458313984 00000100:00100000:0.0:1788201553.638554:0:19164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458313984 00000100:00100000:0.0:1788201553.638567:0:19164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788201553.638579:0:19164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875064458313472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201553.638610:0:19164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875064458313472:12345-0@lo:400:kworker.0 Request processed in 31us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201553.638616:0:19164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788201553.638627:0:19164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788201553.638632:0:19164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875064458313984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201553.638655:0:19164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875064458313984:12345-0@lo:400:kworker.0 Request processed in 22us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201553.638660:0:19164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788201553.638704:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d1f0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875064458313472:0@lo:400:kworker.0 00000100:00100000:0.0:1788201553.638713:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c49f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875064458313984:0@lo:400:kworker.0 00000100:00100000:0.0:1788201553.638719:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d1f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458313344:0@lo:400:kworker.0 00000100:00100000:0.0:1788201553.638726:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d1f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458313856:0@lo:400:kworker.0 00000100:00100000:2.0:1788201553.638830:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788201553.638838:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c49f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458313728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201553.638871:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c49f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458313728:12345-0@lo:400:kworker.0 Request processed in 33us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201553.638877:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00080000:2.0:1788201553.638905:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201553.638909:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201553.638912:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201553.638933:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d1f0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458313728:0@lo:400:kworker.0 00000100:00100000:2.0:1788201553.638943:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d1f0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458313600:0@lo:400:kworker.0 00000100:00100000:0.0:1788201553.820823:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201553.820871:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201553.820920:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201553.820933:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442774272 00000100:00100000:3.0:1788201553.820951:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442774272 00000100:00100000:2.0:1788201553.820976:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442774528 00000100:00100000:2.0:1788201553.820987:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442774528 00000100:00100000:1.0:1788201553.821044:0:19164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442774400 00000100:00100000:1.0:1788201553.821050:0:19164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442774400 00000100:00100000:3.0:1788201553.821056:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 114 00000100:00100000:3.0:1788201553.821074:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c32eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442774272:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201553.821086:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 337 00000100:00100000:1.0:1788201553.821088:0:19164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 97 00000100:00100000:1.0:1788201553.821099:0:19164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2359:x1875064442774400:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201553.821099:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f0004e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2359:x1875064442774528:12345-192.168.201.30@tcp:400:kworker.0 00000100:00080000:0.0:1788201553.821189:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201553.821194:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201553.821361:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c32eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442774272:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 292us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201553.821371:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 114 00000100:00100000:1.0:1788201553.821695:0:19164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2359:x1875064442774400:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 596us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201553.821705:0:19164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 97 00000100:00100000:1.0:1788201553.835340:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f0004e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2359:x1875064442774528:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 14186us (14410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201553.835358:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 337 00010000:00010000:1.0:1788201553.894198:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201554.149712:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458314112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201554.149814:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201554.150119:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458314112 00000100:00100000:0.0:1788201554.150129:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458314112 00000100:00100000:0.0:1788201554.150213:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788201554.150226:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458314112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201554.150277:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1788201554.150382:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458314112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201554.150389:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788201554.150599:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458314112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201554.151247:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c49f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458314240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201554.151328:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201554.151509:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458314240 00000100:00100000:2.0:1788201554.151517:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458314240 00000100:00100000:2.0:1788201554.151572:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788201554.151582:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458314240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201554.151625:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 36110336 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201554.151681:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458314240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201554.151689:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788201554.151882:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c49f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458314240:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788201554.917825:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201555.497917:0:21810:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_116a needs >= 2 MDTs 00010000:00010000:3.0:1788201555.943880:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201556.970031:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201557.465854:0:21859:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 116b: large update log slave MDT recovery ========================================================== 14:39:15 (1788201555) 00010000:00010000:1.0:1788201557.992019:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201558.757691:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458314624:0@lo:400:kworker.0 00000100:00100000:1.0:1788201558.757790:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201558.757861:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201558.757868:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458314752:0@lo:400:kworker.0 00000100:00100000:1.0:1788201558.757905:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201558.757964:0:13451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458314752 00000100:00100000:1.0:1788201558.757974:0:13451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458314752 00000100:00100000:1.0:1788201558.758047:0:13451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1788201558.758058:0:13451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458314752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201558.758125:0:13451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458314752:12345-0@lo:400:kworker.0 Request processed in 68us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201558.758133:0:13451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00080000:1.0:1788201558.758158:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201558.758197:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458314752:0@lo:400:kworker.0 00000100:00100000:3.0:1788201558.758289:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458314496:0@lo:400:kworker.0 00000100:00100000:3.0:1788201558.758344:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201558.758364:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875064458315008:0@lo:400:kworker.0 00000100:00100000:3.0:1788201558.758386:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201558.758407:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788201558.758414:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458314368:0@lo:400:kworker.0 00000100:00100000:3.0:1788201558.758445:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201558.758469:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c53ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458314880:0@lo:400:kworker.0 00000100:00100000:3.0:1788201558.758492:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201558.758519:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458314624 00000100:00100000:3.0:1788201558.758523:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458314624 00000100:00100000:3.0:1788201558.758555:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458314496 00000100:00100000:3.0:1788201558.758559:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458314496 00000100:00100000:3.0:1788201558.758573:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458315008 00000100:00100000:3.0:1788201558.758576:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458315008 00000100:00100000:3.0:1788201558.758590:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788201558.758596:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458314624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201558.758649:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458314624:12345-0@lo:400:kworker.0 Request processed in 52us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201558.758655:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788201558.758669:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788201558.758675:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875064458314496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201558.758709:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875064458314496:12345-0@lo:400:kworker.0 Request processed in 34us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201558.758715:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788201558.758726:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788201558.758732:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875064458315008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201558.758758:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875064458315008:12345-0@lo:400:kworker.0 Request processed in 27us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201558.758764:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788201558.758784:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458314368 00000100:00100000:3.0:1788201558.758787:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458314368 00000100:00100000:3.0:1788201558.758814:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788201558.758821:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c32e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458314368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201558.758851:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c32e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458314368:12345-0@lo:400:kworker.0 Request processed in 31us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201558.758857:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788201558.758886:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458314880 00000100:00100000:3.0:1788201558.758889:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458314880 00000100:00100000:3.0:1788201558.758928:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788201558.758935:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458314880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201558.758972:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458314880:12345-0@lo:400:kworker.0 Request processed in 37us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201558.758978:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788201558.759011:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458314368:0@lo:400:kworker.0 00000100:00100000:3.0:1788201558.759021:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458314880:0@lo:400:kworker.0 00000100:00100000:3.0:1788201558.759030:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458314496:0@lo:400:kworker.0 00000100:00100000:3.0:1788201558.759038:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875064458315008:0@lo:400:kworker.0 00000100:00080000:1.0:1788201558.759265:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201558.759271:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201558.759320:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c53ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458314624:0@lo:400:kworker.0 00000100:00100000:3.0:1788201558.931466:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201558.931517:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201558.931552:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201558.931610:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442774784 00000100:00100000:3.0:1788201558.931624:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442774784 00000100:00100000:2.0:1788201558.931699:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442774912 00000100:00100000:2.0:1788201558.931704:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442774912 00000100:00100000:3.0:1788201558.931722:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 101 00000100:00100000:3.0:1788201558.931733:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442774784:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201558.931753:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 340 00000100:00100000:2.0:1788201558.931761:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4de8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2360:x1875064442774912:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201558.931843:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442774784:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 111us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201558.931852:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 101 00000100:00080000:3.0:1788201558.931877:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201558.931883:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201558.932064:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442774656 00000100:00100000:1.0:1788201558.932070:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442774656 00000100:00100000:1.0:1788201558.932105:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 116 00000100:00100000:1.0:1788201558.932113:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c32e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442774656:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201558.936333:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4de8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2360:x1875064442774912:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 4553us (4796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201558.936355:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 340 00000100:00100000:1.0:1788201558.942353:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c32e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442774656:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 10219us (10882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201558.942374:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 116 00010000:00010000:1.0:1788201559.013482:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201559.079940:0:21907:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_116b needs >= 2 MDTs 00000100:00100000:1.0:1788201559.270495:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f4ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458315136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201559.270603:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201559.277125:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201559.277152:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c49f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458315264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201559.277250:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201559.277335:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458315136 00000100:00100000:1.0:1788201559.277345:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458315136 00000100:00100000:1.0:1788201559.277398:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458315264 00000100:00100000:1.0:1788201559.277402:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458315264 00000100:00100000:1.0:1788201559.277419:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788201559.277428:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458315136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201559.277479:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1788201559.277536:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458315136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (6933us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201559.277543:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788201559.277563:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788201559.277570:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458315264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201559.277592:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 36110336 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201559.277620:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458315264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201559.277628:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788201559.277691:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c49f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458315264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201559.277709:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f4ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458315136:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788201560.040109:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201560.880102:0:21955:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 117: DNE: cross MDT unlink, fail MDT1 and MDT2 ========================================================== 14:39:19 (1788201559) 00010000:00010000:0.0:1788201561.065392:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201562.086081:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201562.905455:0:22003:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_117 needs >= 4 MDTs 00010000:00010000:0.0:1788201563.109428:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201563.878203:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458315520:0@lo:400:kworker.0 00000100:00100000:3.0:1788201563.878278:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201563.878371:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875064458316032:0@lo:400:kworker.0 00000100:00100000:3.0:1788201563.878413:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201563.878441:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788201563.878462:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f0004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458315392:0@lo:400:kworker.0 00000100:00100000:3.0:1788201563.878492:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201563.878513:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458315904:0@lo:400:kworker.0 00000100:00100000:3.0:1788201563.878535:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201563.878568:0:19164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458315520 00000100:00100000:3.0:1788201563.878586:0:19164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458315520 00000100:00100000:3.0:1788201563.878635:0:19164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458316032 00000100:00100000:3.0:1788201563.878638:0:19164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458316032 00000100:00100000:3.0:1788201563.878659:0:19164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788201563.878668:0:19164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875064458315520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201563.878730:0:19164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875064458315520:12345-0@lo:400:kworker.0 Request processed in 63us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201563.878737:0:19164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788201563.878753:0:19164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788201563.878759:0:19164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875064458316032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201563.878786:0:19164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875064458316032:12345-0@lo:400:kworker.0 Request processed in 28us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201563.878792:0:19164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788201563.878811:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458315392 00000100:00100000:3.0:1788201563.878814:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458315392 00000100:00100000:3.0:1788201563.878849:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788201563.878855:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458315392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201563.878883:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458315392:12345-0@lo:400:kworker.0 Request processed in 28us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201563.878889:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788201563.878916:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458315904 00000100:00100000:3.0:1788201563.878919:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458315904 00000100:00100000:3.0:1788201563.878946:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1788201563.878952:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458315904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201563.878979:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458315904:12345-0@lo:400:kworker.0 Request processed in 27us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201563.878988:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00080000:3.0:1788201563.879002:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201563.879007:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201563.879042:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f0004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458315392:0@lo:400:kworker.0 00000100:00100000:3.0:1788201563.879054:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d1f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458315904:0@lo:400:kworker.0 00000100:00100000:3.0:1788201563.879062:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d1f0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458315520:0@lo:400:kworker.0 00000100:00100000:3.0:1788201563.879070:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d1f0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875064458316032:0@lo:400:kworker.0 00000100:00100000:1.0:1788201563.879725:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458315648:0@lo:400:kworker.0 00000100:00100000:1.0:1788201563.879761:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201563.879792:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201563.879799:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458315776:0@lo:400:kworker.0 00000100:00100000:1.0:1788201563.879833:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201563.879961:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458315776 00000100:00100000:0.0:1788201563.879966:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458315776 00000100:00100000:0.0:1788201563.880011:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788201563.880019:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458315776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201563.880064:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458315776:12345-0@lo:400:kworker.0 Request processed in 46us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201563.880071:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788201563.880101:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d1f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458315776:0@lo:400:kworker.0 00000100:00080000:1.0:1788201563.880881:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201563.880946:0:19164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458315648 00000100:00100000:3.0:1788201563.880952:0:19164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458315648 00000100:00100000:3.0:1788201563.881006:0:19164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788201563.881014:0:19164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458315648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201563.881067:0:19164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458315648:12345-0@lo:400:kworker.0 Request processed in 55us (1305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201563.881074:0:19164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1788201563.881165:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201563.881185:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d1f0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458315648:0@lo:400:kworker.0 00000100:00100000:3.0:1788201564.056794:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201564.056855:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201564.056942:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201564.056977:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442775168 00000100:00100000:3.0:1788201564.056991:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442775168 00000100:00100000:3.0:1788201564.059040:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 105 00000100:00100000:3.0:1788201564.059067:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2361:x1875064442775168:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201564.059259:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2361:x1875064442775168:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 203us (2402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201564.059268:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 105 00000100:00100000:3.0:1788201564.059331:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442775296 00000100:00100000:3.0:1788201564.059342:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442775296 00000100:00100000:3.0:1788201564.059387:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 343 00000100:00100000:3.0:1788201564.059394:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2362:x1875064442775296:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201564.059423:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2362:x1875064442775296:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 30us (2481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201564.059429:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 343 00000100:00080000:3.0:1788201564.059590:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201564.059597:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201564.059898:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442775040 00000100:00100000:1.0:1788201564.059905:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442775040 00000100:00100000:1.0:1788201564.059953:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 118 00000100:00100000:1.0:1788201564.059961:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2361:x1875064442775040:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201564.060007:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2361:x1875064442775040:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 47us (3231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201564.060015:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 118 00010000:00010000:0.0:1788201564.133514:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201564.402954:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458316160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201564.403062:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201564.403127:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201564.403135:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458316288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201564.403159:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201564.403201:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458316160 00000100:00100000:3.0:1788201564.403210:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458316160 00000100:00100000:3.0:1788201564.403269:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458316288 00000100:00100000:3.0:1788201564.403273:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458316288 00000100:00100000:3.0:1788201564.403317:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788201564.403328:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458316160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201564.403379:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 36110336 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201564.403430:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458316160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201564.403438:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788201564.403471:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788201564.403478:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458316288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201564.403500:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1788201564.403528:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458316288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201564.403535:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788201564.403586:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458316288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201564.403601:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d1f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458316160:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1788201564.878078:0:22052:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 118: invalidate osp update will not cause update log corruption ========================================================== 14:39:23 (1788201563) 00010000:00010000:1.0:1788201565.165746:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201566.197808:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201566.788107:0:22100:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_118 needs >= 2 MDTs 00010000:00010000:0.0:1788201567.205599:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201568.231018:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201568.998412:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458316416:0@lo:400:kworker.0 00000100:00100000:3.0:1788201568.998454:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458316672:0@lo:400:kworker.0 00000100:00100000:0.0:1788201568.998809:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458316544:0@lo:400:kworker.0 00000100:00100000:1.0:1788201569.000249:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458316800:0@lo:400:kworker.0 00000100:00100000:3.0:1788201569.006091:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201569.006225:0:19164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458316672 00000100:00100000:3.0:1788201569.006238:0:19164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458316672 00000100:00100000:3.0:1788201569.006341:0:19164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788201569.006358:0:19164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458316672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201569.006454:0:19164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458316672:12345-0@lo:400:kworker.0 Request processed in 102us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201569.006464:0:19164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:3.0:1788201569.006493:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201569.006538:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458316672:0@lo:400:kworker.0 00000100:00100000:2.0:1788201569.011842:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201569.011946:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458316928:0@lo:400:kworker.0 00000100:00100000:2.0:1788201569.012509:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201569.012569:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458316416 00000100:00100000:2.0:1788201569.012580:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458316416 00000100:00100000:2.0:1788201569.012639:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788201569.012754:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458316416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201569.012823:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458316416:12345-0@lo:400:kworker.0 Request processed in 175us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201569.012831:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788201569.012872:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458316928 00000100:00100000:2.0:1788201569.012877:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458316928 00000100:00100000:2.0:1788201569.012919:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1788201569.012926:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c49f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458316928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201569.013017:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c49f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458316928:12345-0@lo:400:kworker.0 Request processed in 35us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201569.013025:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00080000:2.0:1788201569.013050:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201569.013085:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458316928:0@lo:400:kworker.0 00000100:00100000:2.0:1788201569.013097:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458316416:0@lo:400:kworker.0 00000100:00100000:1.0:1788201569.022174:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201569.022286:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201569.022353:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875064458317056:0@lo:400:kworker.0 00000100:00100000:1.0:1788201569.022403:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201569.022546:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458316800 00000100:00100000:3.0:1788201569.022557:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458316800 00000100:00100000:3.0:1788201569.022636:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1788201569.022649:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458316800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201569.022746:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458316800:12345-0@lo:400:kworker.0 Request processed in 100us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201569.022754:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1788201569.022783:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458316544 00000100:00100000:3.0:1788201569.022787:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458316544 00000100:00100000:3.0:1788201569.022814:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458317056 00000100:00100000:3.0:1788201569.022819:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458317056 00000100:00100000:3.0:1788201569.022838:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788201569.022845:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875064458316544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201569.022880:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875064458316544:12345-0@lo:400:kworker.0 Request processed in 36us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201569.022887:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788201569.022898:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788201569.022903:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c53e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875064458317056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201569.022930:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c53e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875064458317056:12345-0@lo:400:kworker.0 Request processed in 27us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201569.022935:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1788201569.022975:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201569.022980:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201569.023878:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458316800:0@lo:400:kworker.0 00000100:00100000:1.0:1788201569.023926:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458316544:0@lo:400:kworker.0 00000100:00100000:1.0:1788201569.023938:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875064458317056:0@lo:400:kworker.0 00000001:02000400:1.0:1788201569.098784:0:22148:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 119: timeout of normal replay does not cause DNE replay fails ========================================================== 14:39:27 (1788201567) 00000100:00100000:3.0:1788201569.181042:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201569.181108:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201569.181163:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201569.181217:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442775680 00000100:00100000:3.0:1788201569.181228:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442775680 00000100:00100000:3.0:1788201569.181359:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 346 00000100:00100000:3.0:1788201569.181376:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2362:x1875064442775680:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201569.181474:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2362:x1875064442775680:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 102us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201569.181484:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 346 00000100:00100000:3.0:1788201569.181522:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442775552 00000100:00100000:3.0:1788201569.181527:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442775552 00000100:00100000:3.0:1788201569.181597:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 109 00000100:00100000:3.0:1788201569.181618:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2362:x1875064442775552:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201569.181663:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2362:x1875064442775552:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 57us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201569.181674:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 109 00000100:00080000:3.0:1788201569.181709:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201569.181715:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201569.183532:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442775424 00000100:00100000:3.0:1788201569.183544:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442775424 00000100:00100000:3.0:1788201569.184120:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 120 00000100:00100000:3.0:1788201569.184131:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442775424:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201569.185423:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442775424:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 1287us (4392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201569.185434:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 120 00010000:00010000:1.0:1788201569.263173:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201569.509603:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458317312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201569.509749:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201569.509807:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458317312 00000100:00100000:3.0:1788201569.509817:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458317312 00000100:00100000:3.0:1788201569.509882:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788201569.509893:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f964f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458317312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201569.509939:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1788201569.510004:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f964f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458317312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201569.510012:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788201569.510218:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458317312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201569.510331:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458317184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201569.510435:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201569.510738:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458317184 00000100:00100000:2.0:1788201569.510744:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458317184 00000100:00100000:2.0:1788201569.510783:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788201569.510792:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d1f0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458317184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201569.510820:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 36110336 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201569.510870:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d1f0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458317184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201569.510877:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788201569.510994:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d1f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458317184:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788201570.281969:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201570.894172:0:22196:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_119 needs >= 2 MDTs 00010000:00010000:3.0:1788201571.302503:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201572.325655:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201572.993770:0:22245:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 120: DNE fail abort should stop both normal and DNE replay ========================================================== 14:39:31 (1788201571) 00010000:00010000:0.0:1788201573.349504:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201574.118012:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458317568:0@lo:400:kworker.0 00000100:00100000:1.0:1788201574.118081:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201574.118132:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875064458318080:0@lo:400:kworker.0 00000100:00100000:1.0:1788201574.118151:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201574.118176:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788201574.118181:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458317440:0@lo:400:kworker.0 00000100:00100000:1.0:1788201574.118208:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201574.118231:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458317952:0@lo:400:kworker.0 00000100:00100000:1.0:1788201574.118254:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201574.118280:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458317696:0@lo:400:kworker.0 00000100:00100000:1.0:1788201574.118327:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201574.118346:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201574.118352:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458317824:0@lo:400:kworker.0 00000100:00100000:1.0:1788201574.118371:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201574.118399:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458317568 00000100:00100000:1.0:1788201574.118406:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458317568 00000100:00100000:1.0:1788201574.118451:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458318080 00000100:00100000:1.0:1788201574.118454:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458318080 00000100:00100000:1.0:1788201574.118464:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458317696 00000100:00100000:1.0:1788201574.118467:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458317696 00000100:00100000:1.0:1788201574.118481:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788201574.118489:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f964ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875064458317568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201574.118538:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f964ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875064458317568:12345-0@lo:400:kworker.0 Request processed in 49us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201574.118545:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788201574.118561:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788201574.118567:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f964dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875064458318080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201574.118591:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f964dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875064458318080:12345-0@lo:400:kworker.0 Request processed in 26us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201574.118597:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788201574.118606:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788201574.118610:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f964f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458317696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201574.118636:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f964f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458317696:12345-0@lo:400:kworker.0 Request processed in 25us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201574.118654:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788201574.118675:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458317440 00000100:00100000:1.0:1788201574.118678:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458317440 00000100:00100000:1.0:1788201574.118699:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788201574.118704:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458317440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201574.118733:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458317440:12345-0@lo:400:kworker.0 Request processed in 29us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201574.118738:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788201574.118773:0:13451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458317952 00000100:00100000:1.0:1788201574.118777:0:13451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458317952 00000100:00100000:1.0:1788201574.118801:0:13451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458317824 00000100:00100000:1.0:1788201574.118804:0:13451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458317824 00000100:00100000:1.0:1788201574.118821:0:13451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788201574.118827:0:13451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f964ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458317952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201574.118854:0:13451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f964ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458317952:12345-0@lo:400:kworker.0 Request processed in 27us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201574.118860:0:13451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788201574.118870:0:13451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788201574.118876:0:13451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f964c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458317824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201574.118897:0:13451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f964c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458317824:12345-0@lo:400:kworker.0 Request processed in 22us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201574.118902:0:13451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00080000:1.0:1788201574.118914:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201574.118918:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201574.118920:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201574.118961:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458317824:0@lo:400:kworker.0 00000100:00100000:1.0:1788201574.118971:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458317696:0@lo:400:kworker.0 00000100:00100000:1.0:1788201574.118999:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458317440:0@lo:400:kworker.0 00000100:00100000:1.0:1788201574.119007:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458317952:0@lo:400:kworker.0 00000100:00100000:1.0:1788201574.119014:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458317568:0@lo:400:kworker.0 00000100:00100000:1.0:1788201574.119022:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875064458318080:0@lo:400:kworker.0 00000100:00100000:2.0:1788201574.295440:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201574.295476:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442775936 00000100:00100000:2.0:1788201574.295487:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201574.295488:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442775936 00000100:00100000:2.0:1788201574.295571:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201574.295578:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 113 00000100:00100000:3.0:1788201574.295591:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c49f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442775936:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201574.295599:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442776064 00000100:00100000:2.0:1788201574.295604:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442776064 00000100:00100000:3.0:1788201574.295682:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c49f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442775936:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 95us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201574.295684:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 349 00000100:00100000:3.0:1788201574.295694:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 113 00000100:00100000:2.0:1788201574.295700:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c49f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2360:x1875064442776064:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201574.295745:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c49f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2360:x1875064442776064:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 38us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201574.295752:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 349 00000100:00100000:0.0:1788201574.296326:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442775808 00000100:00100000:0.0:1788201574.296333:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442775808 00000100:00100000:0.0:1788201574.296387:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 122 00000100:00100000:0.0:1788201574.296397:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442775808:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201574.296431:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442775808:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 37us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201574.296438:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 122 00000100:00080000:1.0:1788201574.297002:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201574.297009:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788201574.374242:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201574.631866:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201574.631900:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458318208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201574.631997:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201574.632060:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458318208 00000100:00100000:0.0:1788201574.632071:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458318208 00000100:00100000:0.0:1788201574.632149:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788201574.632161:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d1f0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458318208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201574.632208:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 36110336 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201574.632263:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d1f0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458318208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201574.632271:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788201574.632346:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d1f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458318208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201574.634388:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201574.634413:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458318336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201574.634488:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201574.634541:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458318336 00000100:00100000:3.0:1788201574.634549:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458318336 00000100:00100000:3.0:1788201574.634596:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788201574.634606:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458318336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201574.634660:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1788201574.634708:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458318336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201574.634717:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788201574.634764:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458318336:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788201574.635210:0:22293:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_120 needs >= 2 MDTs 00010000:00010000:3.0:1788201575.398055:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201576.350473:0:22341:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 121: lock replay timed out and race ========================================================== 14:39:34 (1788201574) 00010000:00010000:0.0:1788201576.429643:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201577.450480:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201577.572283:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201577.572438:0:18176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442776320 00000100:00100000:3.0:1788201577.572455:0:18176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442776320 00000100:00100000:3.0:1788201577.572546:0:18176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00080000:2.0:1788201577.572560:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201577.572563:0:18176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c49f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:29183:x1875064442776320:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:3.0:1788201577.572608:0:18176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201577.572612:0:18176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788201577.572648:0:18176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d5e2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5365 expref: 7 pid: 18214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.572674:0:18176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33ed400) 00010000:00010000:3.0:1788201577.572688:0:18176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201577.572710:0:18176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d5fd6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c58d6 expref: -99 pid: 18176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.574900:0:18176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d5fdd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.574922:0:18176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d5fdd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.574935:0:18176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d5fdd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.574951:0:18176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d5fe4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.574958:0:18176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d5fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.574965:0:18176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d5fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201577.582904:0:18176:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x471:0x0], count =17 00000004:00080000:3.0:1788201577.582919:0:18176:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x471:0x0]+17 in llog 00000004:00080000:3.0:1788201577.582973:0:18176:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x482:0x0], index 0: 0 00010000:00010000:3.0:1788201577.583322:0:18176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d5feb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x429:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.583337:0:18176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d5feb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x429:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.583349:0:18176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d5feb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x429:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.583396:0:18176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d5fdd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.583403:0:18176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d5fdd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.583410:0:18176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d5fdd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.583416:0:18176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201577.583420:0:18176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d5fdd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.583427:0:18176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d5fdd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.583439:0:18176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c2fc5800) 00010000:00010000:3.0:1788201577.583442:0:18176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201577.583446:0:18176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d5fdd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.583452:0:18176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d5fdd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201577.585317:0:18176:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e99a3276 reply state 00000000e43a86bd transno 21474836481 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d5fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201577.585336:0:18176:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788201577.586616:0:18176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d5fd6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58d6 expref: 9 pid: 18176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.586662:0:18176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d5feb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x429:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58d6 expref: 8 pid: 18176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.586671:0:18176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x429:0x0].0x0 (ffff9e03c2fc5d00) 00010000:00010000:3.0:1788201577.586674:0:18176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201577.586677:0:18176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bc600, rc 0) 00000100:00100000:3.0:1788201577.586772:0:18176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c49f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:29183:x1875064442776320:12345-192.168.201.30@tcp:101:touch.0 Request processed in 14214us (14497us total) trans 21474836481 rc 0/0 00000100:00100000:3.0:1788201577.586782:0:18176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00010000:00010000:2.0:1788201577.597847:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d5fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201577.597867:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d5fe4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201577.597876:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d5fe4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201577.597883:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bd600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201577.597887:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d5fe4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201577.597894:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d5fe4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201577.597910:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff9e03c2fc5500) 00010000:00010000:2.0:1788201577.597913:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201577.597917:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d5fe4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201577.597933:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d5fe4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201577.599637:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201577.599729:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442776576 00000100:00100000:3.0:1788201577.599745:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442776576 00000100:00100000:3.0:1788201577.599811:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:3.0:1788201577.599820:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f964df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:29183:x1875064442776576:12345-192.168.201.30@tcp:36:touch.0 00010000:00010000:3.0:1788201577.599879:0:18173:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201577.599902:0:18173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d5feb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x429:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58d6 expref: 8 pid: 18176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.599917:0:18173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x429:0x0].0x0 (ffff9e03c2fc5d00) 00010000:00010000:3.0:1788201577.599928:0:18173:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201577.599970:0:18173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d5ff9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x429:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.599982:0:18173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d5ff9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x429:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.599991:0:18173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d5ff9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x429:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201577.600131:0:18173:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000425944c9 reply state 000000002f3d6838 transno 21474836482 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d5ff9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x429:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18173 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201577.600141:0:18173:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201577.600266:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f964df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:29183:x1875064442776576:12345-192.168.201.30@tcp:36:touch.0 Request processed in 446us (644us total) trans 21474836482 rc 0/0 00000100:00100000:3.0:1788201577.600274:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:2.0:1788201577.607716:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201577.607781:0:18175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442776704 00000100:00100000:1.0:1788201577.607797:0:18175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442776704 00000100:00100000:1.0:1788201577.607879:0:18175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:1.0:1788201577.607892:0:18175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c49f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:29183:x1875064442776704:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:1.0:1788201577.607924:0:18175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201577.607951:0:18175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d6000 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x429:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c58dd expref: -99 pid: 18175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201577.608030:0:18175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d6000 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x429:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58dd expref: 10 pid: 18175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201577.608050:0:18175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d6000 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x429:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58dd expref: 10 pid: 18175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201577.608073:0:18175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x429:0x0].0x0 (ffff9e03c2fc5800) 00010000:00010000:1.0:1788201577.608077:0:18175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201577.608081:0:18175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c507d000, rc 0) 00000100:00100000:1.0:1788201577.608168:0:18175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c49f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:29183:x1875064442776704:12345-192.168.201.30@tcp:101:touch.0 Request processed in 279us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201577.608176:0:18175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00010000:00010000:3.0:1788201577.609637:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d5ff9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x429:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.609653:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d5ff9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x429:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.609660:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d5ff9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x429:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.609666:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bcc00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201577.609671:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d5ff9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x429:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.609678:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d5ff9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x429:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.609696:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x429:0x0].0x0 (ffff9e03c2fc5800) 00010000:00010000:3.0:1788201577.609700:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201577.609705:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d5ff9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x429:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.609711:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d5ff9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x429:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18173 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201577.633091:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201577.633169:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442776832 00000100:00100000:2.0:1788201577.633184:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442776832 00000100:00100000:2.0:1788201577.633273:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4386 00000100:00100000:2.0:1788201577.633287:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f964e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2362:x1875064442776832:12345-192.168.201.30@tcp:2:touch.0 00000100:00080000:1.0:1788201577.634877:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201577.636002:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f964e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+506:2362:x1875064442776832:12345-192.168.201.30@tcp:2:touch.0 Request processed in 2706us (2908us total) trans 4294968892 rc 0/0 00000100:00100000:2.0:1788201577.636017:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4386 00000100:00100000:1.0:1788201577.645229:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201577.645341:0:18177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442777088 00000100:00100000:2.0:1788201577.645352:0:18177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442777088 00000100:00100000:2.0:1788201577.645399:0:18177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:2.0:1788201577.645409:0:18177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f964c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:29183:x1875064442777088:12345-192.168.201.30@tcp:35:touch.0 00000100:00100000:2.0:1788201577.645798:0:18177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f964c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:29183:x1875064442777088:12345-192.168.201.30@tcp:35:touch.0 Request processed in 389us (579us total) trans 21474836483 rc 0/0 00000100:00100000:2.0:1788201577.645806:0:18177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:1.0:1788201577.733103:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201577.733167:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442777216 00000100:00100000:3.0:1788201577.733179:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442777216 00000100:00100000:3.0:1788201577.733256:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:3.0:1788201577.733266:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f964d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:13084:x1875064442777216:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201577.733284:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201577.733348:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c507d000/0x9383f985bc4d6000 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x429:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58dd expref: 10 pid: 18175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.733367:0:7646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x429:0x0].0x0 (ffff9e03c2fc5800) 00010000:00010000:3.0:1788201577.733379:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201577.733437:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f964d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:13084:x1875064442777216:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 172us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201577.733444:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:1.0:1788201577.993651:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201577.993764:0:19164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442777344 00000100:00100000:0.0:1788201577.993775:0:19164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442777344 00000100:00100000:0.0:1788201577.993840:0:19164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:0.0:1788201577.993850:0:19164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f964ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:29189:x1875064442777344:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:0.0:1788201577.993875:0:19164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201577.993902:0:19164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d6007 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c58e4 expref: -99 pid: 19164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201577.993974:0:19164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128600/0x9383f985bc4d600e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201577.993989:0:19164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128600/0x9383f985bc4d600e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201577.994003:0:19164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128600/0x9383f985bc4d600e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201577.994079:0:19164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1788201577.994084:0:19164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201577.994125:0:19164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128600/0x9383f985bc4d600e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201577.994149:0:19164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff129a00/0x9383f985bc4d6007 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58e4 expref: 11 pid: 19164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201577.994168:0:19164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128600/0x9383f985bc4d600e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58e4 expref: 10 pid: 19164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201577.994176:0:19164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33e8d00) 00010000:00010000:0.0:1788201577.994179:0:19164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201577.994182:0:19164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04ff128600, rc 0) 00000100:00100000:0.0:1788201577.994246:0:19164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f964ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:29189:x1875064442777344:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 398us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201577.994254:0:19164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:1.0:1788201578.001784:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201578.001851:0:18175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442777472 00000100:00100000:2.0:1788201578.001861:0:18175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442777472 00000100:00100000:2.0:1788201578.001920:0:18175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:2.0:1788201578.001930:0:18175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f964f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:29189:x1875064442777472:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:2.0:1788201578.001948:0:18175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201578.001969:0:18175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d6015 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c58eb expref: -99 pid: 18175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201578.002031:0:18175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d601c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201578.002045:0:18175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d601c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201578.002056:0:18175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d601c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201578.002071:0:18175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d6023 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201578.002078:0:18175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d6023 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201578.002085:0:18175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d6023 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201578.002201:0:18175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d602a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x429:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201578.002210:0:18175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d602a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x429:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201578.002216:0:18175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d602a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x429:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18175 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201578.002250:0:18175:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x429:0x0]: returning size 0 00000004:00200000:2.0:1788201578.002254:0:18175:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201578.002274:0:18175:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d602a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x429:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201578.002286:0:18175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d602a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x429:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201578.002327:0:18175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d601c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201578.002334:0:18175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d601c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201578.002341:0:18175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d601c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201578.002347:0:18175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131e200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201578.002352:0:18175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d601c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201578.002358:0:18175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d601c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201578.002369:0:18175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33e8d00) 00010000:00010000:2.0:1788201578.002372:0:18175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201578.002377:0:18175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d601c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201578.002383:0:18175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131e200/0x9383f985bc4d601c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201578.002396:0:18175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d6023 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201578.002402:0:18175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d6023 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201578.002408:0:18175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d6023 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201578.002413:0:18175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131fc00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201578.002416:0:18175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d6023 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201578.002421:0:18175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d6023 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201578.002428:0:18175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff9e03c33edc00) 00010000:00010000:2.0:1788201578.002430:0:18175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201578.002432:0:18175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d6023 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201578.002438:0:18175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fc00/0x9383f985bc4d6023 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201578.002472:0:18175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131f600/0x9383f985bc4d6015 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58eb expref: 12 pid: 18175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201578.002484:0:18175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d602a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x429:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58eb expref: 11 pid: 18175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201578.002491:0:18175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x429:0x0].0x0 (ffff9e03c33eda00) 00010000:00010000:2.0:1788201578.002493:0:18175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201578.002495:0:18175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c131fa00, rc 0) 00000100:00100000:2.0:1788201578.002566:0:18175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f964f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:29189:x1875064442777472:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 636us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201578.002582:0:18175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:1.0:1788201578.006259:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201578.007646:0:13442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442777600 00000100:00100000:3.0:1788201578.007658:0:13442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442777600 00000100:00100000:3.0:1788201578.007724:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4387 00000100:00100000:3.0:1788201578.007734:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f964c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35604eb4-baf9-45be-a20a-4883a2cd8cf9+506:2359:x1875064442777600:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:3.0:1788201578.007752:0:13442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201578.007773:0:13442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd191276/0x9383f985bc4d6031 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x482:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c58f2 expref: -99 pid: 13442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201578.007801:0:13442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x482:0x0] initial LVB size: 0, mtime: 0x6a95ca69, atime: 0x6a95ca69, ctime: 0x6a95ca69, blocks: 0x1 00010000:00010000:3.0:1788201578.007820:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x482:0x0].0x0 since=853s v=(0 0) 00010000:00010000:3.0:1788201578.007825:0:13442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x482:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201578.007833:0:13442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd191276/0x9383f985bc4d6031 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x482:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58f2 expref: 507 pid: 13442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201578.007852:0:13442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cd191276/0x9383f985bc4d6031 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x482:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58f2 expref: 507 pid: 13442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201578.007866:0:13442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bcc00, rc 0) 00000100:00100000:3.0:1788201578.007932:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f964c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35604eb4-baf9-45be-a20a-4883a2cd8cf9+507:2359:x1875064442777600:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 199us (1681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201578.007940:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4387 00010000:00010000:3.0:1788201578.471969:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201579.238647:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458318464:0@lo:400:kworker.0 00000100:00100000:1.0:1788201579.238741:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201579.238804:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458318976:0@lo:400:kworker.0 00000100:00100000:1.0:1788201579.238832:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201579.238856:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788201579.238861:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875064458318592:0@lo:400:kworker.0 00000100:00100000:1.0:1788201579.238882:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201579.238897:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875064458319104:0@lo:400:kworker.0 00000100:00100000:1.0:1788201579.238915:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201579.239107:0:18162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458318464 00000100:00100000:0.0:1788201579.239116:0:18162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458318464 00000100:00100000:0.0:1788201579.239181:0:18162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788201579.239191:0:18162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458318464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201579.239249:0:18162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458318464:12345-0@lo:400:kworker.0 Request processed in 60us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201579.239257:0:18162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788201579.239291:0:19164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458318592 00000100:00100000:0.0:1788201579.239319:0:19164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458318592 00000100:00100000:0.0:1788201579.239351:0:19164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458319104 00000100:00100000:0.0:1788201579.239354:0:19164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458319104 00000100:00100000:0.0:1788201579.239373:0:19164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788201579.239379:0:19164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f964e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875064458318592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201579.239411:0:19164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f964e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875064458318592:12345-0@lo:400:kworker.0 Request processed in 33us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201579.239416:0:19164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788201579.239427:0:19164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788201579.239432:0:19164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f964ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875064458319104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201579.239472:0:19164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f964ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875064458319104:12345-0@lo:400:kworker.0 Request processed in 39us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201579.239478:0:19164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:0.0:1788201579.239495:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201579.239529:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d1f0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875064458318592:0@lo:400:kworker.0 00000100:00100000:0.0:1788201579.239540:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875064458319104:0@lo:400:kworker.0 00000100:00100000:0.0:1788201579.239547:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d1f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458318464:0@lo:400:kworker.0 00000100:00100000:3.0:1788201579.239867:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04d1f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458318720:0@lo:400:kworker.0 00000100:00100000:3.0:1788201579.239902:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201579.239933:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201579.239940:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458318848:0@lo:400:kworker.0 00000100:00100000:3.0:1788201579.239963:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201579.239995:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458318976 00000100:00100000:3.0:1788201579.240000:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458318976 00000100:00100000:3.0:1788201579.240050:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458318848 00000100:00100000:3.0:1788201579.240054:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458318848 00000100:00100000:3.0:1788201579.240079:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1788201579.240085:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f964d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458318976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201579.240132:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f964d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458318976:12345-0@lo:400:kworker.0 Request processed in 48us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201579.240138:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1788201579.240149:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788201579.240154:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458318848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201579.240181:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458318848:12345-0@lo:400:kworker.0 Request processed in 28us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201579.240186:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788201579.240200:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458318720 00000100:00100000:3.0:1788201579.240203:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458318720 00000100:00100000:3.0:1788201579.240224:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788201579.240229:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458318720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201579.240252:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458318720:12345-0@lo:400:kworker.0 Request processed in 24us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201579.240257:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:3.0:1788201579.240283:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201579.240286:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201579.240288:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201579.240323:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458318848:0@lo:400:kworker.0 00000100:00100000:3.0:1788201579.240330:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04d1f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458318720:0@lo:400:kworker.0 00000100:00100000:3.0:1788201579.240350:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458318976:0@lo:400:kworker.0 00000100:00100000:1.0:1788201579.420024:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201579.420055:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201579.420084:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201579.420115:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442777984 00000100:00100000:1.0:1788201579.420126:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442777984 00000100:00100000:1.0:1788201579.420190:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 352 00000100:00100000:1.0:1788201579.420201:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f964d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+507:2362:x1875064442777984:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201579.420274:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f964d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+507:2362:x1875064442777984:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 75us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201579.420281:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 352 00000100:00100000:3.0:1788201579.420513:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442777856 00000100:00100000:3.0:1788201579.420518:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442777856 00000100:00100000:3.0:1788201579.420565:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 117 00000100:00100000:3.0:1788201579.420572:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f964fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:2362:x1875064442777856:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201579.420672:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f964fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:2362:x1875064442777856:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 100us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201579.420679:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 117 00000100:00080000:3.0:1788201579.420700:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201579.420704:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201579.420989:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442777728 00000100:00100000:0.0:1788201579.420995:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442777728 00000100:00100000:0.0:1788201579.421029:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 124 00000100:00100000:0.0:1788201579.421037:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c51b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442777728:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201579.421079:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c51b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442777728:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 44us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201579.421085:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 124 00010000:00010000:0.0:1788201579.493495:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788201579.747595:0:22487:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788201579.747643:0:22487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7800/0x9383f985bc4d5e01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5e08 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.747658:0:22487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7800/0x9383f985bc4d5e01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d5e08 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.747666:0:22487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7800/0x9383f985bc4d5e01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d5e08 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.747673:0:22487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7800/0x9383f985bc4d5e01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d5e08 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.747725:0:22487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788201579.747731:0:22487:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788201579.747754:0:22487:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201579.747759:0:22487:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788201579.747764:0:22487:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788201579.747788:0:22487:0:(import.c:65:import_set_state_nolock()) ffff9e04fae23800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788201579.747866:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875064458319232:0@lo:39:umount.0 00000100:00100000:3.0:1788201579.748002:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201579.748096:0:18175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458319232 00000100:00100000:0.0:1788201579.748104:0:18175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458319232 00000100:00100000:0.0:1788201579.748218:0:18175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788201579.748229:0:18175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875064458319232:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788201579.748255:0:18175:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d5fba 00000100:00080000:0.0:1788201579.748270:0:18175:0:(import.c:65:import_set_state_nolock()) ffff9e03c1e1a000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788201579.748375:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201579.748382:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7800/0x9383f985bc4d5e01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d5e08 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201579.748391:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7800 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:1.0:1788201579.748395:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7800/0x9383f985bc4d5e01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d5e08 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201579.748404:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7800/0x9383f985bc4d5e01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x9383f985bc4d5e08 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201579.748411:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7800/0x9383f985bc4d5e01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x9383f985bc4d5e08 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201579.748416:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788201579.748419:0:5845:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788201579.748421:0:5845:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788201579.748470:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7800/0x9383f985bc4d5e01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d5e08 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201579.748477:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201579.748503:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7800/0x9383f985bc4d5e01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d5e08 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201579.748511:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7800/0x9383f985bc4d5e01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d5e08 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201579.748521:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201579.748522:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201579.748524:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201579.748531:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201579.748551:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f900ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458319360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201579.748585:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201579.748622:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458319360 00000100:00100000:2.0:1788201579.748626:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458319360 00000100:00100000:2.0:1788201579.748660:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788201579.748667:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f900b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3313:x1875064458319360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201579.748678:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201579.748764:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c1b96000/0x9383f985bc4d5e08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d5e01 expref: 19 pid: 18162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201579.748777:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201579.748808:0:18175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3309:x1875064458319232:12345-0@lo:39:umount.0 Request processed in 581us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201579.748814:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f900b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b60c000b-7335-444d-a8dc-1a5956712fb2+18:3313:x1875064458319360:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201579.748816:0:18175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788201579.748819:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000020:00000080:0.0:1788201579.748826:0:18175:0:(genops.c:906:class_export_put()) final put ffff9e04c7de6800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788201579.748865:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c7de6800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788201579.748908:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e03c1e1a000 for lustre-MDT0000 00000100:00100000:1.0:1788201579.749022:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f900ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458319360:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788201579.749045:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04fae23800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788201579.749057:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875064458319232:0@lo:39:umount.0 00000100:00080000:0.0:1788201579.749088:0:22487:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201579.749090:0:22487:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788201579.749093:0:22487:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788201579.749614:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201579.749769:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c49f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458319488:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788201579.750233:0:22487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97600/0x9383f985bc4d5d28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5d2f expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.750245:0:22487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97600/0x9383f985bc4d5d28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d5d2f expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.750253:0:22487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97600/0x9383f985bc4d5d28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d5d2f expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.750260:0:22487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97600/0x9383f985bc4d5d28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d5d2f expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.750280:0:22487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201579.750414:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201579.750441:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201579.750447:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97600/0x9383f985bc4d5d28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d5d2f expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.750454:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97600 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:0.0:1788201579.750458:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97600/0x9383f985bc4d5d28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d5d2f expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.750465:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97600/0x9383f985bc4d5d28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x9383f985bc4d5d2f expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201579.750472:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97600/0x9383f985bc4d5d28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x9383f985bc4d5d2f expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201579.750479:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788201579.750482:0:5846:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788201579.750503:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97600/0x9383f985bc4d5d28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d5d2f expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.750509:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201579.750519:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97600/0x9383f985bc4d5d28 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d5d2f expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201579.750559:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458319488 00000100:00100000:1.0:1788201579.750565:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458319488 00000100:00100000:1.0:1788201579.750607:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788201579.750617:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458319488:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201579.750638:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c49f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458319744:0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201579.750649:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1788201579.750666:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201579.750690:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458319488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201579.750697:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00010000:00010000:0.0:1788201579.750728:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97600/0x9383f985bc4d5d28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d5d2f expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.750740:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201579.750742:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201579.750744:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201579.750755:0:22487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04ff128a00/0x9383f985bc4d5f3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5f43 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.750764:0:22487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04ff128a00/0x9383f985bc4d5f3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d5f43 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.750770:0:22487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04ff128a00/0x9383f985bc4d5f3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d5f43 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.750776:0:22487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e04ff128a00/0x9383f985bc4d5f3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d5f43 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201579.750788:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1788201579.750789:0:22487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201579.750795:0:22487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d5dd0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5dd7 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201579.750795:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458319616:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201579.750802:0:22487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d5dd0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d5dd7 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.750808:0:22487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d5dd0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d5dd7 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.750815:0:22487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d5dd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d5dd7 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201579.750819:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201579.750825:0:22487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788201579.750831:0:22487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04c0030000/0x9383f985bc4d5d1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d5d21 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.750837:0:22487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04c0030000/0x9383f985bc4d5d1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d5d21 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.750843:0:22487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04c0030000/0x9383f985bc4d5d1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d5d21 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.750849:0:22487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e04c0030000/0x9383f985bc4d5d1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d5d21 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201579.750852:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458319616 00000100:00100000:3.0:1788201579.750856:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458319616 00010000:00010000:0.0:1788201579.750858:0:22487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1788201579.750862:0:22487:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788201579.750866:0:22487:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:0.0:1788201579.750886:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201579.750890:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e04ff128a00/0x9383f985bc4d5f3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d5f43 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.750896:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff128a00 already unused, calling callback (ffffffffc1a17c20) 00000100:00100000:3.0:1788201579.750897:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 10000000:00010000:0.0:1788201579.750899:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e04ff128a00/0x9383f985bc4d5f3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d5f43 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201579.750903:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b60c000b-7335-444d-a8dc-1a5956712fb2+18:3310:x1875064458319616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201579.750906:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e04ff128a00/0x9383f985bc4d5f3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9383f985bc4d5f43 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201579.750914:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201579.750926:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c2cc6a00/0x9383f985bc4d5d2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d5d28 expref: 18 pid: 18161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201579.750938:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201579.750964:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b60c000b-7335-444d-a8dc-1a5956712fb2+17:3310:x1875064458319616:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201579.750971:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 10000000:00010000:0.0:1788201579.750988:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e04ff128a00/0x9383f985bc4d5f3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9383f985bc4d5f43 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201579.750990:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:01000000:0.0:1788201579.750994:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201579.750994:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d5dd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d5dd7 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201579.750996:0:5846:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788201579.750998:0:5846:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788201579.751000:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6400 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1788201579.751003:0:7645:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d5dd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d5dd7 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201579.751009:0:7645:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d5dd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9383f985bc4d5dd7 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.751012:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e04ff128a00/0x9383f985bc4d5f3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d5f43 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201579.751017:0:7645:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d5dd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9383f985bc4d5dd7 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.751018:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:3.0:1788201579.751022:0:7645:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788201579.751024:0:7645:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788201579.751026:0:7645:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788201579.751028:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e04ff128a00/0x9383f985bc4d5f3c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d5f43 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.751034:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e04ff128a00/0x9383f985bc4d5f3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d5f43 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201579.751038:0:7645:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d5dd0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d5dd7 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201579.751043:0:7645:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201579.751047:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201579.751048:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d5dd0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d5dd7 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.751050:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e04c0030000/0x9383f985bc4d5d1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d5d21 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201579.751055:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d5dd0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d5dd7 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.751056:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030000 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:0.0:1788201579.751059:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e04c0030000/0x9383f985bc4d5d1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d5d21 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201579.751063:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201579.751064:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201579.751065:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e04c0030000/0x9383f985bc4d5d1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9383f985bc4d5d21 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201579.751066:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1788201579.751070:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e04c0030000/0x9383f985bc4d5d1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9383f985bc4d5d21 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201579.751075:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788201579.751077:0:5846:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788201579.751078:0:5846:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:3.0:1788201579.751083:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458319616:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201579.751088:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e04c0030000/0x9383f985bc4d5d1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d5d21 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.751093:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201579.751106:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e04c0030000/0x9383f985bc4d5d1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d5d21 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.751113:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e04c0030000/0x9383f985bc4d5d1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d5d21 expref: -99 pid: 18158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201579.751120:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201579.751128:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458320128:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201579.751131:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201579.751142:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201579.751144:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201579.751150:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1788201579.751157:0:22487:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788201579.751161:0:22487:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:0.0:1788201579.751165:0:22487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1788201579.751170:0:22487:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00000100:00100000:3.0:1788201579.751342:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458320128 00000100:00100000:3.0:1788201579.751347:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458320128 00000100:00100000:3.0:1788201579.751374:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788201579.751380:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b60c000b-7335-444d-a8dc-1a5956712fb2+17:3311:x1875064458320128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201579.751388:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201579.751397:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c2ef2400/0x9383f985bc4d5d21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d5d1a expref: 17 pid: 18186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201579.751408:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201579.751446:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b60c000b-7335-444d-a8dc-1a5956712fb2+16:3311:x1875064458320128:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201579.751453:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788201579.751479:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458320128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201579.753403:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458319744 00000100:00100000:3.0:1788201579.753415:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458319744 00000100:00100000:3.0:1788201579.753465:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788201579.753474:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458319744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201579.753511:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 36110336 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201579.753588:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458319744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (2920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201579.753595:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788201579.753644:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c49f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458319744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201579.753678:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458320000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201579.753727:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201579.753769:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c49f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458319488:0@lo:13:osp-pre-0-0.0 00000004:00000080:0.0:1788201579.753816:0:22487:0:(mdt_handler.c:8183:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000100:00100000:2.0:1788201579.753961:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458320000 00000100:00100000:2.0:1788201579.753966:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458320000 00000100:00100000:1.0:1788201579.753986:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458319872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201579.754017:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201579.754121:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458319872 00000100:00100000:2.0:1788201579.754126:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458319872 00000100:00100000:3.0:1788201579.754213:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788201579.754222:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8093850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b60c000b-7335-444d-a8dc-1a5956712fb2+17:3313:x1875064458320000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201579.754234:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201579.754253:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c1b97200/0x9383f985bc4d5dd7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d5dd0 expref: 17 pid: 18161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201579.754269:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201579.754315:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8093850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b60c000b-7335-444d-a8dc-1a5956712fb2+16:3313:x1875064458320000:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201579.754320:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788201579.754363:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788201579.754368:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f900ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b60c000b-7335-444d-a8dc-1a5956712fb2+15:3312:x1875064458319872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201579.754374:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201579.754384:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e04c0030a00/0x9383f985bc4d5f43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d5f3c expref: 15 pid: 18162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201579.754394:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201579.754419:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f900ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b60c000b-7335-444d-a8dc-1a5956712fb2+14:3312:x1875064458319872:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201579.754425:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788201579.755056:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458320000:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201579.755358:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201579.755844:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458319872:0@lo:103:ldlm_bl.0 00000001:00080000:2.0:1788201579.771972:0:18184:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 21474836483 is committed 00000020:00000080:3.0:1788201579.776680:0:22487:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 3/7 00000020:00080000:3.0:1788201579.776696:0:22487:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e04fae27800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788201579.776703:0:22487:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e03c5414000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788201579.776710:0:22487:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e04c3667800 35604eb4-baf9-45be-a20a-4883a2cd8cf9 192.168.201.30@tcp 7 (0 0 2) 0 0 0 0: 0000000000000000 21474836483 stale:0 00000020:00080000:3.0:1788201579.776715:0:22487:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9e04d1c34d40) has exports, disconnecting them 00000020:00080000:3.0:1788201579.776720:0:22487:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e04fae27800), last request at 1788201579 00000020:00000080:3.0:1788201579.776727:0:22487:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d5fcf 00000100:00080000:3.0:1788201579.776737:0:22487:0:(import.c:65:import_set_state_nolock()) ffff9e04c6b8b000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788201579.776761:0:22487:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e04fae27800): rc 0 00000020:00000080:3.0:1788201579.776763:0:22487:0:(genops.c:906:class_export_put()) final put ffff9e04fae27800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788201579.776772:0:22487:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e03c5414000), last request at 1788201579 00000020:00000080:3.0:1788201579.776781:0:22487:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d5fc8 00000100:00080000:3.0:1788201579.776785:0:22487:0:(import.c:65:import_set_state_nolock()) ffff9e04fae21000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788201579.776797:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04fae27800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00080000:3.0:1788201579.776827:0:22487:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e03c5414000): rc 0 00000020:00000080:3.0:1788201579.776829:0:22487:0:(genops.c:906:class_export_put()) final put ffff9e03c5414000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788201579.776834:0:22487:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.201.30@tcp (ffff9e04c3667800), last request at 1788201579 00000020:00000080:3.0:1788201579.776837:0:22487:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d5d67 00000020:00000080:2.0:1788201579.776842:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04c6b8b000 for lustre-MDT0000 00000020:00010000:3.0:1788201579.776845:0:22487:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e04c3667800: total 1 00000020:00000080:2.0:1788201579.776848:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03c5414000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:3.0:1788201579.776848:0:22487:0:(import.c:65:import_set_state_nolock()) ffff9e04ff1c1800 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1788201579.776861:0:5845:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e04c3667800: total 1 00000020:00000080:2.0:1788201579.776863:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04fae21000 for lustre-MDT0000 00010000:00010000:3.0:1788201579.776900:0:5845:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e04c3667800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788201579.776946:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d602a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x429:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58eb expref: 6 pid: 18175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201579.776968:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04ff128600/0x9383f985bc4d600e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58e4 expref: 5 pid: 19164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201579.776979:0:5845:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e04c3667800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788201579.777625:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201579.778287:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788201579.779396:0:22487:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.30@tcp (ffff9e04c3667800): rc 0 00000004:00000080:2.0:1788201579.779409:0:22487:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffad61019ebae0 00000100:00080000:2.0:1788201579.779467:0:22487:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788201579.779472:0:22487:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968891 gen 3 00000004:00080000:2.0:1788201579.779494:0:22487:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788201579.779586:0:22487:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788201579.779612:0:22487:0:(import.c:65:import_set_state_nolock()) ffff9e04f976e000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788201579.779638:0:22487:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788201579.779641:0:22487:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968893 gen 3 00000004:00080000:2.0:1788201579.779655:0:22487:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201579.779678:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c49f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458320256:0@lo:9:umount.0 00000100:00080000:2.0:1788201579.779720:0:22487:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788201579.779730:0:22487:0:(import.c:65:import_set_state_nolock()) ffff9e03c55b1800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788201579.779753:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788201579.779762:0:22487:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9e04d1c34d40) has no exports 00000100:00100000:1.0:1788201579.779796:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c49f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458320384:0@lo:9:umount.0 00000100:00100000:1.0:1788201579.779818:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201579.779862:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458320256 00000100:00100000:1.0:1788201579.779869:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458320256 00000100:00100000:2.0:1788201579.780052:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458320384 00000100:00100000:2.0:1788201579.780056:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458320384 00000100:00100000:2.0:1788201579.780082:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4388 00000100:00100000:2.0:1788201579.780090:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3309:x1875064458320256:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788201579.780122:0:13445:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d5da6 00000100:00080000:2.0:1788201579.780130:0:13445:0:(import.c:65:import_set_state_nolock()) ffff9e04fae45800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788201579.780160:0:13445:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968892 00000100:00100000:2.0:1788201579.780492:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+2:3309:x1875064458320256:12345-0@lo:9:umount.0 Request processed in 401us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201579.780502:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4388 00000100:00100000:2.0:1788201579.780530:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4389 00000100:00100000:2.0:1788201579.780537:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3309:x1875064458320384:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788201579.780557:0:13445:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d5dc2 00000100:00080000:2.0:1788201579.780563:0:13445:0:(import.c:65:import_set_state_nolock()) ffff9e04f5755000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788201579.780585:0:13445:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968893 00000100:00100000:2.0:1788201579.780920:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+2:3309:x1875064458320384:12345-0@lo:9:umount.0 Request processed in 383us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201579.780927:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4389 00010000:00010000:1.0:1788201579.780966:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788201579.780997:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e03c55b1800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788201579.781014:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788201579.781016:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201579.781020:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c49f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458320384:0@lo:9:umount.0 00000100:00080000:1.0:1788201579.781032:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04f976e000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788201579.781040:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788201579.781042:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201579.781044:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c49f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458320256:0@lo:9:umount.0 00010000:00010000:0.0:1788201579.781246:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788201579.781682:0:22487:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9e04d1c34d40) has no exports 00000020:00000080:3.0:1788201579.835650:0:5845:0:(genops.c:906:class_export_put()) final put ffff9e04c3667800/35604eb4-baf9-45be-a20a-4883a2cd8cf9 00000020:00000080:1.0:1788201579.835879:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c3667800/35604eb4-baf9-45be-a20a-4883a2cd8cf9 for lustre-MDT0000 00000020:00000080:1.0:1788201579.835955:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04ff1c1800 for lustre-MDT0000 00010000:00010000:2.0:1788201579.836964:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201579.836971:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201579.836974:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788201579.850625:0:22487:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d5d7c 00000020:00000080:0.0:1788201579.850643:0:22487:0:(genops.c:906:class_export_put()) final put ffff9e04d8185000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788201579.850722:0:22487:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788201579.850775:0:22487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201579.850790:0:22487:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788201579.850794:0:22487:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9e03c2640000) has no exports 00000020:00000080:3.0:1788201579.850995:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04d8185000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788201579.852562:0:22487:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d5d75 00000020:00000080:2.0:1788201579.852572:0:22487:0:(genops.c:906:class_export_put()) final put ffff9e04ff1c2000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788201579.852612:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04ff1c2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788201579.852645:0:22487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201579.852655:0:22487:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788201579.852663:0:22487:0:(genops.c:906:class_export_put()) final put ffff9e04ff1c7000/lustre-QMT0000_UUID 00000020:00000080:2.0:1788201579.852665:0:22487:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04ff1c7000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788201579.852674:0:22487:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1788201579.852812:0:22487:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e04d081c2a0 - data ffff9e04ffa546c0/ffff9e04c67d8400 00000020:01000000:2.0:1788201579.852919:0:22487:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e04e1893420 - data ffff9e04ddae25e8/ffff9e03c2ee6800 00000100:00080000:2.0:1788201579.891712:0:22487:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788201579.891721:0:22487:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968891 gen 4 00000004:00080000:2.0:1788201579.891735:0:22487:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788201579.891737:0:22487:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788201579.892414:0:18198:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788201579.892420:0:18198:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 1 count 1 00000040:00080000:3.0:1788201579.892441:0:18198:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 5 count 2 00000100:00080000:0.0:1788201579.893774:0:22487:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788201579.893781:0:22487:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968893 gen 4 00000004:00080000:0.0:1788201579.893801:0:22487:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201579.893804:0:22487:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788201579.894035:0:18200:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788201579.894040:0:18200:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x16:0x0] index 1 count 1 00000040:00080000:2.0:1788201579.894048:0:18200:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 5 count 2 00000020:00000080:3.0:1788201579.939440:0:22487:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d5d3d 00000020:00000080:3.0:1788201579.939453:0:22487:0:(genops.c:906:class_export_put()) final put ffff9e04f9768000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788201579.940221:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04f9768000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788201579.940658:0:22487:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d5d52 00000020:00000080:3.0:1788201579.940667:0:22487:0:(genops.c:906:class_export_put()) final put ffff9e04c3667000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788201579.940681:0:22487:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788201579.940688:0:22487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201579.940696:0:22487:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788201579.940701:0:22487:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9e04d1c30000) has no exports 00000004:01000000:3.0:1788201579.940856:0:22487:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788201579.940865:0:22487:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d5dad 00000020:00000080:3.0:1788201579.940869:0:22487:0:(genops.c:906:class_export_put()) final put ffff9e04c6b88800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788201579.940873:0:22487:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788201579.940876:0:22487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201579.940881:0:22487:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788201579.940883:0:22487:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9e04f9650000) has no exports 00000020:00000080:3.0:1788201579.940889:0:22487:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d5d9f 00000020:00000080:3.0:1788201579.940893:0:22487:0:(genops.c:906:class_export_put()) final put ffff9e03c55b0800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788201579.941251:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c3667000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1788201579.941800:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c6b88800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788201579.941808:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03c55b0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788201579.942025:0:22487:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788201579.942030:0:22487:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788201579.942034:0:22487:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968893 gen 5 00000004:00080000:3.0:1788201579.942041:0:22487:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788201579.942044:0:22487:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788201579.942085:0:22487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201579.942093:0:22487:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201579.942099:0:22487:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d5d91 00000020:00000080:3.0:1788201579.942104:0:22487:0:(genops.c:906:class_export_put()) final put ffff9e04fae46000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201579.942180:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e03c55b1800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788201579.942186:0:38:0:(genops.c:906:class_export_put()) final put ffff9e04c6b8d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201579.942188:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c6b8d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788201579.942193:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788201579.942347:0:22487:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788201579.942352:0:22487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201579.942356:0:22487:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788201579.942359:0:22487:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff9e03c2644d40) has no exports 00000020:00000080:3.0:1788201579.942365:0:22487:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d5d8a 00000020:00000080:3.0:1788201579.942370:0:22487:0:(genops.c:906:class_export_put()) final put ffff9e04f9769800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788201579.942865:0:22487:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788201579.942869:0:22487:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788201579.942873:0:22487:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968891 gen 5 00000004:00080000:3.0:1788201579.942876:0:22487:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788201579.942878:0:22487:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788201579.942904:0:22487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201579.942909:0:22487:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201579.942935:0:22487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201579.942938:0:22487:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201579.942941:0:22487:0:(genops.c:906:class_export_put()) final put ffff9e04f9768800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788201579.942944:0:22487:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04f9768800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788201579.942949:0:22487:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201579.943079:0:22487:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d5d59 00000020:00000080:3.0:1788201579.943084:0:22487:0:(genops.c:906:class_export_put()) final put ffff9e04c3661800/lustre-MDD0000_UUID 00000020:01000000:3.0:1788201579.943088:0:22487:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788201579.943091:0:22487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201579.943094:0:22487:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788201579.943097:0:22487:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9e04d1c33380) has no exports 00000020:00000080:3.0:1788201579.943189:0:22487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201579.943193:0:22487:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788201579.943197:0:22487:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d5d60 00000020:00000080:3.0:1788201579.943201:0:22487:0:(genops.c:906:class_export_put()) final put ffff9e04c3664000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788201579.943208:0:22487:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e03c5130000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788201579.943211:0:22487:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e03c5130000 3 00000020:01000004:3.0:1788201579.943213:0:22487:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e03c5130000 from lustre-MDT0000 00000020:00000080:3.0:1788201579.943230:0:22487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201579.943234:0:22487:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788201579.943237:0:22487:0:(genops.c:906:class_export_put()) final put ffff9e04f976d000/lustre-MDT0000_UUID 00000020:00000080:3.0:1788201579.943239:0:22487:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04f976d000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788201579.943245:0:22487:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788201579.943277:0:22487:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1788201579.943282:0:22487:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788201579.943285:0:22487:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788201579.943287:0:22487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201579.943390:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04fae46000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788201579.943398:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04f9769800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788201579.943402:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04f976e000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788201579.943406:0:38:0:(genops.c:906:class_export_put()) final put ffff9e04d8183000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201579.943408:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04d8183000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788201579.943411:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201579.943493:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c3661800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788201579.943497:0:38:0:(genops.c:906:class_export_put()) final put ffff9e04f976c000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788201579.943499:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04f976c000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788201579.943512:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788201579.943598:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c3664000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788201579.943699:0:22487:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788201579.943707:0:22487:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9e04c6710800 b60c000b-7335-444d-a8dc-1a5956712fb2 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788201579.943715:0:22487:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9e04c8352800 7ad49433-54fa-4e21-b756-859420d95603 192.168.201.30@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788201579.943719:0:22487:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9e04d1c319c0) has exports, disconnecting them 00000020:00080000:3.0:1788201579.943723:0:22487:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9e04c6710800), last request at 1788201420 00000020:00000080:3.0:1788201579.943744:0:22487:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d5cfe 00000020:00010000:3.0:1788201579.943749:0:22487:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e04c6710800: total 0 00000100:00080000:3.0:1788201579.943753:0:22487:0:(import.c:65:import_set_state_nolock()) ffff9e04c6713800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788201579.943808:0:22487:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e04c6710800): rc 0 00000020:00080000:3.0:1788201579.943812:0:22487:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.201.30@tcp (ffff9e04c8352800), last request at 1788201411 00000020:00000080:3.0:1788201579.943856:0:22487:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d5cdb 00000020:00010000:3.0:1788201579.943859:0:22487:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e04c8352800: total 0 00000100:00080000:3.0:1788201579.943862:0:22487:0:(import.c:65:import_set_state_nolock()) ffff9e04c8356800 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1788201579.943953:0:5846:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e04c6710800: total 0 00010000:00010000:0.0:1788201579.943991:0:5846:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e04c6710800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788201579.944021:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e04c0031400/0x9383f985bc4d5f89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d5f82 expref: 9 pid: 18162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.944037:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c32bd800/0x9383f985bc4d5f7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d5f74 expref: 8 pid: 18161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.944047:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e04ff129200/0x9383f985bc4d5f97 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d5f90 expref: 7 pid: 18186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.944061:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c131ee00/0x9383f985bc4d5fa5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d5f9e expref: 6 pid: 18161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.944074:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e04c0031000/0x9383f985bc4d5fb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d5fac expref: 5 pid: 18162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.944083:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c1b96a00/0x9383f985bc4d5f51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d5f4a expref: 4 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.944093:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c32bc000/0x9383f985bc4d5f5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d5f58 expref: 3 pid: 18186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.944102:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e04c0031a00/0x9383f985bc4d5f6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d5f66 expref: 2 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.944185:0:5846:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e04c6710800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1788201579.944205:0:5846:0:(genops.c:906:class_export_put()) final put ffff9e04c6710800/b60c000b-7335-444d-a8dc-1a5956712fb2 00000020:00010000:0.0:1788201579.944223:0:5846:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e04c8352800: total 1 00010000:00010000:0.0:1788201579.944226:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201579.944242:0:5846:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e04c8352800, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1788201579.944259:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c2cc7400/0x9383f985bc4d5e24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58cf expref: 7 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.944273:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c2cc7200/0x9383f985bc4d5cf0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58ba expref: 6 pid: 18162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.944284:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c2cc7a00/0x9383f985bc4d5cf7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58c1 expref: 5 pid: 18161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.944321:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c1b96200/0x9383f985bc4d5ce9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58b3 expref: 4 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201579.944336:0:5846:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e04c8352800, canceled 4 locks, left on hash table 0. 00010000:00010000:0.0:1788201579.944347:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201579.944349:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201579.944351:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788201579.944831:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c6710800/b60c000b-7335-444d-a8dc-1a5956712fb2 for MGS 00000020:00000080:2.0:1788201579.944867:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04c6713800 for MGS 00000020:00080000:3.0:1788201579.944975:0:22487:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.30@tcp (ffff9e04c8352800): rc 0 00000020:00000080:3.0:1788201579.944978:0:22487:0:(genops.c:906:class_export_put()) final put ffff9e04c8352800/7ad49433-54fa-4e21-b756-859420d95603 00000020:00080000:3.0:1788201579.944994:0:22487:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9e04d1c319c0) has no exports 00000100:00100000:3.0:1788201579.945047:0:18163:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9e03c2b09000:18163] 2 exiting: rc = 0 00000020:00000080:2.0:1788201579.945190:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c8352800/7ad49433-54fa-4e21-b756-859420d95603 for MGS 00000020:00000080:2.0:1788201579.945206:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04c8356800 for MGS 00010000:00010000:0.0:1788201579.945239:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201579.945265:0:18162:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9e03c39fa400:18162] 1 exiting: rc = 0 00000100:00100000:2.0:1788201579.945405:0:18186:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff9e04d8925200:18186] 3 exiting: rc = 0 00000100:00100000:0.0:1788201579.945937:0:18161:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9e04c6467e00:18161] 0 exiting: rc = 1 00000100:00100000:3.0:1788201579.946032:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946039:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946044:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946050:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946056:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946062:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946068:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946073:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946079:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946083:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946088:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946093:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946098:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946103:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946119:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946125:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946130:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946135:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946140:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946145:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946151:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946156:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946164:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946169:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946175:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946181:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946186:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946192:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946197:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946202:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946207:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946211:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946217:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946222:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946227:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946232:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946237:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946242:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946246:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946252:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946258:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946263:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946268:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946274:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946281:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946286:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946317:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946324:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946329:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946335:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946340:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946346:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946352:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946357:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946362:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946368:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946373:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946378:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946383:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946388:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946394:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946400:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946405:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201579.946410:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1788201579.946968:0:22487:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788201579.946972:0:22487:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1788201579.947976:0:22487:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e03c20a3060 - data ffff9e04dd8f5510/ffff9e04ff1d9400 00000020:01000000:3.0:1788201579.948094:0:22487:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e03c20a3780 - data ffff9e04dd2750d8/ffff9e03c2a18000 00000020:00000080:3.0:1788201579.948780:0:22487:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d5cd4 00000020:00000080:3.0:1788201579.948788:0:22487:0:(genops.c:906:class_export_put()) final put ffff9e04c8353800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788201579.948807:0:22487:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e03c5130000 from MGS, refs=2 00000020:01000004:3.0:1788201579.948811:0:22487:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e03c5130000 2 00000020:01000004:3.0:1788201579.948814:0:22487:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e03c5130000 from MGS 00000020:00000080:3.0:1788201579.948834:0:22487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201579.948840:0:22487:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788201579.948842:0:22487:0:(genops.c:906:class_export_put()) final put ffff9e03c5410800/MGS 00000020:00000080:3.0:1788201579.948845:0:22487:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03c5410800/MGS for MGS 00000020:01000000:3.0:1788201579.948853:0:22487:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788201579.948922:0:22487:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788201579.948926:0:22487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201579.948934:0:22487:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788201579.948940:0:22487:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9e04fae21800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788201579.948946:0:22487:0:(genops.c:1574:class_disconnect_exports()) OBD device 17 (ffff9e04ff1e3380) has exports, disconnecting them 00000020:00080000:3.0:1788201579.948951:0:22487:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9e04fae21800), last request at 1788201421 00000020:00000080:3.0:1788201579.948955:0:22487:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d5e16 00000020:00080000:3.0:1788201579.948964:0:22487:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e04fae21800): rc 0 00000020:00000080:3.0:1788201579.948968:0:22487:0:(genops.c:906:class_export_put()) final put ffff9e04fae21800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788201579.949208:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c8353800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788201579.949215:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04fae21800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788201579.950560:0:22487:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788201579.950567:0:22487:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201579.950571:0:22487:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788201579.950576:0:22487:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788201579.950719:0:22487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201579.950728:0:22487:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788201579.950734:0:22487:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e03c5130000 1 00000020:00000080:2.0:1788201579.950740:0:22487:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d5cc6 00000020:00000080:2.0:1788201579.950748:0:22487:0:(genops.c:906:class_export_put()) final put ffff9e03c5411800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788201579.950753:0:22487:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788201579.950757:0:22487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201579.950761:0:22487:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788201579.950765:0:22487:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9e04eadcb380) has no exports 00000020:00000080:0.0:1788201579.952362:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04fae23800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788201579.952381:0:36:0:(genops.c:906:class_export_put()) final put ffff9e04f976a000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788201579.952385:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04f976a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788201579.952391:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788201579.952471:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03c5411800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788201579.966759:0:22487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201579.966774:0:22487:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788201579.966780:0:22487:0:(genops.c:906:class_export_put()) final put ffff9e03c5136800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788201579.966784:0:22487:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03c5136800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788201579.966793:0:22487:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788201579.966927:0:22487:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e03c5132800 00000020:01000000:0.0:1788201579.966949:0:22487:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788201579.966953:0:22487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201579.966957:0:22487:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788201579.966961:0:22487:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9e04ff1e4d40) has no exports 00000100:00100000:0.0:1788201579.969115:0:18175:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9e03c39fb000:18175] 1 exiting: rc = 0 00000100:00100000:3.0:1788201579.969354:0:18173:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9e03c198cc00:18173] 0 exiting: rc = 1 00000100:00100000:3.0:1788201579.969411:0:19164:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9e04c6bad000:19164] 3 exiting: rc = 0 00000100:00100000:1.0:1788201579.969754:0:18176:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9e03c2ebf000:18176] 2 exiting: rc = 0 00000100:00100000:0.0:1788201579.970088:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970097:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970104:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970119:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970125:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970130:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970136:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970142:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970148:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970153:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970159:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970164:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970169:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970174:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970180:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970186:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970194:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970199:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970207:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970212:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970218:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970223:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970227:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970233:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970239:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970244:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970250:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970255:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970260:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970265:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970270:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970276:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970281:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970286:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970323:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970331:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970338:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970343:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970348:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970354:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970360:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970365:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970371:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970376:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970382:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970388:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970393:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970398:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970403:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970409:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970414:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970420:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970435:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970440:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970447:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970452:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970457:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970462:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970468:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970473:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970478:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970483:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970488:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.970492:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201579.974810:0:18178:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9e03c1d74c00:18178] 1 exiting: rc = 0 00000100:00100000:2.0:1788201579.974920:0:18177:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9e03c2ebee00:18177] 0 exiting: rc = 1 00000100:00100000:0.0:1788201579.975027:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975035:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975041:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975046:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975052:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975057:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975062:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975068:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975074:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975080:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975086:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975091:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975097:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975102:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975107:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975122:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975129:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975133:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975138:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975143:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975148:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975153:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975158:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975163:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975168:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975174:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975178:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975184:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975191:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975197:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975202:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975207:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975212:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975218:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975223:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975228:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975234:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975239:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975245:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975250:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975256:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975262:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975268:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975273:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975278:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975283:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975287:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975341:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975347:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975353:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975357:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975363:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975367:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975372:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975377:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975382:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975388:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975394:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975399:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975404:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975409:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975414:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975419:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.975461:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201579.976413:0:18180:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9e03c1d74200:18180] 1 exiting: rc = 0 00000100:00100000:2.0:1788201579.978240:0:18179:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9e04e658f800:18179] 0 exiting: rc = 1 00000100:00100000:0.0:1788201579.978416:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978435:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978442:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978448:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978454:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978471:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978479:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978486:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978493:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978510:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978519:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978526:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978533:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978551:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978557:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978564:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978571:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978593:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978600:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978606:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978615:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978624:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978632:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978638:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978645:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978651:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978657:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978663:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978669:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978697:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978704:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978711:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978724:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978730:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978736:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978742:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978750:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978756:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978763:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978769:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978775:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978797:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978803:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978809:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978816:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978822:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978828:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978835:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978841:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978847:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978853:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978859:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978866:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978886:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978893:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978901:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978908:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978914:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978921:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978928:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978934:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978942:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978948:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.978954:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201579.988034:0:18181:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9e04c6637c00:18181] 0 exiting: rc = 1 00000100:00100000:1.0:1788201579.988400:0:18182:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9e04c6636c00:18182] 1 exiting: rc = 0 00000100:00100000:0.0:1788201579.988525:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988532:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988546:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988552:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988557:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988562:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988567:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988572:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988579:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988585:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988590:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988594:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988600:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988605:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988610:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988614:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988619:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988623:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988628:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988634:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988638:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988643:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988648:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988653:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988658:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988663:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988669:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988675:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988680:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988684:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988689:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988694:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988698:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988703:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988707:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988712:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988718:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988724:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988729:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988733:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988739:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988744:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988748:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988754:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988759:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988764:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988768:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988773:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988778:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988783:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988788:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988793:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988798:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988803:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988807:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988812:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988817:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988821:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988825:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988830:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988835:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988840:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988846:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.988851:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201579.989765:0:18183:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9e04c6636000:18183] 0 exiting: rc = 1 00000100:00100000:1.0:1788201579.990026:0:18185:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9e04d8924000:18185] 1 exiting: rc = 0 00000100:00100000:0.0:1788201579.990648:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990655:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990660:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990665:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990670:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990675:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990681:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990686:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990691:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990696:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990702:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990708:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990713:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990718:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990724:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990730:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990735:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990739:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990744:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990749:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990753:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990758:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990763:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990767:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990772:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990777:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990781:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990785:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990789:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990794:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990798:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990802:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990807:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990811:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990816:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990821:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990826:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990831:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990836:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990840:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990844:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990849:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990855:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990859:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990863:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990868:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990873:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990878:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990883:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990887:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990892:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990897:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990901:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990906:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990911:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990917:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990923:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990928:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990933:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990937:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990942:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990947:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990952:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.990958:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201579.991455:0:18187:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9e04d82c1400:18187] 0 exiting: rc = 1 00000100:00100000:2.0:1788201579.991661:0:18188:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9e04d82c1000:18188] 1 exiting: rc = 0 00000100:00100000:0.0:1788201579.991858:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.991864:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.991870:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.991876:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.991880:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.991885:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.991891:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.991896:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.991901:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.991906:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.991911:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.991916:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.991922:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.991927:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.991933:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.991938:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.991943:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.991949:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.991954:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.991960:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.991965:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.991970:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.991975:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.991980:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.991985:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.991990:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.991995:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992000:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992005:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992010:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992015:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992021:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992026:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992032:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992037:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992044:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992049:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992053:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992058:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992063:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992068:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992072:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992078:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992083:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992087:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992092:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992097:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992102:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992169:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992175:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992180:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992185:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992190:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992195:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992201:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992205:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992210:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992215:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992219:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992224:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992229:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992234:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992238:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.992244:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201579.993039:0:18189:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9e04d80d0800:18189] 0 exiting: rc = 1 00000100:00100000:0.0:1788201579.993350:0:18190:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9e04d9b95400:18190] 1 exiting: rc = 0 00000100:00100000:1.0:1788201579.993860:0:18191:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9e04d9b94000:18191] 2 exiting: rc = 0 00000100:00100000:0.0:1788201579.994224:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994232:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994237:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994243:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994249:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994255:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994263:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994269:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994334:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994344:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994350:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994356:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994363:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994369:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994375:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994381:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994387:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994393:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994399:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994406:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994412:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994417:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994567:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994578:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994584:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994591:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994596:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994600:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994605:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994611:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994616:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994621:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994642:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994649:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994654:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994660:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994666:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994671:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994677:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994682:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994688:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994695:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994701:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994707:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994713:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994720:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994726:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994733:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994740:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994747:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994753:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994759:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994765:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994771:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994777:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994784:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994804:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994811:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994818:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994823:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994831:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994837:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994843:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201579.994850:0:22487:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788201580.000385:0:22487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201580.000400:0:22487:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788201580.000406:0:22487:0:(genops.c:906:class_export_put()) final put ffff9e04c2e35800/MDS_uuid 00000020:00000080:0.0:1788201580.000411:0:22487:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c2e35800/MDS_uuid for MDS 00000020:01000000:0.0:1788201580.000416:0:22487:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788201580.000861:0:22487:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000001:00100000:2.0:1788201580.305547:0:7657:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201580.305557:0:7657:0:(genops.c:906:class_export_put()) final put ffff9e04f5757000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201580.305611:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04f5757000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788201580.305665:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04f5755000 for lustre-OST0001 00000001:00100000:3.0:1788201580.307992:0:6732:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788201580.308000:0:6732:0:(genops.c:906:class_export_put()) final put ffff9e04fae40800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788201580.308026:0:6732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294968892 is committed 00000020:00000080:2.0:1788201580.308095:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04fae40800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788201580.308148:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04fae45800 for lustre-OST0000 00010000:00010000:2.0:1788201580.523041:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201581.543632:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201582.567399:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201583.589727:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201584.357561:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458320640:0@lo:400:kworker.0 00000100:00100000:2.0:1788201584.357599:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201584.357614:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458320512:0@lo:400:kworker.0 00000400:00000100:0.0:1788201584.357621:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458320640 offset 0 length 224: 4 00000400:00000100:2.0:1788201584.357637:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875064458320512 offset 0 length 224: 4 00000100:00100000:3.0:1788201584.357989:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458320768:0@lo:400:kworker.0 00000400:00000100:2.0:1788201584.359646:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458320768 offset 0 length 224: 4 00000400:00000100:1.0:1788201584.536652:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.30@tcp portal 26 match 1875064442778112 offset 0 length 224: 4 00000100:00100000:1.0:1788201584.536692:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000400:00000100:1.0:1788201584.536996:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.30@tcp portal 12 match 1875064442778240 offset 0 length 224: 4 00000100:00100000:2.0:1788201584.541909:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442778368 00000100:00100000:2.0:1788201584.541922:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442778368 00000100:00100000:1.0:1788201584.542148:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 353 00000100:00100000:1.0:1788201584.542161:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f900aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+506:2361:x1875064442778368:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201584.542251:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f900aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+506:2361:x1875064442778368:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 92us (5558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201584.542258:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 353 00000100:00080000:3.0:1788201584.542322:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788201584.613512:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201585.637498:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201586.662108:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201587.687720:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201588.712855:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201589.477606:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458321024:0@lo:400:kworker.0 00000400:00000100:0.0:1788201589.477694:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458321024 offset 0 length 224: 4 00000100:00100000:0.0:1788201589.477775:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201589.477781:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458320896:0@lo:400:kworker.0 00000400:00000100:0.0:1788201589.477802:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875064458320896 offset 0 length 224: 4 00000100:00100000:0.0:1788201589.477838:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201589.477850:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458321152:0@lo:400:kworker.0 00000400:00000100:0.0:1788201589.477875:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458321152 offset 0 length 224: 4 00000400:00000100:1.0:1788201589.649209:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.30@tcp portal 26 match 1875064442778496 offset 0 length 224: 4 00000400:00000100:1.0:1788201589.649242:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.30@tcp portal 12 match 1875064442778624 offset 0 length 224: 4 00000100:00100000:1.0:1788201589.649284:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201589.649551:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442778752 00000100:00100000:3.0:1788201589.649566:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442778752 00000100:00100000:3.0:1788201589.649651:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 354 00000100:00100000:3.0:1788201589.649666:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+506:2362:x1875064442778752:12345-192.168.201.30@tcp:400:kworker.0 00000020:02000000:3.0:1788201589.649676:0:10484:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788201589.664909:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+506:2362:x1875064442778752:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 15229us (15607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201589.664930:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 354 00010000:00010000:1.0:1788201589.737851:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201590.757729:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788201591.468147:0:23045:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788201591.468153:0:23045:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788201591.468265:0:23045:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e04ff44c800 00000020:01000004:1.0:1788201591.468326:0:23045:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788201591.468347:0:23045:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788201591.468360:0:23045:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9e04f9650000) 00000020:00000080:1.0:1788201591.468377:0:23045:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788201591.574860:0:23045:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788201591.611792:0:23045:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x39:0x0] (8/32) 00100000:10000000:0.0:1788201591.616572:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 436: rc = 0 00100000:10000000:0.0:1788201591.624868:0:23045:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788201591.625018:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 436: rc = 0 00100000:10000000:0.0:1788201591.625162:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 436: rc = 0 00100000:10000000:0.0:1788201591.625281:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 436: rc = 0 00100000:10000000:0.0:1788201591.625446:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 436: rc = 0 00100000:10000000:0.0:1788201591.625566:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 436: rc = 0 00100000:10000000:0.0:1788201591.627348:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 438: rc = 0 00100000:10000000:1.0:1788201591.661279:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 474: rc = 0 00100000:10000000:1.0:1788201591.661733:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 474: rc = 0 00100000:10000000:1.0:1788201591.674641:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 363: rc = 0 00100000:10000000:1.0:1788201591.687201:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 363: rc = 0 00100000:10000000:1.0:1788201591.698836:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 363: rc = 0 00100000:10000000:1.0:1788201591.707670:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 363: rc = 0 00100000:10000000:1.0:1788201591.708771:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 363: rc = 0 00100000:10000000:2.0:1788201591.724195:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 363: rc = 0 00100000:10000000:2.0:1788201591.734431:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 363: rc = 0 00100000:10000000:2.0:1788201591.742744:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 363: rc = 0 00100000:10000000:2.0:1788201591.758992:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 363: rc = 0 00100000:10000000:2.0:1788201591.761793:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 363: rc = 0 00100000:10000000:2.0:1788201591.765896:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 363: rc = 0 00100000:10000000:3.0:1788201591.776651:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 363: rc = 0 00010000:00010000:2.0:1788201591.782672:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788201591.783890:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 595: rc = 0 00100000:10000000:3.0:1788201591.787086:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 595: rc = 0 00100000:10000000:3.0:1788201591.788893:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 595: rc = 0 00100000:10000000:3.0:1788201591.792787:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 595: rc = 0 00100000:10000000:3.0:1788201591.799457:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 595: rc = 0 00100000:10000000:3.0:1788201591.803076:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 595: rc = 0 00100000:10000000:3.0:1788201591.804961:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 595: rc = 0 00100000:10000000:3.0:1788201591.806662:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 595: rc = 0 00100000:10000000:2.0:1788201591.808913:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 595: rc = 0 00100000:10000000:2.0:1788201591.810699:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 595: rc = 0 00100000:10000000:2.0:1788201591.814956:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 595: rc = 0 00100000:10000000:3.0:1788201591.816283:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 595: rc = 0 00100000:10000000:3.0:1788201591.817505:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 595: rc = 0 00100000:10000000:2.0:1788201591.819164:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 595: rc = 0 00100000:10000000:3.0:1788201591.822032:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 595: rc = 0 00100000:10000000:3.0:1788201591.823166:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 595: rc = 0 00100000:10000000:2.0:1788201591.825048:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 595: rc = 0 00100000:10000000:2.0:1788201591.826212:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 595: rc = 0 00100000:10000000:2.0:1788201591.827760:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 595: rc = 0 00100000:10000000:2.0:1788201591.829178:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 595: rc = 0 00100000:10000000:2.0:1788201591.830959:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 595: rc = 0 00100000:10000000:3.0:1788201591.832095:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 595: rc = 0 00100000:10000000:2.0:1788201591.833199:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 595: rc = 0 00100000:10000000:2.0:1788201591.834486:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 595: rc = 0 00100000:10000000:2.0:1788201591.835969:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 595: rc = 0 00100000:10000000:2.0:1788201591.837015:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 595: rc = 0 00100000:10000000:2.0:1788201591.838025:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 595: rc = 0 00100000:10000000:2.0:1788201591.839067:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 595: rc = 0 00100000:10000000:2.0:1788201591.840076:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 595: rc = 0 00100000:10000000:2.0:1788201591.841016:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 595: rc = 0 00100000:10000000:2.0:1788201591.842103:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 595: rc = 0 00100000:10000000:2.0:1788201591.843189:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 595: rc = 0 00100000:10000000:2.0:1788201591.849854:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 590: rc = 0 00100000:10000000:2.0:1788201591.851042:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000bd0:0x1:0x0] under 590: rc = 0 00100000:10000000:2.0:1788201591.854205:0:23045:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788201591.855652:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 359: rc = 0 00100000:10000000:3.0:1788201591.857052:0:23045:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788201591.857147:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 359: rc = 0 00100000:10000000:3.0:1788201591.858416:0:23045:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788201591.858507:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 359: rc = 0 00100000:10000000:3.0:1788201591.860678:0:23045:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788201591.860779:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 475: rc = 0 00100000:10000000:3.0:1788201591.861915:0:23045:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788201591.861991:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 475: rc = 0 00100000:10000000:3.0:1788201591.863075:0:23045:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788201591.863162:0:23045:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 475: rc = 0 00000020:00000080:3.0:1788201591.863679:0:23045:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788201591.863688:0:23045:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788201591.863698:0:23045:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d603f 00000020:01000004:3.0:1788201591.863705:0:23045:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788201591.863713:0:23045:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788201591.863718:0:23045:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e04ff44c800 from MGS 00000020:01000004:3.0:1788201591.863721:0:23045:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788201591.863742:0:23045:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9e04eadc99c0) 00000020:00000080:3.0:1788201591.863752:0:23045:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788201591.863801:0:23045:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e04ff44c800 from MGS, refs=2 00080000:01000000:3.0:1788201591.863805:0:23045:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788201591.863808:0:23045:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d604d 00010000:00010000:3.0:1788201591.863911:0:23045:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-2 is initialized 00000040:01000000:3.0:1788201591.876810:0:23045:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788201591.876827:0:23045:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788201591.876830:0:23045:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788201591.878410:0:23046:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788201591.878807:0:23045:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788201591.878904:0:23045:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788201591.885722:0:23045:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788201591.885985:0:23045:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788201591.886142:0:23045:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788201591.886149:0:23045:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788201591.891067:0:23045:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788201591.891080:0:23045:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788201591.891814:0:23045:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788201591.891823:0:23045:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788201591.892722:0:23045:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788201591.892746:0:23045:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1788201591.892748:0:23045:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.130@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1788201591.892751:0:23045:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.130@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:1.0:1788201591.892757:0:23045:0:(import.c:65:import_set_state_nolock()) ffff9e04c6711800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788201591.892763:0:23045:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788201591.899485:0:23045:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.130@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788201591.899490:0:23045:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788201591.899498:0:23045:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e04c12abb80 x1875064458320512/t0(0) o400->MGC192.168.201.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201600 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201591.899650:0:23045:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e04c12ab100 x1875064458320896/t0(0) o400->MGC192.168.201.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201609 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788201591.899671:0:23045:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788201591.899674:0:23045:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788201591.899676:0:23045:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788201591.899680:0:23045:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:0.0:1788201591.899801:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458320896:0@lo:400:kworker.0 00000100:00100000:3.0:1788201591.899899:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458320512:0@lo:400:kworker.0 10000000:01000000:1.0:1788201591.899955:0:23045:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1788201591.899970:0:23045:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c32bca00/0x9383f985bc4d5f90 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4d5f97 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201591.899980:0:23045:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c32bca00/0x9383f985bc4d5f90 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4d5f97 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201591.899986:0:23045:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788201591.900033:0:23045:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201591.900043:0:23045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c32bca00/0x9383f985bc4d5f90 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4d5f97 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.900061:0:23045:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c1b96600/0x9383f985bc4d5f4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4d5f51 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201591.900067:0:23045:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c1b96600/0x9383f985bc4d5f4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4d5f51 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201591.900072:0:23045:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201591.900177:0:23045:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201591.900184:0:23045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c1b96600/0x9383f985bc4d5f4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4d5f51 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.900194:0:23045:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97000/0x9383f985bc4d5f58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4d5f5f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201591.900200:0:23045:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97000/0x9383f985bc4d5f58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4d5f5f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201591.900205:0:23045:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201591.900462:0:23045:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201591.900468:0:23045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c1b97000/0x9383f985bc4d5f58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4d5f5f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.900479:0:23045:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e04ff129600/0x9383f985bc4d5f74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4d5f7b expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201591.900485:0:23045:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e04ff129600/0x9383f985bc4d5f74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4d5f7b expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201591.900491:0:23045:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201591.900866:0:23045:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201591.900872:0:23045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e04ff129600/0x9383f985bc4d5f74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4d5f7b expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.900883:0:23045:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c32bda00/0x9383f985bc4d5f82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4d5f89 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201591.900889:0:23045:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c32bda00/0x9383f985bc4d5f82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4d5f89 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201591.900894:0:23045:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201591.900964:0:23045:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201591.900969:0:23045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c32bda00/0x9383f985bc4d5f82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4d5f89 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.900979:0:23045:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c131f200/0x9383f985bc4d5fac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4d5fb3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201591.900985:0:23045:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c131f200/0x9383f985bc4d5fac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4d5fb3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201591.900993:0:23045:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201591.901063:0:23045:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201591.901068:0:23045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c131f200/0x9383f985bc4d5fac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4d5fb3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.901083:0:23045:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e04ff129400/0x9383f985bc4d5f66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4d5f6d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201591.901089:0:23045:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e04ff129400/0x9383f985bc4d5f66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4d5f6d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201591.901093:0:23045:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788201591.901164:0:23045:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201591.901169:0:23045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e04ff129400/0x9383f985bc4d5f66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4d5f6d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201591.901178:0:23045:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e04c0031800/0x9383f985bc4d5f9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4d5fa5 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201591.901184:0:23045:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e04c0031800/0x9383f985bc4d5f9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4d5fa5 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201591.901189:0:23045:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788201591.901623:0:23045:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201591.901630:0:23045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e04c0031800/0x9383f985bc4d5f9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4d5fa5 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788201591.901652:0:23045:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9e04c6711800 already not connected (conn 7, was 0): DISCONN 00000100:00080000:1.0:1788201591.901657:0:23045:0:(import.c:65:import_set_state_nolock()) ffff9e04c6711800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201591.901664:0:23045:0:(import.c:510:import_select_connection()) MGC192.168.201.130@tcp: connect to NID 0@lo last attempt 695 00000100:00080000:1.0:1788201591.901671:0:23045:0:(import.c:624:import_select_connection()) MGC192.168.201.130@tcp: import ffff9e04c6711800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:1.0:1788201591.901701:0:23045:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e04f9008a80 x1875064458321280/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201591.901729:0:23045:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:2.0:1788201591.901784:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f9008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b60c000b-7335-444d-a8dc-1a5956712fb2:3309:1875064458321280:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788201591.901854:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201591.901947:0:23050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458321280 00000100:00100000:3.0:1788201591.901956:0:23050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458321280 00000100:00100000:3.0:1788201591.901991:0:23050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201591.901999:0:23050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3309:x1875064458321280:12345-0@lo:250:mount.lustre.0 00000020:02000000:3.0:1788201591.902005:0:23050:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:1.0:1788201591.904818:0:23050:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from b60c000b-7335-444d-a8dc-1a5956712fb2@0@lo t0 exp 0000000000000000 cur 867 last 0 00000020:00000080:1.0:1788201591.904851:0:23050:0:(genops.c:1406:class_connect()) connect: client b60c000b-7335-444d-a8dc-1a5956712fb2, cookie 0x9383f985bc4d6054 00000100:00080000:1.0:1788201591.904990:0:23050:0:(import.c:65:import_set_state_nolock()) ffff9e04ff44b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201591.905087:0:23050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+5:3309:x1875064458321280:12345-0@lo:250:mount.lustre.0 Request processed in 3086us (3231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201591.905102:0:23050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201591.905196:0:3309:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.130@tcp: committing for last_committed 0 gen 6 00000100:00080000:3.0:1788201591.905206:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.130@tcp: connect to target with instance 0 00000100:00080000:3.0:1788201591.905280:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.130@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788201591.905285:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788201591.905289:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04c6711800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788201591.905323:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788201591.905362:0:3309:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788201591.905370:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f9008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b60c000b-7335-444d-a8dc-1a5956712fb2:3309:1875064458321280:0@lo:250:mount.lustre.0 00000020:01000000:3.0:1788201591.905422:0:38:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.201.130@tcp 10000000:01000000:3.0:1788201591.905437:0:38:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1788201591.905441:0:38:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788201591.905443:0:38:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788201591.905444:0:38:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201591.905445:0:38:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201591.905446:0:38:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201591.905447:0:38:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201591.905449:0:38:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201591.905451:0:38:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201591.905452:0:38:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1788201591.905488:0:38:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1788201591.905494:0:38:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:3.0:1788201591.905497:0:38:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788201591.905498:0:38:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788201591.905499:0:38:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201591.905500:0:38:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201591.905501:0:38:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201591.905502:0:38:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201591.905503:0:38:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201591.905504:0:38:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201591.905505:0:38:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1788201591.905524:0:38:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1788201591.905632:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458321408:0@lo:253:kworker.0 00000100:00100000:3.0:1788201591.905671:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201591.905718:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458321536:0@lo:253:kworker.0 00000100:00100000:3.0:1788201591.905748:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201591.905785:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458321408 00000100:00100000:3.0:1788201591.905791:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458321408 00000100:00100000:3.0:1788201591.905816:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458321536 00000100:00100000:3.0:1788201591.905819:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458321536 00000100:00100000:3.0:1788201591.905834:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788201591.905842:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+6:3313:x1875064458321408:12345-0@lo:253:kworker.0 00000020:02000000:3.0:1788201591.905847:0:23051:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 20000000:01000000:3.0:1788201591.905866:0:23051:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:3.0:1788201591.906008:0:23052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788201591.906016:0:23052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+6:3310:x1875064458321536:12345-0@lo:253:kworker.0 00000020:02000000:3.0:1788201591.906020:0:23052:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 20000000:01000000:3.0:1788201591.906033:0:23052:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00080000:1.0:1788201591.906310:0:23045:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:1.0:1788201591.906321:0:23045:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788201591.906327:0:23045:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788201591.906360:0:23045:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9e04f9654d40) 00000020:00000080:1.0:1788201591.906374:0:23045:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 10000000:01000000:3.0:1788201591.920115:0:23053:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788201591.920562:0:23051:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 17 00000100:00100000:1.0:1788201591.926914:0:23045:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201591.927084:0:23045:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788201591.927090:0:23045:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788201591.930764:0:23045:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788201591.930776:0:23045:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788201591.933130:0:23045:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788201591.933141:0:23045:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788201591.933905:0:23045:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201591.934057:0:23045:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788201591.934063:0:23045:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 20000000:01000000:3.0:1788201591.938678:0:23057:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788201591.938688:0:23057:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788201591.938691:0:23057:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788201591.938753:0:23057:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1788201591.938984:0:23051:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788201591.939005:0:23051:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788201591.944718:0:23045:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788201591.944733:0:23045:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 20000000:01000000:2.0:1788201591.996193:0:23051:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788201591.996206:0:23051:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788201591.996248:0:23052:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788201591.996623:0:23053:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788201591.996629:0:23053:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788201591.996655:0:23053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e03c131f000/0x9383f985bc4d6062 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201591.996673:0:23053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c131f000/0x9383f985bc4d6062 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788201591.996682:0:23053:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000054744s 00010000:00010000:2.0:1788201591.996687:0:23053:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03c131f000/0x9383f985bc4d6062 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201591.996694:0:23053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03c131f000/0x9383f985bc4d6062 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201591.996702:0:23053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e03c131f000/0x9383f985bc4d6062 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201591.996708:0:23053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e03c131f000/0x9383f985bc4d6062 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201591.996715:0:23053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131f000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201591.996720:0:23053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e03c131f000/0x9383f985bc4d6062 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201591.996728:0:23053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e03c131f000/0x9383f985bc4d6062 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201591.996740:0:23053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e03c131f000/0x9383f985bc4d6062 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201591.996747:0:23053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e03c131f000/0x9383f985bc4d6062 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201591.996753:0:23053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c131f000/0x9383f985bc4d6062 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788201592.046453:0:23052:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788201592.046465:0:23052:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788201592.046510:0:23053:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788201592.046515:0:23053:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788201592.046551:0:23053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e03c131fe00/0x9383f985bc4d6069 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201592.046569:0:23053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c131fe00/0x9383f985bc4d6069 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788201592.046579:0:23053:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000064367s 00010000:00010000:2.0:1788201592.046584:0:23053:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03c131fe00/0x9383f985bc4d6069 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201592.046591:0:23053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03c131fe00/0x9383f985bc4d6069 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201592.046598:0:23053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e03c131fe00/0x9383f985bc4d6069 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201592.046607:0:23053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e03c131fe00/0x9383f985bc4d6069 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201592.046614:0:23053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131fe00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201592.046619:0:23053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e03c131fe00/0x9383f985bc4d6069 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201592.046627:0:23053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e03c131fe00/0x9383f985bc4d6069 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201592.046639:0:23053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e03c131fe00/0x9383f985bc4d6069 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201592.046646:0:23053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e03c131fe00/0x9383f985bc4d6069 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201592.046653:0:23053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c131fe00/0x9383f985bc4d6069 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201592.058529:0:23045:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788201592.060679:0:23045:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788201592.060689:0:23045:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788201592.066639:0:23045:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788201592.066656:0:23045:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788201592.068040:0:23045:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201592.068207:0:23045:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788201592.068213:0:23045:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788201592.071381:0:23045:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788201592.071395:0:23045:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788201592.072712:0:23045:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201592.072857:0:23045:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788201592.072862:0:23045:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788201592.073645:0:23045:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788201592.073652:0:23045:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788201592.074086:0:23045:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201592.074215:0:23045:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788201592.074220:0:23045:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788201592.074663:0:23045:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788201592.074669:0:23045:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788201592.087845:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+6:3313:x1875064458321408:12345-0@lo:253:kworker.0 Request processed in 181991us (182161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201592.087859:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:0.0:1788201592.087984:0:3313:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788201592.087987:0:3313:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788201592.087989:0:3313:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201592.087990:0:3313:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201592.087991:0:3313:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201592.087993:0:3313:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201592.087994:0:3313:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788201592.087997:0:3313:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201592.087998:0:3313:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788201592.088003:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458321408:0@lo:253:kworker.0 00000100:00100000:3.0:1788201592.088748:0:23052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+5:3310:x1875064458321536:12345-0@lo:253:kworker.0 Request processed in 182730us (182996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201592.088758:0:23052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:0.0:1788201592.088844:0:3310:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788201592.088846:0:3310:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788201592.088847:0:3310:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201592.088849:0:3310:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201592.088850:0:3310:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201592.088851:0:3310:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201592.088852:0:3310:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788201592.088854:0:3310:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201592.088855:0:3310:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788201592.088858:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458321536:0@lo:253:kworker.0 00000100:00100000:2.0:1788201592.097098:0:23045:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201592.097447:0:23045:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788201592.097453:0:23045:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788201592.098751:0:23045:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788201592.098761:0:23045:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788201592.099667:0:23045:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788201592.099678:0:23045:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788201592.100838:0:23045:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788201592.100867:0:23045:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788201592.100874:0:23045:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788201592.101023:0:23045:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.130@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788201592.101068:0:23045:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.130@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788201592.101073:0:23045:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788201592.101075:0:23045:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788201592.101077:0:23045:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201592.101078:0:23045:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201592.101079:0:23045:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201592.101081:0:23045:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201592.101083:0:23045:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201592.101084:0:23045:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788201592.101086:0:23045:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201592.101087:0:23045:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788201592.101090:0:23045:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788201592.101092:0:23045:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788201592.101094:0:23045:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788201592.101095:0:23045:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201592.101096:0:23045:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201592.101097:0:23045:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201592.101098:0:23045:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201592.101100:0:23045:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201592.101101:0:23045:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788201592.101102:0:23045:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201592.101103:0:23045:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788201592.101132:0:23045:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788201592.101154:0:23045:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c49f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:23045:1875064458321664:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788201592.101788:0:23045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201592.101890:0:23045:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1c24a80 going to sleep for 20 seconds 00000100:00100000:0.0:1788201592.101938:0:23050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458321664 00000100:00100000:0.0:1788201592.101948:0:23050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458321664 00000100:00100000:0.0:1788201592.102023:0:23050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788201592.102032:0:23050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+5:23045:x1875064458321664:12345-0@lo:253:mount.lustre.0 00000020:02000000:0.0:1788201592.102039:0:23050:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 20000000:01000000:0.0:1788201592.102088:0:23050:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788201592.102091:0:23050:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788201592.102094:0:23050:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:0.0:1788201592.102100:0:23050:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788201592.107942:0:23050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+5:23045:x1875064458321664:12345-0@lo:253:mount.lustre.0 Request processed in 5902us (6147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201592.107958:0:23050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201592.108053:0:23045:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c49f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:23045:1875064458321664:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788201592.108069:0:23045:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788201592.108073:0:23045:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788201592.108075:0:23045:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788201592.108076:0:23045:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201592.108077:0:23045:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201592.108078:0:23045:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201592.108080:0:23045:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201592.108081:0:23045:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201592.108083:0:23045:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788201592.108085:0:23045:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201592.108086:0:23045:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788201592.108105:0:23045:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e04ff44c800 from lustre-MDT0000 10000000:01000000:2.0:1788201592.108132:0:23045:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788201592.108135:0:23045:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788201592.108143:0:23045:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e04ff44c800 10000000:01000000:2.0:1788201592.108147:0:23045:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788201592.108151:0:23045:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e04ff44c800 10000000:01000000:2.0:1788201592.108154:0:23045:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788201592.108157:0:23045:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9e04ff44c800 from 1 10000000:01000000:2.0:1788201592.108160:0:23045:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788201592.108195:0:23045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c131fe00/0x9383f985bc4d6070 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201592.108205:0:23045:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c131fe00/0x9383f985bc4d6070 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201592.108275:0:23045:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c131fe00/0x9383f985bc4d6070 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201592.108468:0:23045:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c49f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:23045:1875064458321792:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201592.108506:0:23045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201592.108570:0:23045:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1c249c0 going to sleep for 20 seconds 00000100:00100000:3.0:1788201592.108608:0:23052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458321792 00000100:00100000:3.0:1788201592.108614:0:23052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458321792 00000100:00100000:3.0:1788201592.108682:0:23052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788201592.108691:0:23052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+5:23045:x1875064458321792:12345-0@lo:101:mount.lustre.0 00000020:02000000:3.0:1788201592.108697:0:23052:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:3.0:1788201592.108707:0:23052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201592.108721:0:23052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c32bc600/0x9383f985bc4d6077 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d6070 expref: -99 pid: 23052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.108741:0:23052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c32bc600/0x9383f985bc4d6077 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d6070 expref: 6 pid: 23052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.108750:0:23052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c32bc600/0x9383f985bc4d6077 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d6070 expref: 6 pid: 23052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.108758:0:23052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bc600, rc 0) 00000100:00100000:3.0:1788201592.108796:0:23052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+6:23045:x1875064458321792:12345-0@lo:101:mount.lustre.0 Request processed in 106us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201592.108802:0:23052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788201592.108862:0:23045:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c49f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:23045:1875064458321792:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201592.108874:0:23045:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c131fe00/0x9383f985bc4d6070 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6077 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.108883:0:23045:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c131fe00/0x9383f985bc4d6070 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d6077 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201592.108895:0:23045:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788201592.108913:0:23045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c131fe00/0x9383f985bc4d6070 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6077 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.108921:0:23045:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c131fe00/0x9383f985bc4d6070 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6077 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201592.108926:0:23045:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788201592.108930:0:23045:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788201592.108934:0:23045:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e04ff44c800 10000000:01000000:0.0:1788201592.108936:0:23045:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788201592.108939:0:23045:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788201592.108941:0:23045:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788201592.108955:0:23045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04ff129e00/0x9383f985bc4d607e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.108962:0:23045:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e04ff129e00/0x9383f985bc4d607e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.108968:0:23045:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e04ff129e00/0x9383f985bc4d607e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201592.108979:0:23045:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:23045:1875064458321920:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788201592.109003:0:23045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201592.109128:0:23045:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7fd2900 going to sleep for 20 seconds 00000100:00100000:2.0:1788201592.109198:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458321920 00000100:00100000:2.0:1788201592.109203:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458321920 00000100:00100000:2.0:1788201592.109234:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201592.109240:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+6:23045:x1875064458321920:12345-0@lo:101:mount.lustre.0 00000020:02000000:2.0:1788201592.109245:0:23051:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:2.0:1788201592.109251:0:23051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201592.109260:0:23051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c131f000/0x9383f985bc4d6085 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d607e expref: -99 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201592.109273:0:23051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c131f000/0x9383f985bc4d6085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d607e expref: 7 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201592.109281:0:23051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c131f000/0x9383f985bc4d6085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d607e expref: 7 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201592.109288:0:23051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c131f000, rc 0) 00000100:00100000:2.0:1788201592.109350:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+7:23045:x1875064458321920:12345-0@lo:101:mount.lustre.0 Request processed in 108us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201592.109356:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788201592.109497:0:23045:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:23045:1875064458321920:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201592.109508:0:23045:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e04ff129e00/0x9383f985bc4d607e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6085 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.109515:0:23045:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e04ff129e00/0x9383f985bc4d607e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d6085 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201592.109556:0:23045:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:23045:1875064458322048:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201592.109581:0:23045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201592.109608:0:23045:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7fd2900 going to sleep for 20 seconds 00000100:00100000:2.0:1788201592.109723:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458322048 00000100:00100000:2.0:1788201592.109728:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458322048 00000100:00100000:2.0:1788201592.109745:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788201592.109751:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+7:23045:x1875064458322048:12345-0@lo:501:mount.lustre.0 00000020:02000000:2.0:1788201592.109755:0:23051:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1788201592.110107:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+8:23045:x1875064458322048:12345-0@lo:501:mount.lustre.0 Request processed in 355us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201592.110114:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788201592.110184:0:23045:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:23045:1875064458322048:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201592.110223:0:23045:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:23045:1875064458322176:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201592.110261:0:23045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201592.110283:0:23045:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7fd2900 going to sleep for 20 seconds 00000100:00100000:3.0:1788201592.110597:0:23052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458322176 00000100:00100000:3.0:1788201592.110602:0:23052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458322176 00000100:00100000:3.0:1788201592.110628:0:23052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788201592.110634:0:23052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+8:23045:x1875064458322176:12345-0@lo:503:mount.lustre.0 00000020:02000000:3.0:1788201592.110639:0:23052:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1788201592.114623:0:23052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+8:23045:x1875064458322176:12345-0@lo:503:mount.lustre.0 Request processed in 3979us (4351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201592.114639:0:23052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788201592.114764:0:23045:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:23045:1875064458322176:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201592.115192:0:23074:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:23074:1875064458322304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201592.115256:0:23074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201592.115426:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458322304 00000100:00100000:2.0:1788201592.115433:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458322304 00000100:00100000:2.0:1788201592.115474:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788201592.115483:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+8:23074:x1875064458322304:12345-0@lo:502:llog_process_th.0 00000020:02000000:2.0:1788201592.115489:0:23051:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788201592.116155:0:23074:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c5e3f780 going to sleep for 20 seconds 00000100:00100000:0.0:1788201592.122765:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+8:23074:x1875064458322304:12345-0@lo:502:llog_process_th.0 Request processed in 7274us (7500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201592.122781:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201592.122882:0:23074:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:23074:1875064458322304:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201592.122927:0:23074:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201592.122938:0:23074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201592.122941:0:23074:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788201592.122946:0:23074:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788201592.122949:0:23074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201592.122964:0:23074:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9e04eadc8000) 00000020:00000080:3.0:1788201592.122986:0:23074:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788201592.122992:0:23074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788201592.123068:0:23074:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788201592.123075:0:23074:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d6093 00000020:00000080:3.0:1788201592.123619:0:23074:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788201592.123626:0:23074:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201592.123630:0:23074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201592.123632:0:23074:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788201592.123635:0:23074:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201592.123639:0:23074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201592.123640:0:23074:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788201592.123643:0:23074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201592.123653:0:23074:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9e04eadcb380) 00000020:00000080:3.0:1788201592.123666:0:23074:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788201592.123669:0:23074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788201592.123671:0:23074:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788201592.123674:0:23074:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788201592.123680:0:23074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788201592.123726:0:23074:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e04ff44c800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788201592.123737:0:23074:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9e04eadccd40) 00000020:00000080:3.0:1788201592.123746:0:23074:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788201592.123789:0:23074:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788201592.123794:0:23074:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9383f985bc4d60a8 00000020:00000080:3.0:1788201592.123881:0:23074:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788201592.123887:0:23074:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788201592.123892:0:23074:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9383f985bc4d60af 00080000:01000000:3.0:1788201592.123896:0:23074:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788201592.123900:0:23074:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d60b6 00010000:00010000:3.0:1788201592.194881:0:23074:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-3 is initialized 00000001:00080000:3.0:1788201592.198684:0:23074:0:(tgt_lastrcvd.c:1749:tgt_clients_data_init()) RCVRNG CLIENT uuid: 35604eb4-baf9-45be-a20a-4883a2cd8cf9 idx: 0 lr: 17179869289 srv lr: 21474836480 lx: 0 gen 2 00000001:00000004:3.0:1788201592.198736:0:23074:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 6, last_transno is 21474836480 00000001:00080000:2.0:1788201592.199609:0:23074:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1788201592.199693:0:23074:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04ffca6480: xid 1875064442776576, transno 21474836482, client gen 2, slot idx 0 00000001:00080000:2.0:1788201592.199716:0:23074:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e03c2ff0540: xid 1875064442777088, transno 21474836483, client gen 2, slot idx 1 00000001:00080000:2.0:1788201592.199727:0:23074:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e03c2ff00c0: xid 1875064442704256, transno 12884901935, client gen 2, slot idx 2 00000001:00080000:2.0:1788201592.199738:0:23074:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e03c2ff0180: xid 1875064442705152, transno 12884901936, client gen 2, slot idx 3 00000001:00080000:2.0:1788201592.199750:0:23074:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04c543ab40: xid 1875064442705536, transno 12884901937, client gen 2, slot idx 4 00000001:00080000:2.0:1788201592.199761:0:23074:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04c543a3c0: xid 1875064442705920, transno 12884901938, client gen 2, slot idx 5 00000001:00080000:2.0:1788201592.199772:0:23074:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04c543a9c0: xid 1875064442706176, transno 12884901939, client gen 2, slot idx 6 00000001:00080000:2.0:1788201592.199783:0:23074:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04c543ac00: xid 1875064442706432, transno 12884901940, client gen 2, slot idx 7 00000020:00000080:2.0:1788201592.200639:0:23074:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9e03c2644d40) 00000020:00000080:2.0:1788201592.200660:0:23074:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788201592.200727:0:23074:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788201592.200735:0:23074:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d60cb 00000020:00000080:2.0:1788201592.204483:0:23074:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788201592.215971:0:23074:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9383f985bc4d60d2 00000020:00000080:3.0:1788201592.216887:0:23074:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788201592.216898:0:23074:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201592.216905:0:23074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201592.216907:0:23074:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788201592.216910:0:23074:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201592.216916:0:23074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201592.216917:0:23074:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788201592.216920:0:23074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788201592.216956:0:23074:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788201592.216969:0:23074:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201592.216973:0:23074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201592.216974:0:23074:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788201592.216976:0:23074:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788201592.216979:0:23074:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #10 00000020:01000000:3.0:1788201592.216981:0:23074:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201592.216982:0:23074:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201592.216983:0:23074:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788201592.216986:0:23074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201592.216987:0:23074:0:(obd_config.c:1561:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788201592.216989:0:23074:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788201592.216992:0:23074:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788201592.216995:0:23074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201592.216996:0:23074:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788201592.216999:0:23074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788201592.217004:0:23074:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.130@tcp to nid 0x20000c0a8c982 (192.168.201.130@tcp) 00000020:01000000:3.0:1788201592.217029:0:23074:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788201592.217032:0:23074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201592.217047:0:23074:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9e04d1c319c0) 00000020:00000080:3.0:1788201592.217065:0:23074:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788201592.217070:0:23074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788201592.217123:0:23074:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788201592.217129:0:23074:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788201592.217134:0:23074:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d60e0 00010000:00080000:3.0:1788201592.217176:0:23074:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e0501572800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.130@tcp at head 00010000:00010000:3.0:1788201592.217456:0:23074:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788201592.218001:0:23074:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788201592.218049:0:23074:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788201592.223926:0:23074:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201592.227264:0:23074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].6, 64 off8576 00000040:00080000:2.0:1788201592.227517:0:23074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x18:0x0].1, 64 off8256 00000020:00000080:3.0:1788201592.229484:0:23074:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201592.229499:0:23074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788201592.229602:0:23074:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788201592.229624:0:23074:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9383f985bc4d60e7 00000100:00080000:3.0:1788201592.229636:0:23074:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201592.229642:0:23074:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e0501572800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1788201592.229676:0:23074:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e04cffd5c00 x1875064458322432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201592.229698:0:23074:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788201592.229805:0:23074:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201592.229809:0:23074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201592.229811:0:23074:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788201592.229814:0:23074:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788201592.229817:0:23074:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1788201592.229819:0:23074:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201592.229820:0:23074:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201592.229822:0:23074:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788201592.229824:0:23074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201592.229825:0:23074:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788201592.229827:0:23074:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788201592.229832:0:23074:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788201592.229834:0:23074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201592.229836:0:23074:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788201592.229838:0:23074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788201592.229842:0:23074:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.130@tcp to nid 0x20000c0a8c982 (192.168.201.130@tcp) 00000020:01000000:3.0:1788201592.229862:0:23074:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788201592.229865:0:23074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201592.229875:0:23074:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9e04d1c33380) 00000020:00000080:3.0:1788201592.229889:0:23074:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788201592.229893:0:23074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788201592.229944:0:23074:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788201592.229949:0:23074:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788201592.229954:0:23074:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d60f5 00010000:00080000:3.0:1788201592.229980:0:23074:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e04ff4bd800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.130@tcp at head 00000100:00100000:0.0:1788201592.230273:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458322432:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788201592.230374:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201592.231924:0:23074:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-4 is initialized 00000040:01000000:3.0:1788201592.232100:0:23074:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788201592.232122:0:23074:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1788201592.232463:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458322432 00000100:00100000:0.0:1788201592.232474:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458322432 00000100:00100000:0.0:1788201592.232514:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4390 00000100:00100000:0.0:1788201592.232523:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3309:x1875064458322432:12345-0@lo:8:llog_process_th.0 00000020:02000000:0.0:1788201592.232543:0:13439:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:0.0:1788201592.232572:0:13439:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 867 last 0 00000020:00000080:0.0:1788201592.232605:0:13439:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9383f985bc4d60fc 00002000:00100000:0.0:1788201592.232618:0:13439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9e04d99bf000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788201592.232622:0:13439:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788201592.232625:0:13439:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788201592.232830:0:13439:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788201592.232856:0:13439:0:(import.c:65:import_set_state_nolock()) ffff9e04d99be800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201592.232935:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3309:x1875064458322432:12345-0@lo:8:llog_process_th.0 Request processed in 411us (2560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201592.232943:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4390 00000100:00100000:0.0:1788201592.232991:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788201592.233001:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788201592.233009:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788201592.233014:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788201592.233017:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e0501572800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788201592.233022:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788201592.233026:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458322432:0@lo:8:llog_process_th.0 00000040:00080000:0.0:1788201592.233111:0:23078:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1788201592.233115:0:23078:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x18:0x0] at index 6 of catalog [0x1:0x2:0x0] 00000004:00080000:0.0:1788201592.233148:0:23078:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788201592.233681:0:23078:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 867491386358ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788201592.234923:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458322560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201592.235006:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201592.235064:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458322560 00000100:00100000:3.0:1788201592.235071:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458322560 00000100:00100000:3.0:1788201592.235118:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788201592.235127:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875064458322560:12345-0@lo:13:osp-pre-0-0.0 00000020:02000000:3.0:1788201592.235133:0:16084:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1788201592.235160:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1788201592.235203:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875064458322560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201592.235211:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788201592.235249:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458322560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201592.239269:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201592.239316:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f900b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458322688:0@lo:400:kworker.0 00000100:00100000:1.0:1788201592.239399:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201592.239466:0:23055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458322688 00000100:00100000:1.0:1788201592.239475:0:23055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458322688 00000100:00100000:1.0:1788201592.239503:0:23055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788201592.239510:0:23055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1875064458322688:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1788201592.239517:0:23055:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000020:00080000:1.0:1788201592.239521:0:23055:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788201592.239705:0:23055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1875064458322688:12345-0@lo:400:kworker.0 Request processed in 193us (305us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788201592.239711:0:23055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788201592.239746:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788201592.239751:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788201592.239754:0:3313:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1788201592.249088:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201592.249110:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458322816:0@lo:400:kworker.0 00000100:00100000:2.0:1788201592.250736:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201592.250829:0:23058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458322816 00000100:00100000:2.0:1788201592.250841:0:23058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458322816 00000100:00100000:2.0:1788201592.250886:0:23058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201592.250896:0:23058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c49f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1875064458322816:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1788201592.250906:0:23058:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000020:00080000:2.0:1788201592.250911:0:23058:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788201592.250958:0:23058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c49f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1875064458322816:12345-0@lo:400:kworker.0 Request processed in 62us (226us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788201592.250965:0:23058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788201592.251007:0:3312:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788201592.251013:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788201592.251016:0:3312:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788201592.251021:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201592.251025:0:3312:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 710 00000100:00080000:2.0:1788201592.251032:0:3312:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e04f5751000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1788201592.251061:0:3312:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e04c49f2a00 x1875064458322944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201592.251085:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458322816:0@lo:400:kworker.0 00000100:00100000:2.0:1788201592.251108:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c49f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875064458322944:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788201592.251139:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201592.251853:0:23055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458322944 00000100:00100000:0.0:1788201592.251859:0:23055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458322944 00000100:00100000:0.0:1788201592.251883:0:23055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788201592.251889:0:23055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c49f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875064458322944:12345-0@lo:38:ptlrpcd_00_02.0 00000020:02000000:0.0:1788201592.251894:0:23055:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000040:00080000:2.0:1788201592.252912:0:23074:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201592.261395:0:23074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].6, 64 off8576 00000040:00080000:3.0:1788201592.261555:0:23074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].1, 64 off8256 00000100:00100000:0.0:1788201592.263641:0:23055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c49f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875064458322944:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 11740us (12491us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788201592.263656:0:23055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788201592.264147:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201592.264167:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788201592.264171:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c49f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875064458322944:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1788201592.269004:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201592.269019:0:3313:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 710 00000100:00080000:1.0:1788201592.269029:0:3313:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e04ff4ba000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:1.0:1788201592.269097:0:3313:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e04f9008000 x1875064458323072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201592.269124:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f900b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458322688:0@lo:400:kworker.0 00000100:00100000:1.0:1788201592.269140:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f9008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875064458323072:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788201592.269211:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201592.269270:0:23058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458323072 00000100:00100000:1.0:1788201592.269278:0:23058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458323072 00000100:00100000:1.0:1788201592.269349:0:23058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201592.269358:0:23058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1875064458323072:12345-0@lo:38:ptlrpcd_00_03.0 00000020:02000000:1.0:1788201592.269364:0:23058:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1788201592.269417:0:23058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1875064458323072:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 59us (205us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788201592.269424:0:23058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788201592.269464:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201592.269469:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788201592.269471:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f9008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875064458323072:0@lo:38:ptlrpcd_00_03.0 00000040:00080000:3.0:1788201592.275634:0:23080:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788201592.275645:0:23080:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 6 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788201592.282334:0:23074:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201592.282350:0:23074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788201592.282389:0:23074:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788201592.282412:0:23074:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9383f985bc4d6103 00000100:00080000:3.0:1788201592.282422:0:23074:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201592.282428:0:23074:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e04ff4bd800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1788201592.282461:0:23074:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e04cffd5c00 x1875064458323200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201592.282485:0:23074:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788201592.282552:0:23074:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201592.282557:0:23074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201592.282560:0:23074:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788201592.282563:0:23074:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201592.282568:0:23074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201592.282569:0:23074:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788201592.282572:0:23074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788201592.282574:0:23074:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788201592.282576:0:23074:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201592.282578:0:23074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201592.282579:0:23074:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788201592.282581:0:23074:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201592.282583:0:23074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201592.282584:0:23074:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788201592.282587:0:23074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788201592.282621:0:23074:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:23074:1875064458323328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201592.282706:0:23074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201592.282747:0:23074:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f577d540 going to sleep for 20 seconds 00000100:00100000:3.0:1788201592.282766:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458323200:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788201592.282795:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201592.282831:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458323200 00000100:00100000:3.0:1788201592.282838:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458323200 00000100:00100000:3.0:1788201592.282864:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4391 00000100:00100000:3.0:1788201592.282871:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1875064458323200:12345-0@lo:8:llog_process_th.0 00000020:02000000:3.0:1788201592.282877:0:6703:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:3.0:1788201592.282897:0:6703:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 867 last 0 00000020:00000080:3.0:1788201592.282917:0:6703:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9383f985bc4d610a 00002000:00100000:3.0:1788201592.282930:0:6703:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9e04c7de2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788201592.282934:0:6703:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788201592.282936:0:6703:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788201592.283139:0:6703:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788201592.283160:0:6703:0:(import.c:65:import_set_state_nolock()) ffff9e04c7de1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201592.283206:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1875064458323200:12345-0@lo:8:llog_process_th.0 Request processed in 334us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201592.283213:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4391 00000100:00100000:3.0:1788201592.283249:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201592.283257:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788201592.283263:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788201592.283268:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788201592.283270:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4bd800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788201592.283278:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788201592.283284:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458323200:0@lo:8:llog_process_th.0 00000004:00080000:3.0:1788201592.283343:0:23080:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788201592.283435:0:23080:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 867541140543ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788201592.283521:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458323456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201592.283551:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201592.283597:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458323456 00000100:00100000:3.0:1788201592.283601:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458323456 00000100:00100000:3.0:1788201592.283628:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788201592.283635:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875064458323456:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:3.0:1788201592.283639:0:6708:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1788201592.283660:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 36110336 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201592.283695:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875064458323456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201592.283701:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788201592.283735:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458323456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201592.284206:0:23052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458323328 00000100:00100000:0.0:1788201592.284211:0:23052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458323328 00000100:00100000:0.0:1788201592.284240:0:23052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788201592.284248:0:23052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+8:23074:x1875064458323328:12345-0@lo:502:llog_process_th.0 00000020:02000000:0.0:1788201592.284253:0:23052:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1788201592.284525:0:23052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+8:23074:x1875064458323328:12345-0@lo:502:llog_process_th.0 Request processed in 277us (1819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201592.284532:0:23052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201592.287147:0:23074:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:23074:1875064458323328:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201592.288068:0:23074:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201592.288078:0:23074:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201592.288081:0:23074:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788201592.288088:0:23074:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788201592.288577:0:23045:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1788201592.288602:0:23045:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788201592.288623:0:23045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04ff129e00/0x9383f985bc4d607e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6085 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.288635:0:23045:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e04ff129e00/0x9383f985bc4d607e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6085 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201592.288643:0:23045:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e04ff44c800 from 1 10000000:01000000:3.0:1788201592.288647:0:23045:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788201592.288681:0:23045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc200/0x9383f985bc4d6111 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.288688:0:23045:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc200/0x9383f985bc4d6111 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.288697:0:23045:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc200/0x9383f985bc4d6111 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201592.288718:0:23045:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:23045:1875064458323584:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201592.288780:0:23045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201592.288830:0:23045:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f577d540 going to sleep for 20 seconds 00000100:00100000:3.0:1788201592.288853:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458323584 00000100:00100000:3.0:1788201592.288860:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458323584 00000100:00100000:3.0:1788201592.288896:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788201592.288905:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+8:23045:x1875064458323584:12345-0@lo:101:mount.lustre.0 00000020:02000000:3.0:1788201592.288912:0:23051:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:3.0:1788201592.288922:0:23051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201592.288936:0:23051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c32bda00/0x9383f985bc4d6118 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d6111 expref: -99 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.288958:0:23051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c32bda00/0x9383f985bc4d6118 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d6111 expref: 9 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.288967:0:23051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c32bda00/0x9383f985bc4d6118 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d6111 expref: 9 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.288975:0:23051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bda00, rc 0) 00000100:00100000:3.0:1788201592.289009:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+9:23045:x1875064458323584:12345-0@lo:101:mount.lustre.0 Request processed in 105us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201592.289015:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788201592.289058:0:23045:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:23045:1875064458323584:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201592.289069:0:23045:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc200/0x9383f985bc4d6111 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6118 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.289077:0:23045:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc200/0x9383f985bc4d6111 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d6118 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201592.290024:0:23045:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:23045:1875064458323712:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788201592.290074:0:23045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201592.290273:0:23045:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f577d540 going to sleep for 20 seconds 00000100:00100000:1.0:1788201592.292930:0:23050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458323712 00000100:00100000:1.0:1788201592.292944:0:23050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458323712 00000100:00100000:1.0:1788201592.293001:0:23050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788201592.293012:0:23050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+9:23045:x1875064458323712:12345-0@lo:256:mount.lustre.0 00000020:02000000:1.0:1788201592.293020:0:23050:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 20000000:01000000:1.0:1788201592.293045:0:23050:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788201592.293072:0:23050:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788201592.293076:0:23050:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788201592.293079:0:23050:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 19 00000100:00100000:1.0:1788201592.294693:0:23050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+9:23045:x1875064458323712:12345-0@lo:256:mount.lustre.0 Request processed in 1677us (4611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201592.294705:0:23050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788201592.295435:0:23045:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:23045:1875064458323712:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788201592.298083:0:23045:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788201592.298106:0:23045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc200/0x9383f985bc4d6111 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6118 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.298125:0:23045:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc200/0x9383f985bc4d6111 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6118 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201592.298133:0:23045:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e04ff44c800 from 1 10000000:01000000:3.0:1788201592.298136:0:23045:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788201592.298192:0:23045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c32bca00/0x9383f985bc4d611f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.298200:0:23045:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c32bca00/0x9383f985bc4d611f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.298221:0:23045:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c32bca00/0x9383f985bc4d611f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201592.298246:0:23045:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:23045:1875064458323840:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201592.298356:0:23045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201592.298390:0:23045:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f577d540 going to sleep for 20 seconds 00000100:00100000:2.0:1788201592.298524:0:23052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458323840 00000100:00100000:2.0:1788201592.298544:0:23052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458323840 00000100:00100000:2.0:1788201592.298597:0:23052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788201592.298607:0:23052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+9:23045:x1875064458323840:12345-0@lo:101:mount.lustre.0 00000020:02000000:2.0:1788201592.298615:0:23052:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:2.0:1788201592.298627:0:23052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201592.298641:0:23052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c131e400/0x9383f985bc4d6126 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d611f expref: -99 pid: 23052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201592.298664:0:23052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c131e400/0x9383f985bc4d6126 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d611f expref: 10 pid: 23052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201592.298674:0:23052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c131e400/0x9383f985bc4d6126 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d611f expref: 10 pid: 23052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201592.298683:0:23052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c131e400, rc 0) 00000100:00100000:2.0:1788201592.298726:0:23052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+10:23045:x1875064458323840:12345-0@lo:101:mount.lustre.0 Request processed in 120us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201592.298733:0:23052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788201592.298900:0:23045:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:23045:1875064458323840:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201592.298914:0:23045:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c32bca00/0x9383f985bc4d611f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6126 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.298923:0:23045:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c32bca00/0x9383f985bc4d611f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d6126 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201592.298979:0:23045:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:23045:1875064458323968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201592.299006:0:23045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201592.299031:0:23045:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f577d540 going to sleep for 20 seconds 00000100:00100000:2.0:1788201592.299953:0:23050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458323968 00000100:00100000:2.0:1788201592.299962:0:23050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458323968 00000100:00100000:2.0:1788201592.300007:0:23050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788201592.300016:0:23050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d11bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+10:23045:x1875064458323968:12345-0@lo:501:mount.lustre.0 00000020:02000000:2.0:1788201592.300023:0:23050:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1788201592.300482:0:23050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d11bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+10:23045:x1875064458323968:12345-0@lo:501:mount.lustre.0 Request processed in 467us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201592.300491:0:23050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788201592.301108:0:23045:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:23045:1875064458323968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201592.301168:0:23045:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:23045:1875064458324096:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201592.301221:0:23045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201592.301249:0:23045:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f577d540 going to sleep for 20 seconds 00000100:00100000:0.0:1788201592.301716:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458324096 00000100:00100000:0.0:1788201592.301724:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458324096 00000100:00100000:0.0:1788201592.301769:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788201592.301778:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d11be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+10:23045:x1875064458324096:12345-0@lo:503:mount.lustre.0 00000020:02000000:0.0:1788201592.301785:0:23051:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1788201592.301971:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d11be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+10:23045:x1875064458324096:12345-0@lo:503:mount.lustre.0 Request processed in 193us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201592.301978:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788201592.302200:0:23045:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:23045:1875064458324096:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201592.302873:0:23082:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:23082:1875064458324224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201592.302924:0:23082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201592.302951:0:23052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458324224 00000100:00100000:0.0:1788201592.302955:0:23052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458324224 00000100:00100000:0.0:1788201592.302993:0:23052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788201592.303000:0:23052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d11bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+10:23082:x1875064458324224:12345-0@lo:502:llog_process_th.0 00000020:02000000:0.0:1788201592.303006:0:23052:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1788201592.304015:0:23082:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1c1d180 going to sleep for 20 seconds 00000004:00080000:1.0:1788201592.305422:0:23062:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788201592.312661:0:23052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d11bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+10:23082:x1875064458324224:12345-0@lo:502:llog_process_th.0 Request processed in 9653us (9728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201592.312675:0:23052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788201592.312739:0:23082:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:23082:1875064458324224:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788201592.312773:0:23082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201592.312781:0:23082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201592.312783:0:23082:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788201592.312791:0:23082:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e04ff44c800 00000020:00000080:2.0:1788201592.312794:0:23082:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788201592.312812:0:23082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201592.312815:0:23082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201592.312816:0:23082:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788201592.312818:0:23082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201592.312820:0:23082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201592.312822:0:23082:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788201592.312825:0:23082:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e04ff44c800 00000020:00000080:2.0:1788201592.312826:0:23082:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788201592.312897:0:23082:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c49f2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:23082:1875064458324352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201592.312937:0:23082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201592.312964:0:23050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458324352 00000100:00100000:2.0:1788201592.312970:0:23050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458324352 00000100:00100000:2.0:1788201592.312998:0:23050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788201592.313005:0:23050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d11bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+10:23082:x1875064458324352:12345-0@lo:502:llog_process_th.0 00000020:02000000:2.0:1788201592.313011:0:23050:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1788201592.313171:0:23050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d11bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+10:23082:x1875064458324352:12345-0@lo:502:llog_process_th.0 Request processed in 165us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201592.313178:0:23050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788201592.313221:0:23082:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f9635c00 going to sleep for 20 seconds 00000100:00100000:2.0:1788201592.313231:0:23082:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c49f2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:23082:1875064458324352:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788201592.313250:0:23082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201592.313253:0:23082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201592.313255:0:23082:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788201592.313258:0:23082:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788201592.315242:0:23045:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1788201592.315272:0:23045:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201592.315315:0:23045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c32bca00/0x9383f985bc4d611f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6126 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.315336:0:23045:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c32bca00/0x9383f985bc4d611f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6126 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201592.315385:0:23045:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788201592.315388:0:23045:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e04ff44c800 10000000:01000000:3.0:1788201592.315391:0:23045:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e04ff44c800 10000000:01000000:3.0:1788201592.315395:0:23045:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788201592.315401:0:23045:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e04ff44c800 from 1 10000000:01000000:3.0:1788201592.315403:0:23045:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201592.315434:0:23045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc000/0x9383f985bc4d612d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.315442:0:23045:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc000/0x9383f985bc4d612d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.315452:0:23045:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc000/0x9383f985bc4d612d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201592.315474:0:23045:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:23045:1875064458324480:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201592.315766:0:23045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201592.315863:0:23045:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f577d780 going to sleep for 20 seconds 00000100:00100000:2.0:1788201592.315974:0:23052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458324480 00000100:00100000:2.0:1788201592.315981:0:23052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458324480 00000100:00100000:2.0:1788201592.316027:0:23052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788201592.316037:0:23052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d11bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+10:23045:x1875064458324480:12345-0@lo:101:mount.lustre.0 00000020:02000000:2.0:1788201592.316044:0:23052:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:2.0:1788201592.316056:0:23052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201592.316069:0:23052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c131f200/0x9383f985bc4d6134 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d612d expref: -99 pid: 23052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201592.316093:0:23052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c131f200/0x9383f985bc4d6134 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d612d expref: 11 pid: 23052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201592.316103:0:23052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c131f200/0x9383f985bc4d6134 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d612d expref: 11 pid: 23052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201592.316112:0:23052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c131f200, rc 0) 00000100:00100000:2.0:1788201592.316164:0:23052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d11bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+11:23045:x1875064458324480:12345-0@lo:101:mount.lustre.0 Request processed in 116us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201592.316171:0:23052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788201592.317410:0:23045:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:23045:1875064458324480:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201592.317435:0:23045:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc000/0x9383f985bc4d612d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6134 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.317445:0:23045:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc000/0x9383f985bc4d612d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d6134 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201592.317510:0:23045:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:23045:1875064458324608:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201592.317630:0:23045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201592.317662:0:23045:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f577d780 going to sleep for 20 seconds 00000100:00100000:3.0:1788201592.317680:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458324608 00000100:00100000:3.0:1788201592.317685:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458324608 00000100:00100000:3.0:1788201592.317719:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788201592.317727:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d11bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+11:23045:x1875064458324608:12345-0@lo:501:mount.lustre.0 00000020:02000000:3.0:1788201592.317733:0:23051:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788201592.318066:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d11bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+11:23045:x1875064458324608:12345-0@lo:501:mount.lustre.0 Request processed in 338us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201592.318073:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788201592.318115:0:23045:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:23045:1875064458324608:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201592.318144:0:23045:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:23045:1875064458324736:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201592.319386:0:23045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201592.319425:0:23050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458324736 00000100:00100000:3.0:1788201592.319432:0:23050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458324736 00000100:00100000:3.0:1788201592.319469:0:23050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788201592.319478:0:23050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d11bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+11:23045:x1875064458324736:12345-0@lo:503:mount.lustre.0 00000020:02000000:3.0:1788201592.319486:0:23050:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788201592.319670:0:23050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d11bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+11:23045:x1875064458324736:12345-0@lo:503:mount.lustre.0 Request processed in 193us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201592.319678:0:23050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788201592.319726:0:23045:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f577d780 going to sleep for 20 seconds 00000100:00100000:3.0:1788201592.319746:0:23045:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:23045:1875064458324736:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201592.321978:0:23084:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:23084:1875064458324864:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201592.322045:0:23084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201592.322090:0:23084:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f577db40 going to sleep for 20 seconds 00000100:00100000:0.0:1788201592.322146:0:23052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458324864 00000100:00100000:0.0:1788201592.322162:0:23052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458324864 00000100:00100000:0.0:1788201592.322204:0:23052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788201592.322221:0:23052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d11bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+11:23084:x1875064458324864:12345-0@lo:502:llog_process_th.0 00000020:02000000:0.0:1788201592.322228:0:23052:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1788201592.322496:0:23052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d11bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+11:23084:x1875064458324864:12345-0@lo:502:llog_process_th.0 Request processed in 275us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201592.322504:0:23052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788201592.322819:0:23084:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:23084:1875064458324864:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788201592.322875:0:23084:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788201592.322889:0:23084:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9e04d1c34d40) 00000020:00000080:3.0:1788201592.322913:0:23084:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788201592.323053:0:23084:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e04ff44c800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788201592.323057:0:23084:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e04ff44c800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788201592.323059:0:23084:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e04ff44c800 4 00010000:00080000:3.0:1788201592.323094:0:23084:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e03c55b4000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.130@tcp at head 00010000:00010000:3.0:1788201592.330735:0:23084:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-5 is initialized 00000020:00000080:3.0:1788201592.331455:0:23084:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788201592.331514:0:23084:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788201592.331526:0:23084:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9383f985bc4d6142 00000100:00080000:3.0:1788201592.332286:0:23084:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201592.332313:0:23084:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e03c55b4000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1788201592.332360:0:23084:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e04cffd6300 x1875064458324992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201592.332405:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875064458324992:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788201592.332491:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201592.332923:0:23055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458324992 00000100:00100000:1.0:1788201592.332931:0:23055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458324992 00000100:00100000:1.0:1788201592.332969:0:23055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201592.332976:0:23055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875064458324992:12345-0@lo:38:llog_process_th.0 00000020:02000000:1.0:1788201592.332983:0:23055:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1788201592.333038:0:23055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875064458324992:12345-0@lo:38:llog_process_th.0 Request processed in 61us (547us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788201592.333046:0:23055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788201592.333931:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201592.333940:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e03c55b4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201592.333957:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788201592.333960:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875064458324992:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788201592.333999:0:23084:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788201592.335428:0:23084:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:23084:1875064458325120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201592.335494:0:23084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201592.335530:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458325120 00000100:00100000:3.0:1788201592.335536:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458325120 00000100:00100000:3.0:1788201592.335573:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788201592.335581:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d11be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+11:23084:x1875064458325120:12345-0@lo:502:llog_process_th.0 00000020:02000000:3.0:1788201592.335588:0:23051:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788201592.335802:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d11be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+11:23084:x1875064458325120:12345-0@lo:502:llog_process_th.0 Request processed in 221us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201592.335810:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788201592.335853:0:23084:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c2e0b300 going to sleep for 20 seconds 00000100:00100000:3.0:1788201592.335869:0:23084:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:23084:1875064458325120:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788201592.335890:0:23084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788201592.336625:0:23045:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788201592.336648:0:23045:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788201592.336666:0:23045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc000/0x9383f985bc4d612d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6134 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201592.336677:0:23045:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc000/0x9383f985bc4d612d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6134 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788201592.336721:0:23045:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788201592.336723:0:23045:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788201592.336724:0:23045:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201592.336726:0:23045:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201592.336727:0:23045:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201592.336728:0:23045:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201592.336730:0:23045:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201592.336731:0:23045:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788201592.336732:0:23045:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201592.336734:0:23045:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788201592.336737:0:23045:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788201592.336739:0:23045:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788201592.336740:0:23045:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788201592.336741:0:23045:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201592.336742:0:23045:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201592.336743:0:23045:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201592.336744:0:23045:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201592.336745:0:23045:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201592.336746:0:23045:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788201592.336747:0:23045:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201592.336748:0:23045:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788201592.336763:0:23045:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788201592.336773:0:23045:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:23045:1875064458325248:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788201592.336821:0:23045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201592.336842:0:23045:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8073f00 going to sleep for 20 seconds 00000100:00100000:3.0:1788201592.341007:0:23050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458325248 00000100:00100000:3.0:1788201592.341022:0:23050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458325248 00000100:00100000:3.0:1788201592.341070:0:23050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788201592.341079:0:23050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d11bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+11:23045:x1875064458325248:12345-0@lo:253:mount.lustre.0 00000020:02000000:3.0:1788201592.341089:0:23050:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 20000000:01000000:3.0:1788201592.341118:0:23050:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788201592.341130:0:23050:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000004:00080000:2.0:1788201592.366873:0:23062:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 20000000:01000000:3.0:1788201592.395340:0:23050:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788201592.395427:0:23050:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788201592.398096:0:23053:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788201592.398104:0:23053:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788201592.398127:0:23053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e03c131ec00/0x9383f985bc4d6149 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201592.398145:0:23053:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e03c32bda00/0x9383f985bc4d6118 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d6111 expref: 11 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201592.398164:0:23053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e03c131ec00/0x9383f985bc4d6149 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201592.398216:0:23053:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e03c32bda00/0x9383f985bc4d6118 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9383f985bc4d6111 expref: 11 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201592.398231:0:23053:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 10, AT: off) ns: MGS lock: ffff9e03c32bda00/0x9383f985bc4d6118 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9383f985bc4d6111 expref: 11 pid: 23051 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201592.398247:0:23053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c49f2a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23053:1875064458325376:0@lo:104: 00000100:00100000:2.0:1788201592.398348:0:23053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201592.398394:0:23053:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f9635300 going to sleep for 6 seconds 00000100:00100000:3.0:1788201592.398569:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458325376 00000100:00100000:3.0:1788201592.398578:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458325376 00000100:00100000:3.0:1788201592.398615:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788201592.398623:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c49f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b60c000b-7335-444d-a8dc-1a5956712fb2+3:23053:x1875064458325376:12345-0@lo:104: 00010000:00010000:3.0:1788201592.398635:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc200/0x9383f985bc4d6111 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9383f985bc4d6118 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.398695:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201592.398701:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c49f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b60c000b-7335-444d-a8dc-1a5956712fb2+3:23053:x1875064458325376:12345-0@lo:104: Request processed in 78us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201592.398707:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1788201592.398727:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201592.398732:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc200/0x9383f985bc4d6111 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9383f985bc4d6118 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.398739:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc200 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1788201592.398743:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc200/0x9383f985bc4d6111 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9383f985bc4d6118 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.398751:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc200/0x9383f985bc4d6111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9383f985bc4d6118 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201592.398758:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc200/0x9383f985bc4d6111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9383f985bc4d6118 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201592.398767:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201592.398793:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc200/0x9383f985bc4d6111 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9383f985bc4d6118 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.398923:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201592.398943:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc200/0x9383f985bc4d6111 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9383f985bc4d6118 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.398949:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc200/0x9383f985bc4d6111 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9383f985bc4d6118 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.398964:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201592.398966:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201592.398967:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201592.398980:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458325504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201592.399008:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201592.399051:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458325504 00000100:00100000:3.0:1788201592.399055:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458325504 00010000:00010000:3.0:1788201592.399069:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e03c32bda00/0x9383f985bc4d6118 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9383f985bc4d6111 expref: 12 pid: 23051 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201592.399090:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1601 00000100:00100000:3.0:1788201592.399097:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b60c000b-7335-444d-a8dc-1a5956712fb2+12:3311:x1875064458325504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201592.399107:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201592.399112:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e03c32bda00/0x9383f985bc4d6118 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9383f985bc4d6111 expref: 12 pid: 23051 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.399121:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e03c32bda00/0x9383f985bc4d6118 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9383f985bc4d6111 expref: 12 pid: 23051 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.399137:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e03c131ec00/0x9383f985bc4d6149 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.399145:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c131ec00/0x9383f985bc4d6149 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788201592.399169:0:5843:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001065736s 00010000:00010000:3.0:1788201592.399173:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03c131ec00/0x9383f985bc4d6149 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.399180:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03c131ec00/0x9383f985bc4d6149 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.399188:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e03c131ec00/0x9383f985bc4d6149 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.399194:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e03c131ec00/0x9383f985bc4d6149 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.399199:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131ec00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201592.399212:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e03c131ec00/0x9383f985bc4d6149 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.399220:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e03c131ec00/0x9383f985bc4d6149 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.399229:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e03c131ec00/0x9383f985bc4d6149 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201592.399238:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201592.399266:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b60c000b-7335-444d-a8dc-1a5956712fb2+12:3311:x1875064458325504:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201592.399273:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1601 00000100:00100000:3.0:1788201592.399435:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458325504:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201592.399578:0:23053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c32bda00/0x9383f985bc4d6118 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9383f985bc4d6111 expref: 11 pid: 23051 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201592.399590:0:23053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c49f2a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23053:1875064458325376:0@lo:104: 00010000:00010000:2.0:1788201592.399607:0:23053:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e03c131ec00/0x9383f985bc4d6149 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201592.399615:0:23053:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e03c131ec00/0x9383f985bc4d6149 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201592.399621:0:23053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e03c131ec00/0x9383f985bc4d6149 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201592.399627:0:23053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c131ec00/0x9383f985bc4d6149 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201592.407065:0:23050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d11bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+10:23045:x1875064458325248:12345-0@lo:253:mount.lustre.0 Request processed in 65977us (70234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201592.407081:0:23050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788201592.407253:0:23045:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:23045:1875064458325248:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788201592.407270:0:23045:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788201592.407273:0:23045:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788201592.407275:0:23045:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788201592.407276:0:23045:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201592.407277:0:23045:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201592.407279:0:23045:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201592.407280:0:23045:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201592.407281:0:23045:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201592.407283:0:23045:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788201592.407285:0:23045:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201592.407286:0:23045:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788201592.407489:0:23045:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788201592.413680:0:23045:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788201592.413890:0:23045:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788201592.414118:0:23045:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788201592.414429:0:23045:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788201592.414913:0:23045:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788201592.415041:0:23045:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788201592.416361:0:23045:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788201592.416611:0:23045:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788201592.416970:0:23045:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788201592.417501:0:23045:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788201592.417925:0:23045:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788201592.418089:0:23045:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000040:01000000:2.0:1788201592.449071:0:23045:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1788201592.449471:0:23091:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1788201592.451645:0:23091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1788201592.454289:0:23090:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788201592.454307:0:23090:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:2.0:1788201592.456508:0:23091:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000bd0:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788201592.456704:0:23091:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788201592.456709:0:23091:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1788201592.458992:0:23045:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788201592.459127:0:23045:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788201592.459864:0:23045:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788201592.459874:0:23045:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788201592.460007:0:23045:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201592.461713:0:23045:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788201592.462522:0:23045:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788201592.462637:0:23045:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788201592.462972:0:23045:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788201592.465626:0:23045:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3a:0x0] (8/8/4) registered 00010000:00080000:2.0:1788201592.472988:0:23045:0:(ldlm_lib.c:3054:target_recovery_init()) RECOVERY: service lustre-MDT0000, 1 recoverable clients, last_transno 21474836483 00010000:00080000:2.0:1788201592.473949:0:23092:0:(ldlm_lib.c:2854:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 23092 00010000:02000000:2.0:1788201592.473963:0:23092:0:(ldlm_lib.c:2336:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00000020:01000004:3.0:1788201592.474342:0:23045:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788201592.474358:0:23045:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.130@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788201592.474374:0:23045:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788201592.474402:0:23045:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00080000:2.0:1788201592.496189:0:23092:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 1 abort 0 expired 0 00010000:00080000:2.0:1788201592.496196:0:23092:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 1 abort 0 expired 0 00010000:00010000:0.0:1788201592.815116:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788201593.131396:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788201593.131404:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e04ff44c800 from 20 10000000:01000000:0.0:1788201593.131409:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788201593.131459:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04ff129200/0x9383f985bc4d6150 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.131470:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e04ff129200/0x9383f985bc4d6150 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.131481:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e04ff129200/0x9383f985bc4d6150 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201593.131506:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458325632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201593.131575:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201593.131639:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1daa240 going to sleep for 20 seconds 00000100:00100000:3.0:1788201593.131642:0:23052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458325632 00000100:00100000:3.0:1788201593.131656:0:23052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458325632 00000100:00100000:3.0:1788201593.131793:0:23052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788201593.131807:0:23052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f617f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+10:5855:x1875064458325632:12345-0@lo:101:ll_cfg_requeue.0 00000020:02000000:3.0:1788201593.131817:0:23052:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:3.0:1788201593.131835:0:23052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201593.131858:0:23052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c32bc200/0x9383f985bc4d6157 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d6150 expref: -99 pid: 23052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.131902:0:23052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c32bc200/0x9383f985bc4d6157 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d6150 expref: 11 pid: 23052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.131915:0:23052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c32bc200/0x9383f985bc4d6157 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d6150 expref: 11 pid: 23052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.131926:0:23052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bc200, rc 0) 00000100:00100000:3.0:1788201593.132010:0:23052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f617f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+11:5855:x1875064458325632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 205us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201593.132017:0:23052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788201593.132104:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458325632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201593.132127:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e04ff129200/0x9383f985bc4d6150 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6157 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.132138:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e04ff129200/0x9383f985bc4d6150 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d6157 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201593.132221:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f900b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458325760:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788201593.132260:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201593.132424:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f44e40 going to sleep for 20 seconds 00000100:00100000:0.0:1788201593.132491:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458325760 00000100:00100000:0.0:1788201593.132500:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458325760 00000100:00100000:0.0:1788201593.132540:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788201593.132547:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f617f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+11:5855:x1875064458325760:12345-0@lo:256:ll_cfg_requeue.0 00000020:02000000:0.0:1788201593.132551:0:23051:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 20000000:01000000:0.0:1788201593.132566:0:23051:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788201593.132588:0:23051:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788201593.132591:0:23051:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 20 00000100:00100000:0.0:1788201593.132680:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f617f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+11:5855:x1875064458325760:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 133us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201593.132687:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788201593.132750:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f900b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458325760:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788201593.132800:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788201593.132808:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04ff129200/0x9383f985bc4d6150 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6157 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.132818:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e04ff129200/0x9383f985bc4d6150 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6157 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201593.132829:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788201593.132832:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e04c6b8b800 from 42 10000000:01000000:1.0:1788201593.132835:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788201593.132855:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c507c000/0x9383f985bc4d615e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.132864:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c507c000/0x9383f985bc4d615e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.132883:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c507c000/0x9383f985bc4d615e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201593.132897:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f900b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458325888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201593.132928:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201593.132958:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f44e40 going to sleep for 20 seconds 00000100:00100000:0.0:1788201593.133039:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458325888 00000100:00100000:0.0:1788201593.133043:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458325888 00000100:00100000:0.0:1788201593.133059:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788201593.133064:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f617fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+11:5855:x1875064458325888:12345-0@lo:101:ll_cfg_requeue.0 00000020:02000000:0.0:1788201593.133068:0:23051:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:0.0:1788201593.133074:0:23051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201593.133088:0:23051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e04ff128a00/0x9383f985bc4d6165 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d615e expref: -99 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.133103:0:23051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e04ff128a00/0x9383f985bc4d6165 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d615e expref: 12 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.133112:0:23051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e04ff128a00/0x9383f985bc4d6165 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d615e expref: 12 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.133120:0:23051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04ff128a00, rc 0) 00000100:00100000:0.0:1788201593.133157:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f617fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+12:5855:x1875064458325888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201593.133163:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788201593.133224:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f900b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458325888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201593.133235:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c507c000/0x9383f985bc4d615e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6165 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.133243:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c507c000/0x9383f985bc4d615e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d6165 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201593.133385:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f900b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458326016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201593.133421:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201593.133482:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f44e40 going to sleep for 20 seconds 00000100:00100000:3.0:1788201593.133597:0:23052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458326016 00000100:00100000:3.0:1788201593.133602:0:23052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458326016 00000100:00100000:0.0:1788201593.133644:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788201593.133652:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f617c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+12:5855:x1875064458326016:12345-0@lo:501:ll_cfg_requeue.0 00000020:02000000:0.0:1788201593.133657:0:23051:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1788201593.134124:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f617c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+12:5855:x1875064458326016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 470us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201593.134135:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788201593.134216:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f900b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458326016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201593.134258:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f900b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458326144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201593.134370:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201593.134393:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f44e40 going to sleep for 20 seconds 00000100:00100000:0.0:1788201593.134463:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458326144 00000100:00100000:0.0:1788201593.134469:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458326144 00000100:00100000:0.0:1788201593.134487:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788201593.134493:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f617d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+12:5855:x1875064458326144:12345-0@lo:503:ll_cfg_requeue.0 00000020:02000000:0.0:1788201593.134497:0:23051:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1788201593.134686:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f617d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+12:5855:x1875064458326144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 192us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201593.134693:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788201593.135356:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f900b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458326144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201593.136853:0:23122:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 42 00000020:01000000:0.0:1788201593.137803:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 42-41 (rc=0) 10000000:01000000:0.0:1788201593.137830:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788201593.137846:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c507c000/0x9383f985bc4d615e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6165 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.137861:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c507c000/0x9383f985bc4d615e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6165 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201593.137938:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788201593.137941:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1788201593.137945:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788201593.137998:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04ff128600/0x9383f985bc4d616c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.138008:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e04ff128600/0x9383f985bc4d616c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.138021:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e04ff128600/0x9383f985bc4d616c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201593.138052:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458326272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201593.138136:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201593.142168:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1daad80 going to sleep for 20 seconds 00000100:00100000:2.0:1788201593.142776:0:23052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458326272 00000100:00100000:2.0:1788201593.142793:0:23052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458326272 00000100:00100000:0.0:1788201593.143408:0:23052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788201593.143420:0:23052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f617d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+12:5855:x1875064458326272:12345-0@lo:101:ll_cfg_requeue.0 00000020:02000000:0.0:1788201593.143429:0:23052:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:0.0:1788201593.143449:0:23052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201593.143481:0:23052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e04ff129a00/0x9383f985bc4d6173 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d616c expref: -99 pid: 23052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.143516:0:23052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e04ff129a00/0x9383f985bc4d6173 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d616c expref: 13 pid: 23052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.143528:0:23052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e04ff129a00/0x9383f985bc4d6173 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d616c expref: 13 pid: 23052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.143537:0:23052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04ff129a00, rc 0) 00000100:00100000:0.0:1788201593.143625:0:23052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f617d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+13:5855:x1875064458326272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 207us (5488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201593.143631:0:23052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788201593.143794:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458326272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201593.143825:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e04ff128600/0x9383f985bc4d616c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6173 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.143839:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e04ff128600/0x9383f985bc4d616c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d6173 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201593.143928:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c49f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458326400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201593.143990:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201593.144038:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04e18a8b40 going to sleep for 20 seconds 00000100:00100000:0.0:1788201593.144682:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458326400 00000100:00100000:0.0:1788201593.144692:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458326400 00000100:00100000:0.0:1788201593.144740:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788201593.144751:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f617f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+13:5855:x1875064458326400:12345-0@lo:501:ll_cfg_requeue.0 00000020:02000000:0.0:1788201593.144759:0:23051:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1788201593.145376:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f617f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+13:5855:x1875064458326400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 625us (1384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201593.145385:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788201593.145565:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c49f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458326400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201593.145631:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458326528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201593.145682:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201593.145722:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1daa300 going to sleep for 20 seconds 00000100:00100000:3.0:1788201593.145814:0:23052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458326528 00000100:00100000:3.0:1788201593.145820:0:23052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458326528 00000100:00100000:3.0:1788201593.145922:0:23052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788201593.145936:0:23052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f617e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+13:5855:x1875064458326528:12345-0@lo:503:ll_cfg_requeue.0 00000020:02000000:3.0:1788201593.145943:0:23052:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788201593.162953:0:23052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f617e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+13:5855:x1875064458326528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 17007us (17256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201593.162972:0:23052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788201593.163101:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458326528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788201593.164081:0:23124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 11 00000020:01000000:2.0:1788201593.164181:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1788201593.164231:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788201593.164245:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04ff128600/0x9383f985bc4d616c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6173 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.164260:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e04ff128600/0x9383f985bc4d616c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6173 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201593.164272:0:5855:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788201593.164275:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e04c6b8b800 from 7 10000000:01000000:2.0:1788201593.164278:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788201593.164365:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c131e800/0x9383f985bc4d617a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.164375:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c131e800/0x9383f985bc4d617a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.164806:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c131e800/0x9383f985bc4d617a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201593.164998:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c49f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458326656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201593.165067:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201593.165115:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1daa3c0 going to sleep for 20 seconds 00000100:00100000:3.0:1788201593.165170:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458326656 00000100:00100000:3.0:1788201593.165179:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458326656 00000100:00100000:3.0:1788201593.165238:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788201593.165248:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f617c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+13:5855:x1875064458326656:12345-0@lo:101:ll_cfg_requeue.0 00000020:02000000:3.0:1788201593.165256:0:23051:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:3.0:1788201593.165271:0:23051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201593.165324:0:23051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c32bdc00/0x9383f985bc4d6181 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d617a expref: -99 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.165357:0:23051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c32bdc00/0x9383f985bc4d6181 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d617a expref: 14 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.165368:0:23051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c32bdc00/0x9383f985bc4d6181 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d617a expref: 14 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201593.165377:0:23051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bdc00, rc 0) 00000100:00100000:3.0:1788201593.165421:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f617c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+14:5855:x1875064458326656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201593.165427:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788201593.165610:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c49f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458326656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201593.165628:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c131e800/0x9383f985bc4d617a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6181 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.165638:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c131e800/0x9383f985bc4d617a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d6181 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201593.165702:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f900b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458326784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201593.165730:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201593.165762:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f44e40 going to sleep for 20 seconds 00000100:00100000:3.0:1788201593.165884:0:23052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458326784 00000100:00100000:3.0:1788201593.165889:0:23052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458326784 00000100:00100000:3.0:1788201593.165952:0:23052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788201593.165961:0:23052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f617cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+14:5855:x1875064458326784:12345-0@lo:501:ll_cfg_requeue.0 00000020:02000000:3.0:1788201593.165967:0:23052:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788201593.166347:0:23052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f617cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+14:5855:x1875064458326784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 385us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201593.166357:0:23052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788201593.166464:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f900b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458326784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201593.166498:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f900b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458326912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201593.166537:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201593.167468:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f44e40 going to sleep for 20 seconds 00000100:00100000:0.0:1788201593.167644:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458326912 00000100:00100000:0.0:1788201593.167654:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458326912 00000100:00100000:0.0:1788201593.167695:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788201593.167704:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f617dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+14:5855:x1875064458326912:12345-0@lo:503:ll_cfg_requeue.0 00000020:02000000:0.0:1788201593.167711:0:23051:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1788201593.167952:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f617dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+14:5855:x1875064458326912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 248us (1413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201593.167960:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788201593.168062:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f900b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458326912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201593.168996:0:23125:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788201593.169218:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788201593.169239:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788201593.169251:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c131e800/0x9383f985bc4d617a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6181 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.169264:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c131e800/0x9383f985bc4d617a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6181 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201593.169275:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788201593.169278:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e04f9036000 from 42 10000000:01000000:0.0:1788201593.169282:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788201593.169368:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04ff129800/0x9383f985bc4d6188 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.169377:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e04ff129800/0x9383f985bc4d6188 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.169389:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e04ff129800/0x9383f985bc4d6188 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201593.169415:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458327040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201593.169481:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201593.169517:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1daa9c0 going to sleep for 20 seconds 00000100:00100000:1.0:1788201593.169644:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458327040 00000100:00100000:1.0:1788201593.169652:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458327040 00000100:00100000:1.0:1788201593.169683:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788201593.169693:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+14:5855:x1875064458327040:12345-0@lo:101:ll_cfg_requeue.0 00000020:02000000:1.0:1788201593.169699:0:23051:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:1.0:1788201593.169712:0:23051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201593.169730:0:23051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c507dc00/0x9383f985bc4d618f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d6188 expref: -99 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.169756:0:23051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c507dc00/0x9383f985bc4d618f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d6188 expref: 15 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.169769:0:23051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c507dc00/0x9383f985bc4d618f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d6188 expref: 15 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.169779:0:23051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c507dc00, rc 0) 00000100:00100000:1.0:1788201593.169824:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+15:5855:x1875064458327040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201593.169831:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788201593.169875:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458327040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201593.169890:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e04ff129800/0x9383f985bc4d6188 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d618f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.169900:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e04ff129800/0x9383f985bc4d6188 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d618f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201593.169953:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f900b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458327168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201593.169981:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201593.169994:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f44840 going to sleep for 20 seconds 00000100:00100000:1.0:1788201593.170006:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458327168 00000100:00100000:1.0:1788201593.170009:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458327168 00000100:00100000:1.0:1788201593.170026:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788201593.170032:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+15:5855:x1875064458327168:12345-0@lo:501:ll_cfg_requeue.0 00000020:02000000:1.0:1788201593.170037:0:23051:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1788201593.170424:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+15:5855:x1875064458327168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 390us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201593.170431:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788201593.170457:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f900b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458327168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201593.170485:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f900b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458327296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201593.170524:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201593.170537:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f44840 going to sleep for 20 seconds 00000100:00100000:1.0:1788201593.170547:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458327296 00000100:00100000:1.0:1788201593.170551:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458327296 00000100:00100000:1.0:1788201593.170566:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788201593.170571:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+15:5855:x1875064458327296:12345-0@lo:503:ll_cfg_requeue.0 00000020:02000000:1.0:1788201593.170578:0:23051:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1788201593.170712:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+15:5855:x1875064458327296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201593.170718:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788201593.170751:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f900b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458327296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201593.172798:0:23126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 42 00000020:01000000:2.0:1788201593.173052:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 42-41 (rc=0) 10000000:01000000:2.0:1788201593.173075:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788201593.173089:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04ff129800/0x9383f985bc4d6188 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d618f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.173101:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e04ff129800/0x9383f985bc4d6188 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d618f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201593.173112:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788201593.173116:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1788201593.173118:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788201593.173167:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c131e600/0x9383f985bc4d6196 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.173176:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c131e600/0x9383f985bc4d6196 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.173190:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c131e600/0x9383f985bc4d6196 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201593.173651:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c49f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458327424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201593.173728:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201593.173805:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04e18a8e40 going to sleep for 20 seconds 00000100:00100000:1.0:1788201593.174637:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458327424 00000100:00100000:1.0:1788201593.174649:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458327424 00000100:00100000:0.0:1788201593.174810:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788201593.174825:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+15:5855:x1875064458327424:12345-0@lo:101:ll_cfg_requeue.0 00000020:02000000:0.0:1788201593.174833:0:23051:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:0.0:1788201593.174851:0:23051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201593.174883:0:23051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e04ff128400/0x9383f985bc4d619d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d6196 expref: -99 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.174916:0:23051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e04ff128400/0x9383f985bc4d619d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d6196 expref: 16 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.174930:0:23051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e04ff128400/0x9383f985bc4d619d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d6196 expref: 16 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.174940:0:23051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04ff128400, rc 0) 00000100:00100000:0.0:1788201593.175062:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+16:5855:x1875064458327424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 240us (1332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201593.175071:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788201593.175270:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c49f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458327424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201593.175290:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c131e600/0x9383f985bc4d6196 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d619d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.175438:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c131e600/0x9383f985bc4d6196 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d619d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201593.175527:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c49f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458327552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201593.175569:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201593.175607:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04e18a8e40 going to sleep for 20 seconds 00000100:00100000:3.0:1788201593.175662:0:23050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458327552 00000100:00100000:3.0:1788201593.175668:0:23050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458327552 00000100:00100000:3.0:1788201593.175703:0:23050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788201593.175712:0:23050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+16:5855:x1875064458327552:12345-0@lo:501:ll_cfg_requeue.0 00000020:02000000:3.0:1788201593.175717:0:23050:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788201593.176239:0:23050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+16:5855:x1875064458327552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 528us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201593.176248:0:23050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788201593.176622:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c49f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458327552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201593.176660:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c49f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458327680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201593.176702:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201593.176734:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04e18a8e40 going to sleep for 20 seconds 00000100:00100000:2.0:1788201593.176749:0:23052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458327680 00000100:00100000:2.0:1788201593.176755:0:23052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458327680 00000100:00100000:2.0:1788201593.176779:0:23052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788201593.176787:0:23052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+16:5855:x1875064458327680:12345-0@lo:503:ll_cfg_requeue.0 00000020:02000000:2.0:1788201593.176792:0:23052:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788201593.180116:0:23052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+16:5855:x1875064458327680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3316us (3399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201593.180134:0:23052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788201593.180277:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c49f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458327680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788201593.181287:0:23127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 14 00000020:01000000:0.0:1788201593.183936:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1788201593.183976:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788201593.183992:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c131e600/0x9383f985bc4d6196 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d619d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.184007:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c131e600/0x9383f985bc4d6196 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d619d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201593.184019:0:5855:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788201593.184023:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9e04c6718000 from 1 10000000:01000000:0.0:1788201593.184026:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788201593.184084:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04ff129400/0x9383f985bc4d61a4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.184093:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e04ff129400/0x9383f985bc4d61a4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.184107:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e04ff129400/0x9383f985bc4d61a4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201593.184145:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458327808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201593.184239:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201593.185691:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1daa9c0 going to sleep for 20 seconds 00000100:00100000:1.0:1788201593.185978:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458327808 00000100:00100000:1.0:1788201593.185990:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458327808 00000100:00100000:1.0:1788201593.186103:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788201593.186116:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+16:5855:x1875064458327808:12345-0@lo:101:ll_cfg_requeue.0 00000020:02000000:1.0:1788201593.186125:0:23051:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:1.0:1788201593.186144:0:23051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201593.186169:0:23051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c507de00/0x9383f985bc4d61ab lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d61a4 expref: -99 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.186201:0:23051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c507de00/0x9383f985bc4d61ab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d61a4 expref: 17 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.186213:0:23051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c507de00/0x9383f985bc4d61ab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d61a4 expref: 17 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.186221:0:23051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c507de00, rc 0) 00000100:00100000:0.0:1788201593.186442:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458327808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201593.186462:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e04ff129400/0x9383f985bc4d61a4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d61ab expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.186472:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e04ff129400/0x9383f985bc4d61a4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d61ab expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201593.186498:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788201593.186504:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04ff129400/0x9383f985bc4d61a4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d61ab expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.186511:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e04ff129400/0x9383f985bc4d61a4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d61ab expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201593.186520:0:5855:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788201593.186522:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e04f9036000 from 7 10000000:01000000:0.0:1788201593.186525:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201593.186549:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04ff129600/0x9383f985bc4d61b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.186556:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e04ff129600/0x9383f985bc4d61b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.186563:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e04ff129600/0x9383f985bc4d61b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201593.186587:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458327936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201593.186622:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201593.186678:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+17:5855:x1875064458327808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 564us (2439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201593.186685:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788201593.187018:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1daa9c0 going to sleep for 20 seconds 00000100:00100000:1.0:1788201593.187102:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458327936 00000100:00100000:1.0:1788201593.187109:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458327936 00000100:00100000:1.0:1788201593.187133:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788201593.187140:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+17:5855:x1875064458327936:12345-0@lo:101:ll_cfg_requeue.0 00000020:02000000:1.0:1788201593.187145:0:23051:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:1.0:1788201593.187152:0:23051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201593.187164:0:23051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c507d200/0x9383f985bc4d61b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d61b2 expref: -99 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.187183:0:23051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c507d200/0x9383f985bc4d61b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d61b2 expref: 18 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.187192:0:23051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c507d200/0x9383f985bc4d61b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d61b2 expref: 18 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.187199:0:23051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c507d200, rc 0) 00000100:00100000:1.0:1788201593.187276:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+18:5855:x1875064458327936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201593.187283:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788201593.187443:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458327936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201593.187456:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e04ff129600/0x9383f985bc4d61b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d61b9 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201593.187465:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e04ff129600/0x9383f985bc4d61b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d61b9 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201593.187528:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458328064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201593.187557:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201593.187581:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1daa9c0 going to sleep for 20 seconds 00000100:00100000:1.0:1788201593.187617:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458328064 00000100:00100000:1.0:1788201593.187621:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458328064 00000100:00100000:1.0:1788201593.187638:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788201593.187643:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+18:5855:x1875064458328064:12345-0@lo:501:ll_cfg_requeue.0 00000020:02000000:1.0:1788201593.187647:0:23051:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1788201593.187989:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+18:5855:x1875064458328064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 344us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201593.187996:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788201593.188026:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458328064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201593.188056:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f900b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458328192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201593.188094:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201593.188107:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f44840 going to sleep for 20 seconds 00000100:00100000:1.0:1788201593.188119:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458328192 00000100:00100000:1.0:1788201593.188123:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458328192 00000100:00100000:1.0:1788201593.188141:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788201593.188147:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+18:5855:x1875064458328192:12345-0@lo:503:ll_cfg_requeue.0 00000020:02000000:1.0:1788201593.188151:0:23051:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1788201593.188341:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+18:5855:x1875064458328192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 193us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201593.188347:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788201593.188377:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f900b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458328192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201593.189087:0:23128:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788201593.189249:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788201593.189273:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788201593.189283:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04ff129600/0x9383f985bc4d61b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d61b9 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.189324:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e04ff129600/0x9383f985bc4d61b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d61b9 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201593.189336:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788201593.189339:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9e04c6718000 from 1 10000000:01000000:1.0:1788201593.189342:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788201593.189374:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c507ca00/0x9383f985bc4d61c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.189382:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c507ca00/0x9383f985bc4d61c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.189395:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c507ca00/0x9383f985bc4d61c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201593.189415:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f900b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458328320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201593.189460:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201593.189480:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f967e9c0 going to sleep for 20 seconds 00000100:00100000:1.0:1788201593.189499:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458328320 00000100:00100000:1.0:1788201593.189505:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458328320 00000100:00100000:1.0:1788201593.189535:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788201593.189544:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+18:5855:x1875064458328320:12345-0@lo:101:ll_cfg_requeue.0 00000020:02000000:1.0:1788201593.189550:0:23051:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:1.0:1788201593.189558:0:23051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201593.189572:0:23051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c507c400/0x9383f985bc4d61c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d61c0 expref: -99 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.189593:0:23051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c507c400/0x9383f985bc4d61c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d61c0 expref: 19 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.189602:0:23051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c507c400/0x9383f985bc4d61c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d61c0 expref: 19 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.189610:0:23051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c507c400, rc 0) 00000100:00100000:1.0:1788201593.189639:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:5855:x1875064458328320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201593.189645:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788201593.189678:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f900b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458328320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201593.189689:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c507ca00/0x9383f985bc4d61c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d61c7 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.189698:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c507ca00/0x9383f985bc4d61c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d61c7 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201593.189739:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f900b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458328448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201593.189763:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201593.189775:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f967e9c0 going to sleep for 20 seconds 00000100:00100000:1.0:1788201593.189787:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458328448 00000100:00100000:1.0:1788201593.189790:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458328448 00000100:00100000:1.0:1788201593.189805:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788201593.189810:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:5855:x1875064458328448:12345-0@lo:501:ll_cfg_requeue.0 00000020:02000000:1.0:1788201593.189815:0:23051:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1788201593.190028:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:5855:x1875064458328448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 217us (264us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201593.190034:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788201593.190057:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f900b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458328448:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788201593.190073:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788201593.190078:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c507ca00/0x9383f985bc4d61c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d61c7 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201593.190085:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c507ca00/0x9383f985bc4d61c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d61c7 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201593.830158:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201594.779696:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201594.779747:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201594.779785:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201594.779830:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442779136 00000100:00100000:0.0:1788201594.779843:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442779136 00000100:00100000:0.0:1788201594.779909:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 355 00000100:00100000:0.0:1788201594.779922:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+506:2359:x1875064442779136:12345-192.168.201.30@tcp:400:kworker.0 00000020:02000000:0.0:1788201594.779931:0:13448:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788201594.783253:0:23056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442779008 00000100:00100000:3.0:1788201594.783271:0:23056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442779008 00000100:00100000:3.0:1788201594.783358:0:23056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:3.0:1788201594.783369:0:23056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2360:x1875064442779008:12345-192.168.201.30@tcp:400:kworker.0 00000020:02000000:3.0:1788201594.783379:0:23056:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000020:00080000:3.0:1788201594.783386:0:23056:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.30@tcp 00000100:00100000:3.0:1788201594.783485:0:23056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2360:x1875064442779008:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 115us (3736us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788201594.783494:0:23056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:2.0:1788201594.784437:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442778880 00000100:00100000:2.0:1788201594.784447:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442778880 00000100:00100000:2.0:1788201594.784479:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:2.0:1788201594.784487:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2359:x1875064442778880:12345-192.168.201.30@tcp:400:kworker.0 00000020:02000000:2.0:1788201594.784494:0:23051:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000020:00080000:2.0:1788201594.784499:0:23051:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.30@tcp 00000100:00100000:2.0:1788201594.784551:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2359:x1875064442778880:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 64us (4871us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788201594.784558:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:0.0:1788201594.792764:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+506:2359:x1875064442779136:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 12828us (12962us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201594.792785:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 355 00000100:00100000:2.0:1788201594.807012:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201594.807077:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201594.807228:0:23058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442779264 00000100:00100000:1.0:1788201594.807243:0:23058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442779264 00000100:00100000:1.0:1788201594.807330:0:23058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:1.0:1788201594.807342:0:23058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c49f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2358:x1875064442779264:12345-192.168.201.30@tcp:38:ptlrpcd_00_01.0 00000020:02000000:1.0:1788201594.807352:0:23058:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:1.0:1788201594.807410:0:23058:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '35604eb4-baf9-45be-a20a-4883a2cd8cf9' at ffff9e04c7de5000, cookie 0x9383f985bc4d60bd 00010000:00080000:1.0:1788201594.807417:0:23058:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp recovering/t21474836481 exp ffff9e04c7de5000 cur 870 last 1788201592 00010000:02000400:1.0:1788201594.807430:0:23058:0:(ldlm_lib.c:2037:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 1 client reconnects 00000100:00100000:0.0:1788201594.808277:0:23052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442779392 00000100:00100000:0.0:1788201594.808315:0:23052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442779392 00000100:00100000:0.0:1788201594.808357:0:23052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00100000:0.0:1788201594.808364:0:23052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2358:x1875064442779392:12345-192.168.201.30@tcp:250:ptlrpcd_00_00.0 00000020:02000000:0.0:1788201594.808371:0:23052:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:0.0:1788201594.808391:0:23052:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 7ad49433-54fa-4e21-b756-859420d95603@192.168.201.30@tcp t0 exp 0000000000000000 cur 870 last 0 00000020:00000080:0.0:1788201594.808438:0:23052:0:(genops.c:1406:class_connect()) connect: client 7ad49433-54fa-4e21-b756-859420d95603, cookie 0x9383f985bc4d61ce 00000100:00080000:0.0:1788201594.808592:0:23052:0:(import.c:65:import_set_state_nolock()) ffff9e03c5130800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201594.808693:0:23052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+5:2358:x1875064442779392:12345-192.168.201.30@tcp:250:ptlrpcd_00_00.0 Request processed in 327us (1614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201594.808703:0:23052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 47 00010000:00080000:1.0:1788201594.814971:0:23058:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1788201594.815542:0:23058:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type 77, return 77 00000100:00080000:0.0:1788201594.815769:0:23058:0:(import.c:65:import_set_state_nolock()) ffff9e03c5131000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201594.815880:0:23058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c49f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2358:x1875064442779264:12345-192.168.201.30@tcp:38:ptlrpcd_00_01.0 Request processed in 8537us (8881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201594.815893:0:23058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00010000:00080000:2.0:1788201594.816232:0:23092:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 1 abort 0 expired 0 00010000:00080000:2.0:1788201594.816239:0:23092:0:(ldlm_lib.c:2684:replay_request_or_update()) Waiting for transno 21474836484 00000020:00080000:2.0:1788201594.816246:0:23092:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788201594.816250:0:23092:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 0, req_transno: 0, next_transno: 21474836484 00000020:00080000:2.0:1788201594.816254:0:23092:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788201594.816256:0:23092:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 0, req_transno: 0, next_transno: 21474836484 00000100:00100000:2.0:1788201594.827806:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201594.827862:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201594.828267:0:23056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442779520 00000100:00100000:0.0:1788201594.828509:0:23056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442779520 00000100:00100000:0.0:1788201594.828580:0:23056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442779648 00000100:00100000:0.0:1788201594.828584:0:23056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442779648 00000100:00100000:0.0:1788201594.828605:0:23056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:0.0:1788201594.828617:0:23056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c49f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2358:x1875064442779520:12345-192.168.201.30@tcp:101:ldlm_lock_repla.0 00000020:02000000:0.0:1788201594.828626:0:23056:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:3.0:1788201594.857491:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788201595.688033:0:6732:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788201595.719565:0:7657:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788201595.878036:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201595.988189:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201595.989434:0:23050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442779776 00000100:00100000:0.0:1788201595.989446:0:23050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442779776 00000100:00100000:0.0:1788201595.989508:0:23050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:0.0:1788201595.989518:0:23050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+5:5601:x1875064442779776:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00000020:02000000:0.0:1788201595.989530:0:23050:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00010000:00010000:0.0:1788201595.989543:0:23050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201595.989565:0:23050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e04ff128200/0x9383f985bc4d61d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c58f9 expref: -99 pid: 23050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.989594:0:23050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e04ff128200/0x9383f985bc4d61d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58f9 expref: 6 pid: 23050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.989605:0:23050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e04ff128200/0x9383f985bc4d61d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58f9 expref: 6 pid: 23050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201595.989614:0:23050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04ff128200, rc 0) 00000100:00100000:0.0:1788201595.989673:0:23050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+6:5601:x1875064442779776:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 156us (1494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201595.989680:0:23050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:2.0:1788201595.992376:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201595.992531:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442779904 00000100:00100000:0.0:1788201595.992541:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442779904 00000100:00100000:0.0:1788201595.992595:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:0.0:1788201595.992605:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+6:5601:x1875064442779904:12345-192.168.201.30@tcp:256:ll_cfg_requeue.0 00000020:02000000:0.0:1788201595.992612:0:23051:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 20000000:01000000:0.0:1788201595.992636:0:23051:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1788201595.992653:0:23051:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788201595.992657:0:23051:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1788201595.992659:0:23051:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1788201595.992662:0:23051:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 20 00000100:00100000:1.0:1788201595.996870:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+6:5601:x1875064442779904:12345-192.168.201.30@tcp:256:ll_cfg_requeue.0 Request processed in 4255us (4492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201595.996884:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:2.0:1788201596.009027:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201596.009686:0:23052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442780032 00000100:00100000:3.0:1788201596.009697:0:23052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442780032 00000100:00100000:2.0:1788201596.020901:0:23052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:2.0:1788201596.020929:0:23052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+6:5601:x1875064442780032:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00000020:02000000:2.0:1788201596.020939:0:23052:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00010000:00010000:2.0:1788201596.020960:0:23052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201596.020981:0:23052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c131ee00/0x9383f985bc4d61dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5900 expref: -99 pid: 23052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.021012:0:23052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c131ee00/0x9383f985bc4d61dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5900 expref: 7 pid: 23052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.021023:0:23052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c131ee00/0x9383f985bc4d61dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5900 expref: 7 pid: 23052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.021031:0:23052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c131ee00, rc 0) 00000100:00100000:2.0:1788201596.021113:0:23052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+7:5601:x1875064442780032:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 196us (12095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201596.021120:0:23052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:2.0:1788201596.023198:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201596.031443:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442780160 00000100:00100000:1.0:1788201596.031458:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442780160 00000100:00100000:2.0:1788201596.031596:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00100000:2.0:1788201596.031607:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+7:5601:x1875064442780160:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000020:02000000:2.0:1788201596.031615:0:23051:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00000100:00100000:2.0:1788201596.032010:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+8:5601:x1875064442780160:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 402us (8817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201596.032019:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00100000:2.0:1788201596.042549:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201596.042634:0:23050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442780288 00000100:00100000:1.0:1788201596.042643:0:23050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442780288 00000100:00100000:1.0:1788201596.042699:0:23050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:1.0:1788201596.042710:0:23050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+8:5601:x1875064442780288:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 00000020:02000000:1.0:1788201596.042718:0:23050:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00000100:00100000:1.0:1788201596.043110:0:23050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+8:5601:x1875064442780288:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 Request processed in 399us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201596.043118:0:23050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:1.0:1788201596.052683:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201596.052768:0:23052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442780416 00000100:00100000:3.0:1788201596.052778:0:23052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442780416 00000100:00100000:3.0:1788201596.052832:0:23052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:3.0:1788201596.052843:0:23052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+8:5601:x1875064442780416:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00000020:02000000:3.0:1788201596.052850:0:23052:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00010000:00010000:3.0:1788201596.052863:0:23052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201596.052883:0:23052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c32bd600/0x9383f985bc4d61e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5907 expref: -99 pid: 23052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.052912:0:23052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c32bd600/0x9383f985bc4d61e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5907 expref: 9 pid: 23052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.052923:0:23052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c32bd600/0x9383f985bc4d61e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5907 expref: 9 pid: 23052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201596.052931:0:23052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bd600, rc 0) 00000100:00100000:3.0:1788201596.052985:0:23052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442780416:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 144us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201596.052992:0:23052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:0.0:1788201596.064943:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201596.065004:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442780544 00000100:00100000:2.0:1788201596.065015:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442780544 00000100:00100000:2.0:1788201596.065073:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00100000:2.0:1788201596.065083:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442780544:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000020:02000000:2.0:1788201596.065090:0:23051:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00000100:00100000:2.0:1788201596.065540:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442780544:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 456us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201596.065548:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00100000:2.0:1788201596.067484:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201596.067570:0:23050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442780672 00000100:00100000:3.0:1788201596.067586:0:23050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442780672 00000100:00100000:3.0:1788201596.067657:0:23050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 55 00000100:00100000:3.0:1788201596.067671:0:23050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442780672:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 00000020:02000000:3.0:1788201596.067681:0:23050:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00000100:00100000:3.0:1788201596.068254:0:23050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442780672:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 Request processed in 584us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201596.068278:0:23050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 55 00000100:00100000:1.0:1788201596.077663:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201596.079316:0:23052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442780800 00000100:00100000:2.0:1788201596.079331:0:23052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442780800 00000100:00100000:2.0:1788201596.079391:0:23052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 56 00000100:00100000:2.0:1788201596.079402:0:23052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442780800:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00000020:02000000:2.0:1788201596.079409:0:23052:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00010000:00010000:2.0:1788201596.079422:0:23052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201596.079443:0:23052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c131ec00/0x9383f985bc4d61ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c590e expref: -99 pid: 23052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.079471:0:23052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c131ec00/0x9383f985bc4d61ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c590e expref: 10 pid: 23052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.079483:0:23052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c131ec00/0x9383f985bc4d61ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c590e expref: 10 pid: 23052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201596.079491:0:23052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c131ec00, rc 0) 00000100:00100000:2.0:1788201596.079557:0:23052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:5601:x1875064442780800:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 156us (1902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201596.079564:0:23052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 56 00000100:00100000:0.0:1788201596.081974:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201596.086194:0:23050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442780928 00000100:00100000:3.0:1788201596.086216:0:23050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442780928 00000100:00100000:3.0:1788201596.086320:0:23050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:3.0:1788201596.086334:0:23050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:5601:x1875064442780928:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000020:02000000:3.0:1788201596.086344:0:23050:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00000100:00100000:3.0:1788201596.086771:0:23050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:5601:x1875064442780928:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 437us (4801us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201596.086781:0:23050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 57 00010000:00010000:1.0:1788201596.901558:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201597.459908:0:23343:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1788201597.669694:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201597.669703:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201597.669706:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201597.669718:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e04ff4ba000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1788201597.669740:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e04c12aa680 x1875064458328704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201597.669767:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201597.669771:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201597.669772:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201597.669778:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e04f5751000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1788201597.669789:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e04c12a9f80 x1875064458328832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201597.669821:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788201597.669825:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201597.669826:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e03c55b4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201597.669831:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e03c55b4000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1788201597.669845:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e04c6bbd880 x1875064458329216/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201597.669920:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458328576:0@lo:400:kworker.0 00000100:00100000:1.0:1788201597.670005:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201597.670132:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201597.670139:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458328960:0@lo:400:kworker.0 00000100:00100000:2.0:1788201597.670157:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875064458328704:0@lo:38:kworker.0 00000100:00100000:1.0:1788201597.670170:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201597.670184:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201597.670202:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875064458328832:0@lo:38:kworker.0 00000100:00100000:1.0:1788201597.670204:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458328960 00000100:00100000:1.0:1788201597.670211:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458328960 00000100:00100000:2.0:1788201597.670248:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201597.670259:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1788201597.670263:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c6bbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875064458329216:0@lo:38:kworker.0 00000100:00100000:1.0:1788201597.670268:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f900b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458328960:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1788201597.670274:0:13444:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00000100:00100000:2.0:1788201597.670284:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201597.670350:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f900b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458328960:12345-0@lo:400:kworker.0 Request processed in 82us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201597.670357:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788201597.670382:0:23058:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788201597.670389:0:23058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788201597.670452:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458328960:0@lo:400:kworker.0 00000100:00100000:2.0:1788201597.670510:0:23058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458328704 00000100:00100000:2.0:1788201597.670514:0:23058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458328704 00000100:00100000:2.0:1788201597.670531:0:23058:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788201597.670537:0:23058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458328832 00000100:00100000:0.0:1788201597.670538:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458328576 00000100:00100000:2.0:1788201597.670539:0:23058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458328832 00000100:00100000:0.0:1788201597.670542:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458328576 00000100:00100000:2.0:1788201597.670547:0:23058:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788201597.670550:0:23058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458329216 00000100:00100000:2.0:1788201597.670552:0:23058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458329216 00000100:00100000:0.0:1788201597.670566:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788201597.670573:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3312:x1875064458328576:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1788201597.670578:0:23051:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00000100:00100000:0.0:1788201597.670622:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3312:x1875064458328576:12345-0@lo:400:kworker.0 Request processed in 49us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201597.670629:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788201597.670675:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458328576:0@lo:400:kworker.0 00000100:00100000:3.0:1788201597.671220:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458329088:0@lo:400:kworker.0 00000100:00100000:3.0:1788201597.671262:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201597.671379:0:23366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:1.0:1788201597.671389:0:23366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c49f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2358:x1875064442779648:12345-192.168.201.30@tcp:101:ldlm_lock_repla.0 00000020:02000000:1.0:1788201597.671395:0:23366:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00010000:00080000:1.0:1788201597.671414:0:23366:0:(ldlm_lib.c:3188:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9e04c49f2d80 x1875064442779648/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:0/0 lens 328/0 e 0 to 0 dl 1788201605 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201597.671440:0:23366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c49f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2358:x1875064442779648:12345-192.168.201.30@tcp:101:ldlm_lock_repla.0 Request processed in 53us (2843577us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788201597.671446:0:23366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:1.0:1788201597.671456:0:23366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788201597.671461:0:23366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c49f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3309:x1875064458328704:12345-0@lo:38:kworker.0 00000020:02000000:1.0:1788201597.671465:0:23366:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00000020:00080000:3.0:1788201597.671472:0:23092:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201597.671476:0:23092:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 1, connected: 1, completed: 1, queue_len: 0, req_transno: 0, next_transno: 21474836484 00010000:00080000:3.0:1788201597.671478:0:23092:0:(ldlm_lib.c:2263:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1788201597.671481:0:23092:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788201597.671484:0:23366:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 872 last 0 00010000:00080000:3.0:1788201597.671486:0:23092:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1788201597.671489:0:23092:0:(ldlm_lib.c:2283:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1788201597.671494:0:23092:0:(ldlm_lib.c:2889:target_recovery_thread()) @@@ processing lock from 192.168.201.30@tcp: req@ffff9e04c49f2d80 x1875064442779648/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:0/0 lens 328/0 e 0 to 0 dl 1788201605 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:02000000:3.0:1788201597.671502:0:23092:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00000020:00000080:1.0:1788201597.671518:0:23366:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9383f985bc4d61f1 00010000:00010000:3.0:1788201597.671521:0:23092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00100000:1.0:1788201597.671534:0:23366:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00010000:3.0:1788201597.671544:0:23092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d61f8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c58e4 expref: -99 pid: 23092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201597.671564:0:23092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d61f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58e4 expref: 8 pid: 23092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201597.671582:0:23092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d61f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58e4 expref: 8 pid: 23092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201597.671589:0:23092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bd800, rc 0) 00010000:00080000:3.0:1788201597.671627:0:23092:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 67 seconds 00010000:00080000:3.0:1788201597.671636:0:23092:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00000100:00080000:1.0:1788201597.671649:0:23366:0:(import.c:65:import_set_state_nolock()) ffff9e04c6b18800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201597.671689:0:23366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c49f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875064458328704:12345-0@lo:38:kworker.0 Request processed in 226us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201597.671695:0:23366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788201597.671709:0:23366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788201597.671713:0:23366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c49f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3309:x1875064458328832:12345-0@lo:38:kworker.0 00000020:02000000:1.0:1788201597.671716:0:23366:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00010000:00080000:1.0:1788201597.671726:0:23366:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 872 last 0 00000020:00000080:1.0:1788201597.671750:0:23366:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9383f985bc4d61ff 00000004:00100000:1.0:1788201597.671756:0:23366:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788201597.672791:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 6 00000100:00100000:0.0:1788201597.673363:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458329088 00000100:00100000:0.0:1788201597.673371:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458329088 00000100:00100000:0.0:1788201597.673414:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788201597.673423:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458329088:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1788201597.673429:0:13446:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00000100:00100000:0.0:1788201597.673491:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458329088:12345-0@lo:400:kworker.0 Request processed in 69us (2228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201597.673497:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00080000:3.0:1788201597.673797:0:3309:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9e04c12aa680 x1875064458328704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201602 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201597.673807:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788201597.673811:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788201597.673815:0:3309:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00080000:1.0:1788201597.674723:0:23366:0:(import.c:65:import_set_state_nolock()) ffff9e04fae46000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201597.674788:0:23366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c49f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875064458328832:12345-0@lo:38:kworker.0 Request processed in 3072us (4538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201597.674798:0:23366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788201597.674825:0:23366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788201597.674831:0:23366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c49f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3309:x1875064458329216:12345-0@lo:38:kworker.0 00000020:02000000:1.0:1788201597.674836:0:23366:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00010000:00080000:1.0:1788201597.674855:0:23366:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 872 last 0 00000020:00000080:1.0:1788201597.674894:0:23366:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9383f985bc4d6206 00000004:00100000:1.0:1788201597.674908:0:23366:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788201597.674930:0:23366:0:(import.c:65:import_set_state_nolock()) ffff9e04fae42800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201597.674960:0:23366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c49f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875064458329216:12345-0@lo:38:kworker.0 Request processed in 128us (4674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201597.674966:0:23366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788201597.679241:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458329088:0@lo:400:kworker.0 00000100:00100000:3.0:1788201597.684781:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875064458328704:0@lo:38:kworker.0 00000100:00080000:1.0:1788201597.685583:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 6 00000100:00080000:1.0:1788201597.686838:0:3309:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9e04c12a9f80 x1875064458328832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201602 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788201597.686848:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1788201597.686852:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788201597.686855:0:3309:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788201597.686860:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875064458328832:0@lo:38:kworker.0 00000100:00080000:1.0:1788201597.686891:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 6 00000100:00080000:1.0:1788201597.686896:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788201597.686900:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788201597.686901:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e03c55b4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788201597.686904:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c6bbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875064458329216:0@lo:38:kworker.0 00010000:00010000:1.0:1788201597.933357:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201598.950397:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201599.893400:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201599.893445:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201599.894516:0:23052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442781056 00000100:00100000:3.0:1788201599.894528:0:23052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442781056 00000100:00100000:3.0:1788201599.894604:0:23052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:3.0:1788201599.894615:0:23052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442781056:12345-192.168.201.30@tcp:400:kworker.0 00000020:02000000:3.0:1788201599.894624:0:23052:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00000100:00100000:1.0:1788201599.900035:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442781184 00000100:00100000:1.0:1788201599.900050:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442781184 00000100:00100000:1.0:1788201599.900129:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 358 00000100:00100000:1.0:1788201599.900140:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9659850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+506:2360:x1875064442781184:12345-192.168.201.30@tcp:400:kworker.0 00000020:02000000:1.0:1788201599.900148:0:13438:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00000100:00100000:1.0:1788201599.900251:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9659850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+506:2360:x1875064442781184:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 111us (6805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201599.900258:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 358 00000100:00100000:3.0:1788201599.912066:0:23052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442781056:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 17442us (18665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201599.912090:0:23052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 59 00010000:00010000:1.0:1788201599.973946:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1788201600.485568:0:3313:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201584/real 1788201584] req@ffff9e04c12a8700 x1875064458320768/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201600 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201600.530127:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e04c12a8700 x1875064458320768/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201600 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201600.530690:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458320768:0@lo:400:kworker.0 00000100:00000400:0.0:1788201600.742755:0:3312:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201584/real 1788201584] req@ffff9e04c12a9c00 x1875064458320640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201600 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201600.742806:0:3312:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e04c12a9c00 x1875064458320640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201600 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201600.742829:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458320640:0@lo:400:kworker.0 00010000:00010000:1.0:1788201600.997772:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201602.023402:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201602.799364:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f9009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458329728:0@lo:400:kworker.0 00000100:00100000:1.0:1788201602.799469:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201602.799550:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788201602.799556:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f9008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458329344:0@lo:400:kworker.0 00000100:00100000:1.0:1788201602.799592:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201602.799616:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f900b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458329856:0@lo:400:kworker.0 00000100:00100000:1.0:1788201602.799645:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201602.799701:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458329728 00000100:00100000:1.0:1788201602.799711:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458329728 00000100:00100000:1.0:1788201602.799759:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458329856 00000100:00100000:1.0:1788201602.799762:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458329856 00000100:00100000:1.0:1788201602.799789:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1788201602.799801:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f900a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458329728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201602.800066:0:23050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458329344 00000100:00100000:3.0:1788201602.800071:0:23050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458329344 00000100:00100000:3.0:1788201602.800103:0:23050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788201602.800111:0:23050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458329344:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1788201602.800119:0:23050:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00000100:00100000:3.0:1788201602.800199:0:23050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458329344:12345-0@lo:400:kworker.0 Request processed in 87us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201602.800207:0:23050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788201602.800274:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f9008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458329344:0@lo:400:kworker.0 00000100:00100000:3.0:1788201602.800333:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f900aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458329600:0@lo:400:kworker.0 00000100:00100000:3.0:1788201602.800367:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201602.800395:0:23058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458329600 00000100:00100000:3.0:1788201602.800399:0:23058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458329600 00000100:00100000:3.0:1788201602.800429:0:23058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201602.800436:0:23058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458329600:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1788201602.800441:0:23058:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00010000:00080000:3.0:1788201602.800456:0:23058:0:(ldlm_lib.c:3212:target_queue_recovery_request()) @@@ not queueing req@ffff9e04cffd4700 x1875064458329600/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:0/0 lens 224/0 e 0 to 0 dl 1788201622 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201602.800492:0:23058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458329600:12345-0@lo:400:kworker.0 Request processed in 56us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201602.800499:0:23058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201602.800531:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f900aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458329600:0@lo:400:kworker.0 00000100:00100000:3.0:1788201602.800547:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788201602.800554:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f9009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458329472:0@lo:400:kworker.0 00000100:00100000:3.0:1788201602.800579:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201602.800600:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f9008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875064458329984:0@lo:400:kworker.0 00000100:00100000:3.0:1788201602.800622:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201602.800640:0:23058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458329472 00000100:00100000:3.0:1788201602.800644:0:23058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458329472 00000100:00100000:3.0:1788201602.800662:0:23058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458329984 00000100:00100000:3.0:1788201602.800665:0:23058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458329984 00000100:00100000:3.0:1788201602.800680:0:23058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788201602.800686:0:23058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875064458329472:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1788201602.800690:0:23058:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00010000:00080000:3.0:1788201602.800697:0:23058:0:(ldlm_lib.c:3212:target_queue_recovery_request()) @@@ not queueing req@ffff9e04cffd5180 x1875064458329472/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:0/0 lens 224/0 e 0 to 0 dl 1788201622 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201602.800728:0:23058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875064458329472:12345-0@lo:400:kworker.0 Request processed in 42us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201602.800735:0:23058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788201602.800746:0:23058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788201602.800752:0:23058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875064458329984:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1788201602.800756:0:23058:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00010000:00080000:3.0:1788201602.800762:0:23058:0:(ldlm_lib.c:3212:target_queue_recovery_request()) @@@ not queueing req@ffff9e04cffd4000 x1875064458329984/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:0/0 lens 224/0 e 0 to 0 dl 1788201622 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201602.800790:0:23058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875064458329984:12345-0@lo:400:kworker.0 Request processed in 39us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201602.800797:0:23058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788201602.801003:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f9008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875064458329984:0@lo:400:kworker.0 00000100:00100000:3.0:1788201602.801021:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f9009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458329472:0@lo:400:kworker.0 00000100:00100000:3.0:1788201602.801127:0:13451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788201602.801137:0:13451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458329856:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1788201602.801152:0:13451:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00000100:00100000:3.0:1788201602.801206:0:13451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458329856:12345-0@lo:400:kworker.0 Request processed in 71us (1560us total) trans 0 rc 0/0 00000020:02000000:1.0:1788201602.801311:0:6705:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00000100:00100000:1.0:1788201602.801350:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f900a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458329728:12345-0@lo:400:kworker.0 Request processed in 1551us (1882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201602.801358:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1788201602.801410:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f900b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458329856:0@lo:400:kworker.0 00000100:00100000:1.0:1788201602.801421:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f9009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458329728:0@lo:400:kworker.0 00000100:00100000:3.0:1788201602.801573:0:13451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00010000:00010000:1.0:1788201603.048217:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201604.073607:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201605.011389:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201605.011438:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201605.011580:0:23052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442781440 00000100:00100000:3.0:1788201605.011590:0:23052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442781440 00000100:00100000:3.0:1788201605.011647:0:23052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00100000:3.0:1788201605.011656:0:23052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442781440:12345-192.168.201.30@tcp:400:kworker.0 00000020:02000000:3.0:1788201605.011664:0:23052:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00000100:00100000:3.0:1788201605.011744:0:23052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442781440:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 88us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201605.011752:0:23052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00100000:1.0:1788201605.012825:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442781568 00000100:00100000:1.0:1788201605.012831:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442781568 00000100:00100000:1.0:1788201605.012875:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 361 00000100:00100000:1.0:1788201605.012884:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c49f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+506:2362:x1875064442781568:12345-192.168.201.30@tcp:400:kworker.0 00000020:02000000:1.0:1788201605.012889:0:13449:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00000100:00100000:1.0:1788201605.012942:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c49f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+506:2362:x1875064442781568:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 59us (1572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201605.012949:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 361 00010000:00010000:0.0:1788201605.093714:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201606.117839:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201607.146636:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201607.909745:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f9009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875064458330368:0@lo:400:kworker.0 00000100:00100000:1.0:1788201607.909851:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201607.909934:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788201607.909941:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f900b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458330240:0@lo:400:kworker.0 00000100:00100000:1.0:1788201607.909968:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201607.909994:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f9009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875064458330752:0@lo:400:kworker.0 00000100:00100000:1.0:1788201607.910016:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201607.910062:0:23058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458330368 00000100:00100000:1.0:1788201607.910071:0:23058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458330368 00000100:00100000:1.0:1788201607.910119:0:23058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458330240 00000100:00100000:1.0:1788201607.910123:0:23058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458330240 00000100:00100000:1.0:1788201607.910137:0:23058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458330752 00000100:00100000:1.0:1788201607.910139:0:23058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458330752 00000100:00100000:1.0:1788201607.910157:0:23058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201607.910167:0:23058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f900a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875064458330368:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1788201607.910175:0:23058:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00000100:00100000:2.0:1788201607.910430:0:23055:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788201607.910442:0:23055:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1788201607.910640:0:23055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788201607.910649:0:23055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875064458330240:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1788201607.910654:0:23055:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00010000:00080000:2.0:1788201607.910671:0:23055:0:(ldlm_lib.c:3212:target_queue_recovery_request()) @@@ not queueing req@ffff9e04f9009f80 x1875064458330240/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:0/0 lens 224/0 e 0 to 0 dl 1788201627 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201607.910741:0:23055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875064458330240:12345-0@lo:400:kworker.0 Request processed in 93us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201607.910761:0:23055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788201607.910786:0:23055:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788201607.910794:0:23055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201607.910801:0:23055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875064458330752:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1788201607.910805:0:23055:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00010000:00080000:2.0:1788201607.910811:0:23055:0:(ldlm_lib.c:3212:target_queue_recovery_request()) @@@ not queueing req@ffff9e04f9008000 x1875064458330752/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:0/0 lens 224/0 e 0 to 0 dl 1788201627 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201607.910842:0:23055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875064458330752:12345-0@lo:400:kworker.0 Request processed in 42us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201607.910848:0:23055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201607.911063:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f900b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458330240:0@lo:400:kworker.0 00000100:00100000:2.0:1788201607.911078:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f9009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875064458330752:0@lo:400:kworker.0 00000100:00100000:0.0:1788201607.913528:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f900bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458330496:0@lo:400:kworker.0 00000100:00100000:0.0:1788201607.913650:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201607.913719:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788201607.913728:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f9009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458330112:0@lo:400:kworker.0 00000100:00100000:0.0:1788201607.913771:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201607.913809:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f900b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458330624:0@lo:400:kworker.0 00000100:00100000:0.0:1788201607.913839:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201607.913876:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458330112 00000100:00100000:0.0:1788201607.913885:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458330112 00000100:00100000:0.0:1788201607.913940:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788201607.913950:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c268d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3312:x1875064458330112:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1788201607.913958:0:23051:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00000100:00100000:0.0:1788201607.914017:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c268d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3312:x1875064458330112:12345-0@lo:400:kworker.0 Request processed in 68us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201607.914025:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788201607.914073:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458330496 00000100:00100000:0.0:1788201607.914078:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458330496 00000100:00100000:0.0:1788201607.914104:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458330624 00000100:00100000:0.0:1788201607.914108:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458330624 00000100:00100000:0.0:1788201607.914128:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788201607.914136:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c6bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458330496:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1788201607.914141:0:13439:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00000100:00100000:0.0:1788201607.914173:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c6bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458330496:12345-0@lo:400:kworker.0 Request processed in 38us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201607.914180:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788201607.914192:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788201607.914199:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458330624:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1788201607.914204:0:13439:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00000100:00100000:0.0:1788201607.914243:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458330624:12345-0@lo:400:kworker.0 Request processed in 31us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201607.914251:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788201607.914333:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f9009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458330112:0@lo:400:kworker.0 00000100:00100000:0.0:1788201607.914350:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f900b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458330624:0@lo:400:kworker.0 00000100:00100000:0.0:1788201607.914361:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f900bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458330496:0@lo:400:kworker.0 00010000:00080000:1.0:1788201607.936152:0:23058:0:(ldlm_lib.c:3212:target_queue_recovery_request()) @@@ not queueing req@ffff9e04f900a300 x1875064458330368/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:0/0 lens 224/0 e 0 to 0 dl 1788201627 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201607.936345:0:23058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f900a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875064458330368:12345-0@lo:400:kworker.0 Request processed in 26177us (26492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201607.936359:0:23058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201607.936439:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f9009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875064458330368:0@lo:400:kworker.0 00010000:00010000:0.0:1788201608.166666:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201609.189748:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1788201609.829463:0:3313:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201589/real 1788201589] req@ffff9e04c12a9880 x1875064458321152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201609 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201609.829498:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e04c12a9880 x1875064458321152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201609 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201609.829517:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458321152:0@lo:400:kworker.0 00000100:00000400:1.0:1788201609.959530:0:3311:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201589/real 1788201589] req@ffff9e04c12a8380 x1875064458321024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201609 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201609.959575:0:3311:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e04c12a8380 x1875064458321024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201609 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201609.959613:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458321024:0@lo:400:kworker.0 00000100:00100000:2.0:1788201610.130933:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201610.130982:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201610.131044:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201610.131148:0:23055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442781952 00000100:00100000:1.0:1788201610.131161:0:23055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442781952 00000100:00100000:1.0:1788201610.131229:0:23055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:1.0:1788201610.131242:0:23055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c49f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2358:x1875064442781952:12345-192.168.201.30@tcp:38:ptlrpcd_rcv.0 00000020:02000000:1.0:1788201610.131252:0:23055:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00010000:02000400:1.0:1788201610.131335:0:23055:0:(ldlm_lib.c:976:target_handle_reconnect()) lustre-MDT0000: Client 35604eb4-baf9-45be-a20a-4883a2cd8cf9 (at 192.168.201.30@tcp) reconnected, waiting for 1 clients in recovery for 0:55 00000100:00100000:0.0:1788201610.131822:0:23050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442781696 00000100:00100000:0.0:1788201610.131829:0:23050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442781696 00000100:00100000:0.0:1788201610.131873:0:23050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:0.0:1788201610.131881:0:23050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8045050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442781696:12345-192.168.201.30@tcp:400:kworker.0 00000020:02000000:0.0:1788201610.131887:0:23050:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00000100:00100000:0.0:1788201610.131970:0:23050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8045050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442781696:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 89us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201610.131979:0:23050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:3.0:1788201610.132130:0:13442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442781824 00000100:00100000:3.0:1788201610.132135:0:13442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442781824 00000100:00100000:3.0:1788201610.132175:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 364 00000100:00100000:3.0:1788201610.132182:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c49f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35604eb4-baf9-45be-a20a-4883a2cd8cf9+506:2362:x1875064442781824:12345-192.168.201.30@tcp:400:kworker.0 00000020:02000000:3.0:1788201610.132188:0:13442:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00000100:00100000:3.0:1788201610.132331:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c49f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35604eb4-baf9-45be-a20a-4883a2cd8cf9+506:2362:x1875064442781824:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 148us (1411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201610.132339:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 364 00010000:00080000:1.0:1788201610.148683:0:23055:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp recovering/t21474836481 exp ffff9e04c7de5000 cur 885 last 1788201610 00000004:00100000:1.0:1788201610.148730:0:23055:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli 192.168.201.30@tcp supports cksum type 77, return 77 00000100:00080000:1.0:1788201610.148761:0:23055:0:(import.c:65:import_set_state_nolock()) ffff9e03c5131000 : changing import state from FULL to RECOVER 00000100:00080000:1.0:1788201610.148771:0:23055:0:(import.c:65:import_set_state_nolock()) ffff9e03c5131000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201610.151547:0:23055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c49f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2358:x1875064442781952:12345-192.168.201.30@tcp:38:ptlrpcd_rcv.0 Request processed in 20298us (20493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201610.151559:0:23055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:2.0:1788201610.158611:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201610.158727:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201610.158928:0:23366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442782080 00000100:00100000:1.0:1788201610.158949:0:23366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442782080 00000100:00100000:1.0:1788201610.159006:0:23366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442782208 00000100:00100000:1.0:1788201610.159010:0:23366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442782208 00000100:00100000:1.0:1788201610.159062:0:23366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:1.0:1788201610.159073:0:23366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c49f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:2358:x1875064442782080:12345-192.168.201.30@tcp:101:ldlm_lock_repla.0 00000020:02000000:1.0:1788201610.159081:0:23366:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00010000:00080000:1.0:1788201610.159099:0:23366:0:(ldlm_lib.c:3188:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9e04c49f0700 x1875064442782080/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:0/0 lens 328/0 e 0 to 0 dl 1788201621 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201610.159122:0:23366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c49f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:2358:x1875064442782080:12345-192.168.201.30@tcp:101:ldlm_lock_repla.0 Request processed in 51us (521us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201610.159130:0:23055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:0.0:1788201610.159143:0:23055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c49f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:2358:x1875064442782208:12345-192.168.201.30@tcp:101:ldlm_lock_repla.0 00000020:02000000:0.0:1788201610.159148:0:23055:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00010000:00080000:0.0:1788201610.159158:0:23055:0:(ldlm_lib.c:3188:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9e04c49f2680 x1875064442782208/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:0/0 lens 328/0 e 0 to 0 dl 1788201621 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201610.159169:0:23055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c49f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:2358:x1875064442782208:12345-192.168.201.30@tcp:101:ldlm_lock_repla.0 Request processed in 31us (443us total) trans 0 rc 0/-999 00010000:00080000:2.0:1788201610.159199:0:23092:0:(ldlm_lib.c:2283:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788201610.159209:0:23092:0:(ldlm_lib.c:2889:target_recovery_thread()) @@@ processing lock from 192.168.201.30@tcp: req@ffff9e04c49f0700 x1875064442782080/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:0/0 lens 328/0 e 0 to 0 dl 1788201621 ref 2 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:02000000:2.0:1788201610.159220:0:23092:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00010000:00010000:2.0:1788201610.159232:0:23092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201610.159261:0:23092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d620d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x429:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c58eb expref: -99 pid: 23092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201610.159323:0:23092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d620d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x429:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58eb expref: 10 pid: 23092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201610.159359:0:23092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d620d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x429:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58eb expref: 10 pid: 23092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201610.159369:0:23092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c131fa00, rc 0) 00010000:00080000:2.0:1788201610.159420:0:23092:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 55 seconds 00010000:00080000:2.0:1788201610.159424:0:23092:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788201610.159426:0:23092:0:(ldlm_lib.c:2283:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788201610.159431:0:23092:0:(ldlm_lib.c:2889:target_recovery_thread()) @@@ processing lock from 192.168.201.30@tcp: req@ffff9e04c49f2680 x1875064442782208/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:0/0 lens 328/0 e 0 to 0 dl 1788201621 ref 2 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:02000000:2.0:1788201610.159440:0:23092:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00010000:00010000:2.0:1788201610.159446:0:23092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201610.159453:0:23092:0:(ldlm_lockd.c:1319:ldlm_handle_enqueue()) @@@ found existing lock cookie 0x9383f985bc4d61f8 req@ffff9e04c49f2680 x1875064442782208/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:0/0 lens 328/0 e 0 to 0 dl 1788201621 ref 2 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788201610.159467:0:23092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d61f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58e4 expref: 10 pid: 23092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201610.159475:0:23092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bd800, rc 0) 00010000:00080000:2.0:1788201610.159492:0:23092:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 55 seconds 00010000:00080000:2.0:1788201610.159495:0:23092:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00000100:00100000:1.0:1788201610.160005:0:23366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:0.0:1788201610.161041:0:23055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:3.0:1788201610.170739:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201610.171075:0:23463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442782336 00000100:00100000:2.0:1788201610.171086:0:23463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442782336 00000100:00100000:2.0:1788201610.171215:0:23463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:2.0:1788201610.171227:0:23463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:2358:x1875064442782336:12345-192.168.201.30@tcp:400:ptlrpcd_rcv.0 00000020:02000000:2.0:1788201610.171234:0:23463:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=1*** 00010000:02000000:2.0:1788201610.171248:0:23463:0:(ldlm_lib.c:3122:target_queue_recovery_request()) *** cfs_fail_loc=721, val=1*** 00000020:00000400:3.0:1788201610.180532:0:23056:0:(tgt_handler.c:713:process_req_last_xid()) @@@ unexpected xid=6a95c760af780 != exp_last_xid=6a95c760afe7f, rc = -71 req@ffff9e04c49f3100 x1875064442779520/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:0/0 lens 328/0 e 0 to 0 dl 1788201605 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000400:3.0:1788201610.198764:0:23056:0:(service.c:2582:ptlrpc_server_handle_request()) @@@ Request took longer than estimated (11/5s); client may timeout req@ffff9e04c49f3100 x1875064442779520/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:0/0 lens 328/224 e 0 to 0 dl 1788201605 ref 1 fl Complete:/240/0 rc -71/-71 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788201610.214429:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201610.226718:0:23056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c49f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:2358:x1875064442779520:12345-192.168.201.30@tcp:101:ldlm_lock_repla.0 Request processed in 15398092us (15398920us total) trans 0 rc -71/-71 00000100:00100000:3.0:1788201610.226731:0:23056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00010000:00010000:0.0:1788201611.237474:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1788201611.237825:0:23463:0:(ldlm_lib.c:3138:target_queue_recovery_request()) @@@ queue final req req@ffff9e04cffd7b80 x1875064442782336/t0(0) o400->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:0/0 lens 224/0 e 0 to 0 dl 1788201621 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201611.237863:0:23463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2358:x1875064442782336:12345-192.168.201.30@tcp:400:ptlrpcd_rcv.0 Request processed in 1066638us (1067133us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201611.237875:0:23463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00010000:00080000:3.0:1788201611.242122:0:23092:0:(ldlm_lib.c:2286:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1788201611.242543:0:23092:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 6, last_transno is 25769803776 00000001:00080000:1.0:1788201611.329657:0:23092:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:1.0:1788201611.329716:0:23092:0:(ldlm_lib.c:1997:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:1.0:1788201611.329732:0:23092:0:(ldlm_lib.c:2941:target_recovery_thread()) @@@ processing final ping from 192.168.201.30@tcp: req@ffff9e04cffd7b80 x1875064442782336/t0(0) o400->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:0/0 lens 224/0 e 0 to 0 dl 1788201621 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000020:02000000:1.0:1788201611.329745:0:23092:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:02000000:1.0:1788201611.329838:0:23092:0:(ldlm_lib.c:1869:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:16, of 1 clients 1 recovered and 0 were evicted. 00000001:00100000:3.0:1788201611.330062:0:23062:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 35604eb4-baf9-45be-a20a-4883a2cd8cf9 00000100:00100000:3.0:1788201611.340609:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201611.340700:0:23058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442781312 00000100:00100000:2.0:1788201611.340717:0:23058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442781312 00000100:00100000:2.0:1788201611.340774:0:23058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:2.0:1788201611.340783:0:23058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:29575:x1875064442781312:12345-192.168.201.30@tcp:41:lfs.0 00000020:02000000:2.0:1788201611.340790:0:23058:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1788201611.340836:0:23058:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788201611.340926:0:23058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:29575:x1875064442781312:12345-192.168.201.30@tcp:41:lfs.0 Request processed in 144us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201611.340934:0:23058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:0.0:1788201611.354574:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201611.354892:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442782464 00000100:00100000:2.0:1788201611.354902:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442782464 00000100:00100000:2.0:1788201611.355017:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 250 00000100:00100000:2.0:1788201611.355093:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+506:29575:x1875064442782464:12345-192.168.201.30@tcp:13:lfs.0 00000020:02000000:2.0:1788201611.355101:0:6707:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:2.0:1788201611.355136:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1788201611.355217:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+506:29575:x1875064442782464:12345-192.168.201.30@tcp:13:lfs.0 Request processed in 128us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201611.355223:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 250 00000100:00100000:3.0:1788201611.357457:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201611.357553:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442782592 00000100:00100000:0.0:1788201611.357561:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442782592 00000100:00100000:0.0:1788201611.357614:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4392 00000100:00100000:0.0:1788201611.357622:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:2358:x1875064442782592:12345-192.168.201.30@tcp:8:lfs.0 00000020:02000000:0.0:1788201611.357629:0:13448:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:0.0:1788201611.357659:0:13448:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp t0 exp 0000000000000000 cur 886 last 0 00000020:00000080:0.0:1788201611.357687:0:13448:0:(genops.c:1406:class_connect()) connect: client 35604eb4-baf9-45be-a20a-4883a2cd8cf9, cookie 0x9383f985bc4d6214 00002000:00100000:0.0:1788201611.357699:0:13448:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 35604eb4-baf9-45be-a20a-4883a2cd8cf9/ffff9e03c5134800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788201611.357720:0:13448:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 77, return 77 00002000:00080000:0.0:1788201611.357954:0:13448:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788201611.357983:0:13448:0:(import.c:65:import_set_state_nolock()) ffff9e03c5132000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201611.358055:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2358:x1875064442782592:12345-192.168.201.30@tcp:8:lfs.0 Request processed in 431us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201611.358063:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4392 00000100:00100000:0.0:1788201611.363313:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201611.363408:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442782720 00000100:00100000:3.0:1788201611.363418:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442782720 00000100:00100000:3.0:1788201611.363481:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 251 00000100:00100000:3.0:1788201611.363491:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1a70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:29575:x1875064442782720:12345-192.168.201.30@tcp:13:lfs.0 00000020:02000000:3.0:1788201611.363498:0:16084:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1788201611.363522:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 39518208 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201611.363605:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1a70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:29575:x1875064442782720:12345-192.168.201.30@tcp:13:lfs.0 Request processed in 115us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201611.363614:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 251 00000004:00000080:2.0:1788201611.415580:0:23092:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffad6104233e10 00100000:10000000:2.0:1788201611.415596:0:23092:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1788201611.419637:0:23081:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x470:0x0] 00000100:00100000:0.0:1788201611.419688:0:23081:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c56f6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23081:1875064458330880:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788201611.419755:0:23081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201611.419833:0:23081:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1150000 going to sleep for 20 seconds 00000004:00080000:1.0:1788201611.420108:0:23079:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x482:0x0] 00000100:00100000:1.0:1788201611.420130:0:23079:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f9009500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23079:1875064458331008:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788201611.420161:0:23079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201611.420188:0:23079:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c83f6b40 going to sleep for 20 seconds 00000100:00100000:2.0:1788201611.420376:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458330880 00000100:00100000:2.0:1788201611.420385:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458330880 00000100:00100000:2.0:1788201611.420419:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458331008 00000100:00100000:2.0:1788201611.420423:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458331008 00000100:00100000:2.0:1788201611.420445:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4393 00000100:00100000:2.0:1788201611.420454:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:23081:x1875064458330880:12345-0@lo:5:osp-pre-1-0.0 00000020:02000000:2.0:1788201611.420473:0:13440:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:2.0:1788201611.420503:0:13440:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1185 -> diff = -49 00002000:02000040:2.0:1788201611.420507:0:13440:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:1137 to 0x280000400:1185) 00000100:00100000:3.0:1788201611.421246:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4394 00000100:00100000:3.0:1788201611.421258:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f900aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:23079:x1875064458331008:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:3.0:1788201611.421263:0:13445:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:3.0:1788201611.421279:0:13445:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1185 -> diff = -31 00002000:02000040:3.0:1788201611.421283:0:13445:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:1155 to 0x240000400:1185) 00002000:00010000:2.0:1788201611.433624:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.433640:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e749fcab/0x9383f985bc4d621b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.433660:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a1:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.433665:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.433672:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e749fcab/0x9383f985bc4d621b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.433690:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e749fcab/0x9383f985bc4d621b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.433702:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e749fcab/0x9383f985bc4d621b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.433711:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e749fcab/0x9383f985bc4d621b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.433741:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201611.436279:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201611.436314:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e749fcab/0x9383f985bc4d621b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.436329:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131f600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.436335:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e749fcab/0x9383f985bc4d621b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.436348:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e749fcab/0x9383f985bc4d621b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.436369:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e749fcab/0x9383f985bc4d621b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.436384:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e749fcab/0x9383f985bc4d621b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.436409:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.436412:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.436414:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201611.436684:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.436692:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033a0bd08/0x9383f985bc4d6222 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.436705:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a0:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.436710:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.436716:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033a0bd08/0x9383f985bc4d6222 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.436729:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033a0bd08/0x9383f985bc4d6222 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.436739:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033a0bd08/0x9383f985bc4d6222 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.436747:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033a0bd08/0x9383f985bc4d6222 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.436778:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201611.437438:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201611.437445:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033a0bd08/0x9383f985bc4d6222 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.437455:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131e000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.437459:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033a0bd08/0x9383f985bc4d6222 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.437467:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033a0bd08/0x9383f985bc4d6222 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.437479:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033a0bd08/0x9383f985bc4d6222 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.437486:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033a0bd08/0x9383f985bc4d6222 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.437503:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.437505:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.437507:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201611.439521:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x49f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.439532:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000940106f/0x9383f985bc4d6229 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x49f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.439547:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x49f:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.439552:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x49f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.439558:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000940106f/0x9383f985bc4d6229 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.439570:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000940106f/0x9383f985bc4d6229 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.439654:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000940106f/0x9383f985bc4d6229 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.439663:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000940106f/0x9383f985bc4d6229 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.439741:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201611.440256:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x49e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.440262:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab45217d/0x9383f985bc4d6230 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x49e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.440271:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x49e:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.440274:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x49e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.440279:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab45217d/0x9383f985bc4d6230 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.440288:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab45217d/0x9383f985bc4d6230 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.441611:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab45217d/0x9383f985bc4d6230 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.441622:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab45217d/0x9383f985bc4d6230 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.446989:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201611.447012:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000940106f/0x9383f985bc4d6229 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.448001:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131fc00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.448009:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000940106f/0x9383f985bc4d6229 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.448085:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000940106f/0x9383f985bc4d6229 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x49f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.448109:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000940106f/0x9383f985bc4d6229 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x49f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.448117:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000940106f/0x9383f985bc4d6229 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x49f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201611.449040:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201611.449049:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab45217d/0x9383f985bc4d6230 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x49e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201611.449059:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131e200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201611.449063:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab45217d/0x9383f985bc4d6230 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x49e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201611.449072:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab45217d/0x9383f985bc4d6230 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x49e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201611.449086:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab45217d/0x9383f985bc4d6230 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x49e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201611.449096:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201611.449098:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201611.449101:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201611.449286:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201611.449320:0:13440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab45217d/0x9383f985bc4d6230 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x49e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201611.449821:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x49d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.449828:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043faf69f/0x9383f985bc4d6237 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x49d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.449840:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x49d:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.449844:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x49d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.449850:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043faf69f/0x9383f985bc4d6237 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.449862:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043faf69f/0x9383f985bc4d6237 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.449871:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043faf69f/0x9383f985bc4d6237 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.449891:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043faf69f/0x9383f985bc4d6237 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.449914:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201611.450235:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x49c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.450241:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009af5a16c/0x9383f985bc4d623e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x49c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.450249:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x49c:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.450253:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x49c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.450257:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009af5a16c/0x9383f985bc4d623e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.450266:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009af5a16c/0x9383f985bc4d623e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.450274:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009af5a16c/0x9383f985bc4d623e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.450281:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009af5a16c/0x9383f985bc4d623e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.450319:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788201611.450592:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x49b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.450597:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026901fce/0x9383f985bc4d6245 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x49b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.450605:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x49b:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.450608:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x49b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.450612:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026901fce/0x9383f985bc4d6245 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.450621:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026901fce/0x9383f985bc4d6245 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.450634:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026901fce/0x9383f985bc4d6245 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.450641:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026901fce/0x9383f985bc4d6245 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.450648:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788201611.450909:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x49a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.450915:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000655b0fa6/0x9383f985bc4d624c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x49a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.450922:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x49a:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.450925:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x49a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.450930:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000655b0fa6/0x9383f985bc4d624c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.450938:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000655b0fa6/0x9383f985bc4d624c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.450946:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000655b0fa6/0x9383f985bc4d624c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.450953:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000655b0fa6/0x9383f985bc4d624c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.450967:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788201611.451250:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x499:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.451256:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000265086a3/0x9383f985bc4d6253 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x499:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.451264:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x499:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.451268:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x499:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.451271:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000265086a3/0x9383f985bc4d6253 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x499:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.451280:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000265086a3/0x9383f985bc4d6253 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x499:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.451288:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000265086a3/0x9383f985bc4d6253 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x499:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.451321:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000265086a3/0x9383f985bc4d6253 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x499:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.451330:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788201611.451598:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x498:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.451604:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ba119c4/0x9383f985bc4d625a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x498:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.451611:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x498:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.451614:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x498:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.451618:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ba119c4/0x9383f985bc4d625a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x498:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.451626:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ba119c4/0x9383f985bc4d625a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x498:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.451634:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ba119c4/0x9383f985bc4d625a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x498:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.451641:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ba119c4/0x9383f985bc4d625a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x498:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.451648:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1788201611.451912:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x497:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.451917:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a21aad4/0x9383f985bc4d6261 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x497:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.451925:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x497:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.451928:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x497:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.451932:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a21aad4/0x9383f985bc4d6261 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x497:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.451941:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a21aad4/0x9383f985bc4d6261 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x497:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.451948:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a21aad4/0x9383f985bc4d6261 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x497:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.451956:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a21aad4/0x9383f985bc4d6261 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x497:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.451964:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1788201611.452333:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x496:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.452339:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a37ad28c/0x9383f985bc4d6268 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x496:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.452346:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x496:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.452349:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x496:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.452353:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a37ad28c/0x9383f985bc4d6268 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x496:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.452362:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a37ad28c/0x9383f985bc4d6268 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x496:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.452369:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a37ad28c/0x9383f985bc4d6268 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x496:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.452377:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a37ad28c/0x9383f985bc4d6268 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x496:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.452385:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1788201611.452665:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x495:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.452671:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c5f2dbd/0x9383f985bc4d626f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x495:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.452680:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x495:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.452683:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x495:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.452686:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c5f2dbd/0x9383f985bc4d626f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x495:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.452696:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c5f2dbd/0x9383f985bc4d626f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x495:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.452704:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c5f2dbd/0x9383f985bc4d626f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x495:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.452710:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c5f2dbd/0x9383f985bc4d626f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x495:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.452718:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:2.0:1788201611.452986:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x494:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201611.453513:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1788201611.453522:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043faf69f/0x9383f985bc4d6237 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453531:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef0400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.453536:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043faf69f/0x9383f985bc4d6237 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453546:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043faf69f/0x9383f985bc4d6237 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x49d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453563:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043faf69f/0x9383f985bc4d6237 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x49d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453570:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043faf69f/0x9383f985bc4d6237 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x49d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453603:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1788201611.453608:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009af5a16c/0x9383f985bc4d623e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453614:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef1200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.453617:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009af5a16c/0x9383f985bc4d623e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453624:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009af5a16c/0x9383f985bc4d623e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x49c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453634:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009af5a16c/0x9383f985bc4d623e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x49c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453641:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009af5a16c/0x9383f985bc4d623e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x49c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453653:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788201611.453656:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026901fce/0x9383f985bc4d6245 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453663:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef1e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.453666:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026901fce/0x9383f985bc4d6245 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453674:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026901fce/0x9383f985bc4d6245 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x49b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453683:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026901fce/0x9383f985bc4d6245 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x49b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453690:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026901fce/0x9383f985bc4d6245 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x49b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453702:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788201611.453705:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000655b0fa6/0x9383f985bc4d624c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453711:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef0600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.453715:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000655b0fa6/0x9383f985bc4d624c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453722:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000655b0fa6/0x9383f985bc4d624c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x49a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453730:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000655b0fa6/0x9383f985bc4d624c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x49a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453737:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000655b0fa6/0x9383f985bc4d624c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x49a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453749:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788201611.453752:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000265086a3/0x9383f985bc4d6253 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x499:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453758:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef1400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.453761:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000265086a3/0x9383f985bc4d6253 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x499:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453768:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000265086a3/0x9383f985bc4d6253 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x499:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453776:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000265086a3/0x9383f985bc4d6253 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x499:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453783:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000265086a3/0x9383f985bc4d6253 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x499:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453794:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788201611.453798:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ba119c4/0x9383f985bc4d625a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x498:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453804:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef0000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.453807:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ba119c4/0x9383f985bc4d625a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x498:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453814:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ba119c4/0x9383f985bc4d625a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x498:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453822:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ba119c4/0x9383f985bc4d625a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x498:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453829:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ba119c4/0x9383f985bc4d625a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x498:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453839:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201611.453843:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a21aad4/0x9383f985bc4d6261 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x497:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453849:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef1800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.453852:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a21aad4/0x9383f985bc4d6261 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x497:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453859:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a21aad4/0x9383f985bc4d6261 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x497:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453868:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a21aad4/0x9383f985bc4d6261 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x497:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453875:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a21aad4/0x9383f985bc4d6261 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x497:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453886:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201611.453890:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a37ad28c/0x9383f985bc4d6268 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x496:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453896:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef1a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.453900:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a37ad28c/0x9383f985bc4d6268 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x496:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453906:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a37ad28c/0x9383f985bc4d6268 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x496:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453915:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a37ad28c/0x9383f985bc4d6268 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x496:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453921:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a37ad28c/0x9383f985bc4d6268 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x496:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453932:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201611.453935:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c5f2dbd/0x9383f985bc4d626f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x495:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453942:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef0200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.453945:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c5f2dbd/0x9383f985bc4d626f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x495:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453956:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c5f2dbd/0x9383f985bc4d626f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x495:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453964:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c5f2dbd/0x9383f985bc4d626f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x495:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453971:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c5f2dbd/0x9383f985bc4d626f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x495:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.453982:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.453984:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.453986:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201611.454214:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201611.454241:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201611.471266:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a8acf4d/0x9383f985bc4d6276 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x494:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.471410:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x494:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.471416:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x494:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.471424:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a8acf4d/0x9383f985bc4d6276 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x494:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.471441:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a8acf4d/0x9383f985bc4d6276 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x494:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.471458:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a8acf4d/0x9383f985bc4d6276 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x494:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.471466:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a8acf4d/0x9383f985bc4d6276 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x494:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.471499:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201611.471706:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201611.471714:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a8acf4d/0x9383f985bc4d6276 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x494:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.471723:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c36e7400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.471727:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a8acf4d/0x9383f985bc4d6276 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x494:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.471737:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a8acf4d/0x9383f985bc4d6276 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x494:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.471753:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a8acf4d/0x9383f985bc4d6276 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x494:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.471766:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a8acf4d/0x9383f985bc4d6276 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x494:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.471792:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.471794:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.471796:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201611.473857:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x493:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.473869:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b64a507/0x9383f985bc4d627d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x493:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.473954:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x493:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.473959:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x493:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.473964:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b64a507/0x9383f985bc4d627d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x493:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.473978:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b64a507/0x9383f985bc4d627d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x493:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.473987:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b64a507/0x9383f985bc4d627d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x493:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.474004:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b64a507/0x9383f985bc4d627d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x493:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.475121:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201611.476119:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201611.476128:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b64a507/0x9383f985bc4d627d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x493:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201611.476141:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c36e7600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201611.476147:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b64a507/0x9383f985bc4d627d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x493:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201611.476157:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b64a507/0x9383f985bc4d627d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x493:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201611.476190:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b64a507/0x9383f985bc4d627d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x493:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201611.476200:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b64a507/0x9383f985bc4d627d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x493:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201611.476221:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201611.476223:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201611.476225:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201611.476573:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201611.479457:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d6284 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.479476:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4a1:0x0].0x0 since=886s v=(0 0) 00010000:00010000:3.0:1788201611.479481:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4a1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201611.479488:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d6284 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.479502:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d6284 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.479512:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d6284 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.479520:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d6284 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201611.479930:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x492:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.479936:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ae24c56/0x9383f985bc4d628b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x492:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.479945:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x492:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.479949:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x492:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.479953:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ae24c56/0x9383f985bc4d628b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x492:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.479963:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ae24c56/0x9383f985bc4d628b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x492:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.479971:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ae24c56/0x9383f985bc4d628b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x492:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.479979:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ae24c56/0x9383f985bc4d628b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x492:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.481711:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788201611.485093:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00002000:00010000:3.0:1788201611.485101:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201611.485106:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d6284 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.485110:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d6292 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.485120:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.485125:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d6284 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.485129:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4a0:0x0].0x0 since=886s v=(0 0) 00010000:00010000:3.0:1788201611.485134:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4a0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201611.485136:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d6284 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.485140:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d6292 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.485152:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d6292 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.485154:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d6284 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.485161:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d6292 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.485162:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d6284 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.485170:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d6292 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.485200:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788201611.485210:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201611.485215:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ae24c56/0x9383f985bc4d628b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x492:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.485223:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c36e7000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.485226:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ae24c56/0x9383f985bc4d628b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x492:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.485233:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ae24c56/0x9383f985bc4d628b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x492:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.485244:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ae24c56/0x9383f985bc4d628b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x492:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.485251:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201611.485254:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d6292 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.485260:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bce00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.485263:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d6292 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.485269:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d6292 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.485277:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d6292 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.485283:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d6292 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.485311:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.485314:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.485316:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.486760:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.486766:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.486769:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201611.488051:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201611.488064:0:13440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ae24c56/0x9383f985bc4d628b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x492:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.488118:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201611.488496:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x49f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201611.488504:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a3bf8dd/0x9383f985bc4d6299 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x49f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.488518:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x49f:0x0].0x0 since=886s v=(0 0) 00010000:00010000:3.0:1788201611.488522:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x49f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201611.488528:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a3bf8dd/0x9383f985bc4d6299 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x49f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.488540:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a3bf8dd/0x9383f985bc4d6299 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x49f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201611.488553:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x491:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201611.488555:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a3bf8dd/0x9383f985bc4d6299 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x49f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.488558:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8ff04cb/0x9383f985bc4d62a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x491:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.488563:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a3bf8dd/0x9383f985bc4d6299 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x49f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.488565:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x491:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.488568:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x491:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.488572:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8ff04cb/0x9383f985bc4d62a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x491:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.488581:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8ff04cb/0x9383f985bc4d62a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x491:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.488589:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8ff04cb/0x9383f985bc4d62a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x491:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.488595:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201611.488596:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8ff04cb/0x9383f985bc4d62a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x491:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.488608:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788201611.488865:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x490:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00002000:00010000:3.0:1788201611.488865:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x49e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.488872:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004862939e/0x9383f985bc4d62a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x490:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.488872:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d62ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x49e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.488880:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x490:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.488883:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x490:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.488887:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004862939e/0x9383f985bc4d62a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x490:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.488893:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x49e:0x0].0x0 since=886s v=(0 0) 00010000:00010000:3.0:1788201611.488895:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x49e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.488897:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004862939e/0x9383f985bc4d62a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x490:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.488899:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d62ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x49e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.488908:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d62ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x49e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.488910:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004862939e/0x9383f985bc4d62a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x490:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.488916:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d62ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x49e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.488918:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004862939e/0x9383f985bc4d62a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x490:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.488924:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d62ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x49e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.488934:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788201611.488936:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1788201611.488943:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788201611.488949:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a3bf8dd/0x9383f985bc4d6299 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x49f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.488957:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bda00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201611.488961:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a3bf8dd/0x9383f985bc4d6299 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x49f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.488970:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a3bf8dd/0x9383f985bc4d6299 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x49f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.488984:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a3bf8dd/0x9383f985bc4d6299 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x49f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.489121:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201611.489128:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8ff04cb/0x9383f985bc4d62a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x491:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.489136:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c36e7a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.489139:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8ff04cb/0x9383f985bc4d62a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x491:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.489147:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8ff04cb/0x9383f985bc4d62a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x491:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.489158:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8ff04cb/0x9383f985bc4d62a0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x491:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.489165:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8ff04cb/0x9383f985bc4d62a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x491:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.489180:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201611.489183:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004862939e/0x9383f985bc4d62a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x490:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.489190:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c36e7e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.489194:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004862939e/0x9383f985bc4d62a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x490:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.489201:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004862939e/0x9383f985bc4d62a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x490:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.489210:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004862939e/0x9383f985bc4d62a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x490:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.489217:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004862939e/0x9383f985bc4d62a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x490:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.489227:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201611.489231:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d62ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x49e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.489237:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.489240:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d62ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x49e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.489248:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d62ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x49e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.489257:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d62ae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x49e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.489265:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000566e57bc/0x9383f985bc4d62ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x49e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.489277:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.489279:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.489281:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.489287:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201611.490113:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a3bf8dd/0x9383f985bc4d6299 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x49f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.490135:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201611.490137:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201611.490140:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201611.490989:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x48f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.491184:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc669414/0x9383f985bc4d62b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x48f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.491196:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x48f:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.491200:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x48f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.491205:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc669414/0x9383f985bc4d62b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x48f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.491217:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc669414/0x9383f985bc4d62b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x48f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.491227:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc669414/0x9383f985bc4d62b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x48f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.491234:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc669414/0x9383f985bc4d62b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x48f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.491948:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201611.491989:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201611.492006:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc669414/0x9383f985bc4d62b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x48f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.492015:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c36e6e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.492027:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc669414/0x9383f985bc4d62b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x48f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.492036:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc669414/0x9383f985bc4d62b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x48f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.492051:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc669414/0x9383f985bc4d62b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x48f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.492058:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc669414/0x9383f985bc4d62b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x48f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.492076:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.492078:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.492080:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201611.492475:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x48e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.492482:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af8460ee/0x9383f985bc4d62bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x48e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201611.492489:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x49d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.492491:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x48e:0x0].0x0 since=886s v=(0 0) 00010000:00010000:3.0:1788201611.492494:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002c7609e/0x9383f985bc4d62c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x49d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.492495:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x48e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.492500:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af8460ee/0x9383f985bc4d62bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x48e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.492501:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x49d:0x0].0x0 since=886s v=(0 0) 00010000:00010000:3.0:1788201611.492505:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x49d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201611.492508:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002c7609e/0x9383f985bc4d62c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x49d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.492511:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af8460ee/0x9383f985bc4d62bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x48e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.492517:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002c7609e/0x9383f985bc4d62c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x49d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.492519:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af8460ee/0x9383f985bc4d62bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x48e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.492526:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002c7609e/0x9383f985bc4d62c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x49d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.492527:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af8460ee/0x9383f985bc4d62bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x48e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.492533:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002c7609e/0x9383f985bc4d62c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x49d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.492548:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788201611.492558:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788201611.492564:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201611.492568:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af8460ee/0x9383f985bc4d62bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x48e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.492576:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c36e6200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201611.492579:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af8460ee/0x9383f985bc4d62bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x48e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.492587:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af8460ee/0x9383f985bc4d62bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x48e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.492597:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af8460ee/0x9383f985bc4d62bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x48e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.492603:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af8460ee/0x9383f985bc4d62bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x48e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.492615:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201611.492619:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002c7609e/0x9383f985bc4d62c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x49d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.492624:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201611.492627:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002c7609e/0x9383f985bc4d62c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x49d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.492633:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002c7609e/0x9383f985bc4d62c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x49d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.492642:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002c7609e/0x9383f985bc4d62c3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x49d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.492650:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002c7609e/0x9383f985bc4d62c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x49d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.492663:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201611.492664:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201611.492665:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201611.492822:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x49c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201611.492827:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d62ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x49c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.492836:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x49c:0x0].0x0 since=886s v=(0 0) 00010000:00010000:3.0:1788201611.492839:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x49c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201611.492843:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d62ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x49c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.492852:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d62ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x49c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.492860:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d62ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x49c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.492867:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d62ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x49c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201611.492926:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x48d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.492932:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca754662/0x9383f985bc4d62d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x48d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.492941:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x48d:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.492944:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x48d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.492948:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca754662/0x9383f985bc4d62d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x48d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.492957:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca754662/0x9383f985bc4d62d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x48d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.492960:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201611.492965:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca754662/0x9383f985bc4d62d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x48d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.492971:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca754662/0x9383f985bc4d62d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x48d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.492999:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201611.493317:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201611.493332:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca754662/0x9383f985bc4d62d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x48d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.493340:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c36e7c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.493344:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca754662/0x9383f985bc4d62d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x48d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.493352:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca754662/0x9383f985bc4d62d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x48d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.493363:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca754662/0x9383f985bc4d62d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x48d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.493371:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca754662/0x9383f985bc4d62d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x48d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201611.493382:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x48c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201611.493385:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.493387:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201611.493388:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b99cfb8/0x9383f985bc4d62d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x48c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.493389:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201611.493395:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x48c:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.493398:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x48c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.493402:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b99cfb8/0x9383f985bc4d62d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x48c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.493411:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b99cfb8/0x9383f985bc4d62d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x48c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.493419:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b99cfb8/0x9383f985bc4d62d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x48c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.493426:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b99cfb8/0x9383f985bc4d62d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x48c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.493622:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201611.493895:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x48b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.493900:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052b12998/0x9383f985bc4d62df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x48b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.493908:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x48b:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.493911:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x48b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.493915:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052b12998/0x9383f985bc4d62df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x48b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.493923:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052b12998/0x9383f985bc4d62df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x48b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.493931:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052b12998/0x9383f985bc4d62df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x48b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.493938:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052b12998/0x9383f985bc4d62df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x48b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.496930:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201611.496945:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b99cfb8/0x9383f985bc4d62d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x48c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.496960:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c36e6600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.496966:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b99cfb8/0x9383f985bc4d62d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x48c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.496977:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b99cfb8/0x9383f985bc4d62d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x48c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.497011:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b99cfb8/0x9383f985bc4d62d8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x48c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.497020:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b99cfb8/0x9383f985bc4d62d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x48c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.497046:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201611.497061:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d62ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x49c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.497069:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.497072:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d62ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x49c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.497080:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d62ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x49c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.497092:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d62ca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x49c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.497100:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201611.497104:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052b12998/0x9383f985bc4d62df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x48b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.497111:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c36e6c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.497114:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052b12998/0x9383f985bc4d62df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x48b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.497121:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052b12998/0x9383f985bc4d62df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x48b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.497131:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052b12998/0x9383f985bc4d62df lrc: 2/0,0 mode: --/PW res: [0x280000400:0x48b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.498946:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.498948:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.498952:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201611.503473:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201611.503491:0:13440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052b12998/0x9383f985bc4d62df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x48b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201611.504110:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x48a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.504118:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000643c6252/0x9383f985bc4d62e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x48a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.504132:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x48a:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.504137:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x48a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.504143:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000643c6252/0x9383f985bc4d62e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x48a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.504157:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000643c6252/0x9383f985bc4d62e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x48a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.504166:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000643c6252/0x9383f985bc4d62e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x48a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.504173:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000643c6252/0x9383f985bc4d62e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x48a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.504193:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201611.504204:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201611.504210:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000643c6252/0x9383f985bc4d62e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x48a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.504218:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c36e6800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201611.504222:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000643c6252/0x9383f985bc4d62e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x48a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.504232:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000643c6252/0x9383f985bc4d62e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x48a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.504248:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000643c6252/0x9383f985bc4d62e6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x48a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.504256:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000643c6252/0x9383f985bc4d62e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x48a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.504268:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201611.504270:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201611.504272:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201611.504651:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x489:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.504657:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067773a5a/0x9383f985bc4d62ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x489:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.504666:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x489:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.504669:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x489:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.504673:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067773a5a/0x9383f985bc4d62ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x489:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.504682:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067773a5a/0x9383f985bc4d62ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x489:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.504690:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067773a5a/0x9383f985bc4d62ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x489:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.504698:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067773a5a/0x9383f985bc4d62ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x489:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.504711:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201611.504717:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201611.504720:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067773a5a/0x9383f985bc4d62ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x489:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.504727:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c36e7200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201611.504731:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067773a5a/0x9383f985bc4d62ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x489:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.504739:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067773a5a/0x9383f985bc4d62ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x489:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.504750:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067773a5a/0x9383f985bc4d62ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x489:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.504756:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067773a5a/0x9383f985bc4d62ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x489:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.504770:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201611.504772:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201611.504774:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201611.505081:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x488:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.505087:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b55b6d7/0x9383f985bc4d62f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x488:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.505096:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x488:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.505099:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x488:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.505103:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b55b6d7/0x9383f985bc4d62f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x488:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.505112:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b55b6d7/0x9383f985bc4d62f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x488:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.505120:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b55b6d7/0x9383f985bc4d62f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x488:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.505126:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b55b6d7/0x9383f985bc4d62f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x488:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.505140:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201611.505147:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201611.505150:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b55b6d7/0x9383f985bc4d62f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x488:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.505156:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c7ea6200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201611.505160:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b55b6d7/0x9383f985bc4d62f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x488:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.505167:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b55b6d7/0x9383f985bc4d62f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x488:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.505177:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b55b6d7/0x9383f985bc4d62f4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x488:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.505184:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b55b6d7/0x9383f985bc4d62f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x488:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.505197:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201611.505199:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201611.505201:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201611.505535:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x487:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.505542:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c77ce88/0x9383f985bc4d62fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x487:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.505550:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x487:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.505552:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x487:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.505556:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c77ce88/0x9383f985bc4d62fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x487:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.505566:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c77ce88/0x9383f985bc4d62fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x487:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.505573:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c77ce88/0x9383f985bc4d62fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x487:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.505580:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c77ce88/0x9383f985bc4d62fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x487:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.505599:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201611.505606:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201611.505610:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c77ce88/0x9383f985bc4d62fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x487:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.505617:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c7ea6a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201611.505620:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c77ce88/0x9383f985bc4d62fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x487:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.505627:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c77ce88/0x9383f985bc4d62fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x487:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.505637:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c77ce88/0x9383f985bc4d62fb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x487:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.505644:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c77ce88/0x9383f985bc4d62fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x487:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.505654:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201611.505656:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201611.505657:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201611.505943:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x486:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.505949:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005390407a/0x9383f985bc4d6302 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x486:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.505958:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x486:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.505961:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x486:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.505965:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005390407a/0x9383f985bc4d6302 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x486:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.505974:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005390407a/0x9383f985bc4d6302 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x486:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.505981:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005390407a/0x9383f985bc4d6302 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x486:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.505989:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005390407a/0x9383f985bc4d6302 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x486:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.506017:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201611.506025:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201611.506028:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005390407a/0x9383f985bc4d6302 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x486:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.506035:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c7ea7400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201611.506039:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005390407a/0x9383f985bc4d6302 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x486:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.506046:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005390407a/0x9383f985bc4d6302 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x486:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.506056:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005390407a/0x9383f985bc4d6302 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x486:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.506068:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005390407a/0x9383f985bc4d6302 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x486:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.506081:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201611.506083:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201611.506084:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201611.506382:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x485:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.506388:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000077c8f94/0x9383f985bc4d6309 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x485:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.506397:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x485:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.506400:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x485:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.506404:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000077c8f94/0x9383f985bc4d6309 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x485:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.506412:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000077c8f94/0x9383f985bc4d6309 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x485:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.506419:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000077c8f94/0x9383f985bc4d6309 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x485:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.506426:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000077c8f94/0x9383f985bc4d6309 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x485:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.507394:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201611.514832:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201611.516864:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788201611.516884:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053e3adb2/0x9383f985bc4d62ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x49c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.518988:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201611.520000:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x49b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201611.520010:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e08abbd/0x9383f985bc4d6310 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x49b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.520027:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x49b:0x0].0x0 since=886s v=(0 0) 00010000:00010000:3.0:1788201611.520036:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x49b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201611.520042:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e08abbd/0x9383f985bc4d6310 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x49b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.520056:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e08abbd/0x9383f985bc4d6310 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x49b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.520066:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e08abbd/0x9383f985bc4d6310 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x49b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.520075:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e08abbd/0x9383f985bc4d6310 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x49b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201611.520211:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x484:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.520218:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e93ab620/0x9383f985bc4d6317 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x484:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.520226:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x484:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.520229:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x484:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.520233:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e93ab620/0x9383f985bc4d6317 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x484:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.520256:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e93ab620/0x9383f985bc4d6317 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x484:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.520265:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e93ab620/0x9383f985bc4d6317 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x484:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.520272:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e93ab620/0x9383f985bc4d6317 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x484:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201611.522171:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788201611.522272:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201611.522282:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000077c8f94/0x9383f985bc4d6309 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x485:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.522313:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c7ea6800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.522319:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000077c8f94/0x9383f985bc4d6309 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x485:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.522329:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000077c8f94/0x9383f985bc4d6309 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x485:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.522354:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000077c8f94/0x9383f985bc4d6309 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x485:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.522362:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000077c8f94/0x9383f985bc4d6309 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x485:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.522383:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201611.522387:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e08abbd/0x9383f985bc4d6310 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x49b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.522394:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.522398:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e08abbd/0x9383f985bc4d6310 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x49b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.522405:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e08abbd/0x9383f985bc4d6310 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x49b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.522417:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e08abbd/0x9383f985bc4d6310 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x49b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.522425:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e08abbd/0x9383f985bc4d6310 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x49b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.522441:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201611.522445:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e93ab620/0x9383f985bc4d6317 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x484:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.522452:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c7ea6e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.522455:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e93ab620/0x9383f985bc4d6317 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x484:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.522463:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e93ab620/0x9383f985bc4d6317 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x484:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.522473:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e93ab620/0x9383f985bc4d6317 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x484:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.522480:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.522482:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.522484:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201611.522545:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201611.522561:0:13440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e93ab620/0x9383f985bc4d6317 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x484:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201611.523042:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x483:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.523050:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8f6c847/0x9383f985bc4d631e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x483:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.523059:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x483:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.523064:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x483:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.523069:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8f6c847/0x9383f985bc4d631e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x483:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.523080:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8f6c847/0x9383f985bc4d631e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x483:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.523088:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8f6c847/0x9383f985bc4d631e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x483:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.523096:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8f6c847/0x9383f985bc4d631e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x483:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.523108:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201611.523414:0:13440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x482:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.523420:0:13440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bfaa0f6/0x9383f985bc4d6325 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x482:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.523428:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x482:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.523432:0:13440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x482:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.523436:0:13440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bfaa0f6/0x9383f985bc4d6325 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x482:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.523445:0:13440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bfaa0f6/0x9383f985bc4d6325 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x482:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.523453:0:13440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bfaa0f6/0x9383f985bc4d6325 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x482:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.523461:0:13440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bfaa0f6/0x9383f985bc4d6325 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x482:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.523475:0:13440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788201611.524203:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201611.524211:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8f6c847/0x9383f985bc4d631e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x483:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.524220:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c7ea7e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.524225:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8f6c847/0x9383f985bc4d631e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x483:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.524234:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8f6c847/0x9383f985bc4d631e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x483:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.524249:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8f6c847/0x9383f985bc4d631e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x483:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.524256:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8f6c847/0x9383f985bc4d631e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x483:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.524276:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201611.524280:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bfaa0f6/0x9383f985bc4d6325 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x482:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.524286:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c7ea6600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.524289:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bfaa0f6/0x9383f985bc4d6325 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x482:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.524311:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bfaa0f6/0x9383f985bc4d6325 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x482:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.524332:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bfaa0f6/0x9383f985bc4d6325 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x482:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.524340:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bfaa0f6/0x9383f985bc4d6325 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x482:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.524353:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.524355:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.524357:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.524364:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788201611.524938:0:13440:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:1136 00000100:00100000:2.0:1788201611.525053:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:23081:x1875064458330880:12345-0@lo:5:osp-pre-1-0.0 Request processed in 104596us (105293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201611.525063:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4393 00000100:00100000:1.0:1788201611.525262:0:23081:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c56f6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23081:1875064458330880:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788201611.525277:0:23081:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x4a1:0x0] from OST, last_created [0x280000400:0x4a1:0x0]last_used is [0x280000400:0x470:0x0] 00000100:00100000:1.0:1788201611.525369:0:23081:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f9008a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23081:1875064458331264:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788201611.525406:0:23081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201611.525447:0:23081:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d8073780 going to sleep for 20 seconds 00000100:00100000:1.0:1788201611.525464:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458331264 00000100:00100000:1.0:1788201611.525470:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458331264 00000100:00100000:1.0:1788201611.525505:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4395 00000100:00100000:1.0:1788201611.525513:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f900b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:23081:x1875064458331264:12345-0@lo:5:osp-pre-1-0.0 00000020:02000000:1.0:1788201611.525519:0:13438:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:1.0:1788201611.525554:0:13438:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1186 00000100:00100000:1.0:1788201611.527752:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f900b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:23081:x1875064458331264:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2234us (2341us total) trans 4294968894 rc 0/0 00000100:00100000:1.0:1788201611.527763:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4395 00000100:00100000:1.0:1788201611.527869:0:23081:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f9008a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23081:1875064458331264:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788201611.527881:0:23081:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x4a1:0x0]-[0x280000400:0x4c1:0x0] 00000100:00100000:2.0:1788201611.528217:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f9008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458331136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201611.528258:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201611.528394:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201611.528401:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201611.531780:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x49a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.531794:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f007e4c/0x9383f985bc4d632c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x49a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.531812:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x49a:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.531817:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x49a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.531823:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f007e4c/0x9383f985bc4d632c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x49a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.531837:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f007e4c/0x9383f985bc4d632c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x49a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.531848:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f007e4c/0x9383f985bc4d632c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x49a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.531861:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f007e4c/0x9383f985bc4d632c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x49a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.531925:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201611.532262:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x499:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.532268:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f7e3645/0x9383f985bc4d6333 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x499:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.532276:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x499:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.532280:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x499:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.532284:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f7e3645/0x9383f985bc4d6333 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x499:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.532311:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f7e3645/0x9383f985bc4d6333 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x499:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.532320:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f7e3645/0x9383f985bc4d6333 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x499:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.532328:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f7e3645/0x9383f985bc4d6333 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x499:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201611.532434:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201611.532443:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f007e4c/0x9383f985bc4d632c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x49a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201611.532456:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c7ea7800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201611.532460:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f007e4c/0x9383f985bc4d632c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x49a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201611.532468:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f007e4c/0x9383f985bc4d632c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x49a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201611.532484:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f007e4c/0x9383f985bc4d632c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x49a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201611.532491:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f007e4c/0x9383f985bc4d632c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x49a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201611.532507:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201611.532510:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f7e3645/0x9383f985bc4d6333 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x499:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201611.532516:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c7ea7c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201611.532519:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f7e3645/0x9383f985bc4d6333 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x499:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201611.532525:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f7e3645/0x9383f985bc4d6333 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x499:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201611.532533:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f7e3645/0x9383f985bc4d6333 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x499:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201611.532540:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201611.532542:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201611.532543:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201611.533939:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458331136 00000100:00100000:1.0:1788201611.533951:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458331136 00010000:00010000:2.0:1788201611.536277:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201611.536303:0:13445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f7e3645/0x9383f985bc4d6333 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x499:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201611.536824:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x498:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201611.536833:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b887fc4/0x9383f985bc4d633a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x498:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.536845:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x498:0x0].0x0 since=886s v=(0 0) 00010000:00010000:2.0:1788201611.536850:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x498:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201611.536855:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b887fc4/0x9383f985bc4d633a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x498:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.536870:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b887fc4/0x9383f985bc4d633a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x498:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.536879:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b887fc4/0x9383f985bc4d633a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x498:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.536886:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b887fc4/0x9383f985bc4d633a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x498:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201611.536984:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788201611.537009:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c49f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875064458331136:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:1.0:1788201611.537017:0:6707:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1788201611.537043:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 39387136 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201611.537155:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c49f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875064458331136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (8896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201611.537163:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788201611.537374:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f9008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458331136:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788201611.539842:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201611.541986:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201611.542011:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b887fc4/0x9383f985bc4d633a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x498:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.542026:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c7ea6000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.542031:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b887fc4/0x9383f985bc4d633a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x498:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.542043:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b887fc4/0x9383f985bc4d633a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x498:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.542065:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b887fc4/0x9383f985bc4d633a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x498:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.542072:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b887fc4/0x9383f985bc4d633a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x498:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.542100:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.542102:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.542104:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201611.542691:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x497:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201611.542699:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0d4f162/0x9383f985bc4d6341 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x497:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.542711:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x497:0x0].0x0 since=886s v=(0 0) 00010000:00010000:1.0:1788201611.543052:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x497:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201611.543061:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0d4f162/0x9383f985bc4d6341 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x497:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.543080:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0d4f162/0x9383f985bc4d6341 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x497:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.543090:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0d4f162/0x9383f985bc4d6341 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x497:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.543097:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0d4f162/0x9383f985bc4d6341 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x497:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.543122:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201611.543428:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x496:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201611.543434:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000927e33d1/0x9383f985bc4d6348 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x496:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.543442:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x496:0x0].0x0 since=886s v=(0 0) 00010000:00010000:1.0:1788201611.543445:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x496:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201611.543449:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000927e33d1/0x9383f985bc4d6348 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x496:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.543458:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000927e33d1/0x9383f985bc4d6348 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x496:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.543466:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000927e33d1/0x9383f985bc4d6348 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x496:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.543479:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000927e33d1/0x9383f985bc4d6348 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x496:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.543488:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788201611.543770:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x495:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201611.543776:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d634f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x495:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.543784:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x495:0x0].0x0 since=886s v=(0 0) 00010000:00010000:1.0:1788201611.543787:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x495:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201611.543791:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d634f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x495:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.543800:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d634f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x495:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.543808:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d634f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x495:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.543816:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d634f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x495:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.543834:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788201611.543849:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201611.543855:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0d4f162/0x9383f985bc4d6341 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x497:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.543865:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507da00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.543869:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0d4f162/0x9383f985bc4d6341 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x497:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.543877:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0d4f162/0x9383f985bc4d6341 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x497:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.543890:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0d4f162/0x9383f985bc4d6341 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x497:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.543897:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0d4f162/0x9383f985bc4d6341 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x497:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.543913:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201611.543916:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000927e33d1/0x9383f985bc4d6348 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x496:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.543923:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.543926:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000927e33d1/0x9383f985bc4d6348 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x496:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.543933:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000927e33d1/0x9383f985bc4d6348 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x496:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.543941:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000927e33d1/0x9383f985bc4d6348 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x496:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.543949:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000927e33d1/0x9383f985bc4d6348 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x496:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.543958:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201611.543960:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d634f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x495:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.543966:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507cc00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.543969:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d634f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x495:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.543975:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d634f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x495:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.543983:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d634f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x495:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.544001:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3bc9e08/0x9383f985bc4d634f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x495:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.544011:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.544013:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.544015:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201611.544283:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x494:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201611.544288:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee9d20ef/0x9383f985bc4d6356 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x494:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.544317:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x494:0x0].0x0 since=886s v=(0 0) 00010000:00010000:1.0:1788201611.544320:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x494:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201611.544325:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee9d20ef/0x9383f985bc4d6356 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x494:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.544334:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee9d20ef/0x9383f985bc4d6356 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x494:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.544342:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee9d20ef/0x9383f985bc4d6356 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x494:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.544350:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee9d20ef/0x9383f985bc4d6356 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x494:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.544361:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201611.544381:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201611.544384:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee9d20ef/0x9383f985bc4d6356 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x494:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.544390:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.544393:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee9d20ef/0x9383f985bc4d6356 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x494:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.544400:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee9d20ef/0x9383f985bc4d6356 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x494:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.544415:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee9d20ef/0x9383f985bc4d6356 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x494:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.544422:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee9d20ef/0x9383f985bc4d6356 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x494:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.544434:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.544435:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.544437:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201611.544695:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x493:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201611.544700:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d635d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x493:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.544709:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x493:0x0].0x0 since=886s v=(0 0) 00010000:00010000:1.0:1788201611.544712:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x493:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201611.544716:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d635d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x493:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.544725:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d635d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x493:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.544732:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d635d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x493:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.544740:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d635d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x493:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.544757:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201611.544763:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201611.544767:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d635d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x493:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.544773:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.544777:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d635d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x493:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.544783:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d635d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x493:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.544792:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d635d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x493:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.544799:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e97511ea/0x9383f985bc4d635d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x493:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.544811:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.544812:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.544814:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201611.545106:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x492:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201611.545112:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d6364 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x492:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.545119:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x492:0x0].0x0 since=886s v=(0 0) 00010000:00010000:1.0:1788201611.545123:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x492:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201611.545127:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d6364 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x492:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.545136:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d6364 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x492:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.545143:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d6364 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x492:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.545150:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d6364 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x492:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.545163:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201611.545171:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201611.545174:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d6364 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x492:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.545181:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507c600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.545184:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d6364 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x492:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.545191:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d6364 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x492:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.545201:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d6364 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x492:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.545213:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000382589/0x9383f985bc4d6364 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x492:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.545225:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.545227:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.545228:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201611.545538:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x491:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201611.545543:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d636b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x491:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.545551:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x491:0x0].0x0 since=886s v=(0 0) 00010000:00010000:1.0:1788201611.545554:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x491:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201611.545558:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d636b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x491:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.545567:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d636b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x491:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.545575:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d636b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x491:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.545583:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d636b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x491:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.545596:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201611.545604:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201611.545608:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d636b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x491:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.545615:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507ce00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.545618:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d636b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x491:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.545626:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d636b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x491:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.545636:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d636b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x491:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.545643:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b34924a/0x9383f985bc4d636b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x491:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.545655:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.545657:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.545658:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201611.545971:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x490:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201611.545977:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d6372 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x490:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.545985:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x490:0x0].0x0 since=886s v=(0 0) 00010000:00010000:1.0:1788201611.545988:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x490:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201611.546550:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d6372 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x490:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.546568:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d6372 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x490:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.546577:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d6372 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x490:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.546585:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d6372 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x490:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.546603:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201611.546613:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201611.546618:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d6372 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x490:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.546625:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507d600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.546629:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d6372 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x490:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.546637:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d6372 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x490:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.546648:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d6372 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x490:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.546654:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056e17fb0/0x9383f985bc4d6372 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x490:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.546671:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.546673:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.546675:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201611.547052:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x48f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201611.547057:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d6379 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x48f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.547066:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x48f:0x0].0x0 since=886s v=(0 0) 00010000:00010000:1.0:1788201611.547069:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x48f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201611.547073:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d6379 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x48f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.547082:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d6379 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x48f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.547089:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d6379 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x48f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.547096:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d6379 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x48f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.547109:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201611.547117:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201611.547121:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d6379 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x48f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.547132:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507c800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.547627:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d6379 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x48f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.547637:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d6379 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x48f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.547649:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d6379 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x48f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.547657:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d43c356/0x9383f985bc4d6379 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x48f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.547673:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.547675:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.547676:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201611.548068:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x48e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201611.548075:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008baee9f0/0x9383f985bc4d6380 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x48e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.548084:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x48e:0x0].0x0 since=886s v=(0 0) 00010000:00010000:1.0:1788201611.548087:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x48e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201611.548091:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008baee9f0/0x9383f985bc4d6380 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x48e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.548101:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008baee9f0/0x9383f985bc4d6380 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x48e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.548109:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008baee9f0/0x9383f985bc4d6380 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x48e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.548116:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008baee9f0/0x9383f985bc4d6380 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x48e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.548132:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201611.548216:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201611.548221:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008baee9f0/0x9383f985bc4d6380 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x48e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.548228:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c507c200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.548232:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008baee9f0/0x9383f985bc4d6380 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x48e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.548240:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008baee9f0/0x9383f985bc4d6380 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x48e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.548251:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008baee9f0/0x9383f985bc4d6380 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x48e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.548258:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008baee9f0/0x9383f985bc4d6380 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x48e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.548272:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.548274:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.548276:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201611.548576:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x48d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201611.548582:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d6387 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x48d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.548591:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x48d:0x0].0x0 since=886s v=(0 0) 00010000:00010000:1.0:1788201611.548594:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x48d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201611.548598:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d6387 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x48d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.548607:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d6387 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x48d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.548615:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d6387 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x48d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.548622:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d6387 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x48d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.548637:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201611.548645:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201611.548649:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d6387 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x48d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.548656:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bce00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.548659:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d6387 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x48d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.548672:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d6387 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x48d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.548682:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d6387 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x48d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.548689:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d887faf/0x9383f985bc4d6387 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x48d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.548701:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.548703:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.548704:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201611.549516:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x48c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201611.549523:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d638e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x48c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.549532:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x48c:0x0].0x0 since=886s v=(0 0) 00010000:00010000:1.0:1788201611.549536:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x48c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201611.549540:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d638e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x48c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.549549:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d638e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x48c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.549557:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d638e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x48c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.549565:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d638e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x48c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.549580:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201611.549589:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201611.549592:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d638e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x48c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.549600:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.549603:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d638e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x48c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.549611:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d638e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x48c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.549622:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d638e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x48c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.549629:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abb16771/0x9383f985bc4d638e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x48c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.549643:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.549645:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.549646:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201611.550095:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x48b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201611.550102:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c5f2dbd/0x9383f985bc4d6395 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x48b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.550110:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x48b:0x0].0x0 since=886s v=(0 0) 00010000:00010000:1.0:1788201611.550114:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x48b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201611.550117:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c5f2dbd/0x9383f985bc4d6395 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x48b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.550126:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c5f2dbd/0x9383f985bc4d6395 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x48b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.550134:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c5f2dbd/0x9383f985bc4d6395 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x48b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.550211:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c5f2dbd/0x9383f985bc4d6395 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x48b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.550226:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201611.550234:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201611.550237:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c5f2dbd/0x9383f985bc4d6395 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x48b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.550243:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef0200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.550246:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c5f2dbd/0x9383f985bc4d6395 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x48b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.550253:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c5f2dbd/0x9383f985bc4d6395 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x48b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.550264:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c5f2dbd/0x9383f985bc4d6395 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x48b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.550272:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c5f2dbd/0x9383f985bc4d6395 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x48b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.550285:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.550287:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.550288:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201611.550898:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x48a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201611.550904:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a37ad28c/0x9383f985bc4d639c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x48a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.550912:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x48a:0x0].0x0 since=886s v=(0 0) 00010000:00010000:1.0:1788201611.550915:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x48a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201611.550919:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a37ad28c/0x9383f985bc4d639c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x48a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.550928:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a37ad28c/0x9383f985bc4d639c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x48a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.550936:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a37ad28c/0x9383f985bc4d639c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x48a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.550943:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a37ad28c/0x9383f985bc4d639c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x48a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.550961:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201611.550968:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201611.550972:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a37ad28c/0x9383f985bc4d639c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x48a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.550979:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef1a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.550983:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a37ad28c/0x9383f985bc4d639c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x48a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.551002:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a37ad28c/0x9383f985bc4d639c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x48a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.551013:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a37ad28c/0x9383f985bc4d639c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x48a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.551021:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a37ad28c/0x9383f985bc4d639c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x48a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.551032:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.551034:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.551036:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201611.551350:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x489:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201611.551356:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a21aad4/0x9383f985bc4d63a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x489:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.551364:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x489:0x0].0x0 since=886s v=(0 0) 00010000:00010000:1.0:1788201611.551367:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x489:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201611.551371:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a21aad4/0x9383f985bc4d63a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x489:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.551379:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a21aad4/0x9383f985bc4d63a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x489:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.551387:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a21aad4/0x9383f985bc4d63a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x489:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.551394:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a21aad4/0x9383f985bc4d63a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x489:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.551407:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201611.551414:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201611.551417:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a21aad4/0x9383f985bc4d63a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x489:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.551424:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef1800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.551427:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a21aad4/0x9383f985bc4d63a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x489:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.551434:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a21aad4/0x9383f985bc4d63a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x489:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.551444:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a21aad4/0x9383f985bc4d63a3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x489:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.551457:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a21aad4/0x9383f985bc4d63a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x489:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.551469:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.551470:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.551472:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201611.551774:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x488:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201611.551780:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ba119c4/0x9383f985bc4d63aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x488:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.551788:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x488:0x0].0x0 since=886s v=(0 0) 00010000:00010000:1.0:1788201611.551792:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x488:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201611.551796:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ba119c4/0x9383f985bc4d63aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x488:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.551804:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ba119c4/0x9383f985bc4d63aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x488:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.551813:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ba119c4/0x9383f985bc4d63aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x488:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.551820:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ba119c4/0x9383f985bc4d63aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x488:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.551834:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201611.551841:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201611.551845:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ba119c4/0x9383f985bc4d63aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x488:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.551853:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef0000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.551856:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ba119c4/0x9383f985bc4d63aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x488:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.551864:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ba119c4/0x9383f985bc4d63aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x488:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.551874:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ba119c4/0x9383f985bc4d63aa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x488:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.551881:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ba119c4/0x9383f985bc4d63aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x488:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.551894:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.551895:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.551897:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201611.552197:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x487:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201611.552203:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000265086a3/0x9383f985bc4d63b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x487:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.552210:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x487:0x0].0x0 since=886s v=(0 0) 00010000:00010000:1.0:1788201611.552213:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x487:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201611.552217:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000265086a3/0x9383f985bc4d63b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x487:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.552230:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000265086a3/0x9383f985bc4d63b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x487:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.552238:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000265086a3/0x9383f985bc4d63b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x487:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.552245:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000265086a3/0x9383f985bc4d63b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x487:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.552258:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201611.552265:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201611.552268:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000265086a3/0x9383f985bc4d63b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x487:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.552275:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef1400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.552278:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000265086a3/0x9383f985bc4d63b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x487:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.552285:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000265086a3/0x9383f985bc4d63b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x487:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.552314:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000265086a3/0x9383f985bc4d63b1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x487:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.552322:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000265086a3/0x9383f985bc4d63b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x487:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.552335:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.552336:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.552338:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201611.552612:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x486:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201611.552618:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000655b0fa6/0x9383f985bc4d63b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x486:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.552626:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x486:0x0].0x0 since=886s v=(0 0) 00010000:00010000:1.0:1788201611.552629:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x486:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201611.552633:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000655b0fa6/0x9383f985bc4d63b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x486:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.552642:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000655b0fa6/0x9383f985bc4d63b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x486:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.552650:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000655b0fa6/0x9383f985bc4d63b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x486:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.552656:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000655b0fa6/0x9383f985bc4d63b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x486:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.552670:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201611.552677:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201611.552680:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000655b0fa6/0x9383f985bc4d63b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x486:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.552692:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef0600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201611.552695:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000655b0fa6/0x9383f985bc4d63b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x486:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.552703:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000655b0fa6/0x9383f985bc4d63b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x486:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.552712:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000655b0fa6/0x9383f985bc4d63b8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x486:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.552720:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000655b0fa6/0x9383f985bc4d63b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x486:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.552731:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.552733:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.552734:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201611.557738:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201611.557754:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201611.557984:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201611.558024:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x485:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201611.558035:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026901fce/0x9383f985bc4d63bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x485:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.558053:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x485:0x0].0x0 since=886s v=(0 0) 00010000:00010000:1.0:1788201611.558058:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x485:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201611.558064:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026901fce/0x9383f985bc4d63bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x485:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.558083:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026901fce/0x9383f985bc4d63bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x485:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.558092:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026901fce/0x9383f985bc4d63bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x485:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.558096:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026901fce/0x9383f985bc4d63bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x485:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.558113:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201611.558133:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201611.558142:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026901fce/0x9383f985bc4d63bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x485:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.558154:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef1e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201611.558159:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026901fce/0x9383f985bc4d63bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x485:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.558169:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026901fce/0x9383f985bc4d63bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x485:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.558199:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026901fce/0x9383f985bc4d63bf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x485:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.558206:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026901fce/0x9383f985bc4d63bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x485:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.558226:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201611.558228:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201611.558230:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201611.558712:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x484:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201611.558717:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009af5a16c/0x9383f985bc4d63c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x484:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.558724:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x484:0x0].0x0 since=886s v=(0 0) 00010000:00010000:1.0:1788201611.558728:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x484:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201611.558732:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009af5a16c/0x9383f985bc4d63c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x484:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.558741:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009af5a16c/0x9383f985bc4d63c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x484:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.558749:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009af5a16c/0x9383f985bc4d63c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x484:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.558762:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009af5a16c/0x9383f985bc4d63c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x484:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.558780:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201611.558801:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201611.558807:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009af5a16c/0x9383f985bc4d63c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x484:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.558815:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef1200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201611.558819:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009af5a16c/0x9383f985bc4d63c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x484:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.558827:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009af5a16c/0x9383f985bc4d63c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x484:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.558838:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009af5a16c/0x9383f985bc4d63c6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x484:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.558845:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009af5a16c/0x9383f985bc4d63c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x484:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.558858:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201611.558859:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201611.558861:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201611.559149:0:13445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x483:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201611.559155:0:13445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043faf69f/0x9383f985bc4d63cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x483:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.559164:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x483:0x0].0x0 since=886s v=(0 0) 00010000:00010000:1.0:1788201611.559168:0:13445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x483:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201611.559173:0:13445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043faf69f/0x9383f985bc4d63cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x483:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.559182:0:13445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043faf69f/0x9383f985bc4d63cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x483:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.559190:0:13445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043faf69f/0x9383f985bc4d63cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x483:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.559196:0:13445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043faf69f/0x9383f985bc4d63cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x483:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201611.559221:0:13445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201611.559253:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201611.559260:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043faf69f/0x9383f985bc4d63cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x483:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.559268:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef0400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201611.559271:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043faf69f/0x9383f985bc4d63cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x483:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.559279:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043faf69f/0x9383f985bc4d63cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x483:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.559289:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043faf69f/0x9383f985bc4d63cd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x483:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.559322:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043faf69f/0x9383f985bc4d63cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x483:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201611.559336:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201611.559338:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201611.559340:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788201611.560491:0:13445:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:1154 00000100:00100000:1.0:1788201611.560606:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f900aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:23079:x1875064458331008:12345-0@lo:5:osp-pre-0-0.0 Request processed in 139348us (140441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201611.560617:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4394 00000100:00100000:3.0:1788201611.561843:0:23079:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f9009500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23079:1875064458331008:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788201611.561861:0:23079:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x4a1:0x0] from OST, last_created [0x240000400:0x4a1:0x0]last_used is [0x240000400:0x482:0x0] 00000100:00100000:3.0:1788201611.561941:0:23079:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23079:1875064458331520:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788201611.562034:0:23079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201611.562075:0:23079:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91f00 going to sleep for 20 seconds 00000100:00100000:0.0:1788201611.563102:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458331392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201611.563145:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201611.563783:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458331392 00000100:00100000:3.0:1788201611.563791:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458331392 00000100:00100000:3.0:1788201611.563839:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788201611.563849:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458331392:12345-0@lo:13:osp-pre-0-0.0 00000020:02000000:3.0:1788201611.563856:0:6708:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1788201611.563876:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524615680 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1788201611.563921:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458331392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201611.563928:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788201611.564252:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458331520 00000100:00100000:1.0:1788201611.564257:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458331520 00000100:00100000:1.0:1788201611.564282:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4396 00000100:00100000:1.0:1788201611.564289:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:23079:x1875064458331520:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:1.0:1788201611.564309:0:13450:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:1.0:1788201611.564344:0:13450:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1186 00000100:00100000:0.0:1788201611.565097:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458331392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201611.568386:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:23079:x1875064458331520:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4091us (6346us total) trans 4294968893 rc 0/0 00000100:00100000:1.0:1788201611.568399:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4396 00000100:00100000:3.0:1788201611.568478:0:23079:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23079:1875064458331520:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788201611.568493:0:23079:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x4a1:0x0]-[0x240000400:0x4c1:0x0] 00010000:00010000:2.0:1788201612.268579:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201613.029881:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458332032:0@lo:400:kworker.0 00000100:00100000:2.0:1788201613.029953:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201613.030024:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788201613.030032:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c49f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458331648:0@lo:400:kworker.0 00000100:00100000:2.0:1788201613.030067:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201613.030092:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458332160:0@lo:400:kworker.0 00000100:00100000:2.0:1788201613.030120:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201613.030151:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c49f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875064458331776:0@lo:400:kworker.0 00000100:00100000:2.0:1788201613.030179:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201613.030198:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875064458332288:0@lo:400:kworker.0 00000100:00100000:2.0:1788201613.030218:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201613.030238:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201613.030244:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c49f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875064458331904:0@lo:400:kworker.0 00000100:00100000:2.0:1788201613.030267:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201613.030338:0:13451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458332032 00000100:00100000:2.0:1788201613.030346:0:13451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458332032 00000100:00100000:2.0:1788201613.030384:0:13451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458332160 00000100:00100000:2.0:1788201613.030388:0:13451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458332160 00000100:00100000:2.0:1788201613.030411:0:13451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1788201613.030421:0:13451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3312:x1875064458332032:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1788201613.030428:0:13451:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788201613.030481:0:23056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458331776 00000100:00100000:3.0:1788201613.030485:0:23056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458331776 00000100:00100000:3.0:1788201613.030507:0:23056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458332288 00000100:00100000:3.0:1788201613.030508:0:23056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458332288 00000100:00100000:3.0:1788201613.030520:0:23056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458331904 00000100:00100000:3.0:1788201613.030521:0:23056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458331904 00000100:00100000:3.0:1788201613.030530:0:23056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201613.030534:0:23056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875064458331776:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1788201613.030537:0:23056:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788201613.030575:0:23056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875064458331776:12345-0@lo:400:kworker.0 Request processed in 40us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201613.030579:0:23056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201613.030590:0:23056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201613.030594:0:23056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875064458332288:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1788201613.030596:0:23056:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788201613.030613:0:23056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875064458332288:12345-0@lo:400:kworker.0 Request processed in 18us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201613.030616:0:23056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201613.030623:0:23056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788201613.030627:0:23056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875064458331904:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1788201613.030629:0:23056:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788201613.030642:0:23056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875064458331904:12345-0@lo:400:kworker.0 Request processed in 16us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201613.030646:0:23056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788201613.030662:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788201613.030666:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3312:x1875064458332160:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1788201613.031023:0:13449:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788201613.031121:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3312:x1875064458332160:12345-0@lo:400:kworker.0 Request processed in 452us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201613.031129:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788201613.031152:0:23052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458331648 00000100:00100000:3.0:1788201613.031156:0:23052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458331648 00000100:00100000:3.0:1788201613.031177:0:23052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788201613.031183:0:23052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3312:x1875064458331648:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1788201613.031187:0:23052:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788201613.031214:0:23052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3312:x1875064458331648:12345-0@lo:400:kworker.0 Request processed in 31us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201613.031220:0:23052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788201613.031345:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c49f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875064458331904:0@lo:400:kworker.0 00000100:00100000:3.0:1788201613.031356:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c49f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875064458331776:0@lo:400:kworker.0 00000100:00100000:3.0:1788201613.031365:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875064458332288:0@lo:400:kworker.0 00000100:00100000:3.0:1788201613.031401:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c49f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458331648:0@lo:400:kworker.0 00000100:00100000:3.0:1788201613.031411:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458332160:0@lo:400:kworker.0 00000100:00100000:2.0:1788201613.031909:0:13451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3312:x1875064458332032:12345-0@lo:400:kworker.0 Request processed in 1488us (1954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201613.031917:0:13451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1788201613.032047:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458332032:0@lo:400:kworker.0 00010000:00010000:2.0:1788201613.288668:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201614.309511:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201614.536670:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201614.536743:0:23056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442782976 00000100:00100000:3.0:1788201614.536753:0:23056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442782976 00000100:00100000:3.0:1788201614.536842:0:23056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:3.0:1788201614.536852:0:23056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:29686:x1875064442782976:12345-192.168.201.30@tcp:36:rm.0 00000004:00080000:2.0:1788201614.537973:0:23056:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1067us 00000100:00080000:1.0:1788201614.539958:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788201614.578690:0:23056:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788201614.578726:0:23056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c131fa00/0x9383f985bc4d620d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x429:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58eb expref: 8 pid: 23092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201614.578744:0:23056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x429:0x0].0x0 (ffff9e03c33edf00) 00010000:00010000:2.0:1788201614.578761:0:23056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d61f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58e4 expref: 7 pid: 23092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201614.578771:0:23056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c2fc5c00) 00010000:00010000:2.0:1788201614.578778:0:23056:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201614.578803:0:23056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6a00/0x9383f985bc4d63d4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201614.578815:0:23056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6a00/0x9383f985bc4d63d4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201614.578823:0:23056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6a00/0x9383f985bc4d63d4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201614.578834:0:23056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6200/0x9383f985bc4d63db lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201614.578841:0:23056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6200/0x9383f985bc4d63db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201614.578847:0:23056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6200/0x9383f985bc4d63db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201614.589600:0:23056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1a00/0x9383f985bc4d63e2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x429:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201614.589620:0:23056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1a00/0x9383f985bc4d63e2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x429:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201614.589634:0:23056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1a00/0x9383f985bc4d63e2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x429:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201614.639073:0:23056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x18:0x0].2, 64 off8320 00000004:00080000:2.0:1788201614.639093:0:23056:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 889896798299ns, next at 890896792337ns, rc = 0 00010000:00010000:2.0:1788201614.639212:0:23056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7200/0x9383f985bc4d63e9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x429:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201614.639230:0:23056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7200/0x9383f985bc4d63e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x429:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201614.639242:0:23056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7200/0x9383f985bc4d63e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x429:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201614.639252:0:23056:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7200/0x9383f985bc4d63e9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x429:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201614.639258:0:23056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7200/0x9383f985bc4d63e9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x429:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201614.639264:0:23056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7200/0x9383f985bc4d63e9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x429:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201614.639324:0:23056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201614.639368:0:23056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1a00/0x9383f985bc4d63e2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x429:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201614.639375:0:23056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1a00/0x9383f985bc4d63e2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x429:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201614.639382:0:23056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1a00/0x9383f985bc4d63e2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x429:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201614.639390:0:23056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef1a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201614.639398:0:23056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1a00/0x9383f985bc4d63e2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x429:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201614.639406:0:23056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1a00/0x9383f985bc4d63e2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x429:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201614.639418:0:23056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x429:0x0].0x0 (ffff9e03c316f400) 00010000:00010000:2.0:1788201614.639421:0:23056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201614.639425:0:23056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1a00/0x9383f985bc4d63e2 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x429:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201614.639431:0:23056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1a00/0x9383f985bc4d63e2 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x429:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201614.639451:0:23056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6a00/0x9383f985bc4d63d4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201614.639457:0:23056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6a00/0x9383f985bc4d63d4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201614.639463:0:23056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6a00/0x9383f985bc4d63d4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201614.639469:0:23056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c7ea6a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201614.639472:0:23056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6a00/0x9383f985bc4d63d4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201614.639477:0:23056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6a00/0x9383f985bc4d63d4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201614.639484:0:23056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c36c8900) 00010000:00010000:2.0:1788201614.639486:0:23056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201614.639490:0:23056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6a00/0x9383f985bc4d63d4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201614.639496:0:23056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6a00/0x9383f985bc4d63d4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201614.639511:0:23056:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000085e55dbb reply state 000000009aab9b56 transno 25769803777 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6200/0x9383f985bc4d63db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201614.639520:0:23056:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201614.639616:0:23056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:29686:x1875064442782976:12345-192.168.201.30@tcp:36:rm.0 Request processed in 102762us (102950us total) trans 25769803777 rc 0/0 00000100:00100000:2.0:1788201614.639626:0:23056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15 00010000:00010000:3.0:1788201614.645964:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201614.645979:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7200/0x9383f985bc4d63e9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x429:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201614.645990:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c7ea7200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201614.645994:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7200/0x9383f985bc4d63e9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x429:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201614.646004:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7200/0x9383f985bc4d63e9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x429:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201614.646023:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x429:0x0].0x0 (ffff9e03c316f400) 00010000:00010000:3.0:1788201614.646026:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788201614.646030:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7200/0x9383f985bc4d63e9 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x429:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201614.646036:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7200/0x9383f985bc4d63e9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x429:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201614.646061:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201614.646063:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201614.646065:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201614.650245:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6200/0x9383f985bc4d63db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201614.650261:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6200/0x9383f985bc4d63db lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201614.650269:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6200/0x9383f985bc4d63db lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201614.650275:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c7ea6200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201614.650280:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6200/0x9383f985bc4d63db lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201614.650288:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6200/0x9383f985bc4d63db lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201614.650453:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff9e03c36c8c00) 00010000:00010000:0.0:1788201614.650457:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201614.650461:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6200/0x9383f985bc4d63db lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201614.650473:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6200/0x9383f985bc4d63db lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201615.252905:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201615.252954:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201615.252988:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201615.253201:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442783360 00000100:00100000:3.0:1788201615.253211:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442783360 00000100:00100000:3.0:1788201615.253271:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442783232 00000100:00100000:3.0:1788201615.253275:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442783232 00000100:00100000:3.0:1788201615.253343:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 367 00000100:00100000:3.0:1788201615.253354:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2361:x1875064442783360:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201615.253428:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2361:x1875064442783360:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 76us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201615.253435:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 367 00000100:00100000:3.0:1788201615.253451:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 368 00000100:00100000:3.0:1788201615.253458:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+506:2361:x1875064442783232:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201615.253486:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+506:2361:x1875064442783232:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 29us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201615.253492:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 368 00000100:00100000:0.0:1788201615.253907:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442783104 00000100:00100000:0.0:1788201615.253912:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442783104 00000100:00100000:0.0:1788201615.253958:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00100000:0.0:1788201615.253966:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2361:x1875064442783104:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201615.253999:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2361:x1875064442783104:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 34us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201615.254005:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00080000:2.0:1788201615.254329:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201615.254334:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788201615.333573:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788201616.208642:0:6732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294968893 is committed 00000001:00100000:0.0:1788201616.211239:0:7657:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 35604eb4-baf9-45be-a20a-4883a2cd8cf9 00000001:00080000:0.0:1788201616.211255:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968894 is committed 00010000:00010000:1.0:1788201616.357538:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788201616.613974:0:23079:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 891871677563ns, next at 892871675013ns, rc = 0 00000100:00100000:3.0:1788201616.613993:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201616.614024:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04cffd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458332416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201616.614092:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201616.614240:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458332544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201616.614269:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201616.614316:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458332416 00000100:00100000:2.0:1788201616.614316:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458332544 00000100:00100000:0.0:1788201616.614322:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458332416 00000100:00100000:2.0:1788201616.614322:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458332544 00000100:00100000:0.0:1788201616.614373:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788201616.614382:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c49f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458332416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201616.614413:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524484608 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1788201616.614477:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c49f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458332416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201616.614485:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788201616.615789:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968893 gen 2 00000100:00100000:3.0:1788201616.615822:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04cffd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458332416:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788201616.616121:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201616.616127:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201616.616136:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788201616.616147:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458332544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201616.616174:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 39387136 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201616.617941:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458332544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1791us (3665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201616.617953:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788201616.618086:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968894 gen 2 00000100:00100000:3.0:1788201616.618114:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458332544:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1788201616.691848:0:23062:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803777 is committed 00000004:00080000:3.0:1788201616.691861:0:23062:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788201616.693143:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201616.693163:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c56f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458332672:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201616.693229:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201616.693315:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458332672 00000100:00100000:0.0:1788201616.693322:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458332672 00000100:00100000:0.0:1788201616.693366:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4397 00000100:00100000:0.0:1788201616.693374:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458332672:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201616.693400:0:13447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1154 count 1 00010000:00010000:0.0:1788201616.693425:0:13447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0ebfad4/0x9383f985bc4d63f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x482:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201616.693448:0:13447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd191276/0x9383f985bc4d6031 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x482:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58f2 expref: 505 pid: 13442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201616.693475:0:13447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x482:0x0].0x0 since=38s v=(0 0) 00010000:00010000:0.0:1788201616.693479:0:13447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x482:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201616.693484:0:13447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0ebfad4/0x9383f985bc4d63f0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x482:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201616.693513:0:13447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cd191276/0x9383f985bc4d6031 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x482:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58f2 expref: 505 pid: 13442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201616.693528:0:13447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cd191276/0x9383f985bc4d6031 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x482:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58f2 expref: 505 pid: 13442 timeout: 991 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201616.693539:0:13447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2200700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:13447:1875064458332800:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788201616.693603:0:13447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c33d5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201616.701066:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201616.701589:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442783488 00000100:00100000:0.0:1788201616.701600:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442783488 00010000:00010000:0.0:1788201616.701648:0:13458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cd191276/0x9383f985bc4d6031 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x482:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58f2 expref: 506 pid: 13442 timeout: 991 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201616.701696:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1602 00000100:00100000:0.0:1788201616.701706:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c49f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+506:2359:x1875064442783488:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201616.701721:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201616.701727:0:13458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cd191276/0x9383f985bc4d6031 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x482:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58f2 expref: 506 pid: 13442 timeout: 991 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201616.701740:0:13458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cd191276/0x9383f985bc4d6031 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x482:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58f2 expref: 506 pid: 13442 timeout: 991 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201616.701765:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x482:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201616.701770:0:13458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x482:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201616.701776:0:13458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c0ebfad4/0x9383f985bc4d63f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x482:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201616.701797:0:13458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0ebfad4/0x9383f985bc4d63f0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x482:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201616.701819:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201616.701875:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c49f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+506:2359:x1875064442783488:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 170us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201616.701882:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1602 00010000:00010000:0.0:1788201616.701941:0:13447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd191276/0x9383f985bc4d6031 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x482:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58f2 expref: 505 pid: 13442 timeout: 991 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201616.701960:0:13447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2200700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:13447:1875064458332800:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788201616.701982:0:13447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c0ebfad4/0x9383f985bc4d63f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x482:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201616.701993:0:13447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c0ebfad4/0x9383f985bc4d63f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x482:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201616.702000:0:13447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0ebfad4/0x9383f985bc4d63f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x482:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201616.702020:0:13447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0ebfad4/0x9383f985bc4d63f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x482:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201616.702028:0:13447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0ebfad4/0x9383f985bc4d63f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x482:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201616.702051:0:13447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201616.702068:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201616.702074:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0ebfad4/0x9383f985bc4d63f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x482:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201616.702082:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201616.702086:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0ebfad4/0x9383f985bc4d63f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x482:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201616.702094:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0ebfad4/0x9383f985bc4d63f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x482:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201616.702107:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0ebfad4/0x9383f985bc4d63f0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x482:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201616.702113:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0ebfad4/0x9383f985bc4d63f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x482:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201616.702131:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201616.702133:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201616.702135:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201616.702530:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3312:x1875064458332672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9155us (9300us total) trans 4294968894 rc 0/0 00000100:00100000:0.0:1788201616.702538:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4397 00000004:00080000:3.0:1788201616.706477:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e04c56f6d80/2, rc 0, transno 4294968894 00000100:00100000:3.0:1788201616.706492:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c56f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458332672:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788201617.381725:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201618.150346:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f9009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458333056:0@lo:400:kworker.0 00000100:00100000:2.0:1788201618.150446:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201618.150500:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f9009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875064458333568:0@lo:400:kworker.0 00000100:00100000:2.0:1788201618.150525:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201618.150554:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788201618.150560:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f9008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458332928:0@lo:400:kworker.0 00000100:00100000:2.0:1788201618.150593:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201618.150620:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f900b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458333440:0@lo:400:kworker.0 00000100:00100000:2.0:1788201618.150646:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201618.150674:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f900bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458333312:0@lo:400:kworker.0 00000100:00100000:2.0:1788201618.150698:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201618.150716:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201618.150722:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f9008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458333184:0@lo:400:kworker.0 00000100:00100000:2.0:1788201618.150743:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201618.150911:0:23050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458332928 00000100:00100000:0.0:1788201618.150921:0:23050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458332928 00000100:00100000:0.0:1788201618.150997:0:23050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788201618.151009:0:23050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458332928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201618.151086:0:23050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458332928:12345-0@lo:400:kworker.0 Request processed in 80us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201618.151094:0:23050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788201618.151137:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458333440 00000100:00100000:0.0:1788201618.151140:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458333440 00000100:00100000:0.0:1788201618.151176:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458333312 00000100:00100000:0.0:1788201618.151179:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458333312 00000100:00100000:0.0:1788201618.151201:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1788201618.151207:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458333440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201618.151241:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458333440:12345-0@lo:400:kworker.0 Request processed in 35us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201618.151247:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1788201618.151274:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1788201618.151280:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3313:x1875064458333312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201618.151351:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3313:x1875064458333312:12345-0@lo:400:kworker.0 Request processed in 71us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201618.151357:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1788201618.151378:0:23055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458333056 00000100:00100000:0.0:1788201618.151382:0:23055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458333056 00000100:00100000:0.0:1788201618.151414:0:23055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458333568 00000100:00100000:0.0:1788201618.151417:0:23055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458333568 00000100:00100000:0.0:1788201618.151434:0:23055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458333184 00000100:00100000:0.0:1788201618.151437:0:23055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458333184 00000100:00100000:0.0:1788201618.151454:0:23055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788201618.151459:0:23055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875064458333056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201618.151493:0:23055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875064458333056:12345-0@lo:400:kworker.0 Request processed in 34us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201618.151503:0:23055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788201618.151515:0:23055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788201618.151521:0:23055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875064458333568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201618.151549:0:23055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875064458333568:12345-0@lo:400:kworker.0 Request processed in 29us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201618.151555:0:23055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788201618.151566:0:23055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201618.151572:0:23055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c12a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458333184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201618.151600:0:23055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c12a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458333184:12345-0@lo:400:kworker.0 Request processed in 28us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201618.151605:0:23055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201618.151656:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f9008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458333184:0@lo:400:kworker.0 00000100:00100000:0.0:1788201618.151669:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f900bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458333312:0@lo:400:kworker.0 00000100:00100000:0.0:1788201618.151702:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f9008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458332928:0@lo:400:kworker.0 00000100:00100000:0.0:1788201618.151710:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f900b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458333440:0@lo:400:kworker.0 00000100:00100000:0.0:1788201618.151719:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f9009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458333056:0@lo:400:kworker.0 00000100:00100000:0.0:1788201618.151733:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f9009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875064458333568:0@lo:400:kworker.0 00000100:00080000:3.0:1788201618.152024:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201618.152031:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201618.152033:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788201618.406555:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201619.432342:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201620.370576:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201620.370635:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201620.370832:0:23052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442783616 00000100:00100000:0.0:1788201620.370873:0:23052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442783616 00000100:00100000:0.0:1788201620.370959:0:23052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 67 00000100:00100000:0.0:1788201620.370971:0:23052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442783616:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201620.371072:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442783872 00000100:00100000:1.0:1788201620.371077:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442783872 00000100:00100000:1.0:1788201620.371131:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 371 00000100:00100000:1.0:1788201620.371140:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c49f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2362:x1875064442783872:12345-192.168.201.30@tcp:400:kworker.0 00000100:00080000:2.0:1788201620.371227:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201620.374049:0:23052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442783616:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 3060us (3469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201620.374069:0:23052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 67 00000100:00100000:1.0:1788201620.374338:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c49f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2362:x1875064442783872:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 3197us (3700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201620.374353:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 371 00000100:00100000:3.0:1788201620.384068:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201620.384157:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201620.384429:0:23055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442783744 00000100:00100000:0.0:1788201620.384442:0:23055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442783744 00000100:00100000:0.0:1788201620.384549:0:23055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:0.0:1788201620.384562:0:23055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2362:x1875064442783744:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201620.384685:0:23055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2362:x1875064442783744:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 125us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201620.384693:0:23055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00080000:2.0:1788201620.384878:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201620.384975:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442784000 00000100:00100000:1.0:1788201620.384981:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442784000 00000100:00100000:1.0:1788201620.385040:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 372 00000100:00100000:1.0:1788201620.385051:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2362:x1875064442784000:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201620.385084:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2362:x1875064442784000:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 37us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201620.385091:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 372 00000100:00080000:3.0:1788201620.385231:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788201620.454070:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788201621.342643:0:6732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294968894 is committed 00010000:00010000:3.0:1788201621.478878:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201621.740541:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f9009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458333696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201621.740636:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201621.740730:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458333696 00000100:00100000:1.0:1788201621.740739:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458333696 00000100:00100000:1.0:1788201621.740806:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788201621.740833:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f900b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458333696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201621.740879:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 39387136 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201621.741009:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f900b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458333696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 193us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201621.741016:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00080000:1.0:1788201621.741041:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201621.742848:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f9009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458333696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201621.751226:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201621.751270:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2200700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458333824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201621.751398:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201621.751467:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458333824 00000100:00100000:0.0:1788201621.751476:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458333824 00000100:00100000:0.0:1788201621.751556:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788201621.751566:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2200000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458333824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201621.751611:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524484608 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1788201621.751660:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2200000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458333824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201621.751668:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00080000:0.0:1788201621.751693:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201621.751726:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968894 gen 2 00000004:00080000:0.0:1788201621.751733:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e04c56f6d80, transno 4294968894 00000100:00100000:0.0:1788201621.751751:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2200700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458333824:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1788201621.839616:0:23062:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00010000:00010000:3.0:1788201622.501700:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201623.269980:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458334208:0@lo:400:kworker.0 00000100:00100000:2.0:1788201623.270076:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201623.270153:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201623.270160:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458334336:0@lo:400:kworker.0 00000100:00100000:2.0:1788201623.270189:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201623.270231:0:23058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458334208 00000100:00100000:2.0:1788201623.270241:0:23058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458334208 00000100:00100000:2.0:1788201623.270344:0:23058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788201623.270357:0:23058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458334208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201623.270422:0:23058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458334208:12345-0@lo:400:kworker.0 Request processed in 68us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201623.270430:0:23058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788201623.270456:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201623.270611:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458333952:0@lo:400:kworker.0 00000100:00100000:0.0:1788201623.270663:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201623.270699:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458334464:0@lo:400:kworker.0 00000100:00100000:0.0:1788201623.270723:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201623.270746:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788201623.270751:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875064458334080:0@lo:400:kworker.0 00000100:00100000:0.0:1788201623.270772:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201623.270798:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875064458334592:0@lo:400:kworker.0 00000100:00100000:0.0:1788201623.270821:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201623.270850:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458334336 00000100:00100000:0.0:1788201623.270854:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458334336 00000100:00100000:0.0:1788201623.270893:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458334464 00000100:00100000:0.0:1788201623.270895:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458334464 00000100:00100000:0.0:1788201623.270918:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1788201623.270923:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458334336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201623.270954:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458334336:12345-0@lo:400:kworker.0 Request processed in 31us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201623.270959:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1788201623.270971:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1788201623.270975:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2200700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458334464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201623.270999:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2200700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458334464:12345-0@lo:400:kworker.0 Request processed in 24us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201623.271004:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1788201623.271020:0:23055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458334080 00000100:00100000:0.0:1788201623.271023:0:23055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458334080 00000100:00100000:0.0:1788201623.271043:0:23055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458334592 00000100:00100000:0.0:1788201623.271046:0:23055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458334592 00000100:00100000:0.0:1788201623.271059:0:23055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788201623.271064:0:23055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2202300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875064458334080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201623.271090:0:23055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2202300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875064458334080:12345-0@lo:400:kworker.0 Request processed in 26us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201623.271095:0:23055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788201623.271105:0:23055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788201623.271109:0:23055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875064458334592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201623.271130:0:23055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875064458334592:12345-0@lo:400:kworker.0 Request processed in 20us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201623.271135:0:23055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788201623.271194:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875064458334080:0@lo:400:kworker.0 00000100:00100000:0.0:1788201623.271204:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875064458334592:0@lo:400:kworker.0 00000100:00100000:0.0:1788201623.271212:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458334464:0@lo:400:kworker.0 00000100:00100000:3.0:1788201623.271832:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458333952 00000100:00100000:3.0:1788201623.271840:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458333952 00000100:00100000:2.0:1788201623.271969:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458334208:0@lo:400:kworker.0 00000100:00100000:2.0:1788201623.272002:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458334336:0@lo:400:kworker.0 00000100:00080000:2.0:1788201623.272049:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201623.272054:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201623.272057:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201623.277351:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788201623.277378:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458333952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201623.277518:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458333952:12345-0@lo:400:kworker.0 Request processed in 151us (6854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201623.277526:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788201623.277683:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458333952:0@lo:400:kworker.0 00010000:00010000:1.0:1788201623.526134:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201624.135835:0:23773:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130a: DoM file create (setstripe) replay ========================================================== 14:40:22 (1788201622) 00010000:00010000:3.0:1788201624.549568:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201625.190454:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201625.190570:0:23056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442784128 00000100:00100000:3.0:1788201625.190581:0:23056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442784128 00000100:00100000:3.0:1788201625.190655:0:23056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:3.0:1788201625.190666:0:23056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:30268:x1875064442784128:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788201625.190691:0:23056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201625.190716:0:23056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d63f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5915 expref: -99 pid: 23056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201625.190809:0:23056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d63fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788201625.190811:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788201625.190828:0:23056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d63fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201625.190849:0:23056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d63fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201625.191186:0:23056:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788201625.191193:0:23056:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201625.191278:0:23056:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d63fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201625.191347:0:23056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d63f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5915 expref: 8 pid: 23056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201625.191365:0:23056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d63fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5915 expref: 7 pid: 23056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201625.191375:0:23056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c2fc5d00) 00010000:00010000:3.0:1788201625.191379:0:23056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201625.191384:0:23056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0030a00, rc 0) 00000100:00100000:3.0:1788201625.191611:0:23056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:30268:x1875064442784128:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 945us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201625.191667:0:23056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:2.0:1788201625.199028:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201625.199097:0:23366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442784256 00000100:00100000:0.0:1788201625.199111:0:23366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442784256 00000100:00100000:0.0:1788201625.199189:0:23366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:0.0:1788201625.199205:0:23366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:30268:x1875064442784256:12345-192.168.201.30@tcp:41:lfs.0 00000004:00000024:0.0:1788201625.199266:0:23366:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788201625.199392:0:23366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:30268:x1875064442784256:12345-192.168.201.30@tcp:41:lfs.0 Request processed in 192us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201625.199400:0:23366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:2.0:1788201625.202994:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201625.203101:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442784384 00000100:00100000:3.0:1788201625.203114:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442784384 00000100:00100000:3.0:1788201625.203254:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 258 00000100:00100000:3.0:1788201625.203270:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:30268:x1875064442784384:12345-192.168.201.30@tcp:13:lfs.0 00002000:00000024:3.0:1788201625.203350:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524484608 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1788201625.203464:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:30268:x1875064442784384:12345-192.168.201.30@tcp:13:lfs.0 Request processed in 199us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201625.203473:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 258 00000100:00080000:2.0:1788201625.203992:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201625.209434:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201625.209554:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442784512 00000100:00100000:3.0:1788201625.209570:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442784512 00000100:00100000:3.0:1788201625.209675:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 259 00000100:00100000:3.0:1788201625.209691:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:30268:x1875064442784512:12345-192.168.201.30@tcp:13:lfs.0 00002000:00000024:3.0:1788201625.209959:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 39387136 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201625.210052:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:30268:x1875064442784512:12345-192.168.201.30@tcp:13:lfs.0 Request processed in 366us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201625.210062:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 259 00000100:00080000:2.0:1788201625.210242:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201625.274348:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201625.275133:0:23058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442784768 00000100:00100000:2.0:1788201625.275149:0:23058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442784768 00000100:00100000:0.0:1788201625.275261:0:23055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:0.0:1788201625.275277:0:23055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:30275:x1875064442784768:12345-192.168.201.30@tcp:36:mcreate.0 00010000:00010000:0.0:1788201625.275623:0:23055:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201625.275673:0:23055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030a00/0x9383f985bc4d63fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5915 expref: 7 pid: 23056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.275701:0:23055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c2fc5d00) 00010000:00010000:0.0:1788201625.275726:0:23055:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201625.278627:0:23055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d6405 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.278942:0:23055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d6405 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.278959:0:23055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d6405 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.278982:0:23055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d640c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.278990:0:23055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d640c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.278996:0:23055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d640c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.289149:0:23055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d6405 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.289171:0:23055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d6405 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.289180:0:23055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d6405 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.289187:0:23055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201625.289193:0:23055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d6405 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.289201:0:23055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d6405 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.289223:0:23055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33e8d00) 00010000:00010000:0.0:1788201625.289226:0:23055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201625.289230:0:23055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d6405 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.289236:0:23055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d6405 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201625.289261:0:23055:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f4974eae reply state 00000000c14dcbd7 transno 25769803778 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d640c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201625.289271:0:23055:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201625.289708:0:23055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:30275:x1875064442784768:12345-192.168.201.30@tcp:36:mcreate.0 Request processed in 14430us (15365us total) trans 25769803778 rc 0/0 00000100:00100000:0.0:1788201625.290629:0:23055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 18 00010000:00010000:3.0:1788201625.292968:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d640c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201625.292990:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d640c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201625.293004:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d640c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201625.293012:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201625.293018:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d640c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201625.293026:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d640c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201625.293048:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf2391a86 (ffff9e03c33e8800) 00010000:00010000:3.0:1788201625.293051:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201625.293056:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d640c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201625.293063:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7000/0x9383f985bc4d640c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201625.313099:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201625.313244:0:23056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442784896 00000100:00100000:3.0:1788201625.313258:0:23056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442784896 00000100:00100000:3.0:1788201625.313363:0:23056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:3.0:1788201625.313375:0:23056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:30278:x1875064442784896:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1788201625.313407:0:23056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201625.313437:0:23056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d6413 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c591c expref: -99 pid: 23056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201625.313535:0:23056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d641a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201625.313557:0:23056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d641a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201625.313570:0:23056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d641a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201625.313664:0:23056:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788201625.313669:0:23056:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201625.313700:0:23056:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d641a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201625.313730:0:23056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d6413 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c591c expref: 9 pid: 23056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201625.313759:0:23056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d641a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c591c expref: 8 pid: 23056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201625.313770:0:23056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c2fc5400) 00010000:00010000:3.0:1788201625.313773:0:23056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201625.313776:0:23056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0030000, rc 0) 00000100:00100000:3.0:1788201625.313855:0:23056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:30278:x1875064442784896:12345-192.168.201.30@tcp:101:rm.0 Request processed in 482us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201625.313863:0:23056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:1.0:1788201625.318416:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201625.318523:0:23463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442785024 00000100:00100000:2.0:1788201625.318539:0:23463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442785024 00000100:00100000:2.0:1788201625.318621:0:23463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:2.0:1788201625.318634:0:23463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:30278:x1875064442785024:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1788201625.318665:0:23463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201625.318692:0:23463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7200/0x9383f985bc4d6421 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5923 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.318788:0:23463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6200/0x9383f985bc4d6428 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.318805:0:23463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6200/0x9383f985bc4d6428 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.318819:0:23463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6200/0x9383f985bc4d6428 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.318850:0:23463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6a00/0x9383f985bc4d642f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.318857:0:23463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6a00/0x9383f985bc4d642f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.318865:0:23463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6a00/0x9383f985bc4d642f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.318990:0:23463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7600/0x9383f985bc4d6436 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x42a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.318998:0:23463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7600/0x9383f985bc4d6436 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x42a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.319005:0:23463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7600/0x9383f985bc4d6436 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x42a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201625.319043:0:23463:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x42a:0x0]: returning size 0 00000004:00200000:2.0:1788201625.319047:0:23463:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201625.319074:0:23463:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7600/0x9383f985bc4d6436 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x42a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.319086:0:23463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7600/0x9383f985bc4d6436 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x42a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.319096:0:23463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6200/0x9383f985bc4d6428 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.319102:0:23463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6200/0x9383f985bc4d6428 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.319109:0:23463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6200/0x9383f985bc4d6428 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.319116:0:23463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c7ea6200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201625.319120:0:23463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6200/0x9383f985bc4d6428 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.319128:0:23463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6200/0x9383f985bc4d6428 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.319141:0:23463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c2fc5400) 00010000:00010000:2.0:1788201625.319145:0:23463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201625.319150:0:23463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6200/0x9383f985bc4d6428 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.319157:0:23463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6200/0x9383f985bc4d6428 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.319172:0:23463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6a00/0x9383f985bc4d642f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.319183:0:23463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6a00/0x9383f985bc4d642f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.319188:0:23463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6a00/0x9383f985bc4d642f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.319193:0:23463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c7ea6a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201625.319196:0:23463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6a00/0x9383f985bc4d642f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.319201:0:23463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6a00/0x9383f985bc4d642f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.319208:0:23463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf2391a86 (ffff9e03c36c8100) 00010000:00010000:2.0:1788201625.319211:0:23463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201625.319213:0:23463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6a00/0x9383f985bc4d642f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.319220:0:23463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6a00/0x9383f985bc4d642f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.319250:0:23463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7200/0x9383f985bc4d6421 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5923 expref: 10 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.319263:0:23463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7600/0x9383f985bc4d6436 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x42a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5923 expref: 9 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.319271:0:23463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x42a:0x0].0x0 (ffff9e03c36c8300) 00010000:00010000:2.0:1788201625.319273:0:23463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201625.319276:0:23463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c7ea7600, rc 0) 00000100:00100000:2.0:1788201625.319404:0:23463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:30278:x1875064442785024:12345-192.168.201.30@tcp:101:rm.0 Request processed in 771us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201625.319412:0:23463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:2.0:1788201625.331144:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201625.331280:0:23055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442785280 00000100:00100000:0.0:1788201625.331344:0:23055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442785280 00000100:00100000:0.0:1788201625.331425:0:23055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:0.0:1788201625.331438:0:23055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c344a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:30278:x1875064442785280:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:0.0:1788201625.331510:0:23055:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788201625.331544:0:23055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7600/0x9383f985bc4d6436 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x42a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5923 expref: 9 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.331573:0:23055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x42a:0x0].0x0 (ffff9e03c36c8300) 00010000:00010000:0.0:1788201625.331592:0:23055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0030000/0x9383f985bc4d641a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c591c expref: 8 pid: 23056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.331603:0:23055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c2fc5400) 00010000:00010000:0.0:1788201625.331610:0:23055:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201625.331654:0:23055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d643d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.331670:0:23055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d643d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.331681:0:23055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d643d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.331696:0:23055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d6444 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.331702:0:23055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d6444 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.331709:0:23055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d6444 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.331862:0:23055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d644b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x42a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.331871:0:23055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d644b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x42a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.331883:0:23055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d644b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x42a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.332603:0:23055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d6452 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x42a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.332613:0:23055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d6452 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x42a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.332623:0:23055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d6452 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x42a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.332630:0:23055:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d6452 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x42a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.332637:0:23055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d6452 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x42a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.332643:0:23055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d6452 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x42a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.332932:0:23055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201625.332961:0:23055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d644b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x42a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.332968:0:23055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d644b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x42a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.332974:0:23055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d644b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x42a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.332980:0:23055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201625.332987:0:23055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d644b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x42a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.332996:0:23055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d644b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x42a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.333007:0:23055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x42a:0x0].0x0 (ffff9e03c33e8100) 00010000:00010000:0.0:1788201625.333010:0:23055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201625.333014:0:23055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d644b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x42a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.333020:0:23055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7c00/0x9383f985bc4d644b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x42a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.333039:0:23055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d643d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.333044:0:23055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d643d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.333050:0:23055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d643d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.333054:0:23055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201625.333056:0:23055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d643d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.333061:0:23055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d643d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.333066:0:23055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33e8d00) 00010000:00010000:0.0:1788201625.333068:0:23055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201625.333071:0:23055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d643d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.333076:0:23055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6000/0x9383f985bc4d643d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201625.333090:0:23055:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bc55172b reply state 0000000060b3759d transno 25769803779 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d6444 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201625.333099:0:23055:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201625.333208:0:23055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c344a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:30278:x1875064442785280:12345-192.168.201.30@tcp:36:rm.0 Request processed in 1769us (2075us total) trans 25769803779 rc 0/0 00000100:00100000:0.0:1788201625.333218:0:23055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 21 00010000:00010000:2.0:1788201625.334697:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201625.334712:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d6452 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x42a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.334722:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201625.334726:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d6452 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x42a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.334735:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d6452 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x42a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.334762:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x42a:0x0].0x0 (ffff9e03c33e8100) 00010000:00010000:2.0:1788201625.334766:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788201625.334771:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d6452 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x42a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.334778:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6e00/0x9383f985bc4d6452 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x42a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201625.335349:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201625.335353:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201625.335355:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201625.337462:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d6444 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.337480:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d6444 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.337487:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d6444 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.337495:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201625.337501:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d6444 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.337506:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d6444 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.337532:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf2391a86 (ffff9e03c33e8600) 00010000:00010000:2.0:1788201625.337534:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201625.337538:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d6444 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201625.337542:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d6444 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201625.491988:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201625.492044:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201625.492087:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201625.492136:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201625.492167:0:23052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442785408 00000100:00100000:2.0:1788201625.492179:0:23052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442785408 00000100:00100000:0.0:1788201625.492187:0:23056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442785536 00000100:00100000:0.0:1788201625.492195:0:23056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442785536 00000100:00100000:0.0:1788201625.492378:0:23056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:0.0:1788201625.492391:0:23056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2360:x1875064442785536:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201625.492507:0:23056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2360:x1875064442785536:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 118us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201625.492516:0:23056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:1.0:1788201625.492723:0:13451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442785792 00000100:00100000:1.0:1788201625.492729:0:13451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442785792 00000100:00100000:2.0:1788201625.492764:0:23052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:2.0:1788201625.492774:0:23052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442785408:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201625.492781:0:13451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442785664 00000100:00100000:1.0:1788201625.492787:0:13451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442785664 00000100:00100000:1.0:1788201625.492818:0:13451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 375 00000100:00100000:2.0:1788201625.492823:0:23052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442785408:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 50us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201625.492831:0:23052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:1.0:1788201625.492921:0:13451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2360:x1875064442785792:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201625.492967:0:13451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2360:x1875064442785792:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 51us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201625.492974:0:13451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 375 00000100:00100000:1.0:1788201625.492988:0:13451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 376 00000100:00100000:1.0:1788201625.492995:0:13451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c3449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2360:x1875064442785664:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201625.493021:0:13451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c3449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2360:x1875064442785664:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201625.493028:0:13451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 376 00010000:00010000:1.0:1788201625.574469:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201626.597714:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201626.854649:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201626.854679:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c12a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458334720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201626.854781:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201626.854883:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458334720 00000100:00100000:3.0:1788201626.854893:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458334720 00000100:00100000:3.0:1788201626.854963:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788201626.854976:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f964ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458334720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201626.855022:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524484608 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1788201626.855077:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f964ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458334720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201626.855085:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00080000:3.0:1788201626.855112:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201626.855160:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c12a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458334720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201626.859555:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201626.859593:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f9009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458334848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201626.859708:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201626.860448:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458334848 00000100:00100000:1.0:1788201626.860459:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458334848 00000100:00100000:1.0:1788201626.860993:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788201626.861010:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458334848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201626.861064:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 39387136 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201626.861447:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458334848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 443us (1739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201626.861456:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00080000:1.0:1788201626.861791:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201626.863368:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f9009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458334848:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788201626.915741:0:23062:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803779 is committed 00000020:00000080:3.0:1788201627.285626:0:23923:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=4008668d len=0 uarg=00007ffc1befff50 00000004:00000080:3.0:1788201627.285651:0:23923:0:(mdt_handler.c:8183:mdt_iocontrol()) lustre-MDT0000: cmd=4008668d len=576 karg=ffff9e03c1c9b400 uarg=0000000000000000 00080000:00020000:1.0:1788201627.314972:0:23923:0:(osd_handler.c:720:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only *** 00010000:00010000:0.0:1788201627.622469:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201628.389518:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458335232:0@lo:400:kworker.0 00000100:00100000:3.0:1788201628.389518:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c344b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458334976:0@lo:400:kworker.0 00000100:00100000:1.0:1788201628.389522:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c3448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458335104:0@lo:400:kworker.0 00000100:00100000:3.0:1788201628.389875:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201628.391286:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201628.391405:0:23051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458334976 00000100:00100000:2.0:1788201628.391415:0:23051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458334976 00000100:00100000:2.0:1788201628.391532:0:23051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788201628.391563:0:23051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458334976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201628.391634:0:23051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458334976:12345-0@lo:400:kworker.0 Request processed in 74us (1760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201628.391649:0:23058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458335232 00000100:00100000:0.0:1788201628.391654:0:23058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458335232 00000100:00100000:0.0:1788201628.391713:0:23058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788201628.391721:0:23058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d80f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458335232:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788201628.391739:0:23058:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e04d80f1c00 x1875064458335232/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:4/0 lens 224/224 e 0 to 0 dl 1788201639 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201628.391784:0:23058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d80f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875064458335232:12345-0@lo:400:kworker.0 Request processed in 65us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201628.391792:0:23058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1788201628.391819:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201628.391861:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458335232:0@lo:400:kworker.0 00000100:00100000:1.0:1788201628.392647:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201628.393350:0:23051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788201628.393440:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c344b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458334976:0@lo:400:kworker.0 00000100:00100000:2.0:1788201628.393473:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458335488:0@lo:400:kworker.0 00000100:00100000:1.0:1788201628.393683:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875064458335616:0@lo:400:kworker.0 00000100:00100000:1.0:1788201628.393740:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201628.394351:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201628.394395:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458335488 00000100:00100000:2.0:1788201628.394402:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458335488 00000100:00100000:2.0:1788201628.394460:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1788201628.394469:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d80f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458335488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201628.394604:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d80f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458335488:12345-0@lo:400:kworker.0 Request processed in 135us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201628.394612:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00080000:2.0:1788201628.394633:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201628.394652:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458335360:0@lo:400:kworker.0 00000100:00100000:2.0:1788201628.394680:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201628.394725:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458335360 00000100:00100000:2.0:1788201628.394730:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458335360 00000100:00100000:2.0:1788201628.394766:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1788201628.394772:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458335360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201628.394809:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458335360:12345-0@lo:400:kworker.0 Request processed in 37us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201628.394815:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00080000:2.0:1788201628.395253:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201628.395287:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458335360:0@lo:400:kworker.0 00000100:00100000:2.0:1788201628.395340:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458335488:0@lo:400:kworker.0 00000100:00100000:3.0:1788201628.395629:0:23056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458335104 00000100:00100000:3.0:1788201628.395635:0:23056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458335104 00000100:00080000:2.0:1788201628.395657:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201628.395682:0:23056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458335616 00000100:00100000:3.0:1788201628.395686:0:23056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458335616 00000100:00100000:2.0:1788201628.395705:0:23463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788201628.395718:0:23463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f900b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875064458335104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201628.395731:0:23056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00000080:2.0:1788201628.395740:0:23463:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e04f900b100 x1875064458335104/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:4/0 lens 224/224 e 0 to 0 dl 1788201639 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201628.395743:0:23056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875064458335616:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788201628.395764:0:23056:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e04f9008a80 x1875064458335616/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:4/0 lens 224/224 e 0 to 0 dl 1788201639 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201628.395810:0:23056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875064458335616:12345-0@lo:400:kworker.0 Request processed in 71us (2068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201628.395815:0:23463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f900b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875064458335104:12345-0@lo:400:kworker.0 Request processed in 88us (3157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201628.396062:0:23056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788201628.396071:0:23463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788201628.396113:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875064458335616:0@lo:400:kworker.0 00000100:00100000:2.0:1788201628.396125:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c3448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458335104:0@lo:400:kworker.0 00000001:02000400:3.0:1788201628.454126:0:23971:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:1.0:1788201628.511164:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201628.511252:0:23366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442785920 00000100:00100000:0.0:1788201628.511266:0:23366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442785920 00000100:00100000:0.0:1788201628.511391:0:23366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:0.0:1788201628.511405:0:23366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f900bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:30309:x1875064442785920:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1788201628.511436:0:23366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201628.511469:0:23366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d6459 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c592a expref: -99 pid: 23366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201628.511559:0:23366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d6460 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201628.511576:0:23366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d6460 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201628.511591:0:23366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d6460 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23366 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788201628.511953:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1788201628.512049:0:23366:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1788201628.512054:0:23366:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201628.512225:0:23366:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d6460 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201628.512261:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d6459 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c592a expref: 8 pid: 23366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201628.512279:0:23366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d6460 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c592a expref: 7 pid: 23366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201628.512288:0:23366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33e8d00) 00010000:00010000:0.0:1788201628.512323:0:23366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201628.512327:0:23366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc7200, rc 0) 00010000:00000080:0.0:1788201628.512338:0:23366:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e04f900bb80 x1875064442785920/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:4/0 lens 576/688 e 0 to 0 dl 1788201639 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201628.512442:0:23366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f900bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:30309:x1875064442785920:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1038us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201628.512450:0:23366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:1.0:1788201628.518036:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201628.519107:0:23058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442786048 00000100:00100000:2.0:1788201628.519120:0:23058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442786048 00000100:00100000:2.0:1788201628.519174:0:23058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:2.0:1788201628.519182:0:23058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:30309:x1875064442786048:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1788201628.519204:0:23058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201628.519225:0:23058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7400/0x9383f985bc4d6467 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5931 expref: -99 pid: 23058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.519330:0:23058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6e00/0x9383f985bc4d646e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.519346:0:23058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6e00/0x9383f985bc4d646e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.519360:0:23058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6e00/0x9383f985bc4d646e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.519376:0:23058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7c00/0x9383f985bc4d6475 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.519381:0:23058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7c00/0x9383f985bc4d6475 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.519386:0:23058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7c00/0x9383f985bc4d6475 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.519664:0:23058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6e00/0x9383f985bc4d646e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.519673:0:23058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6e00/0x9383f985bc4d646e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.519681:0:23058:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6e00/0x9383f985bc4d646e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.519688:0:23058:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c7ea6e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201628.519693:0:23058:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6e00/0x9383f985bc4d646e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.519716:0:23058:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6e00/0x9383f985bc4d646e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.519731:0:23058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33e8d00) 00010000:00010000:2.0:1788201628.519734:0:23058:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201628.519738:0:23058:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6e00/0x9383f985bc4d646e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.519743:0:23058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea6e00/0x9383f985bc4d646e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.519753:0:23058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7c00/0x9383f985bc4d6475 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.519757:0:23058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7c00/0x9383f985bc4d6475 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.519762:0:23058:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7c00/0x9383f985bc4d6475 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.519765:0:23058:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c7ea7c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201628.519767:0:23058:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7c00/0x9383f985bc4d6475 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.519770:0:23058:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7c00/0x9383f985bc4d6475 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.519776:0:23058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9e03c36c8400) 00010000:00010000:2.0:1788201628.519778:0:23058:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201628.519780:0:23058:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7c00/0x9383f985bc4d6475 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.519787:0:23058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7c00/0x9383f985bc4d6475 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.519826:0:23058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7400/0x9383f985bc4d6467 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5931 expref: 8 pid: 23058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.519834:0:23058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33e8d00) 00010000:00010000:2.0:1788201628.519835:0:23058:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201628.519838:0:23058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7400/0x9383f985bc4d6467 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5931 expref: 8 pid: 23058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.519844:0:23058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c7ea7400, rc 0) 00010000:00000080:2.0:1788201628.519852:0:23058:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e04f9008380 x1875064442786048/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:4/0 lens 592/584 e 0 to 0 dl 1788201639 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201628.519925:0:23058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:30309:x1875064442786048:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 743us (1899us total) trans 0 rc 301/301 00000100:00100000:2.0:1788201628.519930:0:23058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:3.0:1788201628.530274:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201628.530378:0:23463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442786304 00000100:00100000:0.0:1788201628.530394:0:23463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442786304 00000100:00100000:0.0:1788201628.530475:0:23463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:0.0:1788201628.530486:0:23463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f964d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:30309:x1875064442786304:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1788201628.530515:0:23463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201628.530518:0:23463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788201628.530552:0:23463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7200/0x9383f985bc4d6460 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c592a expref: 7 pid: 23366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201628.530573:0:23463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33e8d00) 00010000:00010000:0.0:1788201628.530586:0:23463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201628.530603:0:23463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d647c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5938 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201628.531004:0:23463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d6483 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201628.531019:0:23463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d6483 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201628.531029:0:23463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d6483 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201628.531042:0:23463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d648a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201628.531050:0:23463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d648a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201628.531056:0:23463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d648a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201628.532194:0:23463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d6491 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x42b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201628.532207:0:23463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d6491 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x42b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201628.532216:0:23463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d6491 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x42b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201628.532230:0:23463:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x42b:0x0]: returning size 0 00010000:00010000:0.0:1788201628.532266:0:23463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d6483 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201628.532278:0:23463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d6483 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201628.532286:0:23463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d6483 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201628.532316:0:23463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201628.532322:0:23463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d6483 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201628.532330:0:23463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d6483 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201628.532342:0:23463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33e8f00) 00010000:00010000:0.0:1788201628.532345:0:23463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201628.532349:0:23463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d6483 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201628.532354:0:23463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7400/0x9383f985bc4d6483 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201628.532365:0:23463:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000ec09a56 reply state 000000003e26f775 transno 25769803780 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d648a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201628.532374:0:23463:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201628.532410:0:23463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7a00/0x9383f985bc4d647c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5938 expref: 9 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201628.532426:0:23463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d6491 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x42b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5938 expref: 8 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201628.532439:0:23463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x42b:0x0].0x0 (ffff9e03c33e8200) 00010000:00010000:0.0:1788201628.532442:0:23463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201628.532444:0:23463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc6a00, rc 0) 00010000:00000080:0.0:1788201628.532455:0:23463:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e04f964d180 x1875064442786304/t25769803780(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:4/0 lens 536/608 e 0 to 0 dl 1788201639 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201628.532553:0:23463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f964d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:30309:x1875064442786304:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 2068us (2293us total) trans 25769803780 rc 0/0 00000100:00100000:0.0:1788201628.532563:0:23463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 24 00010000:00010000:3.0:1788201628.538133:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d648a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201628.538159:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d648a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201628.538168:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d648a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201628.538176:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201628.538181:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d648a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201628.538189:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d648a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201628.538210:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9e03c33e8e00) 00010000:00010000:3.0:1788201628.538214:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201628.538220:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d648a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201628.538228:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6400/0x9383f985bc4d648a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23463 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201628.539369:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201628.539653:0:23366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442786560 00000100:00100000:3.0:1788201628.539666:0:23366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442786560 00000100:00100000:3.0:1788201628.539759:0:23366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:3.0:1788201628.539772:0:23366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:30309:x1875064442786560:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788201628.539904:0:23366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201628.539935:0:23366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d649f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c593f expref: -99 pid: 23366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201628.540075:0:23366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d64a6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x42b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201628.540093:0:23366:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d6491 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x42b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5938 expref: 9 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201628.540102:0:23366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d64a6 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x42b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201628.540146:0:23366:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d6491 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x42b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5938 expref: 9 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201628.540162:0:23366:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d6491 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x42b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5938 expref: 9 pid: 23463 timeout: 1003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201628.540178:0:23366:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23366:1875064458335744:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201628.540422:0:23366:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c1b929c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201628.543505:0:23366:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23366:1875064458335744:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201628.543558:0:23366:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d64a6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x42b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23366 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201628.545002:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201628.545235:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442786688 00000100:00100000:3.0:1788201628.545247:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442786688 00010000:00010000:3.0:1788201628.545328:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d6491 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x42b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5938 expref: 10 pid: 23463 timeout: 1003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201628.545383:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1603 00000100:00100000:3.0:1788201628.545396:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5484a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2360:x1875064442786688:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201628.545416:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201628.545424:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d6491 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x42b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5938 expref: 10 pid: 23463 timeout: 1003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201628.545438:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d6491 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x42b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5938 expref: 10 pid: 23463 timeout: 1003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201628.545481:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc6a00/0x9383f985bc4d6491 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x42b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5938 expref: 10 pid: 23463 timeout: 1003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201628.545502:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x42b:0x0].0x0 (ffff9e03c33e8200) 00010000:00010000:3.0:1788201628.545508:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d64a6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x42b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201628.545519:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d64a6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x42b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201628.545526:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d64a6 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x42b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201628.545557:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201628.545636:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5484a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:2360:x1875064442786688:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 241us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201628.545644:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1603 00010000:00010000:2.0:1788201628.546104:0:23366:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d64a6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x42b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.546115:0:23366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d64a6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x42b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23366 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201628.546140:0:23366:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x42b:0x0]: returning size 0 00010000:00010000:2.0:1788201628.546672:0:23366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d64a6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x42b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.546684:0:23366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d64a6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x42b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.546691:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d64a6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x42b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.546707:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201628.546712:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d64a6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x42b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.546720:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d64a6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x42b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.546735:0:23366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x42b:0x0].0x0 (ffff9e03c33e8200) 00010000:00010000:2.0:1788201628.546738:0:23366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201628.546743:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d64a6 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x42b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.546750:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031000/0x9383f985bc4d64a6 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x42b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.546834:0:23366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d649f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c593f expref: 9 pid: 23366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.546845:0:23366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c2fc5600) 00010000:00010000:2.0:1788201628.546848:0:23366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788201628.546852:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c0031c00/0x9383f985bc4d649f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c593f expref: 9 pid: 23366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201628.546868:0:23366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031c00, rc 0) 00010000:00000080:2.0:1788201628.546878:0:23366:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e03c5484e00 x1875064442786560/t25769803781(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:4/0 lens 712/824 e 0 to 0 dl 1788201639 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201628.547036:0:23366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:30309:x1875064442786560:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 7267us (7746us total) trans 25769803781 rc 301/301 00000100:00100000:2.0:1788201628.547045:0:23366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:0.0:1788201628.563186:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201628.563373:0:23069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442786816 00000100:00100000:1.0:1788201628.563388:0:23069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442786816 00000100:00100000:1.0:1788201628.563457:0:23069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:1.0:1788201628.563469:0:23069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:30309:x1875064442786816:12345-192.168.201.30@tcp:900:lfs.0 00010000:00000080:1.0:1788201628.563519:0:23069:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e03c2b7ea00 x1875064442786816/t0(0) o900->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:4/0 lens 264/248 e 0 to 0 dl 1788201639 ref 1 fl Interpret:/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201628.563670:0:23069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:30309:x1875064442786816:12345-192.168.201.30@tcp:900:lfs.0 Request processed in 202us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201628.563680:0:23069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:1.0:1788201628.566464:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201628.566568:0:23059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442787072 00000100:00100000:3.0:1788201628.566594:0:23059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442787072 00000100:00100000:3.0:1788201628.566659:0:23059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:3.0:1788201628.566672:0:23059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:30309:x1875064442787072:12345-192.168.201.30@tcp:35:lfs.0 00010000:00000080:3.0:1788201628.566950:0:23059:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e04f9009c00 x1875064442787072/t25769803782(0) o35->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:4/0 lens 392/456 e 0 to 0 dl 1788201639 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201628.567031:0:23059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:30309:x1875064442787072:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 362us (579us total) trans 25769803782 rc 0/0 00000100:00100000:3.0:1788201628.567039:0:23059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:0.0:1788201628.570427:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201628.570643:0:23059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442787328 00000100:00100000:3.0:1788201628.570654:0:23059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442787328 00000100:00100000:3.0:1788201628.570753:0:23059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:3.0:1788201628.570766:0:23059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:30309:x1875064442787328:12345-192.168.201.30@tcp:35:lfs.0 00010000:00000080:3.0:1788201628.571026:0:23059:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e03c2b7ce00 x1875064442787328/t25769803783(0) o35->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:4/0 lens 392/456 e 0 to 0 dl 1788201639 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201628.571115:0:23059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:30309:x1875064442787328:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 351us (702us total) trans 25769803783 rc 0/0 00000100:00100000:3.0:1788201628.571124:0:23059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1 00010000:00010000:1.0:1788201628.655486:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201629.673404:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201630.613667:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201630.613716:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201630.613813:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201630.613848:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201630.614016:0:23056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442787584 00000100:00100000:3.0:1788201630.614029:0:23056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442787584 00000100:00100000:3.0:1788201630.614103:0:23056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:3.0:1788201630.614116:0:23056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2359:x1875064442787584:12345-192.168.201.30@tcp:400:kworker.0 00010000:00000080:3.0:1788201630.614158:0:23056:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e03c2b7d880 x1875064442787584/t0(0) o400->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:1/0 lens 224/224 e 0 to 0 dl 1788201641 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201630.614228:0:23056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2359:x1875064442787584:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 116us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201630.614235:0:23056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00080000:3.0:1788201630.614324:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201630.618219:0:23050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442787456 00000100:00100000:0.0:1788201630.618243:0:23050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442787456 00000100:00100000:0.0:1788201630.618528:0:23050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 71 00000100:00100000:0.0:1788201630.618554:0:23050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442787456:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201630.618646:0:23050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442787456:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 98us (4832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201630.618654:0:23050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 71 00000100:00100000:1.0:1788201630.622100:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442787840 00000100:00100000:1.0:1788201630.622120:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442787840 00000100:00100000:1.0:1788201630.622207:0:13443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442787712 00000100:00100000:1.0:1788201630.622210:0:13443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442787712 00000100:00100000:1.0:1788201630.622243:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 379 00000100:00100000:1.0:1788201630.622256:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2359:x1875064442787840:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201630.622385:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2359:x1875064442787840:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 133us (8667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201630.622394:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 379 00000100:00100000:1.0:1788201630.622415:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 380 00000100:00100000:1.0:1788201630.622422:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2359:x1875064442787712:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201630.622446:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2359:x1875064442787712:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (8598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201630.622452:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 380 00000100:00080000:0.0:1788201630.623007:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201630.623015:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788201630.695447:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788201631.100799:0:24069:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788201631.100866:0:24069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc000/0x9383f985bc4d612d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6134 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201631.100886:0:24069:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc000/0x9383f985bc4d612d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d6134 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201631.100894:0:24069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc000/0x9383f985bc4d612d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d6134 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201631.100902:0:24069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc000/0x9383f985bc4d612d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d6134 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201631.100929:0:24069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788201631.100936:0:24069:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788201631.100972:0:24069:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788201631.100978:0:24069:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788201631.100985:0:24069:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788201631.101017:0:24069:0:(import.c:65:import_set_state_nolock()) ffff9e03c55b4000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788201631.102325:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201631.102410:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc000/0x9383f985bc4d612d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d6134 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201631.102423:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc000 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1788201631.102428:0:7645:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc000/0x9383f985bc4d612d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d6134 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201631.102439:0:7645:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc000/0x9383f985bc4d612d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x9383f985bc4d6134 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201631.102453:0:7645:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc000/0x9383f985bc4d612d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x9383f985bc4d6134 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201631.102460:0:7645:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788201631.102463:0:7645:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788201631.102467:0:7645:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788201631.102516:0:7645:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc000/0x9383f985bc4d612d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d6134 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201631.102627:0:7645:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201631.102670:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc000/0x9383f985bc4d612d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d6134 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201631.102678:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c32bc000/0x9383f985bc4d612d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d6134 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201631.102691:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201631.102694:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201631.102696:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201631.103168:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458336000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201631.103267:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201631.103398:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458336000 00000100:00100000:0.0:1788201631.103408:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458336000 00000100:00100000:0.0:1788201631.103472:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788201631.103481:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3312:x1875064458336000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201631.103497:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201631.103515:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c131f200/0x9383f985bc4d6134 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d612d expref: 19 pid: 23052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.103549:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201631.103587:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b60c000b-7335-444d-a8dc-1a5956712fb2+18:3312:x1875064458336000:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201631.103594:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788201631.103642:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458336000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201631.106437:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875064458335872:0@lo:39:umount.0 00000100:00100000:0.0:1788201631.106552:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201631.106621:0:23463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458335872 00000100:00100000:0.0:1788201631.106630:0:23463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458335872 00000100:00100000:0.0:1788201631.106700:0:23463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788201631.106710:0:23463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875064458335872:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788201631.106747:0:23463:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d6206 00000100:00080000:0.0:1788201631.106776:0:23463:0:(import.c:65:import_set_state_nolock()) ffff9e04fae42800 : changing import state from FULL to CLOSED 00010000:00000080:0.0:1788201631.106811:0:23463:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e03c2b7f800 x1875064458335872/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:2/0 lens 224/224 e 0 to 0 dl 1788201642 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201631.106859:0:23463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3309:x1875064458335872:12345-0@lo:39:umount.0 Request processed in 150us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201631.106871:0:23463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000020:00000080:0.0:1788201631.106885:0:23463:0:(genops.c:906:class_export_put()) final put ffff9e04fae45800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1788201631.106942:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201631.106974:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e03c55b4000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788201631.106989:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875064458335872:0@lo:39:umount.0 00000020:00000080:0.0:1788201631.107017:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04fae45800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788201631.107073:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04fae42800 for lustre-MDT0000 00000100:00080000:3.0:1788201631.110972:0:24069:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788201631.110984:0:24069:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788201631.110995:0:24069:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788201631.116226:0:24069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04ff129e00/0x9383f985bc4d607e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6085 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201631.116251:0:24069:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04ff129e00/0x9383f985bc4d607e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d6085 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201631.116260:0:24069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04ff129e00/0x9383f985bc4d607e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d6085 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201631.116269:0:24069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e04ff129e00/0x9383f985bc4d607e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d6085 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201631.116321:0:24069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201631.116327:0:24069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04ff129200/0x9383f985bc4d6150 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6157 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201631.116520:0:24069:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04ff129200/0x9383f985bc4d6150 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d6157 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201631.116636:0:24069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04ff129200/0x9383f985bc4d6150 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d6157 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201631.116643:0:24069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e04ff129200/0x9383f985bc4d6150 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d6157 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201631.116719:0:24069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788201631.116729:0:24069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c32bca00/0x9383f985bc4d611f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6126 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201631.116738:0:24069:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c32bca00/0x9383f985bc4d611f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d6126 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201631.116744:0:24069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c32bca00/0x9383f985bc4d611f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d6126 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201631.116751:0:24069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e03c32bca00/0x9383f985bc4d611f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d6126 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.118479:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201631.118495:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e04ff129e00/0x9383f985bc4d607e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d6085 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.118508:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129e00 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:0.0:1788201631.118513:0:7645:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e04ff129e00/0x9383f985bc4d607e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d6085 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.120439:0:7645:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e04ff129e00/0x9383f985bc4d607e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x9383f985bc4d6085 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201631.120470:0:7645:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e04ff129e00/0x9383f985bc4d607e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x9383f985bc4d6085 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201631.120477:0:7645:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788201631.120480:0:7645:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788201631.120735:0:7645:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e04ff129e00/0x9383f985bc4d607e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d6085 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.120742:0:7645:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201631.120787:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e04ff129e00/0x9383f985bc4d607e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d6085 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.120802:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e04ff129e00/0x9383f985bc4d607e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d6085 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.120827:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201631.120832:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e04ff129200/0x9383f985bc4d6150 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d6157 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.120840:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129200 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:0.0:1788201631.120843:0:7645:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e04ff129200/0x9383f985bc4d6150 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d6157 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.120852:0:7645:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e04ff129200/0x9383f985bc4d6150 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9383f985bc4d6157 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201631.120859:0:7645:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e04ff129200/0x9383f985bc4d6150 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9383f985bc4d6157 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201631.120866:0:7645:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788201631.120868:0:7645:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788201631.120871:0:7645:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788201631.120890:0:7645:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e04ff129200/0x9383f985bc4d6150 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d6157 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.120896:0:7645:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201631.120919:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e04ff129200/0x9383f985bc4d6150 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d6157 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.120926:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e04ff129200/0x9383f985bc4d6150 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d6157 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.120946:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201631.120950:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e03c32bca00/0x9383f985bc4d611f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d6126 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.120957:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bca00 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:0.0:1788201631.120960:0:7645:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e03c32bca00/0x9383f985bc4d611f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d6126 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.120967:0:7645:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c32bca00/0x9383f985bc4d611f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9383f985bc4d6126 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201631.120974:0:7645:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c32bca00/0x9383f985bc4d611f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9383f985bc4d6126 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201631.120979:0:7645:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788201631.120982:0:7645:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788201631.120994:0:7645:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e03c32bca00/0x9383f985bc4d611f lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d6126 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.121000:0:7645:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201631.121005:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e03c32bca00/0x9383f985bc4d611f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d6126 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.121012:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201631.121014:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201631.121017:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201631.121054:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458336128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201631.121148:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201631.121234:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458336256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201631.121263:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201631.121284:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201631.121325:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458336384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201631.121562:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201631.121602:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458336128 00000100:00100000:0.0:1788201631.121610:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458336128 00000100:00100000:0.0:1788201631.121676:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458336256 00000100:00100000:0.0:1788201631.121679:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458336256 00000100:00100000:0.0:1788201631.121699:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458336384 00000100:00100000:0.0:1788201631.121701:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458336384 00000100:00100000:0.0:1788201631.121722:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788201631.121732:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b60c000b-7335-444d-a8dc-1a5956712fb2+20:3313:x1875064458336128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201631.121749:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201631.121780:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c131f000/0x9383f985bc4d6085 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d607e expref: 20 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.121798:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201631.121841:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3313:x1875064458336128:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201631.121850:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788201631.121871:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788201631.121878:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8090c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b60c000b-7335-444d-a8dc-1a5956712fb2+18:3310:x1875064458336256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201631.121886:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201631.121895:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c32bc200/0x9383f985bc4d6157 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d6150 expref: 18 pid: 23052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.121903:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201631.121927:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8090c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b60c000b-7335-444d-a8dc-1a5956712fb2+17:3310:x1875064458336256:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201631.121934:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788201631.121978:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788201631.121984:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b60c000b-7335-444d-a8dc-1a5956712fb2+16:3310:x1875064458336384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201631.121990:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201631.121999:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c131e400/0x9383f985bc4d6126 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d611f expref: 16 pid: 23052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.122008:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201631.122026:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b60c000b-7335-444d-a8dc-1a5956712fb2+15:3310:x1875064458336384:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201631.122031:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788201631.122082:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458336128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201631.122107:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458336384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201631.122114:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458336256:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201631.123878:0:24069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788201631.123894:0:24069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c32bca00/0x9383f985bc4d611f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d6126 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201631.123913:0:24069:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788201631.123924:0:24069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c131fe00/0x9383f985bc4d6070 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6077 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201631.123933:0:24069:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c131fe00/0x9383f985bc4d6070 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d6077 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201631.123941:0:24069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c131fe00/0x9383f985bc4d6070 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d6077 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201631.123948:0:24069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e03c131fe00/0x9383f985bc4d6070 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d6077 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201631.123962:0:24069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788201631.123965:0:24069:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1788201631.123969:0:24069:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788201631.124011:0:24069:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788201631.124016:0:24069:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:3.0:1788201631.124020:0:24069:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1788201631.124027:0:24069:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00000004:00000080:3.0:1788201631.125580:0:24069:0:(mdt_handler.c:8183:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00010000:00010000:0.0:1788201631.126389:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201631.126401:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e03c131fe00/0x9383f985bc4d6070 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d6077 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.126414:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c131fe00 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:0.0:1788201631.126419:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e03c131fe00/0x9383f985bc4d6070 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d6077 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.126431:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c131fe00/0x9383f985bc4d6070 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9383f985bc4d6077 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201631.126439:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c131fe00/0x9383f985bc4d6070 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9383f985bc4d6077 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201631.126447:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788201631.126450:0:5846:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788201631.126454:0:5846:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788201631.126503:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e03c131fe00/0x9383f985bc4d6070 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d6077 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.126509:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201631.126716:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e03c131fe00/0x9383f985bc4d6070 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d6077 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.126724:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c131fe00/0x9383f985bc4d6070 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d6077 expref: -99 pid: 23045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.126747:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201631.126749:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201631.126750:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201631.126770:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201631.126796:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458336512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201631.126882:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201631.126953:0:7646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458336512 00000100:00100000:0.0:1788201631.126961:0:7646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458336512 00000100:00100000:0.0:1788201631.127013:0:7646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788201631.127022:0:7646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b60c000b-7335-444d-a8dc-1a5956712fb2+15:3313:x1875064458336512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201631.127037:0:7646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201631.127054:0:7646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c32bc600/0x9383f985bc4d6077 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d6070 expref: 15 pid: 23052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.127070:0:7646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201631.127109:0:7646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b60c000b-7335-444d-a8dc-1a5956712fb2+14:3313:x1875064458336512:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201631.127116:0:7646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788201631.127159:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458336512:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201631.127186:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201631.127868:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788201631.201978:0:23062:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803780 is committed 00000001:00080000:1.0:1788201631.202005:0:23062:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803781 is committed 00000001:00080000:1.0:1788201631.202014:0:23062:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803783 is committed 00000020:00000080:1.0:1788201631.207830:0:24069:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 3/7 00000020:00080000:1.0:1788201631.207849:0:24069:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e04c6b1f800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201631.207857:0:24069:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e04c6b1e000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201631.207866:0:24069:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e04c7de5000 35604eb4-baf9-45be-a20a-4883a2cd8cf9 192.168.201.30@tcp 5 (0 0 0) 0 0 0 0: 0000000000000000 25769803783 stale:0 00000020:00080000:1.0:1788201631.207872:0:24069:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9e04eadcb380) has exports, disconnecting them 00000020:00080000:1.0:1788201631.207879:0:24069:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e04c6b1f800), last request at 1788201628 00000020:00000080:1.0:1788201631.207888:0:24069:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d61ff 00000100:00080000:1.0:1788201631.207900:0:24069:0:(import.c:65:import_set_state_nolock()) ffff9e04fae46000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788201631.207936:0:24069:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e04c6b1f800): rc 0 00000020:00000080:1.0:1788201631.207939:0:24069:0:(genops.c:906:class_export_put()) final put ffff9e04c6b1f800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788201631.207966:0:24069:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e04c6b1e000), last request at 1788201628 00000020:00000080:1.0:1788201631.207979:0:24069:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d61f1 00000100:00080000:1.0:1788201631.207984:0:24069:0:(import.c:65:import_set_state_nolock()) ffff9e04c6b18800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788201631.207995:0:24069:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e04c6b1e000): rc 0 00000020:00000080:1.0:1788201631.207997:0:24069:0:(genops.c:906:class_export_put()) final put ffff9e04c6b1e000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1788201631.208002:0:24069:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.201.30@tcp (ffff9e04c7de5000), last request at 1788201630 00000020:00000080:1.0:1788201631.208007:0:24069:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d60bd 00000100:00080000:1.0:1788201631.208020:0:24069:0:(import.c:65:import_set_state_nolock()) ffff9e03c5131000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788201631.208031:0:24069:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.30@tcp (ffff9e04c7de5000): rc 0 00000020:00000080:1.0:1788201631.208034:0:24069:0:(genops.c:906:class_export_put()) final put ffff9e04c7de5000/35604eb4-baf9-45be-a20a-4883a2cd8cf9 00000004:00000080:1.0:1788201631.208042:0:24069:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffad6101453ae0 00000100:00080000:1.0:1788201631.208070:0:24069:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788201631.208074:0:24069:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968894 gen 3 00000004:00080000:1.0:1788201631.208091:0:24069:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788201631.208159:0:24069:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788201631.208193:0:24069:0:(import.c:65:import_set_state_nolock()) ffff9e0501572800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788201631.208211:0:24069:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788201631.208214:0:24069:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968894 gen 3 00000004:00080000:1.0:1788201631.208224:0:24069:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788201631.208340:0:24069:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788201631.208352:0:24069:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4bd800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788201631.208384:0:24069:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9e04eadcb380) has no exports 00010000:00010000:1.0:1788201631.208967:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788201631.209163:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c6b1f800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788201631.209225:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c6b1e000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788201631.209245:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c7de5000/35604eb4-baf9-45be-a20a-4883a2cd8cf9 for lustre-MDT0000 00000020:00000080:3.0:1788201631.209276:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04fae46000 for lustre-MDT0000 00000020:00000080:3.0:1788201631.209282:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04c6b18800 for lustre-MDT0000 00000020:00000080:3.0:1788201631.209314:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e03c5131000 for lustre-MDT0000 00000020:00080000:1.0:1788201631.210987:0:24069:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9e04eadcb380) has no exports 00000100:00100000:2.0:1788201631.211857:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f900ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458336640:0@lo:9:umount.0 00000100:00100000:2.0:1788201631.211966:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201631.212010:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f9855f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458336768:0@lo:9:umount.0 00000100:00100000:2.0:1788201631.212033:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201631.213833:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458336640 00000100:00100000:3.0:1788201631.213851:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458336640 00000100:00100000:3.0:1788201631.213945:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458336768 00000100:00100000:3.0:1788201631.213949:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458336768 00000100:00100000:3.0:1788201631.213982:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4398 00000100:00100000:3.0:1788201631.213995:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3309:x1875064458336640:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788201631.214035:0:13438:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d60fc 00000100:00080000:3.0:1788201631.214046:0:13438:0:(import.c:65:import_set_state_nolock()) ffff9e04d99be800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788201631.214094:0:13438:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968894 00000100:00100000:3.0:1788201631.214495:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+2:3309:x1875064458336640:12345-0@lo:9:umount.0 Request processed in 502us (2526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201631.214503:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4398 00000100:00100000:3.0:1788201631.214744:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4399 00000100:00100000:3.0:1788201631.214764:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3309:x1875064458336768:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788201631.214781:0:13438:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d610a 00000100:00080000:3.0:1788201631.214788:0:13438:0:(import.c:65:import_set_state_nolock()) ffff9e04c7de1800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788201631.214807:0:13438:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968894 00000100:00100000:3.0:1788201631.215066:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+2:3309:x1875064458336768:12345-0@lo:9:umount.0 Request processed in 305us (3030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201631.215072:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4399 00010000:00010000:0.0:1788201631.216561:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201631.216581:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201631.216588:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788201631.216610:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788201631.216911:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e0501572800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788201631.216937:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788201631.216941:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788201631.216948:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f900ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458336640:0@lo:9:umount.0 00000100:00080000:3.0:1788201631.216967:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4bd800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788201631.216977:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788201631.216980:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788201631.216983:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f9855f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458336768:0@lo:9:umount.0 00010000:00010000:3.0:1788201631.218190:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201631.220623:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788201631.297116:0:24069:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d60d2 00000020:00000080:1.0:1788201631.297139:0:24069:0:(genops.c:906:class_export_put()) final put ffff9e04f4e62800/lustre-QMT0000_UUID 00000020:01000000:1.0:1788201631.297172:0:24069:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788201631.297571:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04f4e62800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788201631.297610:0:24069:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201631.297624:0:24069:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788201631.297629:0:24069:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9e03c2644d40) has no exports 00000020:00000080:0.0:1788201631.306878:0:24069:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d60cb 00000020:00000080:0.0:1788201631.306899:0:24069:0:(genops.c:906:class_export_put()) final put ffff9e04c8360000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788201631.307025:0:24069:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201631.307040:0:24069:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788201631.307044:0:24069:0:(genops.c:906:class_export_put()) final put ffff9e03c371a000/lustre-QMT0000_UUID 00000020:00000080:0.0:1788201631.307048:0:24069:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03c371a000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788201631.307055:0:24069:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788201631.307336:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c8360000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788201631.307858:0:24069:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e04d8083180 - data ffff9e04dd0c46c0/ffff9e03c2dd7800 00000020:01000000:0.0:1788201631.308027:0:24069:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e03c2ec6840 - data ffff9e04ffbb75e8/ffff9e03c1fdcc00 00000100:00080000:3.0:1788201631.362477:0:24069:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788201631.362490:0:24069:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968894 gen 4 00000004:00080000:3.0:1788201631.362508:0:24069:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788201631.362511:0:24069:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788201631.363954:0:23078:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788201631.363963:0:23078:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x18:0x0] index 2 count 1 00000040:00080000:0.0:1788201631.363976:0:23078:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 6 count 2 00000100:00080000:1.0:1788201631.366409:0:24069:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788201631.366419:0:24069:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968894 gen 4 00000004:00080000:1.0:1788201631.366436:0:24069:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201631.366439:0:24069:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788201631.367208:0:23080:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788201631.367215:0:23080:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 1 count 1 00000040:00080000:3.0:1788201631.367228:0:23080:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 6 count 2 00000020:00000080:1.0:1788201631.464990:0:24069:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d6093 00000020:00000080:1.0:1788201631.465010:0:24069:0:(genops.c:906:class_export_put()) final put ffff9e0501570000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788201631.465240:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0501570000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788201631.469929:0:24069:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d60a8 00000020:00000080:1.0:1788201631.469951:0:24069:0:(genops.c:906:class_export_put()) final put ffff9e04c7de3000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788201631.469969:0:24069:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788201631.469976:0:24069:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201631.469987:0:24069:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788201631.469992:0:24069:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9e04eadc8000) has no exports 00000004:01000000:1.0:1788201631.470269:0:24069:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788201631.470280:0:24069:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d6103 00000020:00000080:1.0:1788201631.470285:0:24069:0:(genops.c:906:class_export_put()) final put ffff9e04c7de0000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788201631.470290:0:24069:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788201631.470311:0:24069:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201631.470318:0:24069:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788201631.470320:0:24069:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9e04d1c33380) has no exports 00000020:00000080:1.0:1788201631.470340:0:24069:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d60f5 00000020:00000080:1.0:1788201631.470346:0:24069:0:(genops.c:906:class_export_put()) final put ffff9e04ff4bb800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788201631.471065:0:24069:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788201631.471072:0:24069:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788201631.471131:0:24069:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968894 gen 5 00000004:00080000:1.0:1788201631.471139:0:24069:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201631.471142:0:24069:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201631.471182:0:24069:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201631.471191:0:24069:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201631.471198:0:24069:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d60e7 00000020:00000080:1.0:1788201631.471204:0:24069:0:(genops.c:906:class_export_put()) final put ffff9e04c7de6800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788201631.471209:0:24069:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788201631.471214:0:24069:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201631.471218:0:24069:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788201631.471221:0:24069:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff9e04d1c319c0) has no exports 00000020:00000080:1.0:1788201631.471227:0:24069:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d60e0 00000020:00000080:1.0:1788201631.471230:0:24069:0:(genops.c:906:class_export_put()) final put ffff9e0501574000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788201631.472381:0:24069:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788201631.472388:0:24069:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788201631.472392:0:24069:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968894 gen 5 00000004:00080000:1.0:1788201631.472398:0:24069:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201631.472402:0:24069:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201631.472440:0:24069:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201631.472448:0:24069:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201631.472484:0:24069:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201631.472487:0:24069:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201631.472519:0:24069:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d60af 00000020:00000080:1.0:1788201631.473840:0:24069:0:(genops.c:906:class_export_put()) final put ffff9e04c7de3800/lustre-MDD0000_UUID 00000020:01000000:1.0:1788201631.473856:0:24069:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788201631.473868:0:24069:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201631.473876:0:24069:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788201631.473881:0:24069:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9e04eadccd40) has no exports 00000020:00000080:1.0:1788201631.473913:0:24069:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201631.473918:0:24069:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788201631.473926:0:24069:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d60b6 00000020:00000080:1.0:1788201631.473932:0:24069:0:(genops.c:906:class_export_put()) final put ffff9e04c7de7000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788201631.473941:0:24069:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e04ff44c800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788201631.473945:0:24069:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e04ff44c800 3 00000020:01000004:1.0:1788201631.473948:0:24069:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e04ff44c800 from lustre-MDT0000 00000020:00000080:1.0:1788201631.473969:0:24069:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201631.473972:0:24069:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788201631.473975:0:24069:0:(genops.c:906:class_export_put()) final put ffff9e0501574800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788201631.473978:0:24069:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0501574800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788201631.473991:0:24069:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788201631.474288:0:24069:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1788201631.474308:0:24069:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788201631.474312:0:24069:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788201631.474315:0:24069:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201631.474319:0:24069:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788201631.474675:0:24069:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9e03c5132800 7ad49433-54fa-4e21-b756-859420d95603 192.168.201.30@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201631.474684:0:24069:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9e04ff44a800 b60c000b-7335-444d-a8dc-1a5956712fb2 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201631.474689:0:24069:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9e04eadc99c0) has exports, disconnecting them 00000020:00080000:1.0:1788201631.474695:0:24069:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.201.30@tcp (ffff9e03c5132800), last request at 1788201594 00000020:00000080:1.0:1788201631.474727:0:24069:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d61ce 00000020:00010000:1.0:1788201631.474733:0:24069:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e03c5132800: total 7 00000100:00080000:1.0:1788201631.474739:0:24069:0:(import.c:65:import_set_state_nolock()) ffff9e03c5130800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788201631.474835:0:24069:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.30@tcp (ffff9e03c5132800): rc 0 00000020:00080000:1.0:1788201631.474839:0:24069:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9e04ff44a800), last request at 1788201591 00000020:00000080:1.0:1788201631.474896:0:24069:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d6054 00000020:00010000:1.0:1788201631.474899:0:24069:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e04ff44a800: total 7 00000100:00080000:1.0:1788201631.474902:0:24069:0:(import.c:65:import_set_state_nolock()) ffff9e04ff44b000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788201631.474915:0:24069:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e04ff44a800): rc 0 00000020:00080000:1.0:1788201631.474920:0:24069:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9e04eadc99c0) has no exports 00000100:00100000:1.0:1788201631.474981:0:23052:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9e04d20cba00:23052] 2 exiting: rc = 0 00000020:00010000:0.0:1788201631.475676:0:5846:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e03c5132800: total 7 00010000:00010000:0.0:1788201631.475730:0:5846:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e03c5132800, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1788201631.475780:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c131ec00/0x9383f985bc4d61ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c590e expref: 5 pid: 23052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.475805:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e04ff128200/0x9383f985bc4d61d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c58f9 expref: 4 pid: 23050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.475824:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c32bd600/0x9383f985bc4d61e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5907 expref: 3 pid: 23052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.475838:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c131ee00/0x9383f985bc4d61dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5900 expref: 2 pid: 23052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.475846:0:5846:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e03c5132800, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1788201631.475864:0:5846:0:(genops.c:906:class_export_put()) final put ffff9e03c5132800/7ad49433-54fa-4e21-b756-859420d95603 00000020:00010000:0.0:1788201631.475872:0:5846:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e04ff44a800: total 8 00010000:00010000:0.0:1788201631.475886:0:5846:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e04ff44a800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788201631.475901:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c507c400/0x9383f985bc4d61c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d61c0 expref: 9 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.475913:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e04ff129a00/0x9383f985bc4d6173 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d616c expref: 8 pid: 23052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.475923:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e04ff128a00/0x9383f985bc4d6165 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d615e expref: 7 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.475935:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e04ff128400/0x9383f985bc4d619d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d6196 expref: 6 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.475945:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c32bdc00/0x9383f985bc4d6181 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d617a expref: 5 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.475955:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c507dc00/0x9383f985bc4d618f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d6188 expref: 4 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.475968:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c507de00/0x9383f985bc4d61ab lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d61a4 expref: 3 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.475981:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c507d200/0x9383f985bc4d61b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d61b2 expref: 2 pid: 23051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201631.475991:0:5846:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e04ff44a800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1788201631.476003:0:5846:0:(genops.c:906:class_export_put()) final put ffff9e04ff44a800/b60c000b-7335-444d-a8dc-1a5956712fb2 00010000:00010000:0.0:1788201631.476010:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201631.476012:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201631.476013:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201631.476042:0:23050:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9e04d20cbe00:23050] 0 exiting: rc = 1 00000020:00000080:0.0:1788201631.476215:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c7de3000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1788201631.476223:0:38:0:(genops.c:906:class_export_put()) final put ffff9e04f0040000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201631.476225:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04f0040000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788201631.476231:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788201631.476393:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c7de0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788201631.476400:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04ff4bb800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788201631.476408:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04ff4bd800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788201631.476414:0:38:0:(genops.c:906:class_export_put()) final put ffff9e04c7de4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201631.476416:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c7de4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788201631.476420:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788201631.476457:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c7de6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788201631.476463:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0501574000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788201631.476468:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0501572800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788201631.476473:0:38:0:(genops.c:906:class_export_put()) final put ffff9e04c7de5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201631.476475:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c7de5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788201631.476479:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788201631.476678:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c7de3800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788201631.476684:0:38:0:(genops.c:906:class_export_put()) final put ffff9e0501577000/lustre-MDD0000_UUID 00000020:00000080:0.0:1788201631.476686:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0501577000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788201631.476690:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1788201631.478864:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c7de7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788201631.478880:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03c5132800/7ad49433-54fa-4e21-b756-859420d95603 for MGS 00010000:00010000:2.0:1788201631.482621:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201631.482701:0:23051:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9e04d20cb000:23051] 1 exiting: rc = 0 00000020:00000080:0.0:1788201631.492878:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04ff44a800/b60c000b-7335-444d-a8dc-1a5956712fb2 for MGS 00000020:00000080:0.0:1788201631.501995:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e03c5130800 for MGS 00000020:00000080:0.0:1788201631.502039:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04ff44b000 for MGS 00000100:00100000:3.0:1788201631.522998:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523013:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523020:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523026:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523033:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523039:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523046:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523053:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523060:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523067:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523074:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523093:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523102:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523109:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523116:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523122:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523130:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523136:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523143:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523149:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523155:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523161:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523167:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523180:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523189:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523196:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523204:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523209:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523215:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523222:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523227:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523233:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523238:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523244:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523251:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523256:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523262:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523268:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523275:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523281:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523288:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523315:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523322:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523328:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523334:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523340:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523345:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523350:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523355:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523373:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523380:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523386:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523391:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523397:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523403:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523408:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523414:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523420:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523425:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523432:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523438:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523444:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523450:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201631.523457:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1788201631.523887:0:24069:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788201631.523891:0:24069:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1788201631.529932:0:24069:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e03c2ec68a0 - data ffff9e04ffbb7e58/ffff9e03c1fdd400 00000020:01000000:3.0:1788201631.530089:0:24069:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e03c3565e40 - data ffff9e04ffa09948/ffff9e04f96be000 00000020:00000080:3.0:1788201631.531204:0:24069:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d604d 00000020:00000080:3.0:1788201631.531215:0:24069:0:(genops.c:906:class_export_put()) final put ffff9e04c8287000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788201631.531238:0:24069:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e04ff44c800 from MGS, refs=2 00000020:01000004:3.0:1788201631.531241:0:24069:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e04ff44c800 2 00000020:01000004:3.0:1788201631.531245:0:24069:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e04ff44c800 from MGS 00000020:00000080:3.0:1788201631.531275:0:24069:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201631.531283:0:24069:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788201631.531286:0:24069:0:(genops.c:906:class_export_put()) final put ffff9e04d20b2000/MGS 00000020:00000080:3.0:1788201631.531289:0:24069:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04d20b2000/MGS for MGS 00000020:01000000:3.0:1788201631.531322:0:24069:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788201631.532233:0:24069:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788201631.532244:0:24069:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201631.532255:0:24069:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788201631.532269:0:24069:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9e03c55b5800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788201631.532277:0:24069:0:(genops.c:1574:class_disconnect_exports()) OBD device 17 (ffff9e04d1c34d40) has exports, disconnecting them 00000020:00080000:3.0:1788201631.532334:0:24069:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9e03c55b5800), last request at 1788201592 00000020:00000080:3.0:1788201631.532340:0:24069:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d6142 00000020:00080000:3.0:1788201631.532349:0:24069:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e03c55b5800): rc 0 00000020:00000080:3.0:1788201631.532355:0:24069:0:(genops.c:906:class_export_put()) final put ffff9e03c55b5800/lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788201631.539997:0:24069:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788201631.540010:0:24069:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788201631.540015:0:24069:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788201631.540024:0:24069:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788201631.540421:0:24069:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201631.540436:0:24069:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788201631.540446:0:24069:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e04ff44c800 1 00000020:00000080:3.0:1788201631.540455:0:24069:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d603f 00000020:00000080:3.0:1788201631.540466:0:24069:0:(genops.c:906:class_export_put()) final put ffff9e04d20b3800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788201631.540472:0:24069:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788201631.540477:0:24069:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201631.540482:0:24069:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788201631.540487:0:24069:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9e04f9650000) has no exports 00000020:00000080:0.0:1788201631.544060:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c8287000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788201631.544471:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03c55b5800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788201631.544481:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e03c55b4000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788201631.544490:0:38:0:(genops.c:906:class_export_put()) final put ffff9e03c55b0000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788201631.544493:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03c55b0000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788201631.544499:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788201631.545483:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04d20b3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000001:00100000:0.0:1788201631.554607:0:7657:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201631.554621:0:7657:0:(genops.c:906:class_export_put()) final put ffff9e04c7de2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201631.554746:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c7de2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788201631.555204:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04c7de1800 for lustre-OST0001 00000020:00000080:0.0:1788201631.571315:0:24069:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201631.571347:0:24069:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788201631.571354:0:24069:0:(genops.c:906:class_export_put()) final put ffff9e04ff44b800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788201631.571361:0:24069:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04ff44b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788201631.571374:0:24069:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788201631.571520:0:24069:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e04ff44e800 00000020:01000000:0.0:1788201631.571563:0:24069:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788201631.571568:0:24069:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201631.571574:0:24069:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788201631.571579:0:24069:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9e04f9654d40) has no exports 00000100:00100000:0.0:1788201631.571688:0:23463:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9e03c1c35200:23463] 4 exiting: rc = 0 00000100:00100000:0.0:1788201631.571828:0:23058:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9e03c32a4e00:23058] 2 exiting: rc = 0 00000100:00100000:3.0:1788201631.576532:0:23056:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9e04f900d200:23056] 1 exiting: rc = 0 00000100:00100000:3.0:1788201631.576693:0:23055:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9e04f900de00:23055] 0 exiting: rc = 1 00000100:00100000:2.0:1788201631.577199:0:23366:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9e03c2b0fe00:23366] 3 exiting: rc = 0 00000100:00100000:0.0:1788201631.581386:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.581400:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.581408:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.581414:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.581420:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.581426:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.581431:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.581436:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.581443:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.581448:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.581454:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.581460:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.581467:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.581472:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.581478:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.581484:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.581495:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.581505:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.582707:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.582721:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.582727:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.582736:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.582743:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.582751:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.582758:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.582765:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.582771:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.582778:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.582786:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.582793:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.582799:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.582806:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.582833:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.582840:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.582847:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.582853:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.582862:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.582869:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.582875:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.582881:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.582888:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.582894:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.582900:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.582906:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.583181:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.583190:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.583197:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.583203:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.583210:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.583215:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.583221:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.583227:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.583232:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.583237:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.583243:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.583249:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.583255:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.583260:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.583271:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.583277:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.583283:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.583290:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.583322:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.583330:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.586874:0:23060:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9e04d889c800:23060] 1 exiting: rc = 0 00000100:00100000:3.0:1788201631.587515:0:23059:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9e04ff437a00:23059] 0 exiting: rc = 1 00000100:00100000:1.0:1788201631.587592:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587600:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587606:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587611:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587621:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587627:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587637:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587651:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587657:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587662:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587668:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587673:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587681:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587687:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587692:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587698:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587703:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587708:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587713:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587718:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587723:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587729:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587734:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587740:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587745:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587751:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587757:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587763:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587768:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587774:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587780:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587786:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587792:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587798:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587808:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587819:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587824:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587830:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587837:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587843:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587849:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587855:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587860:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587865:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587870:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587875:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587885:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587890:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587895:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587900:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587905:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587911:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587922:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587928:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587933:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587939:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587944:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587949:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587954:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587959:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587963:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587968:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587973:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.587977:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201631.588654:0:23063:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9e03c1833200:23063] 0 exiting: rc = 1 00000100:00100000:2.0:1788201631.588741:0:23064:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9e04ff084000:23064] 1 exiting: rc = 0 00000100:00100000:1.0:1788201631.588994:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589001:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589008:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589015:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589028:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589035:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589040:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589047:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589054:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589061:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589067:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589073:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589080:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589087:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589094:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589100:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589122:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589132:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589138:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589146:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589178:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589185:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589191:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589268:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589366:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589374:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589383:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589389:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589485:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589493:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589504:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589511:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589518:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589532:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589539:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589546:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589555:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589560:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589566:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589573:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589579:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589585:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589598:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589606:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589613:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589631:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589662:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589668:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589680:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589687:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589693:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589700:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589707:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589714:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589720:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589727:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589733:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589740:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589746:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589752:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589759:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589766:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589772:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.589778:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.600205:0:23066:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9e04ffce9000:23066] 1 exiting: rc = 0 00000100:00100000:0.0:1788201631.600358:0:23065:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9e04ffce9a00:23065] 0 exiting: rc = 1 00000100:00100000:1.0:1788201631.600722:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.600742:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.600834:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.600840:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.600846:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.600851:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.600857:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.600864:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.600870:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.600876:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.600882:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.600887:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.600893:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.600898:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.600905:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.600911:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.600916:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.600929:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.600935:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.600940:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.600951:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.600957:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.600963:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.600974:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.600980:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.600985:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.600990:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.600995:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601007:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601013:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601018:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601024:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601030:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601035:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601042:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601047:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601053:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601058:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601065:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601071:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601076:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601092:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601098:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601104:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601110:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601115:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601121:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601127:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601138:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601144:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601150:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601160:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601166:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601171:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601177:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601184:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601189:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601195:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601201:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601205:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601208:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601212:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601215:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601220:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201631.601565:0:23067:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9e04ffce9800:23067] 0 exiting: rc = 1 00000100:00100000:1.0:1788201631.601565:0:23068:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9e04ffce9400:23068] 1 exiting: rc = 0 00000100:00100000:1.0:1788201631.601966:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601981:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601987:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601992:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.601997:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602003:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602015:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602021:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602027:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602034:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602043:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602052:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602059:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602063:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602069:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602130:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602140:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602155:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602162:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602168:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602175:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602181:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602187:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602193:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602199:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602205:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602213:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602219:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602233:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602240:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602248:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602255:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602261:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602268:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602275:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602283:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602312:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602327:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602335:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602346:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602353:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602359:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602365:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602374:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602383:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602390:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602396:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602402:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602407:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602412:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602418:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602424:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602430:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602435:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602441:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602448:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602455:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602461:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602467:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602472:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602477:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602483:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602490:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602496:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.602905:0:23069:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9e04ff49ae00:23069] 0 exiting: rc = 1 00000100:00100000:3.0:1788201631.603027:0:23070:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9e04ff49a000:23070] 1 exiting: rc = 0 00000100:00100000:1.0:1788201631.603070:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603511:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603523:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603530:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603535:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603541:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603547:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603553:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603558:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603563:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603569:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603575:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603582:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603589:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603594:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603600:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603605:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603611:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603617:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603623:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603628:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603634:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603639:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603661:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603666:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603672:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603678:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603683:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603689:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603695:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603701:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603707:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603713:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603719:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603725:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603730:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603737:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603742:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603813:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603819:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603825:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603832:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603838:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603844:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603850:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603855:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603862:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603867:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603873:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603878:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603884:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603890:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603896:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603902:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603908:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603914:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603919:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603925:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603930:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603935:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603941:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603946:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603951:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.603957:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201631.604873:0:23072:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9e04ff49a600:23072] 1 exiting: rc = 0 00000100:00100000:0.0:1788201631.605191:0:23071:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9e04ff49b000:23071] 0 exiting: rc = 1 00000100:00100000:3.0:1788201631.605250:0:23073:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9e03c1832800:23073] 2 exiting: rc = 0 00000100:00100000:1.0:1788201631.605487:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.605496:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.605504:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.605512:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.605521:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.605587:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.605593:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.605600:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.605606:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.605612:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.605618:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.605625:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.605633:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.605675:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.605691:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.605700:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.605706:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606114:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606125:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606133:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606140:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606147:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606153:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606159:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606165:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606172:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606179:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606185:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606192:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606200:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606206:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606212:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606218:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606224:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606230:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606236:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606241:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606264:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606270:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606276:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606284:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606289:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606465:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606472:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606479:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606485:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606493:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606501:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606508:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606517:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606532:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606539:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606546:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606552:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606559:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606565:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606571:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606578:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606583:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606590:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606598:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606627:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606634:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201631.606651:0:24069:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000001:00100000:0.0:1788201631.609984:0:6732:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201631.609995:0:6732:0:(genops.c:906:class_export_put()) final put ffff9e04d99bf000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788201631.610098:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04d99bf000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788201631.610148:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04d99be800 for lustre-OST0000 00000020:00000080:1.0:1788201631.611129:0:24069:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201631.611140:0:24069:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788201631.611144:0:24069:0:(genops.c:906:class_export_put()) final put ffff9e04ff44f800/MDS_uuid 00000020:00000080:1.0:1788201631.611147:0:24069:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04ff44f800/MDS_uuid for MDS 00000020:01000000:1.0:1788201631.611156:0:24069:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788201631.611348:0:24069:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788201631.719970:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201632.742924:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201633.510491:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201633.510530:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458336896:0@lo:400:kworker.0 00000400:00000100:3.0:1788201633.510619:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875064458336896 offset 0 length 224: 4 00000100:00100000:0.0:1788201633.511092:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875064458337024:0@lo:400:kworker.0 00000400:00000100:0.0:1788201633.511125:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458337024 offset 0 length 224: 4 00000100:00100000:0.0:1788201633.511145:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201633.511150:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875064458337152:0@lo:400:kworker.0 00000400:00000100:0.0:1788201633.511165:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458337152 offset 0 length 224: 4 00010000:00010000:3.0:1788201633.770027:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201634.789982:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1788201635.733087:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.30@tcp portal 26 match 1875064442787968 offset 0 length 224: 4 00000100:00100000:0.0:1788201635.733158:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000400:00000100:0.0:1788201635.733189:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.30@tcp portal 12 match 1875064442788096 offset 0 length 224: 4 00000100:00100000:0.0:1788201635.733214:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201635.733401:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442788224 00000100:00100000:3.0:1788201635.733416:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442788224 00000100:00100000:3.0:1788201635.733514:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442788352 00000100:00100000:3.0:1788201635.733518:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442788352 00000100:00100000:3.0:1788201635.733549:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 381 00000100:00100000:3.0:1788201635.733582:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2360:x1875064442788224:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201635.733689:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2360:x1875064442788224:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 119us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201635.733697:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 381 00000100:00100000:3.0:1788201635.733717:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 382 00000100:00100000:3.0:1788201635.733724:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2360:x1875064442788352:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201635.733748:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2360:x1875064442788352:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201635.733754:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 382 00000100:00080000:0.0:1788201635.734044:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201635.734050:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788201635.813661:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201636.838683:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201637.861764:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201638.631592:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201638.631615:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875064458337536:0@lo:400:kworker.0 00000100:00100000:1.0:1788201638.631657:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458337408:0@lo:400:kworker.0 00000400:00000100:0.0:1788201638.631674:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458337536 offset 0 length 224: 4 00000400:00000100:1.0:1788201638.631734:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458337408 offset 0 length 224: 4 00000100:00100000:1.0:1788201638.631814:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201638.631822:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458337280:0@lo:400:kworker.0 00000400:00000100:1.0:1788201638.631846:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875064458337280 offset 0 length 224: 4 00010000:00010000:1.0:1788201638.903910:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201639.909619:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1788201640.862017:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.30@tcp portal 26 match 1875064442788480 offset 0 length 224: 4 00000400:00000100:1.0:1788201640.862049:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.30@tcp portal 12 match 1875064442788608 offset 0 length 224: 4 00000100:00100000:0.0:1788201640.868055:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201640.868107:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201640.868227:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442788864 00000100:00100000:1.0:1788201640.868241:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442788864 00000100:00100000:1.0:1788201640.868391:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442788736 00000100:00100000:1.0:1788201640.868395:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442788736 00000100:00100000:1.0:1788201640.868430:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 383 00000100:00100000:1.0:1788201640.868443:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2361:x1875064442788864:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201640.868551:0:10484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 384 00000100:00100000:2.0:1788201640.868565:0:10484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2361:x1875064442788736:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201640.868571:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2361:x1875064442788864:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 129us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201640.868581:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 383 00000100:00100000:2.0:1788201640.868609:0:10484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2361:x1875064442788736:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 47us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201640.868617:0:10484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 384 00000100:00080000:0.0:1788201640.868785:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201640.868790:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788201640.933920:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201641.967673:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201642.981677:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201643.749779:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201643.749812:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458337664:0@lo:400:kworker.0 00000400:00000100:0.0:1788201643.749889:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875064458337664 offset 0 length 224: 4 00000100:00100000:3.0:1788201643.750278:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458337920:0@lo:400:kworker.0 00000400:00000100:3.0:1788201643.750338:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458337920 offset 0 length 224: 4 00000100:00100000:3.0:1788201643.750360:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201643.750367:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458337792:0@lo:400:kworker.0 00000400:00000100:3.0:1788201643.750385:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458337792 offset 0 length 224: 4 00010000:00010000:1.0:1788201644.010510:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201645.030517:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1788201645.969042:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.30@tcp portal 26 match 1875064442788992 offset 0 length 224: 4 00000100:00100000:3.0:1788201645.969101:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000400:00000100:3.0:1788201645.969132:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.30@tcp portal 12 match 1875064442789120 offset 0 length 224: 4 00000100:00100000:2.0:1788201645.969288:0:13448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442789248 00000100:00100000:2.0:1788201645.969350:0:13448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442789248 00000100:00100000:2.0:1788201645.969447:0:13448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 385 00000100:00100000:2.0:1788201645.969459:0:13448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f964e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2362:x1875064442789248:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201645.969559:0:13448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f964e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2362:x1875064442789248:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 103us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201645.969567:0:13448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 385 00000100:00080000:3.0:1788201645.970045:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201645.982622:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201645.996543:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442789376 00000100:00100000:0.0:1788201645.996564:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442789376 00000100:00100000:1.0:1788201645.997064:0:13443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4400 00000100:00100000:1.0:1788201645.997079:0:13443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f964ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2358:x1875064442789376:12345-192.168.201.30@tcp:9:kworker.0 00000020:00000080:1.0:1788201645.997119:0:13443:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d6214 00000100:00080000:1.0:1788201645.997130:0:13443:0:(import.c:65:import_set_state_nolock()) ffff9e03c5132000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788201645.997182:0:13443:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968894 00000100:00100000:1.0:1788201645.997633:0:13443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f964ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35604eb4-baf9-45be-a20a-4883a2cd8cf9+2:2358:x1875064442789376:12345-192.168.201.30@tcp:9:kworker.0 Request processed in 555us (15023us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201645.997642:0:13443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4400 00000100:00080000:0.0:1788201645.999603:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788201646.006868:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201646.059426:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788201646.882087:0:7657:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 35604eb4-baf9-45be-a20a-4883a2cd8cf9 00000020:00000080:1.0:1788201646.882098:0:7657:0:(genops.c:906:class_export_put()) final put ffff9e03c5134800/35604eb4-baf9-45be-a20a-4883a2cd8cf9 00000020:00000080:1.0:1788201646.882143:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03c5134800/35604eb4-baf9-45be-a20a-4883a2cd8cf9 for lustre-OST0001 00000020:00000080:1.0:1788201646.882181:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e03c5132000 for lustre-OST0001 00010000:00010000:1.0:1788201647.077676:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201648.101646:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201648.870587:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f9855f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458338176:0@lo:400:kworker.0 00000400:00000100:3.0:1788201648.870642:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458338176 offset 0 length 224: 4 00000100:00100000:1.0:1788201648.871436:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f4de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458338304:0@lo:400:kworker.0 00000400:00000100:1.0:1788201648.871479:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458338304 offset 0 length 224: 4 00000100:00100000:2.0:1788201648.871558:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f9856680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458338048:0@lo:400:kworker.0 00000400:00000100:2.0:1788201648.871586:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875064458338048 offset 0 length 224: 4 00010000:00010000:3.0:1788201649.125542:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1788201649.893395:0:3312:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201633/real 1788201633] req@ffff9e04f964ea00 x1875064458336896/t0(0) o400->MGC192.168.201.130@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788201649 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201649.893431:0:3312:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e04f964ea00 x1875064458336896/t0(0) o400->MGC192.168.201.130@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788201649 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788201649.893440:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9e04c6711800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788201649.893443:0:3312:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00000400:2.0:1788201649.893491:0:3310:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201633/real 1788201633] req@ffff9e04f964f480 x1875064458337152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201649 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201649.893509:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e04f964f480 x1875064458337152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201649 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201649.893516:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788201649.893519:0:3310:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788201649.900147:0:3312:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.130@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788201649.900152:0:3312:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788201649.900161:0:3312:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e04f964ea00 x1875064458336896/t0(0) o400->MGC192.168.201.130@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788201649 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201649.900177:0:3312:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e03c2b7d880 x1875064458337280/t0(0) o400->MGC192.168.201.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201654 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201649.900200:0:3312:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e04f964df80 x1875064458337664/t0(0) o400->MGC192.168.201.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201659 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201649.900269:0:3312:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e04f9856680 x1875064458338048/t0(0) o400->MGC192.168.201.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201664 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788201649.900277:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788201649.900280:0:3312:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788201649.900282:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788201649.900284:0:3312:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:1.0:1788201649.900956:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458336896:0@lo:400:kworker.0 00000100:00080000:3.0:1788201649.901251:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) b60c000b-7335-444d-a8dc-1a5956712fb2->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201649.901256:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788201649.901261:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e04c6711800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201649.901266:0:38:0:(import.c:510:import_select_connection()) MGC192.168.201.130@tcp: connect to NID 0@lo last attempt 867 00000100:00080000:3.0:1788201649.901275:0:38:0:(import.c:624:import_select_connection()) MGC192.168.201.130@tcp: import ffff9e04c6711800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1788201649.901336:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e04f964fb80 x1875064458338432/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201649.903386:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b60c000b-7335-444d-a8dc-1a5956712fb2:3309:1875064458338432:0@lo:250:kworker.0 00000400:00000100:1.0:1788201649.903446:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875064458338432 offset 0 length 520: 4 00000100:00100000:1.0:1788201649.903528:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201649.903538:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458338560:0@lo:400:kworker.0 00000400:00000100:1.0:1788201649.903561:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458338560 offset 0 length 224: 4 00000100:00080000:2.0:1788201649.910871:0:3310:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00100000:2.0:1788201649.911387:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458337280:0@lo:400:kworker.0 00000100:00000400:2.0:1788201649.911426:0:3310:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201633/real 1788201633] req@ffff9e04f964dc00 x1875064458337024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201649 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201649.911443:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e04f964dc00 x1875064458337024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201649 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201649.911451:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788201649.911455:0:3310:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788201649.911458:0:3310:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00100000:2.0:1788201649.911493:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f9856680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458338048:0@lo:400:kworker.0 00000100:00100000:2.0:1788201649.911507:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458337664:0@lo:400:kworker.0 00000100:00080000:3.0:1788201649.913266:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201649.913273:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201649.913277:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201649.913305:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 872 00000100:00080000:3.0:1788201649.913315:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e04f5751000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1788201649.913357:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e04f964ea00 x1875064458338688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201649.913366:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875064458337152:0@lo:400:kworker.0 00000100:00100000:2.0:1788201649.913379:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875064458337024:0@lo:400:kworker.0 00000100:00080000:3.0:1788201649.913394:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201649.913398:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201649.913400:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201649.913405:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 872 00000100:00080000:3.0:1788201649.913409:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e04ff4ba000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1788201649.913423:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e04f964d180 x1875064458338816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201649.914483:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875064458338688:0@lo:38:kworker.0 00000400:00000100:2.0:1788201649.914540:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458338688 offset 0 length 520: 4 00000100:00100000:2.0:1788201649.914576:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875064458338816:0@lo:38:kworker.0 00000400:00000100:2.0:1788201649.914609:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458338816 offset 0 length 520: 4 00000020:01000004:0.0:1788201649.931136:0:24521:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788201649.931142:0:24521:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788201649.931264:0:24521:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e04c8351000 00000020:01000004:0.0:1788201649.931279:0:24521:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788201649.931291:0:24521:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788201649.931384:0:24521:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9e04ff1e4d40) 00000020:00000080:0.0:1788201649.931400:0:24521:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788201650.034865:0:24521:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788201650.085142:0:24521:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3a:0x0] (8/32) 00100000:10000000:3.0:1788201650.108290:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 436: rc = 0 00100000:10000000:1.0:1788201650.114408:0:24521:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788201650.114539:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 436: rc = 0 00100000:10000000:1.0:1788201650.114700:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 436: rc = 0 00100000:10000000:1.0:1788201650.114790:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 436: rc = 0 00100000:10000000:1.0:1788201650.114882:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 436: rc = 0 00100000:10000000:1.0:1788201650.114985:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 436: rc = 0 00100000:10000000:2.0:1788201650.117436:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 438: rc = 0 00100000:10000000:3.0:1788201650.147081:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 474: rc = 0 00100000:10000000:3.0:1788201650.147184:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 474: rc = 0 00010000:00010000:1.0:1788201650.150545:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788201650.164999:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 363: rc = 0 00100000:10000000:3.0:1788201650.190512:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 363: rc = 0 00100000:10000000:3.0:1788201650.197712:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 363: rc = 0 00100000:10000000:2.0:1788201650.208249:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 363: rc = 0 00100000:10000000:3.0:1788201650.214470:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 363: rc = 0 00100000:10000000:3.0:1788201650.219685:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 363: rc = 0 00100000:10000000:3.0:1788201650.221809:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 363: rc = 0 00100000:10000000:3.0:1788201650.224554:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 363: rc = 0 00100000:10000000:3.0:1788201650.236133:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 363: rc = 0 00100000:10000000:3.0:1788201650.242179:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 363: rc = 0 00100000:10000000:1.0:1788201650.244431:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 363: rc = 0 00100000:10000000:1.0:1788201650.249178:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 363: rc = 0 00100000:10000000:1.0:1788201650.252444:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 595: rc = 0 00100000:10000000:1.0:1788201650.254887:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 595: rc = 0 00100000:10000000:1.0:1788201650.259020:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 595: rc = 0 00100000:10000000:1.0:1788201650.261719:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 595: rc = 0 00100000:10000000:0.0:1788201650.266582:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 595: rc = 0 00100000:10000000:0.0:1788201650.268434:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 595: rc = 0 00100000:10000000:0.0:1788201650.271148:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 595: rc = 0 00100000:10000000:0.0:1788201650.273851:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 595: rc = 0 00100000:10000000:0.0:1788201650.282062:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 595: rc = 0 00100000:10000000:0.0:1788201650.293718:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 595: rc = 0 00100000:10000000:0.0:1788201650.295475:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 595: rc = 0 00100000:10000000:0.0:1788201650.297483:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 595: rc = 0 00100000:10000000:0.0:1788201650.300067:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 595: rc = 0 00100000:10000000:0.0:1788201650.310382:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 595: rc = 0 00100000:10000000:0.0:1788201650.312084:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 595: rc = 0 00100000:10000000:0.0:1788201650.313531:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 595: rc = 0 00100000:10000000:1.0:1788201650.322940:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 595: rc = 0 00100000:10000000:1.0:1788201650.327918:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 595: rc = 0 00100000:10000000:1.0:1788201650.329214:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 595: rc = 0 00100000:10000000:1.0:1788201650.330526:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 595: rc = 0 00100000:10000000:1.0:1788201650.331509:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 595: rc = 0 00100000:10000000:1.0:1788201650.336606:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 595: rc = 0 00100000:10000000:1.0:1788201650.338526:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 595: rc = 0 00100000:10000000:1.0:1788201650.350637:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 595: rc = 0 00100000:10000000:0.0:1788201650.352812:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 595: rc = 0 00100000:10000000:0.0:1788201650.355494:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 595: rc = 0 00100000:10000000:0.0:1788201650.357445:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 595: rc = 0 00100000:10000000:0.0:1788201650.358818:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 595: rc = 0 00100000:10000000:0.0:1788201650.360504:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 595: rc = 0 00100000:10000000:0.0:1788201650.373836:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 595: rc = 0 00100000:10000000:0.0:1788201650.377913:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 595: rc = 0 00100000:10000000:0.0:1788201650.379633:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 595: rc = 0 00100000:10000000:1.0:1788201650.400537:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 590: rc = 0 00100000:10000000:1.0:1788201650.402360:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000bd0:0x1:0x0] under 590: rc = 0 00100000:10000000:0.0:1788201650.415859:0:24521:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1788201650.417066:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 359: rc = 0 00100000:10000000:0.0:1788201650.423384:0:24521:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1788201650.423520:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 359: rc = 0 00100000:10000000:0.0:1788201650.430489:0:24521:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1788201650.430621:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 359: rc = 0 00100000:10000000:1.0:1788201650.441239:0:24521:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1788201650.441472:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 475: rc = 0 00100000:10000000:1.0:1788201650.444586:0:24521:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1788201650.444731:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 475: rc = 0 00100000:10000000:1.0:1788201650.449695:0:24521:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1788201650.449810:0:24521:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 475: rc = 0 00000020:00000080:1.0:1788201650.450692:0:24521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788201650.450701:0:24521:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788201650.450712:0:24521:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d64bb 00000020:01000004:1.0:1788201650.450721:0:24521:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1788201650.450730:0:24521:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788201650.450735:0:24521:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e04c8351000 from MGS 00000020:01000004:1.0:1788201650.450738:0:24521:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788201650.450749:0:24521:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9e04f9654d40) 00000020:00000080:1.0:1788201650.450760:0:24521:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788201650.450815:0:24521:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e04c8351000 from MGS, refs=2 00080000:01000000:1.0:1788201650.450820:0:24521:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788201650.450824:0:24521:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d64c9 00010000:00010000:1.0:1788201650.451065:0:24521:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-2 is initialized 00000040:01000000:1.0:1788201650.536721:0:24521:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788201650.536755:0:24521:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788201650.536758:0:24521:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788201650.543738:0:24523:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788201650.544341:0:24521:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788201650.544503:0:24521:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788201650.570793:0:24521:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788201650.571173:0:24521:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788201650.571458:0:24521:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788201650.571465:0:24521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788201650.572407:0:24521:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788201650.572416:0:24521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788201650.572738:0:24521:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788201650.572745:0:24521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788201650.573583:0:24521:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788201650.573615:0:24521:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1788201650.573616:0:24521:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.130@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1788201650.573620:0:24521:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.130@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:1.0:1788201650.573627:0:24521:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9e04c6711800 already not connected (conn 9, was 0): CONNECTING 00000100:00100000:1.0:1788201650.573633:0:24521:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 12s for inflight to error out 00000100:00100000:3.0:1788201651.110215:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201651.110340:0:24526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442789504 00000100:00100000:0.0:1788201651.110357:0:24526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442789504 00000100:00100000:0.0:1788201651.110478:0:24526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:0.0:1788201651.110489:0:24526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2451450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2361:x1875064442789504:12345-192.168.201.30@tcp:400:kworker.0 00000020:00080000:0.0:1788201651.110499:0:24526:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.30@tcp 00000100:00100000:0.0:1788201651.110588:0:24526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2451450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2361:x1875064442789504:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 99us (391us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788201651.110595:0:24526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:2.0:1788201651.131946:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000400:00000100:2.0:1788201651.131984:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.30@tcp portal 12 match 1875064442789632 offset 0 length 520: 4 00000100:00100000:1.0:1788201651.132181:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442789760 00000100:00100000:1.0:1788201651.132200:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442789760 00000100:00100000:1.0:1788201651.132356:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 386 00000100:00100000:1.0:1788201651.132371:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2362:x1875064442789760:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201651.132488:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2362:x1875064442789760:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 120us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201651.132502:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 386 00000100:00100000:3.0:1788201651.132531:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00080000:0.0:1788201651.133114:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201651.133135:0:24528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442789888 00000100:00100000:0.0:1788201651.133141:0:24528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442789888 00000100:00100000:0.0:1788201651.133177:0:24528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:0.0:1788201651.133185:0:24528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2358:x1875064442789888:12345-192.168.201.30@tcp:250:ptlrpcd_01_00.0 00010000:00080000:0.0:1788201651.133215:0:24528:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 7ad49433-54fa-4e21-b756-859420d95603@192.168.201.30@tcp t0 exp 0000000000000000 cur 926 last 0 00000020:00000080:0.0:1788201651.133255:0:24528:0:(genops.c:1406:class_connect()) connect: client 7ad49433-54fa-4e21-b756-859420d95603, cookie 0x9383f985bc4d64d0 00000100:00080000:0.0:1788201651.133463:0:24528:0:(import.c:65:import_set_state_nolock()) ffff9e04c6b8d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201651.133572:0:24528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+5:2358:x1875064442789888:12345-192.168.201.30@tcp:250:ptlrpcd_01_00.0 Request processed in 386us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201651.133579:0:24528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1 00010000:00010000:0.0:1788201651.173487:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201652.202153:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201653.209210:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201653.209332:0:24526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442790016 00000100:00100000:0.0:1788201653.209342:0:24526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442790016 00000100:00100000:0.0:1788201653.209418:0:24526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:0.0:1788201653.209428:0:24526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2450450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+5:5601:x1875064442790016:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201653.209446:0:24526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201653.209468:0:24526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c2cc7800/0x9383f985bc4d64d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5946 expref: -99 pid: 24526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.209498:0:24526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c2cc7800/0x9383f985bc4d64d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5946 expref: 6 pid: 24526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.209511:0:24526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c2cc7800/0x9383f985bc4d64d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5946 expref: 6 pid: 24526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.209521:0:24526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc7800, rc 0) 00000100:00100000:0.0:1788201653.209600:0:24526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2450450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+6:5601:x1875064442790016:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 173us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201653.209607:0:24526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:2.0:1788201653.220057:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201653.221132:0:24527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442790144 00000100:00100000:3.0:1788201653.221144:0:24527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442790144 00000100:00100000:3.0:1788201653.221218:0:24527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:3.0:1788201653.221229:0:24527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+6:5601:x1875064442790144:12345-192.168.201.30@tcp:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788201653.221361:0:24527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+6:5601:x1875064442790144:12345-192.168.201.30@tcp:256:ll_cfg_requeue.0 Request processed in 133us (1312us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201653.221554:0:24527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3 00010000:00010000:2.0:1788201653.222288:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201653.247486:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201653.247582:0:24528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442790272 00000100:00100000:2.0:1788201653.247593:0:24528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442790272 00000100:00100000:2.0:1788201653.247649:0:24528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:2.0:1788201653.247659:0:24528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+6:5601:x1875064442790272:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201653.247676:0:24528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201653.247699:0:24528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e04c7ea7c00/0x9383f985bc4d64de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c594d expref: -99 pid: 24528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.247726:0:24528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e04c7ea7c00/0x9383f985bc4d64de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c594d expref: 7 pid: 24528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.247742:0:24528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e04c7ea7c00/0x9383f985bc4d64de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c594d expref: 7 pid: 24528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.247750:0:24528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c7ea7c00, rc 0) 00000100:00100000:2.0:1788201653.247815:0:24528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+7:5601:x1875064442790272:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 157us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201653.247831:0:24528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:1.0:1788201653.250712:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201653.251375:0:24526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442790400 00000100:00100000:0.0:1788201653.251387:0:24526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442790400 00000100:00100000:0.0:1788201653.251453:0:24526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:0.0:1788201653.251463:0:24526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+7:5601:x1875064442790400:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788201653.254114:0:24534:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788201653.254538:0:24526:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 20 20000000:01000000:0.0:1788201653.274169:0:24535:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788201653.274179:0:24535:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788201653.274182:0:24535:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788201653.274245:0:24535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1788201653.280455:0:24526:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788201653.280755:0:24526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+8:5601:x1875064442790400:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 29288us (30046us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201653.280774:0:24526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:1.0:1788201653.288721:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201653.288842:0:24527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442790528 00000100:00100000:3.0:1788201653.288853:0:24527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442790528 00000100:00100000:3.0:1788201653.288976:0:24527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:3.0:1788201653.288986:0:24527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+8:5601:x1875064442790528:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201653.289283:0:24527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+8:5601:x1875064442790528:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 Request processed in 298us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201653.289317:0:24527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:3.0:1788201653.297520:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201653.297616:0:24526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442790656 00000100:00100000:1.0:1788201653.297627:0:24526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442790656 00000100:00100000:1.0:1788201653.297689:0:24526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:1.0:1788201653.297701:0:24526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+8:5601:x1875064442790656:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201653.297719:0:24526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201653.297743:0:24526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c2ef0200/0x9383f985bc4d64e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5954 expref: -99 pid: 24526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.297772:0:24526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c2ef0200/0x9383f985bc4d64e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5954 expref: 9 pid: 24526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.297783:0:24526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c2ef0200/0x9383f985bc4d64e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5954 expref: 9 pid: 24526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.297797:0:24526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2ef0200, rc 0) 00000100:00100000:1.0:1788201653.297861:0:24526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442790656:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 162us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201653.297868:0:24526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:1.0:1788201653.302033:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201653.302125:0:24527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442790784 00000100:00100000:3.0:1788201653.302136:0:24527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442790784 00000100:00100000:3.0:1788201653.302254:0:24527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:3.0:1788201653.302273:0:24527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442790784:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201653.303006:0:24527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442790784:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 741us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201653.303016:0:24527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:1.0:1788201653.314109:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201653.317837:0:24528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442790912 00000100:00100000:2.0:1788201653.317852:0:24528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442790912 00000100:00100000:2.0:1788201653.317924:0:24528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:2.0:1788201653.317934:0:24528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442790912:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201653.323427:0:24528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442790912:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 Request processed in 5481us (9313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201653.323444:0:24528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:1.0:1788201653.335008:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201653.335098:0:24527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442791040 00000100:00100000:3.0:1788201653.335108:0:24527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442791040 00000100:00100000:3.0:1788201653.335245:0:24527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:3.0:1788201653.335256:0:24527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442791040:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201653.335281:0:24527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201653.335330:0:24527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e04c0030000/0x9383f985bc4d64ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c595b expref: -99 pid: 24527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.335361:0:24527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e04c0030000/0x9383f985bc4d64ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c595b expref: 10 pid: 24527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.335385:0:24527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e04c0030000/0x9383f985bc4d64ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c595b expref: 10 pid: 24527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.335394:0:24527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0030000, rc 0) 00000100:00100000:3.0:1788201653.335471:0:24527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:5601:x1875064442791040:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 217us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201653.335478:0:24527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:2.0:1788201653.337905:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201653.337993:0:24528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442791168 00000100:00100000:0.0:1788201653.338002:0:24528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442791168 00000100:00100000:0.0:1788201653.338053:0:24528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:0.0:1788201653.338063:0:24528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:5601:x1875064442791168:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201653.338387:0:24528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:5601:x1875064442791168:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 325us (490us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201653.338396:0:24528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00010000:00010000:0.0:1788201654.245755:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1788201654.949439:0:3313:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201638/real 1788201638] req@ffff9e03c2b7f800 x1875064458337408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201654 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201654.949474:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e03c2b7f800 x1875064458337408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201654 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201654.949481:0:3313:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff9e04ff4ba000 already not connected (conn 15, was 14): CONNECTING 00000100:00100000:2.0:1788201654.949497:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458337408:0@lo:400:kworker.0 00000100:00000400:0.0:1788201655.013438:0:3311:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201638/real 1788201638] req@ffff9e03c2b7df80 x1875064458337536/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201654 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201655.013474:0:3311:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e03c2b7df80 x1875064458337536/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201654 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201655.013482:0:3311:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff9e04f5751000 already not connected (conn 15, was 14): CONNECTING 00000100:00100000:0.0:1788201655.013499:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875064458337536:0@lo:400:kworker.0 00000100:00080000:1.0:1788201655.013730:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) b60c000b-7335-444d-a8dc-1a5956712fb2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201655.013735:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) b60c000b-7335-444d-a8dc-1a5956712fb2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201655.013738:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201655.013741:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201655.013743:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201655.013746:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788201655.269531:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201656.213901:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201656.213957:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201656.214062:0:24527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442791296 00000100:00100000:1.0:1788201656.214072:0:24527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442791296 00000100:00100000:1.0:1788201656.214130:0:24527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:1.0:1788201656.214140:0:24527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1e22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442791296:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201656.214236:0:24527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1e22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442791296:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 97us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201656.214243:0:24527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:3.0:1788201656.214688:0:13444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442791424 00000100:00100000:3.0:1788201656.214693:0:13444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442791424 00000100:00100000:3.0:1788201656.214897:0:13444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 387 00000100:00100000:3.0:1788201656.214906:0:13444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2359:x1875064442791424:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201656.215009:0:13444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2359:x1875064442791424:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 104us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201656.215017:0:13444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 387 00000100:00080000:0.0:1788201656.227175:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788201656.293617:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201657.318722:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201658.345171:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1788201659.045466:0:3313:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201643/real 1788201643] req@ffff9e04f964ed80 x1875064458337792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201659 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201659.045513:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e04f964ed80 x1875064458337792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201659 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201659.045523:0:3313:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff9e04ff4ba000 already not connected (conn 15, was 14): CONNECTING 00000100:00000400:2.0:1788201659.045531:0:3313:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201643/real 1788201643] req@ffff9e04f964f800 x1875064458337920/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201659 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201659.045544:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e04f964f800 x1875064458337920/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201659 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201659.045551:0:3313:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff9e04f5751000 already not connected (conn 15, was 14): CONNECTING 00000100:00100000:2.0:1788201659.045563:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875064458337792:0@lo:400:kworker.0 00000100:00100000:2.0:1788201659.045569:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458337920:0@lo:400:kworker.0 00000100:00100000:1.0:1788201659.109507:0:3309:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201649/real 1788201649] req@ffff9e04f964d180 x1875064458338816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201659 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201659.109559:0:3309:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e04f964d180 x1875064458338816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201659 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201659.109573:0:3309:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201649/real 1788201649] req@ffff9e04f964ea00 x1875064458338688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201659 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201659.109585:0:3309:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e04f964ea00 x1875064458338688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201659 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201659.109595:0:3309:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201649/real 1788201649] req@ffff9e04f964fb80 x1875064458338432/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788201659 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201659.109608:0:3309:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e04f964fb80 x1875064458338432/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788201659 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788201659.109630:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201659.109666:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788201659.109671:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875064458338816:0@lo:38:kworker.0 00000100:00080000:1.0:1788201659.109678:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201659.109684:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788201659.109687:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875064458338688:0@lo:38:kworker.0 00000100:00080000:1.0:1788201659.109692:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04c6711800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201659.109695:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788201659.109717:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b60c000b-7335-444d-a8dc-1a5956712fb2:3309:1875064458338432:0@lo:250:kworker.0 00000100:00080000:3.0:1788201659.109836:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) b60c000b-7335-444d-a8dc-1a5956712fb2->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201659.109842:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788201659.109845:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e04c6711800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201659.109851:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.130@tcp: connect to NID 0@lo last attempt 925 00000100:00080000:3.0:1788201659.109857:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.130@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788201659.109865:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.130@tcp: import ffff9e04c6711800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1788201659.109907:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e04f964d500 x1875064458338944/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201659.109936:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201659.109939:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201659.109941:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201659.109944:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 925 00000100:00080000:3.0:1788201659.109947:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788201659.109951:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e04ff4ba000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1788201659.109968:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e04f964c380 x1875064458339072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201659.109976:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201659.109979:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201659.109981:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201659.109985:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 925 00000100:00080000:3.0:1788201659.109987:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788201659.109991:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e04f5751000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1788201659.110004:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e04f964c000 x1875064458339200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:0.0:1788201659.110102:0:24521:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1788201659.110124:0:24521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e04ff129400/0x9383f985bc4d61a4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4d61ab expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201659.110146:0:24521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e04ff129400/0x9383f985bc4d61a4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4d61ab expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201659.110159:0:24521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788201659.110188:0:24521:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201659.110201:0:24521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e04ff129400/0x9383f985bc4d61a4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4d61ab expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.110233:0:24521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c507c000/0x9383f985bc4d615e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4d6165 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201659.110241:0:24521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c507c000/0x9383f985bc4d615e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4d6165 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201659.110246:0:24521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201659.110250:0:24521:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201659.110254:0:24521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c507c000/0x9383f985bc4d615e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4d6165 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.110263:0:24521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e04ff128600/0x9383f985bc4d616c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4d6173 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201659.110270:0:24521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e04ff128600/0x9383f985bc4d616c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4d6173 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201659.110276:0:24521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201659.110289:0:24521:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201659.110339:0:24521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e04ff128600/0x9383f985bc4d616c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4d6173 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.110350:0:24521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e04ff129800/0x9383f985bc4d6188 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4d618f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201659.110360:0:24521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e04ff129800/0x9383f985bc4d6188 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4d618f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201659.110365:0:24521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201659.110369:0:24521:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201659.110373:0:24521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e04ff129800/0x9383f985bc4d6188 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4d618f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.110382:0:24521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c131e600/0x9383f985bc4d6196 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4d619d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201659.110388:0:24521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c131e600/0x9383f985bc4d6196 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4d619d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201659.110392:0:24521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201659.110395:0:24521:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201659.110398:0:24521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c131e600/0x9383f985bc4d6196 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4d619d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.110406:0:24521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c507ca00/0x9383f985bc4d61c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4d61c7 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201659.110411:0:24521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c507ca00/0x9383f985bc4d61c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4d61c7 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201659.110416:0:24521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201659.110420:0:24521:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201659.110422:0:24521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c507ca00/0x9383f985bc4d61c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4d61c7 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.110439:0:24521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c131e800/0x9383f985bc4d617a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4d6181 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201659.110445:0:24521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c131e800/0x9383f985bc4d617a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4d6181 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201659.110450:0:24521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788201659.110453:0:24521:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201659.110457:0:24521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c131e800/0x9383f985bc4d617a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4d6181 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.110465:0:24521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e04ff129600/0x9383f985bc4d61b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x9383f985bc4d61b9 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201659.110471:0:24521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e04ff129600/0x9383f985bc4d61b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x9383f985bc4d61b9 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201659.110476:0:24521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788201659.110479:0:24521:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201659.110483:0:24521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e04ff129600/0x9383f985bc4d61b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x9383f985bc4d61b9 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788201659.110500:0:24521:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9e04c6711800 already not connected (conn 10, was 0): CONNECTING 00000100:00080000:0.0:1788201659.110505:0:24521:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:1.0:1788201659.110879:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b60c000b-7335-444d-a8dc-1a5956712fb2:3309:1875064458338944:0@lo:250:kworker.0 00000100:00100000:1.0:1788201659.110972:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201659.111054:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875064458339072:0@lo:38:kworker.0 00000400:00000100:1.0:1788201659.111079:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458339072 offset 0 length 520: 4 00000100:00100000:1.0:1788201659.111096:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875064458339200:0@lo:38:kworker.0 00000400:00000100:1.0:1788201659.111113:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458339200 offset 0 length 520: 4 00000100:00100000:0.0:1788201659.112205:0:24526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458338944 00000100:00100000:0.0:1788201659.112417:0:24526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458338944 00000100:00100000:0.0:1788201659.112486:0:24526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201659.112495:0:24526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1e22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3309:x1875064458338944:12345-0@lo:250:kworker.0 00010000:00080000:0.0:1788201659.112532:0:24526:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from b60c000b-7335-444d-a8dc-1a5956712fb2@0@lo t0 exp 0000000000000000 cur 934 last 0 00000020:00000080:0.0:1788201659.112568:0:24526:0:(genops.c:1406:class_connect()) connect: client b60c000b-7335-444d-a8dc-1a5956712fb2, cookie 0x9383f985bc4d64f3 00000100:00080000:0.0:1788201659.112737:0:24526:0:(import.c:65:import_set_state_nolock()) ffff9e03c55b5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201659.112898:0:24526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1e22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+5:3309:x1875064458338944:12345-0@lo:250:kworker.0 Request processed in 401us (1924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201659.112906:0:24526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788201659.117043:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.130@tcp: connect to target with instance 0 10000000:01000000:2.0:1788201659.117997:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:02000400:2.0:1788201659.118006:0:3309:0:(import.c:1284:ptlrpc_connect_interpret()) Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0x9383f985bc4d64f3 00000100:00080000:2.0:1788201659.139399:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04c6711800 MGS: changing import state from CONNECTING to EVICTED 00000100:00080000:2.0:1788201659.139420:0:3309:0:(import.c:1674:ptlrpc_import_recovery_state_machine()) evicted from MGS@0@lo; invalidating 00000100:00100000:1.0:1788201659.139791:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b60c000b-7335-444d-a8dc-1a5956712fb2:3309:1875064458338944:0@lo:250:kworker.0 00000100:00080000:1.0:1788201659.139853:0:24521:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished EVICTED, rc = 0 00000020:01000004:1.0:1788201659.139867:0:24521:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788201659.139879:0:24521:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788201659.139896:0:24521:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9e04f9653380) 00000020:00000080:1.0:1788201659.139917:0:24521:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:2.0:1788201659.142645:0:24538:0:(import.c:1598:ptlrpc_invalidate_import_thread()) thread invalidate import MGC192.168.201.130@tcp to MGS@0@lo 00000100:00100000:2.0:1788201659.142654:0:24538:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788201659.142659:0:24538:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00080000:2.0:1788201659.142673:0:24538:0:(import.c:65:import_set_state_nolock()) ffff9e04c6711800 MGS: changing import state from EVICTED to RECOVER 00000100:00080000:2.0:1788201659.142681:0:24538:0:(import.c:65:import_set_state_nolock()) ffff9e04c6711800 MGS: changing import state from RECOVER to FULL 10000000:01000000:2.0:1788201659.142683:0:24538:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788201659.142726:0:24538:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:02000000:2.0:1788201659.142730:0:24538:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) MGC192.168.201.130@tcp: Connection restored to 0@lo (at 0@lo) 00000020:01000000:3.0:1788201659.155405:0:36:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.201.130@tcp 10000000:01000000:3.0:1788201659.155434:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1788201659.155439:0:36:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788201659.155441:0:36:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788201659.155442:0:36:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201659.155444:0:36:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201659.155446:0:36:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201659.155447:0:36:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201659.155449:0:36:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201659.155452:0:36:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201659.155453:0:36:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1788201659.155542:0:36:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1788201659.155549:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:3.0:1788201659.155551:0:36:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788201659.155552:0:36:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788201659.155554:0:36:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201659.155555:0:36:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201659.155556:0:36:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201659.155557:0:36:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201659.155558:0:36:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201659.155559:0:36:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201659.155560:0:36:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1788201659.155576:0:36:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1788201659.155631:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458339328:0@lo:253:kworker.0 00000100:00100000:3.0:1788201659.155732:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201659.155797:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201659.155804:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458339456:0@lo:253:kworker.0 00000100:00100000:3.0:1788201659.155863:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201659.155905:0:24528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458339328 00000100:00100000:3.0:1788201659.155914:0:24528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458339328 00000100:00100000:3.0:1788201659.155988:0:24528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458339456 00000100:00100000:3.0:1788201659.155992:0:24528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458339456 00000100:00100000:3.0:1788201659.156013:0:24528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788201659.156024:0:24528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1e20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+6:3310:x1875064458339328:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1788201659.156060:0:24528:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788201659.156078:0:24528:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788201659.156458:0:24527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788201659.156472:0:24527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1e21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+6:3310:x1875064458339456:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1788201659.156498:0:24527:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:0.0:1788201659.167108:0:24521:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788201659.167393:0:24521:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788201659.167402:0:24521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788201659.169711:0:24521:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788201659.169726:0:24521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788201659.174860:0:24521:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788201659.174876:0:24521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788201659.175936:0:24521:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788201659.176230:0:24521:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788201659.176237:0:24521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788201659.177020:0:24521:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788201659.177029:0:24521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788201659.230889:0:24521:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201659.231229:0:24521:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788201659.231237:0:24521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788201659.232414:0:24521:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788201659.232425:0:24521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788201659.233588:0:24521:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201659.233819:0:24521:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788201659.233826:0:24521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788201659.234479:0:24521:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788201659.234497:0:24521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788201659.235179:0:24521:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201659.235393:0:24521:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788201659.235400:0:24521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788201659.235964:0:24521:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788201659.235972:0:24521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788201659.237892:0:24521:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201659.238206:0:24521:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788201659.238214:0:24521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788201659.238873:0:24521:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788201659.238881:0:24521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 20000000:01000000:2.0:1788201659.249772:0:24528:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788201659.249791:0:24528:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788201659.249827:0:24534:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788201659.249833:0:24534:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788201659.249866:0:24534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e04c7ea6800/0x9383f985bc4d6501 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201659.249892:0:24534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e03c2cc7800/0x9383f985bc4d64d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5946 expref: 9 pid: 24526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201659.249903:0:24534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e04c7ea6800/0x9383f985bc4d6501 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201659.249957:0:24534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e03c2cc7800/0x9383f985bc4d64d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5946 expref: 9 pid: 24526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201659.249980:0:24534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e03c2cc7800/0x9383f985bc4d64d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5946 expref: 9 pid: 24526 timeout: 1034 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201659.250001:0:24534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5487480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:24534:1875064458339584:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788201659.250133:0:24534:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91000 going to sleep for 11 seconds 20000000:01000000:0.0:1788201659.250429:0:24527:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788201659.254696:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201659.256752:0:24534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5487480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:24534:1875064458339584:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788201659.256800:0:24534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e04c7ea6800/0x9383f985bc4d6501 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201659.258348:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442791552 00000100:00100000:0.0:1788201659.258364:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442791552 00010000:00010000:0.0:1788201659.258403:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e03c2cc7800/0x9383f985bc4d64d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5946 expref: 10 pid: 24526 timeout: 1034 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201659.258450:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1604 00000100:00100000:0.0:1788201659.258461:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f964d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442791552:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201659.258478:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201659.258485:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e03c2cc7800/0x9383f985bc4d64d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5946 expref: 10 pid: 24526 timeout: 1034 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.258497:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e03c2cc7800/0x9383f985bc4d64d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5946 expref: 10 pid: 24526 timeout: 1034 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.258520:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c2cc7800/0x9383f985bc4d64d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5946 expref: 10 pid: 24526 timeout: 1034 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.258536:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e04c7ea6800/0x9383f985bc4d6501 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.258544:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e04c7ea6800/0x9383f985bc4d6501 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788201659.258574:0:8524:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008742710s 00010000:00010000:0.0:1788201659.258579:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e04c7ea6800/0x9383f985bc4d6501 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.258585:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e04c7ea6800/0x9383f985bc4d6501 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.258593:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e04c7ea6800/0x9383f985bc4d6501 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.258599:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e04c7ea6800/0x9383f985bc4d6501 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.258605:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c7ea6800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201659.258609:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e04c7ea6800/0x9383f985bc4d6501 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.258617:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e04c7ea6800/0x9383f985bc4d6501 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.258634:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e04c7ea6800/0x9383f985bc4d6501 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.258644:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201659.258669:0:24534:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e04c7ea6800/0x9383f985bc4d6501 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201659.258686:0:24534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e04c7ea6800/0x9383f985bc4d6501 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201659.258695:0:24534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e04c7ea6800/0x9383f985bc4d6501 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201659.258717:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f964d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ad49433-54fa-4e21-b756-859420d95603+9:2360:x1875064442791552:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 255us (4034us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201659.258727:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1604 00000100:00100000:1.0:1788201659.269952:0:24521:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201659.270128:0:24521:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788201659.270134:0:24521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788201659.276079:0:24521:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788201659.276092:0:24521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788201659.294419:0:24521:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788201659.294440:0:24521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788201659.297458:0:24521:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788201659.297510:0:24521:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788201659.297519:0:24521:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788201659.297708:0:24521:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.130@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788201659.297755:0:24521:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.130@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788201659.297761:0:24521:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788201659.297763:0:24521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788201659.297764:0:24521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201659.297766:0:24521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201659.297767:0:24521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201659.297769:0:24521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201659.297770:0:24521:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201659.297772:0:24521:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788201659.297774:0:24521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201659.297776:0:24521:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788201659.297779:0:24521:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788201659.297781:0:24521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788201659.297783:0:24521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788201659.297784:0:24521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201659.297785:0:24521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201659.297787:0:24521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201659.297788:0:24521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201659.297789:0:24521:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201659.297791:0:24521:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788201659.297792:0:24521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201659.297793:0:24521:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788201659.297830:0:24521:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788201659.297858:0:24521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5487480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:24521:1875064458339712:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788201659.297979:0:24521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201659.298035:0:24521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f91f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201659.298071:0:24526:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:3.0:1788201659.298087:0:24526:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:3.0:1788201659.298536:0:24526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458339712 00000100:00100000:3.0:1788201659.298546:0:24526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458339712 00000100:00100000:2.0:1788201659.299409:0:24559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788201659.299426:0:24559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1e21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+7:24521:x1875064458339712:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788201659.299515:0:24559:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788201659.299519:0:24559:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788201659.299522:0:24559:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:2.0:1788201659.299539:0:24559:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788201659.334473:0:24528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1e20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+7:3310:x1875064458339328:12345-0@lo:253:kworker.0 Request processed in 178436us (178726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201659.334493:0:24528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000020:01000004:2.0:1788201659.334591:0:3310:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788201659.334595:0:3310:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788201659.334596:0:3310:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201659.334598:0:3310:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201659.334599:0:3310:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201659.334600:0:3310:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201659.334602:0:3310:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201659.334605:0:3310:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201659.334606:0:3310:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788201659.334611:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458339328:0@lo:253:kworker.0 20000000:01000000:0.0:1788201659.335222:0:24527:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788201659.335242:0:24527:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788201659.335525:0:24534:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788201659.335532:0:24534:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788201659.335562:0:24534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e03c2ef1a00/0x9383f985bc4d6508 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201659.335579:0:24534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c2ef1a00/0x9383f985bc4d6508 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788201659.335588:0:24534:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008742710s 00010000:00010000:1.0:1788201659.335593:0:24534:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03c2ef1a00/0x9383f985bc4d6508 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201659.335599:0:24534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03c2ef1a00/0x9383f985bc4d6508 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201659.335607:0:24534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e03c2ef1a00/0x9383f985bc4d6508 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201659.335614:0:24534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e03c2ef1a00/0x9383f985bc4d6508 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201659.335621:0:24534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef1a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201659.335627:0:24534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e03c2ef1a00/0x9383f985bc4d6508 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201659.335636:0:24534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e03c2ef1a00/0x9383f985bc4d6508 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201659.335652:0:24534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e03c2ef1a00/0x9383f985bc4d6508 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201659.335662:0:24534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e03c2ef1a00/0x9383f985bc4d6508 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201659.335670:0:24534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c2ef1a00/0x9383f985bc4d6508 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201659.365761:0:24559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1e21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+6:24521:x1875064458339712:12345-0@lo:253:mount.lustre.0 Request processed in 66324us (67767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201659.365782:0:24559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788201659.365802:0:24521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5487480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:24521:1875064458339712:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788201659.365825:0:24521:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788201659.365829:0:24521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788201659.365831:0:24521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788201659.365832:0:24521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201659.365834:0:24521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201659.365835:0:24521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201659.365836:0:24521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201659.365839:0:24521:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201659.365841:0:24521:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788201659.365843:0:24521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201659.365844:0:24521:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788201659.365871:0:24521:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e04c8351000 from lustre-MDT0000 10000000:01000000:3.0:1788201659.365899:0:24521:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788201659.365902:0:24521:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788201659.365910:0:24521:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e04c8351000 10000000:01000000:3.0:1788201659.365914:0:24521:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788201659.365919:0:24521:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e04c8351000 10000000:01000000:3.0:1788201659.365925:0:24521:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788201659.365928:0:24521:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9e04c8351000 from 1 10000000:01000000:3.0:1788201659.365931:0:24521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788201659.365965:0:24521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04c0030a00/0x9383f985bc4d650f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201659.365977:0:24521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e04c0030a00/0x9383f985bc4d650f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201659.365987:0:24521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e04c0030a00/0x9383f985bc4d650f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201659.366005:0:24521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:24521:1875064458339840:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201659.366063:0:24521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201659.366113:0:24521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d89e1a80 going to sleep for 11 seconds 00010000:00010000:0.0:1788201659.366142:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201659.366793:0:24526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458339840 00000100:00100000:2.0:1788201659.366803:0:24526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458339840 00000100:00100000:2.0:1788201659.366859:0:24526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788201659.366871:0:24526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1e22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+6:24521:x1875064458339840:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201659.366891:0:24526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201659.366912:0:24526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e04c7ea6800/0x9383f985bc4d6516 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d650f expref: -99 pid: 24526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201659.366945:0:24526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e04c7ea6800/0x9383f985bc4d6516 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d650f expref: 7 pid: 24526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201659.366959:0:24526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e04c7ea6800/0x9383f985bc4d6516 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d650f expref: 7 pid: 24526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201659.366970:0:24526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c7ea6800, rc 0) 00000100:00100000:2.0:1788201659.367041:0:24526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1e22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+7:24521:x1875064458339840:12345-0@lo:101:mount.lustre.0 Request processed in 168us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201659.367275:0:24521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:24521:1875064458339840:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201659.367322:0:24521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e04c0030a00/0x9383f985bc4d650f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6516 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201659.367334:0:24521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e04c0030a00/0x9383f985bc4d650f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d6516 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201659.367352:0:24521:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788201659.367363:0:24521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04c0030a00/0x9383f985bc4d650f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6516 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201659.367370:0:24521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e04c0030a00/0x9383f985bc4d650f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6516 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201659.367377:0:24521:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788201659.367381:0:24521:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788201659.367387:0:24521:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e04c8351000 10000000:01000000:3.0:1788201659.367389:0:24521:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788201659.367392:0:24521:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788201659.367394:0:24521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788201659.367412:0:24521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04c0031400/0x9383f985bc4d651d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201659.367452:0:24521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e04c0031400/0x9383f985bc4d651d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201659.367461:0:24521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e04c0031400/0x9383f985bc4d651d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201659.367515:0:24521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:24521:1875064458339968:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201659.367556:0:24521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201659.367587:0:24521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d89e1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201659.367627:0:24559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458339968 00000100:00100000:0.0:1788201659.367635:0:24559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458339968 00000100:00100000:0.0:1788201659.367698:0:24528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788201659.367710:0:24528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1e20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+8:24521:x1875064458339968:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201659.367722:0:24528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201659.367738:0:24528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c2cc7800/0x9383f985bc4d6524 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d651d expref: -99 pid: 24528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.367759:0:24528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c2cc7800/0x9383f985bc4d6524 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d651d expref: 9 pid: 24528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.367769:0:24528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c2cc7800/0x9383f985bc4d6524 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d651d expref: 9 pid: 24528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.367778:0:24528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc7800, rc 0) 00000100:00100000:0.0:1788201659.367833:0:24528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1e20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+9:24521:x1875064458339968:12345-0@lo:101:mount.lustre.0 Request processed in 127us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201659.367840:0:24528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788201659.367874:0:24521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:24521:1875064458339968:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201659.367889:0:24521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e04c0031400/0x9383f985bc4d651d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6524 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201659.367899:0:24521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e04c0031400/0x9383f985bc4d651d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d6524 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201659.367945:0:24521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:24521:1875064458340096:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201659.367972:0:24521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201659.367998:0:24521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d89e1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201659.368065:0:24528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458340096 00000100:00100000:0.0:1788201659.368072:0:24528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458340096 00000100:00100000:0.0:1788201659.368109:0:24528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788201659.368117:0:24528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1e23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+9:24521:x1875064458340096:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201659.368580:0:24528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1e23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+10:24521:x1875064458340096:12345-0@lo:501:mount.lustre.0 Request processed in 462us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201659.368591:0:24528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788201659.368690:0:24521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:24521:1875064458340096:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201659.368758:0:24521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:24521:1875064458340224:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201659.368824:0:24521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201659.368862:0:24521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d89e1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201659.369032:0:24526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788201659.369532:0:24527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1e21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+8:3310:x1875064458339456:12345-0@lo:253:kworker.0 Request processed in 213061us (213664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201659.369543:0:24527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788201659.369569:0:24527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458340224 00000100:00100000:1.0:1788201659.369575:0:24527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458340224 00000100:00100000:1.0:1788201659.369606:0:24527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788201659.369613:0:24527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1e20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+8:24521:x1875064458340224:12345-0@lo:503:mount.lustre.0 00000020:01000004:2.0:1788201659.370459:0:3310:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788201659.370464:0:3310:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788201659.370467:0:3310:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201659.370469:0:3310:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201659.370471:0:3310:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201659.370474:0:3310:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201659.370476:0:3310:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201659.370479:0:3310:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201659.370480:0:3310:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788201659.370495:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458339456:0@lo:253:kworker.0 00000100:00100000:1.0:1788201659.377904:0:24527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1e20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+8:24521:x1875064458340224:12345-0@lo:503:mount.lustre.0 Request processed in 8284us (9073us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201659.377919:0:24527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788201659.378221:0:24521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:24521:1875064458340224:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201659.380362:0:24561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c6632680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:24561:1875064458340352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201659.380436:0:24561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201659.380480:0:24561:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c1fd1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201659.380637:0:24526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458340352 00000100:00100000:3.0:1788201659.380645:0:24526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458340352 00000100:00100000:3.0:1788201659.380762:0:24526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788201659.380772:0:24526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8059c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+8:24561:x1875064458340352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201659.385535:0:24526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8059c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+8:24561:x1875064458340352:12345-0@lo:502:llog_process_th.0 Request processed in 4757us (5091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201659.385551:0:24526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788201659.385869:0:24561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c6632680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:24561:1875064458340352:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201659.385907:0:24561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201659.385918:0:24561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201659.385920:0:24561:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788201659.385930:0:24561:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788201659.385933:0:24561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201659.385949:0:24561:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9e04f9650000) 00000020:00000080:1.0:1788201659.385968:0:24561:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788201659.385973:0:24561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788201659.386068:0:24561:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788201659.386077:0:24561:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d6532 00000020:00000080:1.0:1788201659.386352:0:24561:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788201659.386356:0:24561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201659.386360:0:24561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201659.386362:0:24561:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788201659.386365:0:24561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201659.386368:0:24561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201659.386370:0:24561:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788201659.386373:0:24561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201659.386382:0:24561:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9e04eadc99c0) 00000020:00000080:1.0:1788201659.386393:0:24561:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788201659.386396:0:24561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788201659.386398:0:24561:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788201659.386401:0:24561:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788201659.386406:0:24561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788201659.386446:0:24561:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e04c8351000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788201659.386458:0:24561:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9e04eadccd40) 00000020:00000080:1.0:1788201659.386467:0:24561:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788201659.386509:0:24561:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788201659.386513:0:24561:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9383f985bc4d6547 00000020:00000080:1.0:1788201659.386594:0:24561:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788201659.386599:0:24561:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788201659.386603:0:24561:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9383f985bc4d654e 00080000:01000000:1.0:1788201659.386608:0:24561:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788201659.386611:0:24561:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d6555 00010000:00010000:2.0:1788201659.481705:0:24561:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-3 is initialized 00000001:00080000:2.0:1788201659.482740:0:24561:0:(tgt_lastrcvd.c:1749:tgt_clients_data_init()) RCVRNG CLIENT uuid: 35604eb4-baf9-45be-a20a-4883a2cd8cf9 idx: 0 lr: 21474836483 srv lr: 25769803776 lx: 0 gen 2 00000001:00000004:2.0:1788201659.482785:0:24561:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 7, last_transno is 25769803776 00000001:00080000:2.0:1788201659.484406:0:24561:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1788201659.484513:0:24561:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e03c1dc0180: xid 1875064442785280, transno 25769803779, client gen 2, slot idx 0 00000001:00080000:2.0:1788201659.484534:0:24561:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e03c1dc0300: xid 1875064442784768, transno 25769803778, client gen 2, slot idx 1 00000001:00080000:2.0:1788201659.484546:0:24561:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04c7f08cc0: xid 1875064442704256, transno 12884901935, client gen 2, slot idx 2 00000001:00080000:2.0:1788201659.484556:0:24561:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04c7f08840: xid 1875064442705152, transno 12884901936, client gen 2, slot idx 3 00000001:00080000:2.0:1788201659.484567:0:24561:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04c833af00: xid 1875064442705536, transno 12884901937, client gen 2, slot idx 4 00000001:00080000:2.0:1788201659.484577:0:24561:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04c833ac00: xid 1875064442705920, transno 12884901938, client gen 2, slot idx 5 00000001:00080000:2.0:1788201659.484587:0:24561:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04c833aa80: xid 1875064442706176, transno 12884901939, client gen 2, slot idx 6 00000001:00080000:2.0:1788201659.484598:0:24561:0:(tgt_lastrcvd.c:2291:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9e04c833ad80: xid 1875064442706432, transno 12884901940, client gen 2, slot idx 7 00000020:00000080:2.0:1788201659.485174:0:24561:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9e03c2640000) 00000020:00000080:2.0:1788201659.485195:0:24561:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788201659.485258:0:24561:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788201659.485265:0:24561:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d656a 00000020:00000080:3.0:1788201659.487211:0:24561:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788201659.499839:0:24561:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9383f985bc4d6571 00000020:00000080:0.0:1788201659.502424:0:24561:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788201659.502440:0:24561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201659.502450:0:24561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201659.502452:0:24561:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788201659.502455:0:24561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201659.502461:0:24561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201659.502462:0:24561:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788201659.502466:0:24561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788201659.502513:0:24561:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788201659.502528:0:24561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201659.502531:0:24561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201659.502533:0:24561:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788201659.502535:0:24561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788201659.502537:0:24561:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #10 00000020:01000000:0.0:1788201659.502538:0:24561:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788201659.502540:0:24561:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788201659.502541:0:24561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788201659.502544:0:24561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201659.502545:0:24561:0:(obd_config.c:1561:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788201659.502547:0:24561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788201659.502551:0:24561:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788201659.502554:0:24561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201659.502555:0:24561:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788201659.502558:0:24561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788201659.502563:0:24561:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.130@tcp to nid 0x20000c0a8c982 (192.168.201.130@tcp) 00000020:01000000:0.0:1788201659.502589:0:24561:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788201659.502592:0:24561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788201659.502605:0:24561:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9e04ff1e3380) 00000020:00000080:0.0:1788201659.502624:0:24561:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788201659.502628:0:24561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788201659.502682:0:24561:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788201659.502687:0:24561:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788201659.502694:0:24561:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d657f 00010000:00080000:0.0:1788201659.502723:0:24561:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e04c6411800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.130@tcp at head 00010000:00010000:0.0:1788201659.502952:0:24561:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1788201659.503351:0:24561:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788201659.503396:0:24561:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788201659.521284:0:24561:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 5, last_idx 6 00000040:00080000:1.0:1788201659.522187:0:24561:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201659.527083:0:24561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].7, 64 off8640 00000040:00080000:2.0:1788201659.527454:0:24561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1c:0x0].1, 64 off8256 00000040:00080000:3.0:1788201659.532629:0:24565:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:3.0:1788201659.532638:0:24565:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x18:0x0] at index 6 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788201659.532975:0:24561:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201659.532990:0:24561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788201659.533023:0:24561:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788201659.533048:0:24561:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9383f985bc4d6586 00000100:00080000:1.0:1788201659.533059:0:24561:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788201659.533066:0:24561:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e04c6411800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:1.0:1788201659.533100:0:24561:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e04c6632680 x1875064458340480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201659.533130:0:24561:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788201659.533201:0:24561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201659.533205:0:24561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201659.533207:0:24561:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788201659.533211:0:24561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788201659.533213:0:24561:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1788201659.533215:0:24561:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201659.533217:0:24561:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201659.533218:0:24561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788201659.533221:0:24561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201659.533222:0:24561:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788201659.533224:0:24561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788201659.533228:0:24561:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788201659.533231:0:24561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201659.533232:0:24561:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788201659.533235:0:24561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788201659.533239:0:24561:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.130@tcp to nid 0x20000c0a8c982 (192.168.201.130@tcp) 00000020:01000000:1.0:1788201659.533260:0:24561:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788201659.533262:0:24561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201659.533274:0:24561:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9e04eadc8000) 00000020:00000080:1.0:1788201659.533289:0:24561:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1788201659.533347:0:24561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788201659.533408:0:24561:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788201659.533414:0:24561:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788201659.533419:0:24561:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9383f985bc4d6594 00010000:00080000:1.0:1788201659.533447:0:24561:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e04ff4be000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.130@tcp at head 00010000:00010000:1.0:1788201659.533653:0:24561:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-4 is initialized 00000040:01000000:1.0:1788201659.533806:0:24561:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788201659.533826:0:24561:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1788201659.534323:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c6632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458340480:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788201659.534391:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201659.535224:0:12363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458340480 00000100:00100000:1.0:1788201659.535234:0:12363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458340480 00000100:00100000:1.0:1788201659.535270:0:12363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4401 00000100:00100000:1.0:1788201659.535278:0:12363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3309:x1875064458340480:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1788201659.535327:0:12363:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 934 last 0 00000020:00000080:1.0:1788201659.535356:0:12363:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9383f985bc4d659b 00002000:00100000:1.0:1788201659.535370:0:12363:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9e04ff4bf800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788201659.535374:0:12363:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788201659.535377:0:12363:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788201659.535574:0:12363:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788201659.535597:0:12363:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4be800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201659.535665:0:12363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3309:x1875064458340480:12345-0@lo:8:llog_process_th.0 Request processed in 386us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201659.535672:0:12363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4401 00000100:00100000:1.0:1788201659.535720:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788201659.535728:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788201659.535735:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788201659.535741:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788201659.535743:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04c6411800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788201659.535753:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788201659.535758:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c6632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458340480:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788201659.535833:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c6632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458340608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201659.535864:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201659.535899:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458340608 00000100:00100000:1.0:1788201659.535903:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458340608 00000100:00100000:1.0:1788201659.535936:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788201659.535943:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c6630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875064458340608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201659.535963:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524484608 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1788201659.535996:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c6630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875064458340608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201659.536003:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00080000:1.0:1788201659.536019:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201659.536058:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c6632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458340608:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788201659.542972:0:24565:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 6, last_idx 7 00000040:00080000:1.0:1788201659.543002:0:24565:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x18:0x0] at index 6 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1788201659.543117:0:24565:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788201659.543121:0:24565:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1c:0x0] at index 7 of catalog [0x1:0x2:0x0] 00000004:00080000:1.0:1788201659.543167:0:24565:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788201659.543216:0:24565:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 934800921746ns, next at 0ns, rc = 0 00000040:00080000:1.0:1788201659.543257:0:24561:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 5, last_idx 6 00000040:00080000:1.0:1788201659.543567:0:24561:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201659.554741:0:24561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].7, 64 off8640 00000040:00080000:3.0:1788201659.554863:0:24561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1e:0x0].1, 64 off8256 00000040:00080000:3.0:1788201659.558271:0:24567:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:3.0:1788201659.558278:0:24567:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 6 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788201659.562967:0:24561:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201659.562982:0:24561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788201659.563013:0:24561:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788201659.563032:0:24561:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9383f985bc4d65a2 00000100:00080000:3.0:1788201659.563055:0:24561:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201659.563061:0:24561:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e04ff4be000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1788201659.563094:0:24561:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e04f964ea00 x1875064458340736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201659.563119:0:24561:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788201659.563195:0:24561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201659.563199:0:24561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201659.563202:0:24561:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788201659.563204:0:24561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201659.563208:0:24561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201659.563209:0:24561:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788201659.563211:0:24561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788201659.563214:0:24561:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788201659.563216:0:24561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201659.563218:0:24561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201659.563219:0:24561:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788201659.563221:0:24561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201659.563223:0:24561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201659.563224:0:24561:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788201659.563227:0:24561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788201659.563257:0:24561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:24561:1875064458340864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201659.563701:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458340736:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788201659.563736:0:24561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201659.563739:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201659.563773:0:24561:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d89e1600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201659.563794:0:24559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458340864 00000100:00100000:2.0:1788201659.563801:0:24559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458340864 00000100:00100000:2.0:1788201659.563849:0:24559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788201659.563858:0:24559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d805b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+8:24561:x1875064458340864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201659.570470:0:13445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458340736 00000100:00100000:1.0:1788201659.570484:0:13445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458340736 00000100:00100000:1.0:1788201659.570530:0:13445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4402 00000100:00100000:1.0:1788201659.570539:0:13445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c6632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3309:x1875064458340736:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1788201659.570573:0:13445:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 934 last 0 00000020:00000080:1.0:1788201659.570622:0:13445:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9383f985bc4d65a9 00002000:00100000:1.0:1788201659.570637:0:13445:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9e04cff4e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113836 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788201659.570641:0:13445:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788201659.570644:0:13445:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788201659.570857:0:13445:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788201659.570880:0:13445:0:(import.c:65:import_set_state_nolock()) ffff9e04cff48800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201659.570952:0:13445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c6632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3309:x1875064458340736:12345-0@lo:8:llog_process_th.0 Request processed in 413us (7211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201659.570959:0:13445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4402 00000100:00100000:1.0:1788201659.570998:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788201659.571007:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788201659.571014:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788201659.571019:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788201659.571022:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4be000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788201659.571032:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788201659.571037:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458340736:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788201659.571100:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c6630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458340992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201659.571136:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201659.571189:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458340992 00000100:00100000:1.0:1788201659.571193:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458340992 00000100:00100000:1.0:1788201659.571226:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788201659.571233:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875064458340992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201659.571251:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 35979264 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788201659.571284:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875064458340992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201659.571289:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:1.0:1788201659.571340:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201659.571376:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c6630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458340992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201659.571501:0:24559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d805b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+8:24561:x1875064458340864:12345-0@lo:502:llog_process_th.0 Request processed in 7643us (7763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201659.571510:0:24559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788201659.572059:0:24561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:24561:1875064458340864:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201659.572095:0:24561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201659.572102:0:24561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201659.572105:0:24561:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788201659.572109:0:24561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000040:00080000:2.0:1788201659.572264:0:24567:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 6, last_idx 7 00000040:00080000:2.0:1788201659.572287:0:24567:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x1a:0x0] at index 6 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1788201659.572353:0:24567:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788201659.572357:0:24567:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1e:0x0] at index 7 of catalog [0x1:0x5:0x0] 00000004:00080000:2.0:1788201659.572390:0:24567:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788201659.572439:0:24567:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 934830144332ns, next at 0ns, rc = 0 00000020:01000000:1.0:1788201659.572606:0:24521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1788201659.572629:0:24521:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788201659.572642:0:24521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04c0031400/0x9383f985bc4d651d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6524 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201659.572653:0:24521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e04c0031400/0x9383f985bc4d651d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6524 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201659.572661:0:24521:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e04c8351000 from 1 10000000:01000000:1.0:1788201659.572664:0:24521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788201659.572695:0:24521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef1a00/0x9383f985bc4d65b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201659.572702:0:24521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef1a00/0x9383f985bc4d65b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201659.572712:0:24521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef1a00/0x9383f985bc4d65b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201659.572729:0:24521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:24521:1875064458341120:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201659.572772:0:24521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201659.572797:0:24521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d436b300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201659.574277:0:24528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458341120 00000100:00100000:0.0:1788201659.574287:0:24528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458341120 00000100:00100000:0.0:1788201659.574367:0:24528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788201659.574376:0:24528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d805bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+8:24521:x1875064458341120:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201659.574391:0:24528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201659.574408:0:24528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c2cc6a00/0x9383f985bc4d65b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d65b0 expref: -99 pid: 24528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.574433:0:24528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c2cc6a00/0x9383f985bc4d65b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d65b0 expref: 9 pid: 24528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.574450:0:24528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c2cc6a00/0x9383f985bc4d65b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d65b0 expref: 9 pid: 24528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.574459:0:24528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc6a00, rc 0) 00000100:00100000:0.0:1788201659.574529:0:24528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d805bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+9:24521:x1875064458341120:12345-0@lo:101:mount.lustre.0 Request processed in 154us (1756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201659.574536:0:24528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788201659.574674:0:24521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:24521:1875064458341120:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201659.574690:0:24521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef1a00/0x9383f985bc4d65b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d65b7 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201659.574700:0:24521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef1a00/0x9383f985bc4d65b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d65b7 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201659.575225:0:24521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:24521:1875064458341248:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788201659.575268:0:24521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201659.575329:0:24521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d436b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788201659.575989:0:24527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458341248 00000100:00100000:2.0:1788201659.575997:0:24527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458341248 00000100:00100000:2.0:1788201659.576038:0:24527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788201659.576045:0:24527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d805a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+9:24521:x1875064458341248:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788201659.576065:0:24527:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788201659.576083:0:24527:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788201659.576088:0:24527:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788201659.576090:0:24527:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 22 00000100:00100000:2.0:1788201659.576193:0:24527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d805a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+9:24521:x1875064458341248:12345-0@lo:256:mount.lustre.0 Request processed in 147us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201659.576201:0:24527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788201659.580336:0:24521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:24521:1875064458341248:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788201659.581080:0:24521:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788201659.581106:0:24521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef1a00/0x9383f985bc4d65b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d65b7 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201659.581119:0:24521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef1a00/0x9383f985bc4d65b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d65b7 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201659.581127:0:24521:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e04c8351000 from 1 10000000:01000000:1.0:1788201659.581130:0:24521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788201659.581178:0:24521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef0000/0x9383f985bc4d65be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201659.581185:0:24521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef0000/0x9383f985bc4d65be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201659.581195:0:24521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef0000/0x9383f985bc4d65be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201659.581215:0:24521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:24521:1875064458341376:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201659.581275:0:24521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201659.581320:0:24521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d436b300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201659.582130:0:24528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458341376 00000100:00100000:0.0:1788201659.582139:0:24528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458341376 00000100:00100000:0.0:1788201659.582202:0:24528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788201659.582211:0:24528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8058050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+9:24521:x1875064458341376:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201659.582225:0:24528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201659.582238:0:24528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c2cc7a00/0x9383f985bc4d65c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d65be expref: -99 pid: 24528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.582261:0:24528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c2cc7a00/0x9383f985bc4d65c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d65be expref: 10 pid: 24528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.582271:0:24528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c2cc7a00/0x9383f985bc4d65c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d65be expref: 10 pid: 24528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.582279:0:24528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc7a00, rc 0) 00000100:00100000:0.0:1788201659.582349:0:24528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8058050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+10:24521:x1875064458341376:12345-0@lo:101:mount.lustre.0 Request processed in 139us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201659.582356:0:24528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788201659.583102:0:24521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:24521:1875064458341376:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201659.583118:0:24521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef0000/0x9383f985bc4d65be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d65c5 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201659.583128:0:24521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef0000/0x9383f985bc4d65be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d65c5 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201659.583209:0:24521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5487100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:24521:1875064458341504:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201659.583245:0:24521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201659.583271:0:24521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c5e34780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201659.583289:0:24527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458341504 00000100:00100000:2.0:1788201659.583315:0:24527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458341504 00000100:00100000:2.0:1788201659.583344:0:24527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788201659.583358:0:24527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8058c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+10:24521:x1875064458341504:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201659.583571:0:24527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8058c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+10:24521:x1875064458341504:12345-0@lo:501:mount.lustre.0 Request processed in 219us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201659.583579:0:24527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788201659.583998:0:24521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5487100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:24521:1875064458341504:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201659.584033:0:24521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:24521:1875064458341632:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201659.584074:0:24521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201659.584104:0:24521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d89e16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201659.584145:0:24528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458341632 00000100:00100000:1.0:1788201659.584150:0:24528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458341632 00000100:00100000:1.0:1788201659.584199:0:24528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788201659.584206:0:24528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8058850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+10:24521:x1875064458341632:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201659.584393:0:24528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8058850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+10:24521:x1875064458341632:12345-0@lo:503:mount.lustre.0 Request processed in 187us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201659.584401:0:24528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788201659.588390:0:24521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:24521:1875064458341632:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201659.588646:0:24569:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:24569:1875064458341760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201659.588714:0:24569:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201659.588763:0:24569:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d89e1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201659.588927:0:24559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458341760 00000100:00100000:0.0:1788201659.588934:0:24559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458341760 00000100:00100000:0.0:1788201659.588987:0:24559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788201659.588996:0:24559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8059850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+10:24569:x1875064458341760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201659.594969:0:24559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8059850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+10:24569:x1875064458341760:12345-0@lo:502:llog_process_th.0 Request processed in 5963us (6244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201659.594983:0:24559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788201659.595086:0:24569:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:24569:1875064458341760:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201659.595123:0:24569:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201659.595132:0:24569:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201659.595134:0:24569:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788201659.595142:0:24569:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e04c8351000 00000020:00000080:3.0:1788201659.595145:0:24569:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788201659.595153:0:24569:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201659.595169:0:24569:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201659.595170:0:24569:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788201659.595173:0:24569:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201659.595176:0:24569:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201659.595177:0:24569:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788201659.595181:0:24569:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e04c8351000 00000020:00000080:3.0:1788201659.595183:0:24569:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788201659.595269:0:24569:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:24569:1875064458341888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201659.595349:0:24569:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201659.595382:0:24569:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d89e1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201659.595468:0:24528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458341888 00000100:00100000:0.0:1788201659.595474:0:24528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458341888 00000100:00100000:0.0:1788201659.595517:0:24528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788201659.595526:0:24528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c23d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+10:24569:x1875064458341888:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201659.595701:0:24528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c23d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+10:24569:x1875064458341888:12345-0@lo:502:llog_process_th.0 Request processed in 176us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201659.595708:0:24528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788201659.595780:0:24569:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:24569:1875064458341888:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788201659.595799:0:24569:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201659.595805:0:24569:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201659.595806:0:24569:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788201659.595811:0:24569:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788201659.595995:0:24521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1788201659.596018:0:24521:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788201659.596039:0:24521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef0000/0x9383f985bc4d65be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d65c5 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.596050:0:24521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef0000/0x9383f985bc4d65be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d65c5 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201659.596092:0:24521:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788201659.596095:0:24521:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e04c8351000 10000000:01000000:0.0:1788201659.596097:0:24521:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e04c8351000 10000000:01000000:0.0:1788201659.596101:0:24521:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788201659.596106:0:24521:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e04c8351000 from 1 10000000:01000000:0.0:1788201659.596108:0:24521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788201659.596132:0:24521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d65cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.596145:0:24521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d65cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.596153:0:24521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d65cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201659.596179:0:24521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:24521:1875064458342016:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788201659.596206:0:24521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201659.596237:0:24521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f9635300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201659.596285:0:24526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458342016 00000100:00100000:3.0:1788201659.596290:0:24526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458342016 00000100:00100000:3.0:1788201659.596335:0:24526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788201659.596341:0:24526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c23d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+10:24521:x1875064458342016:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201659.596350:0:24526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201659.596362:0:24526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e04c0031800/0x9383f985bc4d65d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d65cc expref: -99 pid: 24526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201659.596382:0:24526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e04c0031800/0x9383f985bc4d65d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d65cc expref: 11 pid: 24526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201659.596392:0:24526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e04c0031800/0x9383f985bc4d65d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d65cc expref: 11 pid: 24526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201659.596399:0:24526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031800, rc 0) 00000100:00100000:3.0:1788201659.596423:0:24526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c23d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+11:24521:x1875064458342016:12345-0@lo:101:mount.lustre.0 Request processed in 83us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201659.596432:0:24526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788201659.596548:0:24521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:24521:1875064458342016:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201659.596560:0:24521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d65cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d65d3 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.596567:0:24521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d65cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d65d3 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201659.596606:0:24521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:24521:1875064458342144:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201659.596629:0:24521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201659.596657:0:24521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f9635300 going to sleep for 11 seconds 00000100:00100000:2.0:1788201659.596703:0:24528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458342144 00000100:00100000:2.0:1788201659.596707:0:24528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458342144 00000100:00100000:2.0:1788201659.596735:0:24528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788201659.596741:0:24528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c23d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+11:24521:x1875064458342144:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201659.596947:0:24528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c23d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+11:24521:x1875064458342144:12345-0@lo:501:mount.lustre.0 Request processed in 205us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201659.596954:0:24528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788201659.597044:0:24521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:24521:1875064458342144:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201659.597068:0:24521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:24521:1875064458342272:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201659.597097:0:24521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201659.597119:0:24521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f9635300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201659.597173:0:24526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458342272 00000100:00100000:3.0:1788201659.597178:0:24526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458342272 00000100:00100000:3.0:1788201659.597206:0:24526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788201659.597212:0:24526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c23d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+11:24521:x1875064458342272:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201659.597379:0:24526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c23d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+11:24521:x1875064458342272:12345-0@lo:503:mount.lustre.0 Request processed in 167us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201659.597386:0:24526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788201659.597459:0:24521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:24521:1875064458342272:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201659.600413:0:24571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:24571:1875064458342400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201659.600497:0:24571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201659.600539:0:24571:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04f96350c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201659.600596:0:24528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458342400 00000100:00100000:3.0:1788201659.600604:0:24528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458342400 00000100:00100000:3.0:1788201659.600650:0:24528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788201659.600659:0:24528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c23d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+11:24571:x1875064458342400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201659.600902:0:24528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c23d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+11:24571:x1875064458342400:12345-0@lo:502:llog_process_th.0 Request processed in 244us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201659.600910:0:24528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788201659.600997:0:24571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:24571:1875064458342400:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788201659.601063:0:24571:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788201659.601079:0:24571:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9e04eadcb380) 00000020:00000080:1.0:1788201659.601100:0:24571:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1788201659.601267:0:24571:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e04c8351000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788201659.601271:0:24571:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e04c8351000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788201659.601274:0:24571:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e04c8351000 4 00010000:00080000:1.0:1788201659.601318:0:24571:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e04fae46000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.130@tcp at head 00010000:00010000:3.0:1788201659.602885:0:24571:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-5 is initialized 00000020:00000080:3.0:1788201659.602977:0:24571:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788201659.603010:0:24571:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788201659.603020:0:24571:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9383f985bc4d65e1 00000100:00080000:3.0:1788201659.603029:0:24571:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201659.603033:0:24571:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e04fae46000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1788201659.603063:0:24571:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e04f964ed80 x1875064458342528/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201659.603084:0:24571:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788201659.603148:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875064458342528:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788201659.603214:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201659.603247:0:24542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458342528 00000100:00100000:3.0:1788201659.603254:0:24542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458342528 00000100:00100000:3.0:1788201659.603317:0:24542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201659.603324:0:24542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875064458342528:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788201659.603372:0:24542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875064458342528:12345-0@lo:38:llog_process_th.0 Request processed in 46us (157us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788201659.603378:0:24542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788201659.603621:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788201659.603628:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04fae46000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201659.603633:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788201659.603636:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875064458342528:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788201659.604836:0:24571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:24571:1875064458342656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201659.604899:0:24571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201659.604930:0:24526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458342656 00000100:00100000:1.0:1788201659.604935:0:24526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458342656 00000100:00100000:1.0:1788201659.604969:0:24526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788201659.604977:0:24526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c23d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+11:24571:x1875064458342656:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201659.605221:0:24526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c23d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+11:24571:x1875064458342656:12345-0@lo:502:llog_process_th.0 Request processed in 244us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201659.605229:0:24526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788201659.605273:0:24571:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d436b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201659.605289:0:24571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b60c000b-7335-444d-a8dc-1a5956712fb2:24571:1875064458342656:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788201659.605331:0:24571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788201659.608720:0:24521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788201659.608760:0:24521:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788201659.608783:0:24521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d65cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d65d3 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201659.608794:0:24521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d65cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d65d3 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788201659.608847:0:24521:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788201659.608850:0:24521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788201659.608851:0:24521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201659.608852:0:24521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201659.608853:0:24521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201659.608855:0:24521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201659.608856:0:24521:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201659.608857:0:24521:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788201659.608859:0:24521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201659.608861:0:24521:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788201659.608864:0:24521:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788201659.608867:0:24521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788201659.608868:0:24521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788201659.608869:0:24521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201659.608871:0:24521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201659.608872:0:24521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201659.608873:0:24521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201659.608874:0:24521:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201659.608875:0:24521:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788201659.608876:0:24521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201659.608877:0:24521:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788201659.608903:0:24521:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788201659.608923:0:24521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:24521:1875064458342784:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788201659.608985:0:24521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201659.609026:0:24521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d89e1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201659.610140:0:24528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458342784 00000100:00100000:1.0:1788201659.610150:0:24528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458342784 00000100:00100000:1.0:1788201659.610205:0:24528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788201659.610214:0:24528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c23d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+11:24521:x1875064458342784:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788201659.610241:0:24528:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788201659.610255:0:24528:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000004:00080000:1.0:1788201659.638231:0:24555:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788201659.723567:0:24555:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 20000000:01000000:0.0:1788201659.765941:0:24528:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788201659.765961:0:24528:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788201659.766221:0:24534:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788201659.766226:0:24534:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788201659.766249:0:24534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e03c2ef1400/0x9383f985bc4d65e8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201659.766269:0:24534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e03c2cc6a00/0x9383f985bc4d65b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d65b0 expref: 11 pid: 24528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201659.766278:0:24534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e03c2ef1400/0x9383f985bc4d65e8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201659.766353:0:24534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e03c2cc6a00/0x9383f985bc4d65b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9383f985bc4d65b0 expref: 11 pid: 24528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201659.766368:0:24534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e03c2cc6a00/0x9383f985bc4d65b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9383f985bc4d65b0 expref: 11 pid: 24528 timeout: 1035 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201659.766383:0:24534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:24534:1875064458342912:0@lo:104: 00000100:00100000:1.0:1788201659.766451:0:24534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201659.766491:0:24534:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04ffdba180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201659.766639:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458342912 00000100:00100000:0.0:1788201659.766648:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458342912 00000100:00100000:0.0:1788201659.766699:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788201659.766710:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b60c000b-7335-444d-a8dc-1a5956712fb2+3:24534:x1875064458342912:12345-0@lo:104: 00010000:00010000:0.0:1788201659.766723:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef1a00/0x9383f985bc4d65b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9383f985bc4d65b7 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.766779:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201659.766786:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b60c000b-7335-444d-a8dc-1a5956712fb2+3:24534:x1875064458342912:12345-0@lo:104: Request processed in 78us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201659.766793:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:0.0:1788201659.766817:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201659.766823:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef1a00/0x9383f985bc4d65b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9383f985bc4d65b7 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.766831:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef1a00 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:0.0:1788201659.766836:0:7645:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef1a00/0x9383f985bc4d65b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9383f985bc4d65b7 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.766845:0:7645:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef1a00/0x9383f985bc4d65b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9383f985bc4d65b7 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201659.766854:0:7645:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef1a00/0x9383f985bc4d65b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9383f985bc4d65b7 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201659.766861:0:7645:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201659.766889:0:7645:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef1a00/0x9383f985bc4d65b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9383f985bc4d65b7 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.766897:0:7645:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201659.766917:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef1a00/0x9383f985bc4d65b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9383f985bc4d65b7 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.766924:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef1a00/0x9383f985bc4d65b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9383f985bc4d65b7 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.766941:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201659.766943:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201659.766945:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201659.766964:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458343040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201659.766993:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201659.767270:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458343040 00000100:00100000:0.0:1788201659.767276:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458343040 00010000:00010000:0.0:1788201659.767348:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e03c2cc6a00/0x9383f985bc4d65b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9383f985bc4d65b0 expref: 12 pid: 24528 timeout: 1035 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201659.767373:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1605 00000100:00100000:0.0:1788201659.767382:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b60c000b-7335-444d-a8dc-1a5956712fb2+12:3310:x1875064458343040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201659.767393:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201659.767399:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e03c2cc6a00/0x9383f985bc4d65b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9383f985bc4d65b0 expref: 12 pid: 24528 timeout: 1035 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.767409:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e03c2cc6a00/0x9383f985bc4d65b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9383f985bc4d65b0 expref: 12 pid: 24528 timeout: 1035 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.767425:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e03c2ef1400/0x9383f985bc4d65e8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.767439:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c2ef1400/0x9383f985bc4d65e8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788201659.767454:0:5843:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008742710s 00010000:00010000:0.0:1788201659.767458:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03c2ef1400/0x9383f985bc4d65e8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.767465:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03c2ef1400/0x9383f985bc4d65e8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.767472:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e03c2ef1400/0x9383f985bc4d65e8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.767479:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e03c2ef1400/0x9383f985bc4d65e8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.767484:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef1400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201659.767488:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e03c2ef1400/0x9383f985bc4d65e8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.767495:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e03c2ef1400/0x9383f985bc4d65e8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.767503:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e03c2ef1400/0x9383f985bc4d65e8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201659.767513:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201659.767544:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b60c000b-7335-444d-a8dc-1a5956712fb2+12:3310:x1875064458343040:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201659.767551:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1605 00000100:00100000:0.0:1788201659.767588:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458343040:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201659.767786:0:24534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c2cc6a00/0x9383f985bc4d65b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9383f985bc4d65b0 expref: 11 pid: 24528 timeout: 1035 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201659.767800:0:24534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:24534:1875064458342912:0@lo:104: 00010000:00010000:1.0:1788201659.767813:0:24534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e03c2ef1400/0x9383f985bc4d65e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201659.767822:0:24534:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e03c2ef1400/0x9383f985bc4d65e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201659.767828:0:24534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e03c2ef1400/0x9383f985bc4d65e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201659.767836:0:24534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c2ef1400/0x9383f985bc4d65e8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201659.791986:0:24528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c23d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+10:24521:x1875064458342784:12345-0@lo:253:mount.lustre.0 Request processed in 181764us (182993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201659.792002:0:24528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788201659.792175:0:24521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b60c000b-7335-444d-a8dc-1a5956712fb2:24521:1875064458342784:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788201659.792191:0:24521:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788201659.792194:0:24521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788201659.792195:0:24521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788201659.792197:0:24521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201659.792198:0:24521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201659.792199:0:24521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201659.792201:0:24521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201659.792202:0:24521:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201659.792203:0:24521:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788201659.792205:0:24521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201659.792206:0:24521:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788201659.792223:0:24521:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788201659.797896:0:24521:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788201659.798168:0:24521:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788201659.798857:0:24521:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788201659.799006:0:24521:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788201659.799896:0:24521:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788201659.800439:0:24521:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788201659.804001:0:24521:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788201659.804268:0:24521:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788201659.804631:0:24521:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788201659.804858:0:24521:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788201659.806226:0:24521:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788201659.806745:0:24521:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000040:01000000:3.0:1788201659.861331:0:24521:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788201659.861567:0:24577:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1788201659.861572:0:24577:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788201659.861703:0:24578:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788201659.862353:0:24578:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201659.866877:0:24578:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000bd0:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788201659.866966:0:24578:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788201659.866971:0:24578:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1788201659.877678:0:24521:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788201659.877834:0:24521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788201659.878659:0:24521:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788201659.878668:0:24521:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788201659.878804:0:24521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201659.880439:0:24521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788201659.881012:0:24521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788201659.881046:0:24521:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788201659.883626:0:24521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788201659.885892:0:24521:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3b:0x0] (8/8/4) registered 00010000:00080000:2.0:1788201659.894729:0:24521:0:(ldlm_lib.c:3054:target_recovery_init()) RECOVERY: service lustre-MDT0000, 1 recoverable clients, last_transno 25769803779 00010000:00080000:2.0:1788201659.895706:0:24579:0:(ldlm_lib.c:2854:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 24579 00010000:02000000:2.0:1788201659.895752:0:24579:0:(ldlm_lib.c:2336:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00000020:01000004:3.0:1788201659.900261:0:24521:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788201659.900284:0:24521:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.130@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788201659.900316:0:24521:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788201659.900338:0:24521:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00080000:2.0:1788201659.904836:0:24579:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 1 abort 0 expired 0 00010000:00080000:2.0:1788201659.904845:0:24579:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 1 abort 0 expired 0 10000000:01000000:2.0:1788201660.144670:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788201660.144676:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e04c8351000 from 23 10000000:01000000:2.0:1788201660.144680:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788201660.144722:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea6600/0x9383f985bc4d65ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201660.144733:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea6600/0x9383f985bc4d65ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201660.144743:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea6600/0x9383f985bc4d65ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201660.144768:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5484380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458343168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201660.144834:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201660.144881:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d89e1780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201660.146213:0:24526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458343168 00000100:00100000:3.0:1788201660.146224:0:24526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458343168 00000100:00100000:3.0:1788201660.146309:0:24526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788201660.146320:0:24526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c23d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+10:5855:x1875064458343168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201660.146335:0:24526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201660.146352:0:24526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e04c0031c00/0x9383f985bc4d65f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d65ef expref: -99 pid: 24526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201660.146377:0:24526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e04c0031c00/0x9383f985bc4d65f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d65ef expref: 11 pid: 24526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201660.146388:0:24526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e04c0031c00/0x9383f985bc4d65f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d65ef expref: 11 pid: 24526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201660.146397:0:24526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c0031c00, rc 0) 00000100:00100000:3.0:1788201660.147762:0:24526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c23d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+11:5855:x1875064458343168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1438us (2922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201660.147774:0:24526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788201660.154243:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5484380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458343168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201660.154274:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea6600/0x9383f985bc4d65ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d65f6 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201660.154286:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea6600/0x9383f985bc4d65ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d65f6 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201660.154956:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458343296:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788201660.155023:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201660.158206:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c56ba0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201660.161543:0:24527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458343296 00000100:00100000:2.0:1788201660.161558:0:24527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458343296 00000100:00100000:2.0:1788201660.161620:0:24527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788201660.161630:0:24527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c23d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+11:5855:x1875064458343296:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788201660.161657:0:24527:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788201660.161673:0:24527:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788201660.161676:0:24527:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 23 00000100:00100000:2.0:1788201660.161795:0:24527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c23d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+11:5855:x1875064458343296:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 167us (6772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201660.161802:0:24527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788201660.162221:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458343296:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788201660.162278:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788201660.162287:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea6600/0x9383f985bc4d65ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d65f6 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201660.162322:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea6600/0x9383f985bc4d65ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d65f6 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201660.162333:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788201660.162336:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e04c6b8b800 from 42 10000000:01000000:3.0:1788201660.162338:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201660.162368:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04c0031000/0x9383f985bc4d65fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201660.162376:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e04c0031000/0x9383f985bc4d65fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201660.162385:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e04c0031000/0x9383f985bc4d65fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201660.162405:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458343424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201660.162451:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201660.162486:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c56ba0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201660.162548:0:24526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458343424 00000100:00100000:2.0:1788201660.162553:0:24526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458343424 00000100:00100000:2.0:1788201660.162585:0:24526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788201660.162592:0:24526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c23d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+11:5855:x1875064458343424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201660.162602:0:24526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201660.162612:0:24526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e04c7ea6e00/0x9383f985bc4d6604 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d65fd expref: -99 pid: 24526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201660.162633:0:24526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e04c7ea6e00/0x9383f985bc4d6604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d65fd expref: 12 pid: 24526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201660.162642:0:24526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e04c7ea6e00/0x9383f985bc4d6604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d65fd expref: 12 pid: 24526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201660.162649:0:24526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c7ea6e00, rc 0) 00000100:00100000:2.0:1788201660.162684:0:24526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c23d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+12:5855:x1875064458343424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201660.162690:0:24526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788201660.165588:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458343424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201660.165620:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e04c0031000/0x9383f985bc4d65fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6604 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201660.165634:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e04c0031000/0x9383f985bc4d65fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d6604 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201660.165712:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458343552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201660.165764:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201660.165804:0:24527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458343552 00000100:00100000:3.0:1788201660.165809:0:24527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458343552 00000100:00100000:3.0:1788201660.165846:0:24527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201660.165852:0:24527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c23d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+12:5855:x1875064458343552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201660.166592:0:24527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c23d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+12:5855:x1875064458343552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 735us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201660.166602:0:24527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201660.166647:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c56ba0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201660.166662:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458343552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201660.166697:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458343680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201660.166731:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201660.166755:0:24526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458343680 00000100:00100000:3.0:1788201660.166759:0:24526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458343680 00000100:00100000:3.0:1788201660.166784:0:24526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788201660.166791:0:24526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1bed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+12:5855:x1875064458343680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201660.168395:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c56ba0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201660.169596:0:24526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1bed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+12:5855:x1875064458343680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2801us (2860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201660.169609:0:24526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788201660.170410:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458343680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788201660.175444:0:24595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 42 00000020:01000000:2.0:1788201660.175569:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 42-41 (rc=0) 10000000:01000000:2.0:1788201660.175599:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788201660.175610:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04c0031000/0x9383f985bc4d65fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6604 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201660.175622:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e04c0031000/0x9383f985bc4d65fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6604 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201660.175632:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788201660.175635:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1788201660.175638:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788201660.175674:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea7400/0x9383f985bc4d660b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201660.175687:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea7400/0x9383f985bc4d660b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201660.175698:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea7400/0x9383f985bc4d660b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201660.175724:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5486a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458343808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201660.175791:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201660.175832:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1daa180 going to sleep for 11 seconds 00000100:00100000:3.0:1788201660.177118:0:24527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458343808 00000100:00100000:3.0:1788201660.177127:0:24527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458343808 00000100:00100000:3.0:1788201660.177192:0:24527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788201660.177201:0:24527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1bef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+12:5855:x1875064458343808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201660.177215:0:24527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201660.177230:0:24527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c1b97000/0x9383f985bc4d6612 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d660b expref: -99 pid: 24527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201660.177253:0:24527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c1b97000/0x9383f985bc4d6612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d660b expref: 13 pid: 24527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201660.177264:0:24527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c1b97000/0x9383f985bc4d6612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d660b expref: 13 pid: 24527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201660.177273:0:24527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c1b97000, rc 0) 00000100:00100000:3.0:1788201660.177356:0:24527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1bef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+13:5855:x1875064458343808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (1565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201660.177363:0:24527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788201660.177441:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5486a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458343808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201660.177457:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea7400/0x9383f985bc4d660b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6612 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201660.177467:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea7400/0x9383f985bc4d660b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d6612 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201660.177537:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5486a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458343936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201660.177566:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201660.177599:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1daa180 going to sleep for 11 seconds 00000100:00100000:3.0:1788201660.179540:0:24526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458343936 00000100:00100000:3.0:1788201660.179554:0:24526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458343936 00000100:00100000:3.0:1788201660.179607:0:24526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788201660.179617:0:24526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1bed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+13:5855:x1875064458343936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201660.180020:0:24526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1bed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+13:5855:x1875064458343936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 404us (2452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201660.180619:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5486a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458343936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201660.180674:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5486a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458344064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201660.180724:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201660.180754:0:24528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458344064 00000100:00100000:2.0:1788201660.180760:0:24528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458344064 00000100:00100000:3.0:1788201660.180817:0:24526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788201660.184890:0:24528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788201660.184908:0:24528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1bee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+13:5855:x1875064458344064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201660.185343:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1daa180 going to sleep for 11 seconds 00000100:00100000:1.0:1788201660.206361:0:24528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1bee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+13:5855:x1875064458344064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 21451us (25627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201660.206376:0:24528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788201660.206494:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5486a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458344064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788201660.207352:0:24597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 11 00000020:01000000:1.0:1788201660.207546:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1788201660.207568:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788201660.207577:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea7400/0x9383f985bc4d660b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6612 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201660.207592:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea7400/0x9383f985bc4d660b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6612 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201660.207601:0:5855:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788201660.207604:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e04c6b8b800 from 7 10000000:01000000:1.0:1788201660.207606:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788201660.207638:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef0600/0x9383f985bc4d6619 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201660.207646:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef0600/0x9383f985bc4d6619 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201660.207655:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef0600/0x9383f985bc4d6619 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201660.207674:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458344192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201660.207722:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201660.207762:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1268900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201660.207805:0:24559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458344192 00000100:00100000:3.0:1788201660.207812:0:24559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458344192 00000100:00100000:3.0:1788201660.207856:0:24559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788201660.207866:0:24559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1bec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+13:5855:x1875064458344192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201660.207878:0:24559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201660.207891:0:24559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c1b96600/0x9383f985bc4d6620 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d6619 expref: -99 pid: 24559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201660.207912:0:24559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c1b96600/0x9383f985bc4d6620 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d6619 expref: 14 pid: 24559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201660.207923:0:24559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c1b96600/0x9383f985bc4d6620 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d6619 expref: 14 pid: 24559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201660.207931:0:24559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c1b96600, rc 0) 00000100:00100000:3.0:1788201660.207963:0:24559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1bec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+14:5855:x1875064458344192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201660.207970:0:24559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788201660.208048:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458344192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201660.208060:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef0600/0x9383f985bc4d6619 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6620 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201660.208069:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef0600/0x9383f985bc4d6619 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d6620 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201660.208111:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458344320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201660.208135:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201660.208165:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1268900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201660.208249:0:24527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458344320 00000100:00100000:3.0:1788201660.208254:0:24527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458344320 00000100:00100000:3.0:1788201660.208282:0:24527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788201660.208288:0:24527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1becc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+14:5855:x1875064458344320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201660.208538:0:24527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1becc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+14:5855:x1875064458344320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201660.208545:0:24527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788201660.208617:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458344320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201660.208645:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458344448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201660.208678:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201660.208700:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1268900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201660.208714:0:24528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458344448 00000100:00100000:1.0:1788201660.208717:0:24528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458344448 00000100:00100000:1.0:1788201660.208739:0:24528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788201660.208746:0:24528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1bee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+14:5855:x1875064458344448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201660.208877:0:24528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1bee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+14:5855:x1875064458344448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201660.208884:0:24528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788201660.208917:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458344448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201660.210141:0:24598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788201660.210319:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788201660.210338:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201660.210347:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef0600/0x9383f985bc4d6619 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6620 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201660.210357:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef0600/0x9383f985bc4d6619 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6620 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201660.210366:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788201660.210369:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e04f9036000 from 42 10000000:01000000:3.0:1788201660.210372:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201660.210408:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c1b96200/0x9383f985bc4d6627 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201660.210416:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c1b96200/0x9383f985bc4d6627 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201660.210429:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c1b96200/0x9383f985bc4d6627 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201660.210449:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458344576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201660.210494:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201660.210518:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201660.210946:0:24527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458344576 00000100:00100000:1.0:1788201660.210953:0:24527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458344576 00000100:00100000:1.0:1788201660.210992:0:24527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788201660.210999:0:24527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1befc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+14:5855:x1875064458344576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201660.211015:0:24527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201660.211034:0:24527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c2ef0400/0x9383f985bc4d662e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d6627 expref: -99 pid: 24527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201660.211054:0:24527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c2ef0400/0x9383f985bc4d662e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d6627 expref: 15 pid: 24527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201660.211063:0:24527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c2ef0400/0x9383f985bc4d662e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d6627 expref: 15 pid: 24527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201660.211075:0:24527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2ef0400, rc 0) 00000100:00100000:1.0:1788201660.211115:0:24527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1befc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+15:5855:x1875064458344576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201660.211120:0:24527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788201660.211168:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458344576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201660.211180:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c1b96200/0x9383f985bc4d6627 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d662e expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201660.211188:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c1b96200/0x9383f985bc4d6627 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d662e expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201660.211232:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458344704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201660.211254:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201660.211268:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d12686c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201660.211280:0:24526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458344704 00000100:00100000:1.0:1788201660.211283:0:24526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458344704 00000100:00100000:1.0:1788201660.211320:0:24526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788201660.211328:0:24526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1bef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+15:5855:x1875064458344704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201660.211554:0:24526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1bef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+15:5855:x1875064458344704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 226us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201660.211561:0:24526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788201660.211593:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458344704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201660.211736:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458344832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201660.211777:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201660.211799:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d12686c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201660.211836:0:24527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458344832 00000100:00100000:3.0:1788201660.211840:0:24527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458344832 00000100:00100000:3.0:1788201660.211869:0:24527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788201660.211876:0:24527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8054850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+15:5855:x1875064458344832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201660.212012:0:24527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8054850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+15:5855:x1875064458344832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201660.212019:0:24527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788201660.213188:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458344832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788201660.220101:0:24599:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 42 00000020:01000000:2.0:1788201660.224356:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 42-41 (rc=0) 10000000:01000000:2.0:1788201660.224394:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788201660.224407:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c1b96200/0x9383f985bc4d6627 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d662e expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201660.224419:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c1b96200/0x9383f985bc4d6627 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d662e expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201660.224429:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788201660.224433:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1788201660.224436:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788201660.224473:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea6000/0x9383f985bc4d6635 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201660.224481:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea6000/0x9383f985bc4d6635 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201660.224645:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea6000/0x9383f985bc4d6635 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201660.224671:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5485c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458344960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201660.224737:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201660.224785:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1daa180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201660.224797:0:24559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458344960 00000100:00100000:0.0:1788201660.224807:0:24559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458344960 00000100:00100000:0.0:1788201660.224866:0:24559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788201660.224878:0:24559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8057c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+15:5855:x1875064458344960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201660.224892:0:24559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201660.224906:0:24559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c2cc7400/0x9383f985bc4d663c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d6635 expref: -99 pid: 24559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201660.224928:0:24559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c2cc7400/0x9383f985bc4d663c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d6635 expref: 16 pid: 24559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201660.224939:0:24559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c2cc7400/0x9383f985bc4d663c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d6635 expref: 16 pid: 24559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201660.224948:0:24559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc7400, rc 0) 00000100:00100000:0.0:1788201660.225113:0:24559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8057c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+16:5855:x1875064458344960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 238us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201660.225121:0:24559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788201660.225199:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5485c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458344960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201660.225214:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea6000/0x9383f985bc4d6635 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d663c expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201660.225222:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea6000/0x9383f985bc4d6635 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d663c expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201660.225275:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5485c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458345088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201660.225555:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201660.225571:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1daa180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201660.225681:0:24527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458345088 00000100:00100000:0.0:1788201660.225686:0:24527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458345088 00000100:00100000:0.0:1788201660.225726:0:24527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788201660.225733:0:24527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8054c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+16:5855:x1875064458345088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201660.226138:0:24527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8054c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+16:5855:x1875064458345088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 405us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201660.226160:0:24527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788201660.226196:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5485c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458345088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201660.226233:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5485c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458345216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201660.226270:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201660.226321:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1daa180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201660.226336:0:24526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458345216 00000100:00100000:2.0:1788201660.226340:0:24526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458345216 00000100:00100000:2.0:1788201660.226603:0:24526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788201660.226611:0:24526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8056050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+16:5855:x1875064458345216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201660.232094:0:24526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8056050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+16:5855:x1875064458345216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 5412us (5751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201660.232111:0:24526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788201660.232158:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5485c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458345216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788201660.233100:0:24601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 14 00000020:01000000:2.0:1788201660.233167:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1788201660.233186:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788201660.233195:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea6000/0x9383f985bc4d6635 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d663c expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201660.233206:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea6000/0x9383f985bc4d6635 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d663c expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201660.233215:0:5855:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788201660.233217:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9e04c6718000 from 1 10000000:01000000:2.0:1788201660.233220:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788201660.233252:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea7800/0x9383f985bc4d6643 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201660.233260:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea7800/0x9383f985bc4d6643 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201660.233270:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea7800/0x9383f985bc4d6643 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201660.233289:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5485880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458345344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201660.233365:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201660.233400:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7f08540 going to sleep for 11 seconds 00000100:00100000:2.0:1788201660.233418:0:24527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458345344 00000100:00100000:2.0:1788201660.233424:0:24527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458345344 00000100:00100000:2.0:1788201660.233471:0:24527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788201660.233480:0:24527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+16:5855:x1875064458345344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201660.233500:0:24527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201660.233512:0:24527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e04c7ea7000/0x9383f985bc4d664a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d6643 expref: -99 pid: 24527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201660.233533:0:24527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e04c7ea7000/0x9383f985bc4d664a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d6643 expref: 17 pid: 24527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201660.233543:0:24527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e04c7ea7000/0x9383f985bc4d664a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d6643 expref: 17 pid: 24527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201660.233551:0:24527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c7ea7000, rc 0) 00000100:00100000:2.0:1788201660.233586:0:24527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+17:5855:x1875064458345344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201660.233594:0:24527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788201660.233617:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5485880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458345344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201660.233633:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea7800/0x9383f985bc4d6643 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d664a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201660.233643:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea7800/0x9383f985bc4d6643 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d664a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201660.233659:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788201660.233663:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea7800/0x9383f985bc4d6643 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d664a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201660.233669:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea7800/0x9383f985bc4d6643 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d664a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201660.233676:0:5855:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788201660.233677:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e04f9036000 from 7 10000000:01000000:0.0:1788201660.233679:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201660.233693:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7200/0x9383f985bc4d6651 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201660.233701:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7200/0x9383f985bc4d6651 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201660.233712:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7200/0x9383f985bc4d6651 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201660.233724:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458345472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201660.233750:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201660.233779:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1daa6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201660.233808:0:24559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458345472 00000100:00100000:2.0:1788201660.233814:0:24559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458345472 00000100:00100000:2.0:1788201660.233841:0:24559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788201660.233848:0:24559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+17:5855:x1875064458345472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201660.233855:0:24559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201660.233863:0:24559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e04c7ea7a00/0x9383f985bc4d6658 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d6651 expref: -99 pid: 24559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201660.233876:0:24559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e04c7ea7a00/0x9383f985bc4d6658 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d6651 expref: 18 pid: 24559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201660.233883:0:24559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e04c7ea7a00/0x9383f985bc4d6658 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d6651 expref: 18 pid: 24559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201660.233889:0:24559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e04c7ea7a00, rc 0) 00000100:00100000:2.0:1788201660.233922:0:24559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+18:5855:x1875064458345472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201660.233928:0:24559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788201660.233933:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458345472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201660.233947:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7200/0x9383f985bc4d6651 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6658 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201660.233954:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7200/0x9383f985bc4d6651 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d6658 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201660.234116:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c2b7f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458345600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201660.234142:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201660.234275:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04d1daa6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201660.234352:0:24528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458345600 00000100:00100000:2.0:1788201660.234357:0:24528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458345600 00000100:00100000:2.0:1788201660.234420:0:24528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788201660.234430:0:24528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f962a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+18:5855:x1875064458345600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201660.234683:0:24528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f962a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60c000b-7335-444d-a8dc-1a5956712fb2+18:5855:x1875064458345600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201660.234690:0:24528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788201660.234753:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c2b7f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458345600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201660.234790:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458345728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201660.234833:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201660.234859:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201660.234875:0:24526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458345728 00000100:00100000:3.0:1788201660.234879:0:24526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458345728 00000100:00100000:3.0:1788201660.234916:0:24526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788201660.234924:0:24526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+18:5855:x1875064458345728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201660.235081:0:24526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60c000b-7335-444d-a8dc-1a5956712fb2+18:5855:x1875064458345728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201660.235091:0:24526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788201660.235107:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458345728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788201660.238670:0:24603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788201660.239401:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788201660.239429:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201660.239440:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7200/0x9383f985bc4d6651 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6658 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201660.239452:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc7200/0x9383f985bc4d6651 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6658 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201660.239461:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788201660.239464:0:5855:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9e04c6718000 from 1 10000000:01000000:3.0:1788201660.239466:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788201660.239502:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c1b96a00/0x9383f985bc4d665f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201660.239510:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff9e03c1b96a00/0x9383f985bc4d665f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201660.239520:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff9e03c1b96a00/0x9383f985bc4d665f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201660.239546:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458345856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201660.239611:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201660.239655:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201660.239656:0:24527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458345856 00000100:00100000:0.0:1788201660.239665:0:24527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458345856 00000100:00100000:0.0:1788201660.239749:0:24527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788201660.239759:0:24527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f962b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+18:5855:x1875064458345856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201660.239773:0:24527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201660.239787:0:24527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c2cc7c00/0x9383f985bc4d6666 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9383f985bc4d665f expref: -99 pid: 24527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201660.239811:0:24527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c2cc7c00/0x9383f985bc4d6666 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9383f985bc4d665f expref: 19 pid: 24527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201660.239827:0:24527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c2cc7c00/0x9383f985bc4d6666 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9383f985bc4d665f expref: 19 pid: 24527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201660.239835:0:24527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc7c00, rc 0) 00000100:00100000:0.0:1788201660.239886:0:24527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f962b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:5855:x1875064458345856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201660.239893:0:24527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788201660.239964:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458345856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201660.239978:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff9e03c1b96a00/0x9383f985bc4d665f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6666 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201660.239987:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff9e03c1b96a00/0x9383f985bc4d665f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d6666 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201660.240033:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458345984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201660.240058:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201660.240080:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c341d900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201660.240101:0:24559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458345984 00000100:00100000:2.0:1788201660.240106:0:24559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458345984 00000100:00100000:2.0:1788201660.240141:0:24559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788201660.240160:0:24559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff13fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:5855:x1875064458345984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201660.240421:0:24559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff13fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:5855:x1875064458345984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (360us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201660.240429:0:24559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788201660.240595:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b60c000b-7335-444d-a8dc-1a5956712fb2:5855:1875064458345984:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788201660.240621:0:5855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788201660.240628:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c1b96a00/0x9383f985bc4d665f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6666 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201660.240637:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff9e03c1b96a00/0x9383f985bc4d665f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6666 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201660.369516:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201660.369674:0:24528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442791680 00000100:00100000:0.0:1788201660.369684:0:24528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442791680 00000100:00100000:0.0:1788201660.369799:0:24528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:0.0:1788201660.369810:0:24528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff13c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+9:5601:x1875064442791680:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201660.369827:0:24528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201660.369846:0:24528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03c2cc6000/0x9383f985bc4d666d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5962 expref: -99 pid: 24528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201660.369875:0:24528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03c2cc6000/0x9383f985bc4d666d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5962 expref: 10 pid: 24528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201660.369887:0:24528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03c2cc6000/0x9383f985bc4d666d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5962 expref: 10 pid: 24528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201660.369897:0:24528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc6000, rc 0) 00000100:00100000:0.0:1788201660.369959:0:24528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff13c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:5601:x1875064442791680:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 150us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201660.369967:0:24528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:3.0:1788201660.371924:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201660.380262:0:24527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442791808 00000100:00100000:1.0:1788201660.380278:0:24527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442791808 00000100:00100000:1.0:1788201660.380354:0:24527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:1.0:1788201660.380364:0:24527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff13dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:5601:x1875064442791808:12345-192.168.201.30@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788201660.380392:0:24527:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1788201660.380416:0:24527:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788201660.380420:0:24527:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1788201660.380423:0:24527:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1788201660.380426:0:24527:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 23 00000100:00100000:3.0:1788201660.383468:0:24527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff13dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ad49433-54fa-4e21-b756-859420d95603+10:5601:x1875064442791808:12345-192.168.201.30@tcp:256:ll_cfg_requeue.0 Request processed in 3094us (11540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201660.383483:0:24527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 60 00010000:00010000:3.0:1788201660.391379:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201661.336668:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201661.336708:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201661.336743:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201661.336776:0:13441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442792064 00000100:00100000:3.0:1788201661.336786:0:13441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442792064 00000100:00100000:3.0:1788201661.336847:0:13441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 388 00000100:00100000:3.0:1788201661.336857:0:13441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f964f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2362:x1875064442792064:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201661.336927:0:13441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f964f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2362:x1875064442792064:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 71us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201661.336934:0:13441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 388 00000100:00100000:3.0:1788201661.336964:0:24544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442792192 00000100:00100000:3.0:1788201661.336968:0:24544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442792192 00000100:00100000:3.0:1788201661.336986:0:24544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:3.0:1788201661.336991:0:24544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f964dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2358:x1875064442792192:12345-192.168.201.30@tcp:38:kworker.0 00010000:00080000:3.0:1788201661.337014:0:24544:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '35604eb4-baf9-45be-a20a-4883a2cd8cf9' at ffff9e04f4e64800, cookie 0x9383f985bc4d655c 00010000:00080000:3.0:1788201661.337020:0:24544:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp recovering/t25769803778 exp ffff9e04f4e64800 cur 936 last 1788201659 00010000:02000400:3.0:1788201661.337028:0:24544:0:(ldlm_lib.c:2037:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 1 client reconnects 00000100:00080000:2.0:1788201661.338352:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201661.341210:0:24528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442791936 00000100:00100000:0.0:1788201661.341225:0:24528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442791936 00000100:00100000:0.0:1788201661.341315:0:24528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00100000:0.0:1788201661.341327:0:24528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff4b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2361:x1875064442791936:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201661.341417:0:24528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff4b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2361:x1875064442791936:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 93us (4708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201661.341425:0:24528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 61 00010000:00080000:3.0:1788201661.347080:0:24544:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:3.0:1788201661.347121:0:24544:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type 77, return 77 00000100:00080000:3.0:1788201661.347440:0:24544:0:(import.c:65:import_set_state_nolock()) ffff9e04f48d6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201661.347533:0:24544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f964dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2358:x1875064442792192:12345-192.168.201.30@tcp:38:kworker.0 Request processed in 10538us (10787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201661.347544:0:24544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1 00010000:00080000:0.0:1788201661.347639:0:24579:0:(ldlm_lib.c:2546:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 1 abort 0 expired 0 00010000:00080000:0.0:1788201661.347645:0:24579:0:(ldlm_lib.c:2684:replay_request_or_update()) Waiting for transno 25769803780 00000020:00080000:0.0:1788201661.347650:0:24579:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201661.347654:0:24579:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 0, req_transno: 0, next_transno: 25769803780 00000020:00080000:0.0:1788201661.347657:0:24579:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201661.347659:0:24579:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 0, req_transno: 0, next_transno: 25769803780 00000100:00100000:2.0:1788201661.350418:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201661.350554:0:24543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442786304 00000100:00100000:3.0:1788201661.350564:0:24543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442786304 00000100:00100000:3.0:1788201661.350618:0:24543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:3.0:1788201661.350627:0:24543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2358:x1875064442786304:12345-192.168.201.30@tcp:101:lfs.0 00010000:00080000:3.0:1788201661.350652:0:24543:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 25769803780, current: 25769803780, replaying 00000100:00100000:3.0:1788201661.350667:0:24543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2358:x1875064442786304:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 42us (257us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201661.350674:0:24543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2 00000020:00080000:3.0:1788201661.350689:0:24579:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201661.350693:0:24579:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 1, req_transno: 25769803780, next_transno: 25769803780 00010000:00080000:3.0:1788201661.350697:0:24579:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for next (25769803780) 00000020:00080000:3.0:1788201661.350701:0:24579:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201661.350709:0:24579:0:(ldlm_lib.c:2748:replay_request_or_update()) @@@ processing x1875064442786304 t25769803780 from 192.168.201.30@tcp req@ffff9e03c5487b80 x1875064442786304/t0(25769803780) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:27/0 lens 536/0 e 0 to 0 dl 1788201672 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1788201661.350729:0:24579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201661.350751:0:24579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d6674 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5938 expref: -99 pid: 24579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201661.351724:0:24579:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 925us 00010000:00010000:2.0:1788201661.371762:0:24579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7e00/0x9383f985bc4d667b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.371784:0:24579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7e00/0x9383f985bc4d667b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.371799:0:24579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7e00/0x9383f985bc4d667b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.371815:0:24579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7600/0x9383f985bc4d6682 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.371822:0:24579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7600/0x9383f985bc4d6682 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.371828:0:24579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7600/0x9383f985bc4d6682 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201661.375549:0:24579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x42b:0x0]: returning size 0 00000004:00080000:2.0:1788201661.375572:0:24579:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x200000bd1:0x42b:0x0], cookie = 0x9383f985bc4d6498 00000004:00080000:2.0:1788201661.375575:0:24579:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x9383f985bc4d6498 in new mfd 00010000:00010000:2.0:1788201661.375587:0:24579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7e00/0x9383f985bc4d667b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.375602:0:24579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7e00/0x9383f985bc4d667b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.375609:0:24579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7e00/0x9383f985bc4d667b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.375615:0:24579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c7ea7e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201661.375620:0:24579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7e00/0x9383f985bc4d667b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.375628:0:24579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7e00/0x9383f985bc4d667b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.375643:0:24579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:2.0:1788201661.375647:0:24579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201661.375651:0:24579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7e00/0x9383f985bc4d667b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.375658:0:24579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7e00/0x9383f985bc4d667b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201661.375670:0:24579:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3a26186 reply state 00000000cb966194 transno 25769803780 ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7600/0x9383f985bc4d6682 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201661.375679:0:24579:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201661.375713:0:24579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d6674 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5938 expref: 8 pid: 24579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.375724:0:24579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c2fc5300) 00010000:00010000:2.0:1788201661.375727:0:24579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201661.375731:0:24579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d6674 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5938 expref: 8 pid: 24579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.375747:0:24579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c1b96c00, rc 0) 00010000:00080000:2.0:1788201661.376534:0:24579:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:2.0:1788201661.376556:0:24579:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788201661.376560:0:24579:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 0, req_transno: 0, next_transno: 25769803781 00000020:00080000:2.0:1788201661.376565:0:24579:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788201661.376567:0:24579:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 0, req_transno: 0, next_transno: 25769803781 00010000:00010000:2.0:1788201661.385023:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7600/0x9383f985bc4d6682 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.385044:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7600/0x9383f985bc4d6682 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.385052:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7600/0x9383f985bc4d6682 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.385061:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c7ea7600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201661.385066:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7600/0x9383f985bc4d6682 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.385075:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7600/0x9383f985bc4d6682 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.385093:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9e03c36c8c00) 00010000:00010000:2.0:1788201661.385096:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201661.385101:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7600/0x9383f985bc4d6682 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.385109:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e04c7ea7600/0x9383f985bc4d6682 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.414544:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201661.420985:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201661.425996:0:24544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442786560 00000100:00100000:0.0:1788201661.426024:0:24544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442786560 00000100:00100000:0.0:1788201661.426104:0:24544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:0.0:1788201661.426116:0:24544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f964ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2358:x1875064442786560:12345-192.168.201.30@tcp:101:lfs.0 00010000:00080000:0.0:1788201661.426146:0:24544:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 25769803781, current: 25769803781, replaying 00000100:00100000:0.0:1788201661.426165:0:24544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f964ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2358:x1875064442786560:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 52us (5191us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201661.426171:0:24544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3 00000020:00080000:0.0:1788201661.426197:0:24579:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201661.426201:0:24579:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 1, req_transno: 25769803781, next_transno: 25769803781 00010000:00080000:0.0:1788201661.426205:0:24579:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for next (25769803781) 00000020:00080000:0.0:1788201661.426208:0:24579:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201661.426216:0:24579:0:(ldlm_lib.c:2748:replay_request_or_update()) @@@ processing x1875064442786560 t25769803781 from 192.168.201.30@tcp req@ffff9e04f964ed80 x1875064442786560/t0(25769803781) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:27/0 lens 736/0 e 0 to 0 dl 1788201672 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1788201661.426251:0:24579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201661.426277:0:24579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d6690 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c593f expref: -99 pid: 24579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201661.426393:0:24579:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x42b:0x0]: returning size 0 00000004:00080000:0.0:1788201661.426625:0:24579:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x200000bd1:0x42b:0x0], cookie = 0x9383f985bc4d64ad 00000004:00080000:0.0:1788201661.426629:0:24579:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x9383f985bc4d64ad in new mfd 00010000:00010000:0.0:1788201661.426662:0:24579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d6690 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c593f expref: 9 pid: 24579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.426677:0:24579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c33e8000) 00010000:00010000:0.0:1788201661.426680:0:24579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201661.426684:0:24579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2cc7600/0x9383f985bc4d6690 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c593f expref: 9 pid: 24579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.426712:0:24579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c2cc7600, rc 0) 00010000:00080000:0.0:1788201661.426777:0:24579:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788201661.426790:0:24579:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201661.426793:0:24579:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 0, req_transno: 0, next_transno: 25769803782 00000020:00080000:0.0:1788201661.426796:0:24579:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201661.426798:0:24579:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 0, req_transno: 0, next_transno: 25769803782 00000100:00100000:0.0:1788201661.430638:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201661.430883:0:24545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442787072 00000100:00100000:3.0:1788201661.430894:0:24545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442787072 00000100:00100000:3.0:1788201661.430947:0:24545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:3.0:1788201661.430956:0:24545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2358:x1875064442787072:12345-192.168.201.30@tcp:35:lfs.0 00010000:00080000:3.0:1788201661.430976:0:24545:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 25769803782, current: 25769803782, replaying 00000100:00100000:3.0:1788201661.430990:0:24545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:2358:x1875064442787072:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 36us (363us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201661.430997:0:24545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00000020:00080000:0.0:1788201661.431135:0:24579:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201661.431140:0:24579:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 1, req_transno: 25769803782, next_transno: 25769803782 00010000:00080000:0.0:1788201661.431144:0:24579:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for next (25769803782) 00000020:00080000:0.0:1788201661.431146:0:24579:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201661.431157:0:24579:0:(ldlm_lib.c:2748:replay_request_or_update()) @@@ processing x1875064442787072 t25769803782 from 192.168.201.30@tcp req@ffff9e03c2b7f800 x1875064442787072/t0(25769803782) o35->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:27/0 lens 392/0 e 0 to 0 dl 1788201672 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788201661.431521:0:24579:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788201661.431533:0:24579:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201661.431536:0:24579:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 0, req_transno: 0, next_transno: 25769803783 00000020:00080000:0.0:1788201661.431540:0:24579:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201661.431542:0:24579:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 0, req_transno: 0, next_transno: 25769803783 00000100:00100000:0.0:1788201661.433971:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201661.434037:0:24545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442787328 00000100:00100000:3.0:1788201661.434045:0:24545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442787328 00000100:00100000:3.0:1788201661.434160:0:24545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:3.0:1788201661.434172:0:24545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:2358:x1875064442787328:12345-192.168.201.30@tcp:35:lfs.0 00010000:00080000:3.0:1788201661.434192:0:24545:0:(ldlm_lib.c:3229:target_queue_recovery_request()) Next recovery transno: 25769803783, current: 25769803783, replaying 00000100:00100000:3.0:1788201661.434211:0:24545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:2358:x1875064442787328:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 42us (248us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201661.434218:0:24545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1 00000020:00080000:0.0:1788201661.434320:0:24579:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201661.434324:0:24579:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 1, req_transno: 25769803783, next_transno: 25769803783 00010000:00080000:0.0:1788201661.434328:0:24579:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for next (25769803783) 00000020:00080000:0.0:1788201661.434331:0:24579:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201661.434340:0:24579:0:(ldlm_lib.c:2748:replay_request_or_update()) @@@ processing x1875064442787328 t25769803783 from 192.168.201.30@tcp req@ffff9e03c2b7d880 x1875064442787328/t0(25769803783) o35->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:33/0 lens 392/0 e 0 to 0 dl 1788201678 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788201661.434579:0:24579:0:(ldlm_lib.c:2101:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788201661.434593:0:24579:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201661.434596:0:24579:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 0, req_transno: 0, next_transno: 25769803784 00000020:00080000:0.0:1788201661.434598:0:24579:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201661.434601:0:24579:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 1, connected: 1, completed: 0, queue_len: 0, req_transno: 0, next_transno: 25769803784 00000100:00100000:3.0:1788201661.442316:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201661.443137:0:24542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442792320 00000100:00100000:1.0:1788201661.443149:0:24542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442792320 00000100:00100000:1.0:1788201661.443206:0:24542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:1.0:1788201661.443217:0:24542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f964f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2358:x1875064442792320:12345-192.168.201.30@tcp:400:ldlm_lock_repla.0 00010000:00080000:1.0:1788201661.443255:0:24542:0:(ldlm_lib.c:3138:target_queue_recovery_request()) @@@ queue final req req@ffff9e04f964f800 x1875064442792320/t0(0) o400->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:27/0 lens 224/0 e 0 to 0 dl 1788201672 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201661.443276:0:24542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f964f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:2358:x1875064442792320:12345-192.168.201.30@tcp:400:ldlm_lock_repla.0 Request processed in 61us (988us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788201661.443284:0:24542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00000020:00080000:1.0:1788201661.443326:0:24579:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788201661.443331:0:24579:0:(ldlm_lib.c:2229:check_for_next_transno()) max: 1, connected: 1, completed: 1, queue_len: 0, req_transno: 0, next_transno: 25769803784 00010000:00080000:1.0:1788201661.443335:0:24579:0:(ldlm_lib.c:2263:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1788201661.443338:0:24579:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788201661.443343:0:24579:0:(ldlm_lib.c:2453:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1788201661.443346:0:24579:0:(ldlm_lib.c:2286:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1788201661.443904:0:24579:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 7, last_transno is 30064771072 00000001:00080000:1.0:1788201661.524579:0:24555:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803783 is committed 00000001:00100000:1.0:1788201661.524615:0:24555:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 35604eb4-baf9-45be-a20a-4883a2cd8cf9 00000001:00080000:2.0:1788201661.524752:0:24579:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:2.0:1788201661.524804:0:24579:0:(ldlm_lib.c:1997:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:2.0:1788201661.524822:0:24579:0:(ldlm_lib.c:2941:target_recovery_thread()) @@@ processing final ping from 192.168.201.30@tcp: req@ffff9e04f964f800 x1875064442792320/t0(0) o400->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:27/0 lens 224/0 e 0 to 0 dl 1788201672 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788201661.524938:0:24579:0:(ldlm_lib.c:1869:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:01, of 1 clients 1 recovered and 0 were evicted. 00000004:00000080:3.0:1788201661.553317:0:24579:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffad6103ad3e10 00100000:10000000:3.0:1788201661.553332:0:24579:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:2.0:1788201661.556027:0:24568:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x470:0x0] 00000100:00100000:2.0:1788201661.556081:0:24568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5486d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:24568:1875064458346112:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788201661.556174:0:24568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201661.556212:0:24568:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c1dc0300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201661.556403:0:13450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458346112 00000100:00100000:3.0:1788201661.556412:0:13450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458346112 00000100:00100000:3.0:1788201661.556473:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4403 00000100:00100000:3.0:1788201661.556483:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:24568:x1875064458346112:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788201661.556514:0:13450:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1217 -> diff = -81 00002000:02000040:3.0:1788201661.556519:0:13450:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:1137 to 0x280000400:1217) 00000100:00080000:2.0:1788201661.559365:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788201661.560357:0:24566:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x482:0x0] 00000100:00100000:1.0:1788201661.560412:0:24566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:24566:1875064458346240:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788201661.560479:0:24566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201661.560569:0:24566:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c7ca9480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201661.562513:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458346240 00000100:00100000:2.0:1788201661.562525:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458346240 00000100:00100000:2.0:1788201661.562642:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4404 00000100:00100000:2.0:1788201661.562652:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:24566:x1875064458346240:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788201661.562683:0:6706:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1217 -> diff = -63 00002000:02000040:2.0:1788201661.562688:0:6706:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:1155 to 0x240000400:1217) 00002000:00010000:3.0:1788201661.564030:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201661.564044:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdbe346a/0x9383f985bc4d669e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.564062:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4c1:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1788201661.564066:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201661.564073:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdbe346a/0x9383f985bc4d669e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.564090:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdbe346a/0x9383f985bc4d669e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.564100:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdbe346a/0x9383f985bc4d669e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.564108:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fdbe346a/0x9383f985bc4d669e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.564145:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1788201661.565409:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788201661.565425:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201661.565434:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fdbe346a/0x9383f985bc4d669e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.565446:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201661.565450:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdbe346a/0x9383f985bc4d669e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.565459:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdbe346a/0x9383f985bc4d669e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.565479:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fdbe346a/0x9383f985bc4d669e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.565487:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdbe346a/0x9383f985bc4d669e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.565508:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201661.565510:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201661.565511:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201661.566458:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201661.566468:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d66a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.566480:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4c0:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1788201661.566484:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201661.566490:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d66a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.566503:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d66a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.566513:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d66a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.566521:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d66a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.566543:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201661.566556:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201661.566560:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d66a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.566568:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201661.566572:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d66a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.566586:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d66a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.566598:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d66a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.566606:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006bb6ca01/0x9383f985bc4d66a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.566620:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201661.566622:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201661.566623:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201661.566930:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201661.566936:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008e3c192/0x9383f985bc4d66ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.566945:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4bf:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1788201661.566948:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201661.566953:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008e3c192/0x9383f985bc4d66ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.566962:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008e3c192/0x9383f985bc4d66ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.566971:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008e3c192/0x9383f985bc4d66ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.566978:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008e3c192/0x9383f985bc4d66ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.566992:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201661.567657:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201661.567665:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008e3c192/0x9383f985bc4d66ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.567674:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b96000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201661.567678:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008e3c192/0x9383f985bc4d66ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.567686:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008e3c192/0x9383f985bc4d66ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.567700:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008e3c192/0x9383f985bc4d66ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.567706:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008e3c192/0x9383f985bc4d66ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.567724:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201661.567726:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201661.567727:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201661.571587:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201661.571602:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cb2fb41/0x9383f985bc4d66b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.571620:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4be:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1788201661.571625:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201661.571631:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cb2fb41/0x9383f985bc4d66b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.571646:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cb2fb41/0x9383f985bc4d66b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.571657:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cb2fb41/0x9383f985bc4d66b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.571665:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cb2fb41/0x9383f985bc4d66b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.571692:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201661.572026:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201661.572032:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d66ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.572041:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4bd:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1788201661.572044:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201661.572049:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d66ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.572057:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d66ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.572066:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d66ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.572073:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d66ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.572089:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788201661.573474:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201661.573487:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cb2fb41/0x9383f985bc4d66b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.573499:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201661.573503:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cb2fb41/0x9383f985bc4d66b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.573513:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cb2fb41/0x9383f985bc4d66b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.573539:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cb2fb41/0x9383f985bc4d66b3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.573547:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cb2fb41/0x9383f985bc4d66b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.573572:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201661.573576:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d66ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.573583:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201661.573586:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d66ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.573593:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d66ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.573602:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d66ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.573608:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e735c83/0x9383f985bc4d66ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.573619:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201661.573621:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201661.573623:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201661.575369:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201661.576110:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201661.576129:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d66c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.576147:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4bc:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1788201661.576152:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201661.576158:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d66c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.576173:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d66c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.576184:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d66c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.576192:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d66c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.576432:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788201661.580090:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201661.580119:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d66c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.580148:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4bb:0x0].0x0 since=936s v=(0 0) 00010000:00010000:0.0:1788201661.580154:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201661.580161:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d66c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.580177:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d66c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.580189:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d66c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.580198:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d66c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201661.581700:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201661.581715:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8f6c847/0x9383f985bc4d66cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.581730:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4c1:0x0].0x0 since=936s v=(0 0) 00010000:00010000:2.0:1788201661.581735:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201661.581739:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8f6c847/0x9383f985bc4d66cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.581758:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8f6c847/0x9383f985bc4d66cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.581767:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8f6c847/0x9383f985bc4d66cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.581775:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8f6c847/0x9383f985bc4d66cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.583715:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201661.583732:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d66c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.583748:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201661.583753:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d66c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.583763:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d66c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.583787:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d66c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.583795:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000407d1bb5/0x9383f985bc4d66c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.585336:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201661.585348:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d66c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.585368:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201661.585372:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d66c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.585382:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d66c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.585401:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d66c8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.585411:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201661.585415:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8f6c847/0x9383f985bc4d66cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.585423:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c7ea7e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201661.585427:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8f6c847/0x9383f985bc4d66cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.585434:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8f6c847/0x9383f985bc4d66cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.585443:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8f6c847/0x9383f985bc4d66cf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.585450:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201661.585452:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201661.585455:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201661.585530:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788201661.585537:0:13450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d66c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.586186:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.586389:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201661.586398:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8f6c847/0x9383f985bc4d66cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201661.586808:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201661.586816:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd264a34/0x9383f985bc4d66d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.586830:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4c0:0x0].0x0 since=936s v=(0 0) 00010000:00010000:2.0:1788201661.586835:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201661.586841:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd264a34/0x9383f985bc4d66d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.586854:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd264a34/0x9383f985bc4d66d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.586869:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd264a34/0x9383f985bc4d66d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.586877:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd264a34/0x9383f985bc4d66d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201661.589502:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201661.589518:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d66dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.589536:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4ba:0x0].0x0 since=936s v=(0 0) 00010000:00010000:0.0:1788201661.589542:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201661.589548:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d66dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.589564:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d66dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.589576:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d66dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.589585:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d66dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.595909:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201661.595928:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd264a34/0x9383f985bc4d66d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.595945:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c7ea7200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201661.595951:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd264a34/0x9383f985bc4d66d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.595963:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd264a34/0x9383f985bc4d66d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.595986:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd264a34/0x9383f985bc4d66d6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.595997:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201661.596013:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d66dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.596020:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201661.596024:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d66dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.596032:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d66dd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.596049:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d66dd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.596057:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201661.596058:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201661.596061:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.596500:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201661.596509:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd264a34/0x9383f985bc4d66d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201661.596999:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788201661.597093:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.597921:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c77ce88/0x9383f985bc4d66e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.597939:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4bf:0x0].0x0 since=936s v=(0 0) 00010000:00010000:2.0:1788201661.597943:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201661.597950:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c77ce88/0x9383f985bc4d66e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.597965:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c77ce88/0x9383f985bc4d66e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.597976:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c77ce88/0x9383f985bc4d66e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.597990:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c77ce88/0x9383f985bc4d66e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.598027:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201661.598287:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201661.598323:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c77ce88/0x9383f985bc4d66e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.598332:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c7ea6a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201661.598337:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c77ce88/0x9383f985bc4d66e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.598345:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c77ce88/0x9383f985bc4d66e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.598362:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c77ce88/0x9383f985bc4d66e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.598369:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c77ce88/0x9383f985bc4d66e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.598388:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201661.598389:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201661.598391:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201661.598869:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201661.598876:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bb6ca01/0x9383f985bc4d66eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.598885:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4be:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1788201661.598888:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201661.598893:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bb6ca01/0x9383f985bc4d66eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.598907:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bb6ca01/0x9383f985bc4d66eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.598914:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bb6ca01/0x9383f985bc4d66eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.598921:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bb6ca01/0x9383f985bc4d66eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.598942:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201661.599288:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201661.599327:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007f5270e/0x9383f985bc4d66f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.599337:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4bd:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1788201661.599340:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201661.599344:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007f5270e/0x9383f985bc4d66f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.599353:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007f5270e/0x9383f985bc4d66f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.599361:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007f5270e/0x9383f985bc4d66f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.599373:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007f5270e/0x9383f985bc4d66f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.599395:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788201661.599662:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201661.599668:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d66f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.599677:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4bc:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1788201661.599680:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201661.599683:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d66f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.599692:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d66f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.599700:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d66f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.599707:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d66f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.599724:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788201661.599739:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788201661.599744:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bb6ca01/0x9383f985bc4d66eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.599753:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201661.599757:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bb6ca01/0x9383f985bc4d66eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.599765:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bb6ca01/0x9383f985bc4d66eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.599777:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bb6ca01/0x9383f985bc4d66eb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.599785:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bb6ca01/0x9383f985bc4d66eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.599804:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201661.599808:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007f5270e/0x9383f985bc4d66f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.599815:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201661.599818:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007f5270e/0x9383f985bc4d66f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.599826:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007f5270e/0x9383f985bc4d66f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.599835:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007f5270e/0x9383f985bc4d66f2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.599843:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007f5270e/0x9383f985bc4d66f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.599853:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201661.599856:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d66f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.599862:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201661.599866:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d66f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.599873:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d66f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.599882:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d66f9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.599888:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000897fe451/0x9383f985bc4d66f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.599899:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201661.599900:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201661.599902:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201661.600222:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201661.600228:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d928e625/0x9383f985bc4d6700 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.600237:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4bb:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1788201661.600241:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201661.600245:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d928e625/0x9383f985bc4d6700 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.600254:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d928e625/0x9383f985bc4d6700 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.600262:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d928e625/0x9383f985bc4d6700 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.600271:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d928e625/0x9383f985bc4d6700 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.600286:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201661.600319:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201661.600323:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d928e625/0x9383f985bc4d6700 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.600331:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201661.600334:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d928e625/0x9383f985bc4d6700 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.600341:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d928e625/0x9383f985bc4d6700 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.600356:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d928e625/0x9383f985bc4d6700 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.600363:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d928e625/0x9383f985bc4d6700 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.600375:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201661.600377:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201661.600379:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201661.600667:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201661.600673:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c30a815/0x9383f985bc4d6707 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.600681:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ba:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1788201661.600684:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201661.600688:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c30a815/0x9383f985bc4d6707 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.600697:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c30a815/0x9383f985bc4d6707 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.600704:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c30a815/0x9383f985bc4d6707 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.600711:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c30a815/0x9383f985bc4d6707 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.600731:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201661.600738:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201661.600742:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c30a815/0x9383f985bc4d6707 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.600749:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201661.600752:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c30a815/0x9383f985bc4d6707 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.600760:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c30a815/0x9383f985bc4d6707 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.600770:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c30a815/0x9383f985bc4d6707 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.600777:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c30a815/0x9383f985bc4d6707 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.600789:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201661.600790:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201661.600792:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201661.601075:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201661.601081:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d670e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.601090:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b9:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1788201661.601093:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201661.601098:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d670e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.601107:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d670e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.601115:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d670e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.601138:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d670e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.601153:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201661.601161:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201661.601165:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d670e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.601171:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201661.601175:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d670e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.601181:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d670e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.601192:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d670e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.601203:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d65ba541/0x9383f985bc4d670e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.601216:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201661.601218:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201661.601220:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201661.601530:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201661.601536:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d6715 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.601544:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b8:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1788201661.601547:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201661.601551:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d6715 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.601559:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d6715 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.601567:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d6715 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.601573:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d6715 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.601588:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201661.601596:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201661.601600:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d6715 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.601607:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201661.601611:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d6715 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.601620:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d6715 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.601631:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d6715 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.601639:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7da9776/0x9383f985bc4d6715 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.601652:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201661.601654:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201661.601655:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201661.601964:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201661.601969:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075aceb8e/0x9383f985bc4d671c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.601978:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b7:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1788201661.601981:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201661.601985:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075aceb8e/0x9383f985bc4d671c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.602000:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075aceb8e/0x9383f985bc4d671c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.602008:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075aceb8e/0x9383f985bc4d671c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.602016:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075aceb8e/0x9383f985bc4d671c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.602030:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201661.602038:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201661.602042:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075aceb8e/0x9383f985bc4d671c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.602049:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201661.602052:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075aceb8e/0x9383f985bc4d671c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.602061:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075aceb8e/0x9383f985bc4d671c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.602071:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075aceb8e/0x9383f985bc4d671c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.602080:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075aceb8e/0x9383f985bc4d671c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.602093:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201661.602095:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201661.602097:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201661.602492:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.602565:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201661.603496:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788201661.603508:0:13450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0ebfad4/0x9383f985bc4d66dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201661.603992:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201661.603999:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d6723 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.604242:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b9:0x0].0x0 since=936s v=(0 0) 00010000:00010000:0.0:1788201661.604246:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201661.604253:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d6723 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.604266:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d6723 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.604274:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d6723 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.604281:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d6723 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201661.604752:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201661.604759:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040097fff/0x9383f985bc4d672a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.604768:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b6:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1788201661.604772:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201661.604776:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040097fff/0x9383f985bc4d672a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.604786:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040097fff/0x9383f985bc4d672a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.604796:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040097fff/0x9383f985bc4d672a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.604802:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040097fff/0x9383f985bc4d672a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.604856:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201661.604864:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d6723 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.604873:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201661.604878:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d6723 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.604887:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d6723 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.604903:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d6723 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.604912:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201661.604915:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040097fff/0x9383f985bc4d672a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.604921:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201661.604925:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040097fff/0x9383f985bc4d672a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.604933:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040097fff/0x9383f985bc4d672a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.604944:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040097fff/0x9383f985bc4d672a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.604952:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.604954:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.604956:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201661.605265:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788201661.605271:0:13450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000153b56b9/0x9383f985bc4d6723 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201661.605669:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201661.605675:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fc7740f/0x9383f985bc4d6731 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.605684:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b8:0x0].0x0 since=936s v=(0 0) 00010000:00010000:0.0:1788201661.605687:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201661.605691:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fc7740f/0x9383f985bc4d6731 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.605701:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fc7740f/0x9383f985bc4d6731 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.605708:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fc7740f/0x9383f985bc4d6731 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.605716:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005fc7740f/0x9383f985bc4d6731 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.605733:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788201661.606184:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201661.606191:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008e3c192/0x9383f985bc4d6738 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.606199:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b7:0x0].0x0 since=936s v=(0 0) 00010000:00010000:0.0:1788201661.606202:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201661.606207:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008e3c192/0x9383f985bc4d6738 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.606216:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008e3c192/0x9383f985bc4d6738 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.606224:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008e3c192/0x9383f985bc4d6738 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.606232:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008e3c192/0x9383f985bc4d6738 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.606247:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788201661.606579:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201661.606585:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdbe346a/0x9383f985bc4d673f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.606594:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b6:0x0].0x0 since=936s v=(0 0) 00010000:00010000:0.0:1788201661.606597:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201661.606601:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdbe346a/0x9383f985bc4d673f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.606611:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdbe346a/0x9383f985bc4d673f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.606619:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdbe346a/0x9383f985bc4d673f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.606631:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fdbe346a/0x9383f985bc4d673f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.606640:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788201661.606916:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201661.606922:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4d6746 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.606930:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b5:0x0].0x0 since=936s v=(0 0) 00010000:00010000:0.0:1788201661.606933:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201661.606937:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4d6746 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.606944:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4d6746 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.606952:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4d6746 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.606959:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4d6746 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.606968:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788201661.607257:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788201661.607264:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040097fff/0x9383f985bc4d672a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201661.607625:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201661.607632:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f025b68e/0x9383f985bc4d674d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.607640:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b5:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1788201661.607643:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201661.607647:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f025b68e/0x9383f985bc4d674d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.607656:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f025b68e/0x9383f985bc4d674d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.607663:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f025b68e/0x9383f985bc4d674d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.607670:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f025b68e/0x9383f985bc4d674d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.607678:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788201661.607963:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201661.607969:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2f6912d/0x9383f985bc4d6754 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.607977:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b4:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1788201661.607980:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201661.607984:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2f6912d/0x9383f985bc4d6754 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.607993:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2f6912d/0x9383f985bc4d6754 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.608001:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2f6912d/0x9383f985bc4d6754 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.608078:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2f6912d/0x9383f985bc4d6754 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.608087:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1788201661.608225:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788201661.608232:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005fc7740f/0x9383f985bc4d6731 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.608240:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201661.608245:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005fc7740f/0x9383f985bc4d6731 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.608255:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005fc7740f/0x9383f985bc4d6731 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.608272:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005fc7740f/0x9383f985bc4d6731 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.608281:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fc7740f/0x9383f985bc4d6731 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.608323:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788201661.608326:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008e3c192/0x9383f985bc4d6738 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.608333:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b96000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201661.608336:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008e3c192/0x9383f985bc4d6738 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.608343:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008e3c192/0x9383f985bc4d6738 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.608353:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008e3c192/0x9383f985bc4d6738 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.608361:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008e3c192/0x9383f985bc4d6738 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.608372:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788201661.608376:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fdbe346a/0x9383f985bc4d673f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.608382:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201661.608385:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdbe346a/0x9383f985bc4d673f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.608397:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdbe346a/0x9383f985bc4d673f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.608407:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fdbe346a/0x9383f985bc4d673f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.608414:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdbe346a/0x9383f985bc4d673f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.608428:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788201661.608432:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4d6746 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.608438:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201661.608441:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4d6746 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.608449:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4d6746 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.608458:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4d6746 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.608466:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f50aee85/0x9383f985bc4d6746 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.608484:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201661.608488:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f025b68e/0x9383f985bc4d674d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.608495:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201661.608498:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f025b68e/0x9383f985bc4d674d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.608505:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f025b68e/0x9383f985bc4d674d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.608516:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f025b68e/0x9383f985bc4d674d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.608524:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f025b68e/0x9383f985bc4d674d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.608536:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201661.608539:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2f6912d/0x9383f985bc4d6754 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.608545:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201661.608549:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2f6912d/0x9383f985bc4d6754 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.608562:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2f6912d/0x9383f985bc4d6754 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.608571:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2f6912d/0x9383f985bc4d6754 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.608579:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2f6912d/0x9383f985bc4d6754 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.608590:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.608592:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.608594:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.608601:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201661.608965:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201661.608971:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b6707ed/0x9383f985bc4d675b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.608980:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b3:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1788201661.608984:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201661.608988:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b6707ed/0x9383f985bc4d675b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.608998:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b6707ed/0x9383f985bc4d675b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201661.609488:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201661.609495:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d6762 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.609504:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b4:0x0].0x0 since=936s v=(0 0) 00010000:00010000:0.0:1788201661.609507:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201661.609512:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d6762 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.609521:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d6762 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.609530:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d6762 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.609538:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d6762 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.609551:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788201661.609817:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201661.609822:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d6769 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.609829:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b3:0x0].0x0 since=936s v=(0 0) 00010000:00010000:0.0:1788201661.609832:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201661.609836:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d6769 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.609844:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d6769 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.609855:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d6769 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.609862:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d6769 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.609871:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788201661.610182:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b6707ed/0x9383f985bc4d675b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.610192:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b6707ed/0x9383f985bc4d675b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.610207:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788201661.610542:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201661.610547:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6d23568/0x9383f985bc4d6770 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.610556:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b2:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1788201661.610559:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201661.610562:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d23568/0x9383f985bc4d6770 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.610571:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6d23568/0x9383f985bc4d6770 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.610578:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6d23568/0x9383f985bc4d6770 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.610584:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d23568/0x9383f985bc4d6770 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.610592:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788201661.610877:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201661.610882:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bcb7128/0x9383f985bc4d6777 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.610891:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b1:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1788201661.610893:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201661.610897:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bcb7128/0x9383f985bc4d6777 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.610905:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bcb7128/0x9383f985bc4d6777 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.610911:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bcb7128/0x9383f985bc4d6777 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.610918:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bcb7128/0x9383f985bc4d6777 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.610928:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1788201661.611768:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788201661.611777:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d6762 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.611787:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201661.611792:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d6762 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.611801:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d6762 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.611817:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d6762 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.611825:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0264c4b/0x9383f985bc4d6762 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.611846:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788201661.611850:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d6769 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.611856:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff128600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201661.611859:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d6769 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.611866:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d6769 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.611874:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d6769 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.611881:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c33f0faa/0x9383f985bc4d6769 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.611893:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788201661.611897:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b6707ed/0x9383f985bc4d675b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.611903:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef2600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201661.611906:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b6707ed/0x9383f985bc4d675b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.611914:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b6707ed/0x9383f985bc4d675b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.611922:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b6707ed/0x9383f985bc4d675b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.611928:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b6707ed/0x9383f985bc4d675b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.611941:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201661.611945:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6d23568/0x9383f985bc4d6770 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.611951:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201661.611954:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6d23568/0x9383f985bc4d6770 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.611960:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6d23568/0x9383f985bc4d6770 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.611968:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6d23568/0x9383f985bc4d6770 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.611974:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6d23568/0x9383f985bc4d6770 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.611986:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201661.611989:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bcb7128/0x9383f985bc4d6777 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.611995:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef3c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201661.611998:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bcb7128/0x9383f985bc4d6777 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.612018:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bcb7128/0x9383f985bc4d6777 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.612028:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bcb7128/0x9383f985bc4d6777 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.612035:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bcb7128/0x9383f985bc4d6777 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.612045:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.612047:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.612049:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.612055:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201661.612336:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201661.612799:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201661.612807:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e9d4bc7/0x9383f985bc4d677e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.612816:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b2:0x0].0x0 since=936s v=(0 0) 00010000:00010000:0.0:1788201661.612819:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201661.612824:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e9d4bc7/0x9383f985bc4d677e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.612834:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e9d4bc7/0x9383f985bc4d677e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.612842:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e9d4bc7/0x9383f985bc4d677e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.612849:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e9d4bc7/0x9383f985bc4d677e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201661.613516:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201661.613524:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d6785 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.613533:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b0:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1788201661.613537:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201661.613541:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d6785 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.613551:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d6785 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.613559:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d6785 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.613567:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d6785 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.613615:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788201661.613924:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201661.613930:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001687b5b9/0x9383f985bc4d678c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.613939:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b1:0x0].0x0 since=936s v=(0 0) 00010000:00010000:0.0:1788201661.613943:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201661.613947:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001687b5b9/0x9383f985bc4d678c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.613956:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001687b5b9/0x9383f985bc4d678c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.613964:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001687b5b9/0x9383f985bc4d678c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.613972:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001687b5b9/0x9383f985bc4d678c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.614329:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201661.614337:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e9d4bc7/0x9383f985bc4d677e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.614346:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201661.614350:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e9d4bc7/0x9383f985bc4d677e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.614359:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e9d4bc7/0x9383f985bc4d677e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.614376:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e9d4bc7/0x9383f985bc4d677e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.614384:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e9d4bc7/0x9383f985bc4d677e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.614402:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201661.614406:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d6785 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.614412:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201661.614415:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d6785 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.614428:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d6785 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.614436:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d6785 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.614443:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201661.614446:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001687b5b9/0x9383f985bc4d678c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.614451:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff128400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201661.614454:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001687b5b9/0x9383f985bc4d678c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.614460:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001687b5b9/0x9383f985bc4d678c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.614468:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001687b5b9/0x9383f985bc4d678c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.614475:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201661.614476:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201661.614478:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201661.614785:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788201661.614793:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d6785 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.615199:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201661.619573:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201661.619754:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b61b04/0x9383f985bc4d6793 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.619777:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4af:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1788201661.619782:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201661.619789:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004b61b04/0x9383f985bc4d6793 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.619804:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004b61b04/0x9383f985bc4d6793 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.619814:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b61b04/0x9383f985bc4d6793 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.619821:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004b61b04/0x9383f985bc4d6793 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.619851:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201661.619865:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201661.619871:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004b61b04/0x9383f985bc4d6793 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.619879:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b96c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201661.619883:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b61b04/0x9383f985bc4d6793 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.619891:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b61b04/0x9383f985bc4d6793 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.619907:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004b61b04/0x9383f985bc4d6793 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.619915:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004b61b04/0x9383f985bc4d6793 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.619932:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201661.619933:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201661.619935:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201661.621793:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201661.621807:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd264a34/0x9383f985bc4d679a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.621828:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ae:0x0].0x0 since=936s v=(0 0) 00010000:00010000:2.0:1788201661.621832:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201661.621838:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd264a34/0x9383f985bc4d679a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.621852:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd264a34/0x9383f985bc4d679a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.621862:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd264a34/0x9383f985bc4d679a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.621870:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd264a34/0x9383f985bc4d679a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.621893:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201661.621906:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201661.621911:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd264a34/0x9383f985bc4d679a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.621920:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c7ea7200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201661.621924:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd264a34/0x9383f985bc4d679a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.621931:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd264a34/0x9383f985bc4d679a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.621949:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd264a34/0x9383f985bc4d679a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.621957:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd264a34/0x9383f985bc4d679a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.621973:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.621975:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.621977:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201661.622320:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201661.622326:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8f6c847/0x9383f985bc4d67a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.622334:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ad:0x0].0x0 since=936s v=(0 0) 00010000:00010000:2.0:1788201661.622337:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201661.622341:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8f6c847/0x9383f985bc4d67a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.622350:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8f6c847/0x9383f985bc4d67a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.622358:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8f6c847/0x9383f985bc4d67a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.622364:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8f6c847/0x9383f985bc4d67a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.622384:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201661.622392:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201661.622397:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8f6c847/0x9383f985bc4d67a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.622404:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c7ea7e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201661.622407:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8f6c847/0x9383f985bc4d67a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.622414:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8f6c847/0x9383f985bc4d67a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.622424:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8f6c847/0x9383f985bc4d67a1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.622431:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8f6c847/0x9383f985bc4d67a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.622443:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.622444:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.622446:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201661.622719:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201661.622725:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b55b6d7/0x9383f985bc4d67a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.622734:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ac:0x0].0x0 since=936s v=(0 0) 00010000:00010000:2.0:1788201661.622737:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201661.622741:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b55b6d7/0x9383f985bc4d67a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.622750:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b55b6d7/0x9383f985bc4d67a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.622757:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b55b6d7/0x9383f985bc4d67a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.622764:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b55b6d7/0x9383f985bc4d67a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.622786:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201661.623080:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201661.623086:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c77ce88/0x9383f985bc4d67af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.623094:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ab:0x0].0x0 since=936s v=(0 0) 00010000:00010000:2.0:1788201661.623097:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201661.623100:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c77ce88/0x9383f985bc4d67af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.623108:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c77ce88/0x9383f985bc4d67af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.623116:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c77ce88/0x9383f985bc4d67af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.623138:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c77ce88/0x9383f985bc4d67af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.623154:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788201661.623164:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201661.623168:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b55b6d7/0x9383f985bc4d67a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.623175:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c7ea6200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201661.623179:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b55b6d7/0x9383f985bc4d67a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.623187:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b55b6d7/0x9383f985bc4d67a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.623197:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b55b6d7/0x9383f985bc4d67a8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.623205:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b55b6d7/0x9383f985bc4d67a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.623219:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201661.623222:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c77ce88/0x9383f985bc4d67af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.623234:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c7ea6a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201661.623237:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c77ce88/0x9383f985bc4d67af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.623244:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c77ce88/0x9383f985bc4d67af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.623254:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c77ce88/0x9383f985bc4d67af lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.623261:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c77ce88/0x9383f985bc4d67af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.623272:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.623273:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.623275:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201661.623574:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201661.623579:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ac2b41f/0x9383f985bc4d67b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.623587:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4aa:0x0].0x0 since=936s v=(0 0) 00010000:00010000:2.0:1788201661.623590:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201661.623594:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ac2b41f/0x9383f985bc4d67b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.623602:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ac2b41f/0x9383f985bc4d67b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.623611:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ac2b41f/0x9383f985bc4d67b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.623617:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ac2b41f/0x9383f985bc4d67b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.623633:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201661.623641:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201661.623645:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ac2b41f/0x9383f985bc4d67b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.623652:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c7ea7600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201661.623655:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ac2b41f/0x9383f985bc4d67b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.623662:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ac2b41f/0x9383f985bc4d67b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.623672:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ac2b41f/0x9383f985bc4d67b6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.623679:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ac2b41f/0x9383f985bc4d67b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.623692:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.623694:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.623696:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201661.623989:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201661.623996:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d67bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.624004:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4a9:0x0].0x0 since=936s v=(0 0) 00010000:00010000:2.0:1788201661.624007:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201661.624011:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d67bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.624021:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d67bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.624030:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d67bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.624037:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d67bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.624050:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201661.624058:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201661.624062:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d67bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.624068:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bdc00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201661.624072:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d67bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.624085:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d67bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.624096:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d67bd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.624103:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d67bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.624353:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201661.625465:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788201661.625476:0:13450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001687b5b9/0x9383f985bc4d678c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201661.625917:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201661.625923:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9ed0269/0x9383f985bc4d67c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.625934:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b0:0x0].0x0 since=936s v=(0 0) 00010000:00010000:0.0:1788201661.625938:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201661.625943:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9ed0269/0x9383f985bc4d67c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.625955:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9ed0269/0x9383f985bc4d67c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.625965:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9ed0269/0x9383f985bc4d67c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.625972:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9ed0269/0x9383f985bc4d67c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.625985:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788201661.626510:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201661.626516:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d67cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.626525:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4af:0x0].0x0 since=936s v=(0 0) 00010000:00010000:0.0:1788201661.626528:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201661.626531:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d67cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.626539:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d67cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.626551:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d67cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.626558:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d67cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.626567:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788201661.626862:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201661.626868:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e4d980a/0x9383f985bc4d67d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.626876:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4ae:0x0].0x0 since=936s v=(0 0) 00010000:00010000:0.0:1788201661.626879:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201661.626882:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e4d980a/0x9383f985bc4d67d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.626890:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e4d980a/0x9383f985bc4d67d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.626897:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e4d980a/0x9383f985bc4d67d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.626903:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e4d980a/0x9383f985bc4d67d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.626916:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788201661.627281:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201661.627286:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7f7118e/0x9383f985bc4d67d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.627321:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4ad:0x0].0x0 since=936s v=(0 0) 00010000:00010000:0.0:1788201661.627324:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201661.627328:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7f7118e/0x9383f985bc4d67d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.627337:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7f7118e/0x9383f985bc4d67d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.627346:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7f7118e/0x9383f985bc4d67d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.627353:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7f7118e/0x9383f985bc4d67d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.627365:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788201661.627580:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788201661.627588:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9ed0269/0x9383f985bc4d67c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.627602:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff128a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201661.627606:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9ed0269/0x9383f985bc4d67c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.627616:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9ed0269/0x9383f985bc4d67c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.627633:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9ed0269/0x9383f985bc4d67c4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.627642:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9ed0269/0x9383f985bc4d67c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.627663:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788201661.627668:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d67cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.627675:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201661.627678:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d67cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.627686:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d67cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.627695:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d67cb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.627702:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008eb4b04a/0x9383f985bc4d67cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.627715:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201661.627719:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e4d980a/0x9383f985bc4d67d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.627725:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff128200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201661.627728:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e4d980a/0x9383f985bc4d67d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.627736:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e4d980a/0x9383f985bc4d67d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.627746:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e4d980a/0x9383f985bc4d67d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.627753:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e4d980a/0x9383f985bc4d67d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.627765:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201661.627768:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7f7118e/0x9383f985bc4d67d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.627774:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201661.627777:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7f7118e/0x9383f985bc4d67d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.627785:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7f7118e/0x9383f985bc4d67d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.627794:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7f7118e/0x9383f985bc4d67d9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.627801:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7f7118e/0x9383f985bc4d67d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.627815:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201661.627817:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201661.627819:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201661.627826:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201661.628098:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201661.629215:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066520edc/0x9383f985bc4d67e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.629229:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4ac:0x0].0x0 since=936s v=(0 0) 00010000:00010000:0.0:1788201661.629234:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201661.629239:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066520edc/0x9383f985bc4d67e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.629254:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066520edc/0x9383f985bc4d67e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.629264:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066520edc/0x9383f985bc4d67e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.629271:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066520edc/0x9383f985bc4d67e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.629309:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788201661.629688:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201661.629694:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d67e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.629702:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4ab:0x0].0x0 since=936s v=(0 0) 00010000:00010000:0.0:1788201661.629705:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201661.629709:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d67e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.629718:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d67e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.629726:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d67e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.629734:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d67e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.629749:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788201661.630048:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201661.630054:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067773a5a/0x9383f985bc4d67ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.630062:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4aa:0x0].0x0 since=936s v=(0 0) 00010000:00010000:0.0:1788201661.630065:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201661.630069:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067773a5a/0x9383f985bc4d67ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.630077:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067773a5a/0x9383f985bc4d67ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.630085:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067773a5a/0x9383f985bc4d67ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.630092:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067773a5a/0x9383f985bc4d67ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.631309:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201661.631319:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066520edc/0x9383f985bc4d67e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.631329:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04ff129e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201661.631334:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066520edc/0x9383f985bc4d67e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.631344:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066520edc/0x9383f985bc4d67e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.631363:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066520edc/0x9383f985bc4d67e0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.631371:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066520edc/0x9383f985bc4d67e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.631394:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201661.631398:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d67e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.631405:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc7000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:3.0:1788201661.631408:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d67e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.631415:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d67e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.631424:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d67e7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.631431:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006165ca28/0x9383f985bc4d67e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.631442:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201661.631444:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201661.631446:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201661.631452:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201661.632272:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788201661.632774:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201661.632783:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000643c6252/0x9383f985bc4d67f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.632799:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a9:0x0].0x0 since=936s v=(0 0) 00010000:00010000:0.0:1788201661.632804:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201661.632810:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000643c6252/0x9383f985bc4d67f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.632824:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000643c6252/0x9383f985bc4d67f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.632835:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000643c6252/0x9383f985bc4d67f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.632843:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000643c6252/0x9383f985bc4d67f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.632861:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788201661.632869:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201661.632875:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067773a5a/0x9383f985bc4d67ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.632883:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c36e7200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201661.632887:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067773a5a/0x9383f985bc4d67ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.632895:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067773a5a/0x9383f985bc4d67ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.632915:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067773a5a/0x9383f985bc4d67ee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.632921:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067773a5a/0x9383f985bc4d67ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.632936:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201661.632939:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000643c6252/0x9383f985bc4d67f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.632946:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c36e6800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:0.0:1788201661.632948:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000643c6252/0x9383f985bc4d67f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.632955:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000643c6252/0x9383f985bc4d67f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.632964:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000643c6252/0x9383f985bc4d67f5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.632971:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000643c6252/0x9383f985bc4d67f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.632982:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201661.632984:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201661.632986:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.635421:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.635429:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.635432:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201661.635897:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201661.635907:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052b12998/0x9383f985bc4d67fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.635924:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a8:0x0].0x0 since=936s v=(0 0) 00010000:00010000:0.0:1788201661.635929:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201661.635936:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052b12998/0x9383f985bc4d67fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.635950:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052b12998/0x9383f985bc4d67fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.635960:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052b12998/0x9383f985bc4d67fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.635968:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052b12998/0x9383f985bc4d67fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.636000:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201661.636201:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201661.636208:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052b12998/0x9383f985bc4d67fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.636217:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c36e6c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201661.636222:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052b12998/0x9383f985bc4d67fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.636231:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052b12998/0x9383f985bc4d67fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.636249:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052b12998/0x9383f985bc4d67fc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.636261:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052b12998/0x9383f985bc4d67fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.636279:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.636281:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.636283:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.636380:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201661.636650:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201661.636657:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af8460ee/0x9383f985bc4d6803 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.636666:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a7:0x0].0x0 since=936s v=(0 0) 00010000:00010000:0.0:1788201661.636670:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201661.636674:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af8460ee/0x9383f985bc4d6803 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.636688:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af8460ee/0x9383f985bc4d6803 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.636697:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af8460ee/0x9383f985bc4d6803 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.636705:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af8460ee/0x9383f985bc4d6803 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.636765:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788201661.637067:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201661.637074:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b99cfb8/0x9383f985bc4d680a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.637082:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a6:0x0].0x0 since=936s v=(0 0) 00010000:00010000:0.0:1788201661.637086:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201661.637090:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b99cfb8/0x9383f985bc4d680a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.637183:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b99cfb8/0x9383f985bc4d680a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.637193:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b99cfb8/0x9383f985bc4d680a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.637205:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b99cfb8/0x9383f985bc4d680a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201661.637618:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201661.637627:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bb6ca01/0x9383f985bc4d6811 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.637636:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4a8:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1788201661.637639:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201661.637644:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bb6ca01/0x9383f985bc4d6811 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.637654:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bb6ca01/0x9383f985bc4d6811 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.637662:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bb6ca01/0x9383f985bc4d6811 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.637670:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bb6ca01/0x9383f985bc4d6811 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.640046:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788201661.640063:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af8460ee/0x9383f985bc4d6803 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.640077:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c36e6200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201661.640082:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af8460ee/0x9383f985bc4d6803 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.640092:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af8460ee/0x9383f985bc4d6803 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.640133:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af8460ee/0x9383f985bc4d6803 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.640141:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af8460ee/0x9383f985bc4d6803 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.640175:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201661.640180:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b99cfb8/0x9383f985bc4d680a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.640187:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c36e6600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201661.640190:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b99cfb8/0x9383f985bc4d680a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.640198:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b99cfb8/0x9383f985bc4d680a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.640209:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b99cfb8/0x9383f985bc4d680a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.640216:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201661.640220:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bb6ca01/0x9383f985bc4d6811 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.640226:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97600 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201661.640229:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bb6ca01/0x9383f985bc4d6811 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.640236:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bb6ca01/0x9383f985bc4d6811 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.640245:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bb6ca01/0x9383f985bc4d6811 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.640257:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.640258:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.640260:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201661.640517:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788201661.640526:0:13450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b99cfb8/0x9383f985bc4d680a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201661.641014:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201661.641021:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca754662/0x9383f985bc4d6818 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.641033:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a5:0x0].0x0 since=936s v=(0 0) 00010000:00010000:0.0:1788201661.641037:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201661.641044:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca754662/0x9383f985bc4d6818 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.641055:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca754662/0x9383f985bc4d6818 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.641063:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca754662/0x9383f985bc4d6818 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.641071:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca754662/0x9383f985bc4d6818 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.641202:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788201661.641524:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201661.641530:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc669414/0x9383f985bc4d681f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.641539:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a4:0x0].0x0 since=936s v=(0 0) 00010000:00010000:0.0:1788201661.641543:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201661.641547:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc669414/0x9383f985bc4d681f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.641556:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc669414/0x9383f985bc4d681f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.641564:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc669414/0x9383f985bc4d681f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.641572:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc669414/0x9383f985bc4d681f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.641585:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788201661.641872:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201661.641879:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004862939e/0x9383f985bc4d6826 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.641887:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a3:0x0].0x0 since=936s v=(0 0) 00010000:00010000:0.0:1788201661.641890:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201661.641894:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004862939e/0x9383f985bc4d6826 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.641903:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004862939e/0x9383f985bc4d6826 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.641911:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004862939e/0x9383f985bc4d6826 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.641917:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004862939e/0x9383f985bc4d6826 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.641926:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788201661.642286:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201661.642318:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca754662/0x9383f985bc4d6818 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.642328:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c36e7c00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201661.642333:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca754662/0x9383f985bc4d6818 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.642342:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca754662/0x9383f985bc4d6818 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.642357:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca754662/0x9383f985bc4d6818 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.642364:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca754662/0x9383f985bc4d6818 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.642384:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201661.642388:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc669414/0x9383f985bc4d681f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.642407:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c36e6e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201661.642411:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc669414/0x9383f985bc4d681f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.642418:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc669414/0x9383f985bc4d681f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.642427:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc669414/0x9383f985bc4d681f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.642435:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc669414/0x9383f985bc4d681f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.642447:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201661.642450:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004862939e/0x9383f985bc4d6826 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.642456:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c36e7e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201661.642459:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004862939e/0x9383f985bc4d6826 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.642467:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004862939e/0x9383f985bc4d6826 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.642477:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004862939e/0x9383f985bc4d6826 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.642484:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004862939e/0x9383f985bc4d6826 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.642495:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201661.642497:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201661.642499:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201661.642731:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788201661.642739:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bb6ca01/0x9383f985bc4d6811 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201661.643483:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201661.643490:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cb2fb41/0x9383f985bc4d682d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.643499:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4a7:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1788201661.643504:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201661.643510:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cb2fb41/0x9383f985bc4d682d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.643521:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cb2fb41/0x9383f985bc4d682d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.643530:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cb2fb41/0x9383f985bc4d682d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.643537:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006cb2fb41/0x9383f985bc4d682d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.643683:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201661.643689:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006cb2fb41/0x9383f985bc4d682d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.643698:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201661.643702:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006cb2fb41/0x9383f985bc4d682d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.643710:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006cb2fb41/0x9383f985bc4d682d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.643723:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006cb2fb41/0x9383f985bc4d682d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.643730:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201661.643732:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201661.643734:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201661.643802:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788201661.643808:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cb2fb41/0x9383f985bc4d682d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201661.644155:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201661.644161:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdbe346a/0x9383f985bc4d6834 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.644170:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4a6:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1788201661.644173:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201661.644177:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdbe346a/0x9383f985bc4d6834 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.644187:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdbe346a/0x9383f985bc4d6834 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.644201:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdbe346a/0x9383f985bc4d6834 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.644208:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdbe346a/0x9383f985bc4d6834 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.644704:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201661.644711:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdbe346a/0x9383f985bc4d6834 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.644720:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97200 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201661.644724:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdbe346a/0x9383f985bc4d6834 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.644733:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdbe346a/0x9383f985bc4d6834 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.644745:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdbe346a/0x9383f985bc4d6834 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.646775:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.646783:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.646786:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.646792:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201661.647552:0:13450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788201661.647563:0:13450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8ff04cb/0x9383f985bc4d683b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.647579:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a2:0x0].0x0 since=936s v=(0 0) 00010000:00010000:0.0:1788201661.647583:0:13450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201661.647590:0:13450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8ff04cb/0x9383f985bc4d683b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.647603:0:13450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8ff04cb/0x9383f985bc4d683b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.647614:0:13450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8ff04cb/0x9383f985bc4d683b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.647623:0:13450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8ff04cb/0x9383f985bc4d683b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201661.647644:0:13450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788201661.648608:0:13450:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:1136 00000100:00100000:0.0:1788201661.648707:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:24568:x1875064458346112:12345-0@lo:5:osp-pre-1-0.0 Request processed in 92223us (92530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201661.648719:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4403 00000100:00100000:2.0:1788201661.649039:0:24568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5486d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:24568:1875064458346112:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788201661.649056:0:24568:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x4c1:0x0] from OST, last_created [0x280000400:0x4c1:0x0]last_used is [0x280000400:0x470:0x0] 00000100:00100000:2.0:1788201661.649176:0:24568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5486d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:24568:1875064458346368:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788201661.649220:0:24568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201661.649291:0:24568:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c1dc0300 going to sleep for 11 seconds 00010000:00010000:2.0:1788201661.649322:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201661.649329:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8ff04cb/0x9383f985bc4d683b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.649340:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c36e7a00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201661.649344:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8ff04cb/0x9383f985bc4d683b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.649353:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8ff04cb/0x9383f985bc4d683b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.649372:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8ff04cb/0x9383f985bc4d683b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.649379:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8ff04cb/0x9383f985bc4d683b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.649402:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.649404:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.649406:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201661.649509:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788201661.649517:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdbe346a/0x9383f985bc4d6834 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201661.650014:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201661.650021:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d6842 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.650032:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4a5:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1788201661.650036:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201661.650042:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d6842 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.650054:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d6842 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.650063:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d6842 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.650075:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d6842 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.650089:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201661.650958:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201661.650967:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008e3c192/0x9383f985bc4d6849 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.650978:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4a4:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1788201661.650981:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201661.650985:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008e3c192/0x9383f985bc4d6849 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.650996:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008e3c192/0x9383f985bc4d6849 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.651005:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008e3c192/0x9383f985bc4d6849 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.651011:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008e3c192/0x9383f985bc4d6849 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.651021:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788201661.651498:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788201661.651505:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000407d1bb5/0x9383f985bc4d6850 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.651515:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4a3:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1788201661.651518:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201661.651522:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000407d1bb5/0x9383f985bc4d6850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.651531:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000407d1bb5/0x9383f985bc4d6850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.651540:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000407d1bb5/0x9383f985bc4d6850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201661.651547:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000407d1bb5/0x9383f985bc4d6850 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.652239:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201661.652250:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d6842 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.652259:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97e00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201661.652264:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d6842 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.652272:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d6842 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.652288:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d6842 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.652309:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e735c83/0x9383f985bc4d6842 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.652326:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201661.652330:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008e3c192/0x9383f985bc4d6849 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.652335:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b96000 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201661.652338:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008e3c192/0x9383f985bc4d6849 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.652345:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008e3c192/0x9383f985bc4d6849 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.652354:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008e3c192/0x9383f985bc4d6849 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.652361:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008e3c192/0x9383f985bc4d6849 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.652372:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.652374:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.652376:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.652382:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201661.652452:0:13442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458346368 00000100:00100000:0.0:1788201661.652462:0:13442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458346368 00000100:00100000:0.0:1788201661.652529:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4405 00000100:00100000:0.0:1788201661.652540:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:24568:x1875064458346368:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788201661.652593:0:13442:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1218 00010000:00010000:2.0:1788201661.653362:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201661.653381:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201661.653387:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000407d1bb5/0x9383f985bc4d6850 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.653397:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97400 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:2.0:1788201661.653401:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000407d1bb5/0x9383f985bc4d6850 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.653409:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000407d1bb5/0x9383f985bc4d6850 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.653422:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000407d1bb5/0x9383f985bc4d6850 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.653430:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000407d1bb5/0x9383f985bc4d6850 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.653446:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.653448:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201661.653450:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201661.653868:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788201661.653876:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d6857 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.653887:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4a2:0x0].0x0 since=936s v=(0 0) 00010000:00010000:2.0:1788201661.653891:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201661.653897:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d6857 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.653908:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d6857 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.653917:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d6857 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.653924:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d6857 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201661.653938:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788201661.654760:0:6706:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:1154 00000100:00100000:2.0:1788201661.654871:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:24566:x1875064458346240:12345-0@lo:5:osp-pre-0-0.0 Request processed in 92216us (94387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201661.654882:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4404 00000100:00100000:2.0:1788201661.654962:0:24566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:24566:1875064458346240:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788201661.654978:0:24566:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x4c1:0x0] from OST, last_created [0x240000400:0x4c1:0x0]last_used is [0x240000400:0x482:0x0] 00000100:00100000:2.0:1788201661.655026:0:24566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5486a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:24566:1875064458346496:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788201661.655064:0:24566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201661.655089:0:24566:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03c1dc0240 going to sleep for 11 seconds 00000100:00100000:2.0:1788201661.657240:0:13447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458346496 00000100:00100000:2.0:1788201661.657252:0:13447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458346496 00000100:00100000:2.0:1788201661.657322:0:13447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4406 00000100:00100000:2.0:1788201661.657333:0:13447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:24566:x1875064458346496:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788201661.657384:0:13447:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1218 00010000:00010000:1.0:1788201661.658248:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201661.658258:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d6857 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.658271:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bdc00 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201661.658276:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d6857 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.658286:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d6857 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.658321:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d6857 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.658330:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b289fa11/0x9383f985bc4d6857 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201661.658354:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201661.658356:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201661.658358:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201661.664415:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201661.666408:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:24568:x1875064458346368:12345-0@lo:5:osp-pre-1-0.0 Request processed in 13863us (17180us total) trans 4294968895 rc 0/0 00000100:00100000:0.0:1788201661.666422:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4405 00000100:00100000:3.0:1788201661.666674:0:24568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5486d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:24568:1875064458346368:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788201661.666691:0:24568:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x4c1:0x0]-[0x280000400:0x4e1:0x0] 00000100:00100000:2.0:1788201661.668501:0:13447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+7:24566:x1875064458346496:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11164us (13431us total) trans 4294968895 rc 0/0 00000100:00100000:2.0:1788201661.668512:0:13447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4406 00000100:00100000:3.0:1788201661.668688:0:24566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5486a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:24566:1875064458346496:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788201661.668703:0:24566:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x4c1:0x0]-[0x240000400:0x4e1:0x0] 00000001:00100000:0.0:1788201662.328438:0:6732:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788201662.328460:0:6732:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294968895 is committed 00000001:00080000:1.0:1788201662.335321:0:7657:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294968895 is committed 00000001:00100000:1.0:1788201662.335468:0:7657:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788201662.437591:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201663.461461:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1788201664.168450:0:3311:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201648/real 1788201648] req@ffff9e04f9855f80 x1875064458338176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201664 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201664.168496:0:3311:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e04f9855f80 x1875064458338176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201664 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788201664.168505:0:3311:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff9e04ff4ba000 already not connected (conn 16, was 14): CONNECTING 00000100:00100000:1.0:1788201664.168523:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f9855f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458338176:0@lo:400:kworker.0 00010000:00010000:2.0:1788201664.486560:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201664.638534:0:24829:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00000400:2.0:1788201664.678366:0:3312:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201648/real 1788201648] req@ffff9e04f4de8700 x1875064458338304/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201664 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201664.719133:0:3312:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e04f4de8700 x1875064458338304/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201664 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201664.719147:0:3312:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff9e04f5751000 already not connected (conn 16, was 14): CONNECTING 00000100:00100000:0.0:1788201664.722464:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f4de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458338304:0@lo:400:kworker.0 00000100:00080000:2.0:1788201664.741530:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201664.741537:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201664.741540:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201664.741543:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201664.741566:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788201664.741569:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201664.741572:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e04fae46000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201664.741584:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e04fae46000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1788201664.741604:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e03c5484a80 x1875064458347008/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201664.741765:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458346624:0@lo:400:kworker.0 00000100:00100000:2.0:1788201664.741835:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201664.741895:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458346752:0@lo:400:kworker.0 00000100:00100000:2.0:1788201664.741921:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201664.741941:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201664.741946:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458346880:0@lo:400:kworker.0 00000100:00100000:2.0:1788201664.741965:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201664.742386:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875064458347008:0@lo:38:kworker.0 00000100:00100000:1.0:1788201664.742419:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201664.742454:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458346752 00000100:00100000:1.0:1788201664.742462:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458346752 00000100:00100000:1.0:1788201664.742504:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458346880 00000100:00100000:1.0:1788201664.742508:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458346880 00000100:00100000:1.0:1788201664.742531:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1788201664.742540:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458346752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201664.742585:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458346752:12345-0@lo:400:kworker.0 Request processed in 47us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201664.742596:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1788201664.742612:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1788201664.742618:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458346880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201664.742642:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458346880:12345-0@lo:400:kworker.0 Request processed in 25us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201664.742647:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1788201664.742670:0:24543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458347008 00000100:00100000:1.0:1788201664.742673:0:24543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458347008 00000100:00100000:1.0:1788201664.742693:0:24543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201664.742698:0:24543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3309:x1875064458347008:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788201664.742718:0:24543:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 939 last 0 00000020:00000080:1.0:1788201664.742755:0:24543:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9383f985bc4d685e 00000004:00100000:1.0:1788201664.742770:0:24543:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788201664.742894:0:24543:0:(import.c:65:import_set_state_nolock()) ffff9e04f98c5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201664.742936:0:24543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875064458347008:12345-0@lo:38:kworker.0 Request processed in 237us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201664.742942:0:24543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788201664.742959:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201664.742964:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201664.743012:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 7 00000100:00080000:1.0:1788201664.743019:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788201664.743024:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788201664.743026:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04fae46000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788201664.743031:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875064458347008:0@lo:38:kworker.0 00000100:00100000:3.0:1788201664.743409:0:24527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458346624 00000100:00100000:3.0:1788201664.743415:0:24527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458346624 00000100:00100000:3.0:1788201664.743458:0:24527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788201664.743467:0:24527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff4b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458346624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201664.743538:0:24527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff4b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458346624:12345-0@lo:400:kworker.0 Request processed in 72us (1701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201664.743547:0:24527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788201664.743563:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458346624:0@lo:400:kworker.0 00000100:00100000:1.0:1788201664.743630:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458347136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201664.743665:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201664.743706:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458347136 00000100:00100000:1.0:1788201664.743710:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458347136 00000100:00100000:1.0:1788201664.743743:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788201664.743751:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458347136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201664.743776:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524353536 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1788201664.743881:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458347136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201664.743888:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788201664.744052:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968895 gen 2 00000100:00100000:3.0:1788201664.744161:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458347136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201664.744246:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968895 gen 2 00000100:00100000:3.0:1788201664.744258:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201664.744263:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458346880:0@lo:400:kworker.0 00000100:00100000:3.0:1788201664.744269:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c23d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458347264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201664.744279:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458346752:0@lo:400:kworker.0 00000100:00100000:3.0:1788201664.744326:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201664.744365:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458347264 00000100:00100000:3.0:1788201664.744369:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458347264 00000100:00100000:3.0:1788201664.744452:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788201664.744461:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f964d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458347264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201664.744483:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 35848192 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201664.744518:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f964d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458347264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201664.744525:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788201664.744660:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c23d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458347264:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788201665.509427:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1788201665.783655:0:3312:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201649/real 1788201649] req@ffff9e04f964d880 x1875064458338560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201665 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201665.783687:0:3312:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e04f964d880 x1875064458338560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201665 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201665.783696:0:3312:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff9e04ff4ba000 already not connected (conn 16, was 14): CONNECTING 00000100:00100000:3.0:1788201665.783713:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875064458338560:0@lo:400:kworker.0 00000100:00100000:0.0:1788201666.452875:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201666.452930:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201666.452957:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201666.453078:0:24526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442792448 00000100:00100000:1.0:1788201666.453088:0:24526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442792448 00000100:00100000:1.0:1788201666.453149:0:24526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:1.0:1788201666.453159:0:24526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04ff4b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442792448:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201666.453228:0:24526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04ff4b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2359:x1875064442792448:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 70us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201666.453236:0:24526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:1.0:1788201666.453271:0:24544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442792576 00000100:00100000:1.0:1788201666.453275:0:24544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442792576 00000100:00100000:1.0:1788201666.453339:0:24544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:1.0:1788201666.453357:0:24544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2359:x1875064442792576:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201666.453388:0:24544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2359:x1875064442792576:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 43us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201666.453395:0:24544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00080000:1.0:1788201666.453412:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201666.453583:0:13438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442792704 00000100:00100000:3.0:1788201666.453588:0:13438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442792704 00000100:00100000:3.0:1788201666.453636:0:13438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 391 00000100:00100000:3.0:1788201666.453644:0:13438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2359:x1875064442792704:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201666.453674:0:13438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2359:x1875064442792704:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 32us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201666.453680:0:13438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 391 00000100:00080000:1.0:1788201666.454097:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788201666.536735:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201667.557576:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201668.333196:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201668.333345:0:24542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442792832 00000100:00100000:2.0:1788201668.333360:0:24542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442792832 00000100:00100000:2.0:1788201668.333468:0:24542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:2.0:1788201668.333480:0:24542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:30607:x1875064442792832:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1788201668.333502:0:24542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201668.333527:0:24542:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d6865 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5969 expref: -99 pid: 24542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201668.333592:0:24542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d686c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201668.333606:0:24542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d686c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201668.333619:0:24542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d686c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201668.333882:0:24542:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788201668.333887:0:24542:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201668.333961:0:24542:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d686c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201668.333987:0:24542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d6865 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5969 expref: 8 pid: 24542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201668.334026:0:24542:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d686c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5969 expref: 7 pid: 24542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201668.334036:0:24542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c34bb400) 00010000:00010000:2.0:1788201668.334039:0:24542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000100:00080000:1.0:1788201668.334290:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788201668.334633:0:24542:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bce00, rc 0) 00000100:00100000:2.0:1788201668.334712:0:24542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:30607:x1875064442792832:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1234us (1542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201668.334721:0:24542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:3.0:1788201668.347188:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201668.348291:0:24543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442792960 00000100:00100000:1.0:1788201668.348336:0:24543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442792960 00000100:00100000:1.0:1788201668.348418:0:24543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:1.0:1788201668.348428:0:24543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f964d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:30607:x1875064442792960:12345-192.168.201.30@tcp:41:lfs.0 00000004:00000024:1.0:1788201668.348475:0:24543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788201668.348569:0:24543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f964d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:30607:x1875064442792960:12345-192.168.201.30@tcp:41:lfs.0 Request processed in 142us (1405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201668.348577:0:24543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:0.0:1788201668.360517:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201668.360748:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442793088 00000100:00100000:1.0:1788201668.360757:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442793088 00000100:00100000:1.0:1788201668.360835:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 266 00000100:00100000:1.0:1788201668.360847:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:30607:x1875064442793088:12345-192.168.201.30@tcp:13:lfs.0 00002000:00000024:1.0:1788201668.360884:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524353536 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1788201668.360954:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:30607:x1875064442793088:12345-192.168.201.30@tcp:13:lfs.0 Request processed in 109us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201668.360962:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 266 00000100:00080000:2.0:1788201668.361055:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201668.369633:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201668.369898:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442793216 00000100:00100000:1.0:1788201668.369910:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442793216 00000100:00100000:1.0:1788201668.369958:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4407 00000100:00100000:1.0:1788201668.369966:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4de8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:2358:x1875064442793216:12345-192.168.201.30@tcp:8:lfs.0 00010000:00080000:1.0:1788201668.370259:0:13449:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp t0 exp 0000000000000000 cur 943 last 0 00000020:00000080:1.0:1788201668.370322:0:13449:0:(genops.c:1406:class_connect()) connect: client 35604eb4-baf9-45be-a20a-4883a2cd8cf9, cookie 0x9383f985bc4d6873 00002000:00100000:1.0:1788201668.370333:0:13449:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 35604eb4-baf9-45be-a20a-4883a2cd8cf9/ffff9e04f98c6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113836 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788201668.370356:0:13449:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 77, return 77 00002000:00080000:1.0:1788201668.370576:0:13449:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788201668.370608:0:13449:0:(import.c:65:import_set_state_nolock()) ffff9e04cff4f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201668.370720:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4de8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2358:x1875064442793216:12345-192.168.201.30@tcp:8:lfs.0 Request processed in 753us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201668.370729:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4407 00000100:00100000:0.0:1788201668.375970:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201668.377567:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442793344 00000100:00100000:3.0:1788201668.377581:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442793344 00000100:00100000:3.0:1788201668.377665:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 267 00000100:00100000:3.0:1788201668.377677:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2202300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:30607:x1875064442793344:12345-192.168.201.30@tcp:13:lfs.0 00002000:00000024:3.0:1788201668.377704:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 39256064 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201668.377771:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2202300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:30607:x1875064442793344:12345-192.168.201.30@tcp:13:lfs.0 Request processed in 96us (1810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201668.377778:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 267 00000100:00080000:2.0:1788201668.377866:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788201668.581474:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201669.605446:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201669.862845:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458347392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201669.862926:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201669.863016:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458347392 00000100:00100000:1.0:1788201669.863024:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458347392 00000100:00100000:1.0:1788201669.863094:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788201669.863105:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458347392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201669.863141:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524353536 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1788201669.863184:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458347392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201669.863191:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:1.0:1788201669.863210:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201669.863242:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458347392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201669.868825:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c23d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458347520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201669.868899:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201669.869000:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458347520 00000100:00100000:0.0:1788201669.869009:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458347520 00000100:00100000:0.0:1788201669.869060:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788201669.869069:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458347520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201669.869104:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 39256064 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788201669.869150:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458347520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201669.869157:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788201669.869203:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c23d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458347520:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788201669.869232:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201669.874412:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201669.874419:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201669.874422:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201669.874425:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788201669.874448:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458347648:0@lo:400:kworker.0 00000100:00100000:1.0:1788201669.874534:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201669.874604:0:24559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458347648 00000100:00100000:1.0:1788201669.874612:0:24559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458347648 00000100:00100000:1.0:1788201669.874658:0:24559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788201669.874666:0:24559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2451450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458347648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201669.874718:0:24559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2451450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458347648:12345-0@lo:400:kworker.0 Request processed in 51us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201669.874725:0:24559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788201669.874775:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458347648:0@lo:400:kworker.0 00000100:00100000:1.0:1788201669.874816:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875064458347776:0@lo:400:kworker.0 00000100:00100000:1.0:1788201669.874845:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201669.874879:0:24542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458347776 00000100:00100000:1.0:1788201669.874884:0:24542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458347776 00000100:00100000:1.0:1788201669.874913:0:24542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201669.874919:0:24542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875064458347776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201669.874956:0:24542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875064458347776:12345-0@lo:400:kworker.0 Request processed in 37us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201669.874963:0:24542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201669.875004:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875064458347776:0@lo:400:kworker.0 00010000:00010000:2.0:1788201670.630441:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201671.572878:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201671.572926:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201671.572971:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201671.572994:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201671.573055:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442793728 00000100:00100000:3.0:1788201671.573066:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442793728 00000100:00100000:3.0:1788201671.573130:0:13439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442793856 00000100:00100000:3.0:1788201671.573134:0:13439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442793856 00000100:00100000:3.0:1788201671.573158:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 392 00000100:00100000:3.0:1788201671.573168:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d80f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2360:x1875064442793728:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201671.573239:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d80f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2360:x1875064442793728:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 72us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201671.573246:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 392 00000100:00100000:3.0:1788201671.573263:0:13439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 393 00000100:00100000:3.0:1788201671.573269:0:13439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2360:x1875064442793856:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201671.573320:0:13439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2360:x1875064442793856:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201671.573326:0:13439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 393 00000100:00100000:3.0:1788201671.573346:0:24544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442793600 00000100:00100000:3.0:1788201671.573351:0:24544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442793600 00000100:00100000:3.0:1788201671.573387:0:24544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:3.0:1788201671.573394:0:24544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442793600:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201671.573424:0:24544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442793600:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 31us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201671.573430:0:24544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00080000:0.0:1788201671.573617:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201671.573623:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201671.573625:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201671.574028:0:24526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442793472 00000100:00100000:2.0:1788201671.574033:0:24526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442793472 00000100:00100000:2.0:1788201671.574070:0:24526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00100000:2.0:1788201671.574077:0:24526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442793472:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201671.574120:0:24526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442793472:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 44us (1253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201671.574127:0:24526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 65 00010000:00010000:0.0:1788201671.653413:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788201672.511737:0:7657:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 35604eb4-baf9-45be-a20a-4883a2cd8cf9 00010000:00010000:2.0:1788201672.677539:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201673.654275:0:25128:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:2.0:1788201673.703401:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201674.732565:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201674.981609:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458347904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201674.981712:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788201674.982853:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201674.982859:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201674.982863:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201674.982867:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788201674.982947:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458348032:0@lo:400:kworker.0 00000100:00100000:1.0:1788201674.983010:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201674.983045:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201674.983051:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458348416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201674.983080:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201674.983144:0:3309:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201659/real 1788201659] req@ffff9e04f964c380 x1875064458339072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201674 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201674.983170:0:3309:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e04f964c380 x1875064458339072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201674 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201674.983192:0:3309:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201659/real 1788201659] req@ffff9e04f964c000 x1875064458339200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201674 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201674.983204:0:3309:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e04f964c000 x1875064458339200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201674 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201674.983217:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201674.983229:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788201674.983233:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875064458339072:0@lo:38:kworker.0 00000100:00080000:0.0:1788201674.983239:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201674.983243:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788201674.983246:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875064458339200:0@lo:38:kworker.0 00000100:00100000:1.0:1788201674.984693:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458348160:0@lo:400:kworker.0 00000100:00100000:1.0:1788201674.984755:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201674.984784:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201674.984791:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f00a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875064458348288:0@lo:400:kworker.0 00000100:00100000:1.0:1788201674.984819:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201674.984856:0:24559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458348032 00000100:00100000:1.0:1788201674.984866:0:24559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458348032 00000100:00100000:1.0:1788201674.984935:0:24559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788201674.984948:0:24559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2450450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3313:x1875064458348032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201674.985009:0:24559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2450450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3313:x1875064458348032:12345-0@lo:400:kworker.0 Request processed in 63us (1997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201674.985017:0:24559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788201674.985060:0:10484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458348160 00000100:00100000:1.0:1788201674.985063:0:10484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458348160 00000100:00100000:3.0:1788201674.989388:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458347904 00000100:00100000:3.0:1788201674.989410:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458347904 00000100:00100000:3.0:1788201674.989499:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458348416 00000100:00100000:3.0:1788201674.989503:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458348416 00000100:00100000:3.0:1788201674.989710:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788201674.989726:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458347904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201674.989778:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 39256064 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788201674.989882:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458347904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (8169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201674.989904:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788201674.989927:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788201674.989934:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f00a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875064458348416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201674.989960:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524353536 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1788201674.989995:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f00a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875064458348416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (6913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201674.990001:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788201674.990804:0:24543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458348288 00000100:00100000:2.0:1788201674.990814:0:24543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458348288 00000100:00100000:2.0:1788201674.990867:0:24543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788201674.990876:0:24543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875064458348288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201674.990967:0:24543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875064458348288:12345-0@lo:400:kworker.0 Request processed in 93us (6146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201674.990976:0:24543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788201674.991008:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201674.991013:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201674.991017:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201674.991023:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 934 00000100:00080000:2.0:1788201674.991028:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788201674.991033:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e04ff4ba000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1788201674.991072:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e03c23d9180 x1875064458348544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201674.991097:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201674.991101:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201674.991103:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201674.991107:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 934 00000100:00080000:2.0:1788201674.991110:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788201674.991114:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e04f5751000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1788201674.991128:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e03c23d9c00 x1875064458348672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201674.991627:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c23d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875064458348544:0@lo:38:kworker.0 00000100:00100000:2.0:1788201674.991682:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201674.991715:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c23d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875064458348672:0@lo:38:kworker.0 00000100:00100000:2.0:1788201674.991738:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201674.991773:0:24542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458348544 00000100:00100000:2.0:1788201674.991779:0:24542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458348544 00000100:00100000:2.0:1788201674.991802:0:24542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458348672 00000100:00100000:2.0:1788201674.991804:0:24542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458348672 00000100:00100000:2.0:1788201674.991815:0:24542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788201674.991820:0:24542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c23d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875064458348544:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788201674.991847:0:24542:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 950 last 0 00000020:00000080:2.0:1788201674.991901:0:24542:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9383f985bc4d687a 00000004:00100000:2.0:1788201674.991919:0:24542:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788201674.991957:0:24542:0:(import.c:65:import_set_state_nolock()) ffff9e04c6b1a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201674.992002:0:24542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c23d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875064458348544:12345-0@lo:38:kworker.0 Request processed in 181us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201674.992009:0:24542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788201674.992024:0:24542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788201674.992029:0:24542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0501b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875064458348672:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788201674.992041:0:24542:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 950 last 0 00000020:00000080:2.0:1788201674.992066:0:24542:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9383f985bc4d6881 00000004:00100000:2.0:1788201674.992072:0:24542:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788201674.992087:0:24542:0:(import.c:65:import_set_state_nolock()) ffff9e04c6b19000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201674.992113:0:24542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0501b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875064458348672:12345-0@lo:38:kworker.0 Request processed in 83us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201674.992119:0:24542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788201674.992622:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 7 00000100:00100000:1.0:1788201674.993451:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875064458348288:0@lo:400:kworker.0 00000100:00080000:1.0:1788201674.993503:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201674.993510:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201674.996079:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458347904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201674.997335:0:13450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1788201674.997362:0:13450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458348160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201674.997509:0:13450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3310:x1875064458348160:12345-0@lo:400:kworker.0 Request processed in 159us (12753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201674.997518:0:13450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00080000:2.0:1788201674.997982:0:3309:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9e03c23d9180 x1875064458348544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201694 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201674.997997:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788201674.998005:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4ba000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788201674.998009:0:3309:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788201674.998017:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c23d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875064458348544:0@lo:38:kworker.0 00000100:00080000:2.0:1788201674.998061:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 7 00000100:00100000:3.0:1788201674.998330:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875064458348160:0@lo:400:kworker.0 00000100:00100000:1.0:1788201675.000166:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458348416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201675.001349:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f00a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458348032:0@lo:400:kworker.0 00000100:00080000:2.0:1788201675.004113:0:3309:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9e03c23d9c00 x1875064458348672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201694 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201675.004131:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788201675.004137:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04f5751000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788201675.004142:0:3309:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788201675.004149:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c23d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875064458348672:0@lo:38:kworker.0 00000001:02000400:2.0:1788201675.045673:0:25176:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:2.0:1788201675.749673:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201676.690053:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201676.690107:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201676.690151:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201676.690203:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201676.690246:0:13442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442794240 00000100:00100000:0.0:1788201676.690259:0:13442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442794240 00000100:00100000:0.0:1788201676.690373:0:13442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442794368 00000100:00100000:0.0:1788201676.690377:0:13442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442794368 00000100:00100000:0.0:1788201676.690403:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 395 00000100:00100000:0.0:1788201676.690415:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2360:x1875064442794240:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201676.690507:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2360:x1875064442794240:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 93us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201676.690515:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 395 00000100:00100000:0.0:1788201676.690535:0:13442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 396 00000100:00100000:0.0:1788201676.690542:0:13442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2360:x1875064442794368:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201676.690567:0:13442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2360:x1875064442794368:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201676.690573:0:13442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 396 00000100:00100000:2.0:1788201676.690586:0:24526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442793984 00000100:00100000:2.0:1788201676.690591:0:24526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442793984 00000100:00100000:2.0:1788201676.690625:0:24526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 67 00000100:00100000:2.0:1788201676.690633:0:24526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442793984:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201676.690661:0:24526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442793984:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 30us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201676.690668:0:24526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 67 00000100:00100000:1.0:1788201676.690868:0:24542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442794112 00000100:00100000:1.0:1788201676.690873:0:24542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442794112 00000100:00100000:1.0:1788201676.690918:0:24542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:1.0:1788201676.690928:0:24542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442794112:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201676.690962:0:24542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442794112:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 36us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201676.690969:0:24542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00080000:1.0:1788201676.690989:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201676.690995:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201676.690997:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788201676.773719:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201676.839375:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201676.839680:0:24543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442794496 00000100:00100000:1.0:1788201676.839693:0:24543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442794496 00000100:00100000:1.0:1788201676.839769:0:24543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:1.0:1788201676.839783:0:24543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f964ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:31070:x1875064442794496:12345-192.168.201.30@tcp:41:lfs.0 00000004:00000024:1.0:1788201676.839843:0:24543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788201676.839947:0:24543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f964ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:31070:x1875064442794496:12345-192.168.201.30@tcp:41:lfs.0 Request processed in 167us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201676.839956:0:24543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:0.0:1788201676.844571:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201676.844803:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442794624 00000100:00100000:3.0:1788201676.844816:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442794624 00000100:00100000:3.0:1788201676.844932:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 272 00000100:00100000:3.0:1788201676.844944:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:31070:x1875064442794624:12345-192.168.201.30@tcp:13:lfs.0 00002000:00000024:3.0:1788201676.845004:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524353536 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1788201676.845096:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:31070:x1875064442794624:12345-192.168.201.30@tcp:13:lfs.0 Request processed in 155us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201676.845105:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 272 00000100:00100000:0.0:1788201676.848350:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201676.848716:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442794752 00000100:00100000:2.0:1788201676.848730:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442794752 00000100:00100000:2.0:1788201676.848909:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 273 00000100:00100000:2.0:1788201676.848921:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04cffd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:31070:x1875064442794752:12345-192.168.201.30@tcp:13:lfs.0 00002000:00000024:2.0:1788201676.848980:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 39256064 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201676.849079:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04cffd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:31070:x1875064442794752:12345-192.168.201.30@tcp:13:lfs.0 Request processed in 159us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201676.849086:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 273 00000100:00100000:1.0:1788201676.888073:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201676.888444:0:24542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442795008 00000100:00100000:2.0:1788201676.888468:0:24542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442795008 00000100:00100000:2.0:1788201676.888775:0:24542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:2.0:1788201676.888789:0:24542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:31086:x1875064442795008:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1788201676.888819:0:24542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201676.888865:0:24542:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d6888 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5970 expref: -99 pid: 24542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.888972:0:24542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d688f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.888990:0:24542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d688f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.889196:0:24542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d688f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.889219:0:24542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d6896 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.889228:0:24542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d6896 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.889236:0:24542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d6896 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.889840:0:24542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d688f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.889850:0:24542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d688f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.889868:0:24542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d688f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.889876:0:24542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bda00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201676.889880:0:24542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d688f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.889888:0:24542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d688f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.889902:0:24542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c34bb400) 00010000:00010000:2.0:1788201676.889905:0:24542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201676.889910:0:24542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d688f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.889916:0:24542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bda00/0x9383f985bc4d688f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.889932:0:24542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d6896 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.889938:0:24542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d6896 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.889944:0:24542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d6896 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.889950:0:24542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bd800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201676.889952:0:24542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d6896 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.889959:0:24542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d6896 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.889966:0:24542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9e03c34bbc00) 00010000:00010000:2.0:1788201676.889969:0:24542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201676.889972:0:24542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d6896 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.889978:0:24542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d6896 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.890026:0:24542:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d6888 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5970 expref: 8 pid: 24542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.890038:0:24542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c34bb400) 00010000:00010000:2.0:1788201676.890041:0:24542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788201676.890045:0:24542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d6888 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5970 expref: 8 pid: 24542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.890055:0:24542:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bc400, rc 0) 00000100:00100000:2.0:1788201676.890152:0:24542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:31086:x1875064442795008:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1365us (2091us total) trans 0 rc 301/301 00000100:00100000:2.0:1788201676.890162:0:24542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:3.0:1788201676.894322:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201676.894570:0:24544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442795136 00000100:00100000:2.0:1788201676.894585:0:24544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442795136 00000100:00100000:2.0:1788201676.894671:0:24544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:2.0:1788201676.894684:0:24544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f964fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:31086:x1875064442795136:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:2.0:1788201676.894798:0:24544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d689d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.894816:0:24544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d689d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.894828:0:24544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d689d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.894844:0:24544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d68a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.894850:0:24544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d68a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.894866:0:24544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d68a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.895362:0:24544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d68ab lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x42b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.895370:0:24544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d68ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x42b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.895375:0:24544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d68ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x42b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201676.895412:0:24544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201676.895424:0:24544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d68ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x42b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.895437:0:24544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d689d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.895441:0:24544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d689d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.895447:0:24544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d689d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.895451:0:24544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bcc00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201676.895455:0:24544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d689d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.895462:0:24544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d689d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.895474:0:24544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c34bb400) 00010000:00010000:2.0:1788201676.895477:0:24544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201676.895483:0:24544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d689d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.895490:0:24544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d689d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.895505:0:24544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d68a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.895511:0:24544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d68a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.895517:0:24544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d68a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.895523:0:24544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201676.895527:0:24544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d68a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.895533:0:24544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d68a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.895540:0:24544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9e03c34bbb00) 00010000:00010000:2.0:1788201676.895542:0:24544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201676.895892:0:24544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d68a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.895900:0:24544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d68a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.895924:0:24544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d68ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x42b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.895929:0:24544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d68ab lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x42b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.895935:0:24544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d68ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x42b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.895940:0:24544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201676.895943:0:24544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d68ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x42b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.895948:0:24544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d68ab lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x42b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.896010:0:24544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x42b:0x0].0x0 (ffff9e03c34bb000) 00010000:00010000:2.0:1788201676.896014:0:24544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201676.896017:0:24544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d68ab lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x42b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201676.896022:0:24544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d68ab lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x42b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201676.896519:0:24544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f964fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:31086:x1875064442795136:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 1834us (2239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201676.896908:0:24544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00010000:00010000:0.0:1788201677.797513:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201678.824103:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201679.845921:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201680.101599:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201680.101624:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458348800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201680.101697:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201680.104002:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458348800 00000100:00100000:1.0:1788201680.104015:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458348800 00000100:00100000:1.0:1788201680.104121:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788201680.104132:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f964c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458348800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201680.104172:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524353536 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1788201680.104257:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f964c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875064458348800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (2559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201680.104264:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788201680.104486:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458349056:0@lo:400:kworker.0 00000100:00100000:3.0:1788201680.104528:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201680.104558:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788201680.104564:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458348928:0@lo:400:kworker.0 00000100:00100000:3.0:1788201680.104590:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201680.104614:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f9009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875064458349440:0@lo:400:kworker.0 00000100:00100000:3.0:1788201680.104636:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201680.104662:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458349312:0@lo:400:kworker.0 00000100:00100000:3.0:1788201680.104692:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201680.104712:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201680.104719:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f964c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458349184:0@lo:400:kworker.0 00000100:00100000:3.0:1788201680.104740:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201680.104765:0:24542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458349056 00000100:00100000:3.0:1788201680.104770:0:24542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458349056 00000100:00100000:3.0:1788201680.104814:0:24542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458349440 00000100:00100000:3.0:1788201680.104818:0:24542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458349440 00000100:00100000:3.0:1788201680.104834:0:24542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458349184 00000100:00100000:3.0:1788201680.104836:0:24542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458349184 00000100:00100000:3.0:1788201680.104851:0:24542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788201680.104857:0:24542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875064458349056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201680.104904:0:24542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875064458349056:12345-0@lo:400:kworker.0 Request processed in 46us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201680.104910:0:24542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788201680.104924:0:24542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788201680.104930:0:24542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875064458349440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201680.104964:0:24542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875064458349440:12345-0@lo:400:kworker.0 Request processed in 34us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201680.104970:0:24542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788201680.104981:0:24542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201680.104986:0:24542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458349184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201680.105022:0:24542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875064458349184:12345-0@lo:400:kworker.0 Request processed in 36us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201680.105031:0:24542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201680.105051:0:24559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458348928 00000100:00100000:3.0:1788201680.105055:0:24559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458348928 00000100:00100000:3.0:1788201680.105081:0:24559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788201680.105088:0:24559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458348928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201680.105120:0:24559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3311:x1875064458348928:12345-0@lo:400:kworker.0 Request processed in 33us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201680.105127:0:24559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788201680.105179:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875064458349184:0@lo:400:kworker.0 00000100:00100000:3.0:1788201680.105222:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875064458348800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201680.105246:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b60c000b-7335-444d-a8dc-1a5956712fb2:3311:1875064458348928:0@lo:400:kworker.0 00000100:00100000:3.0:1788201680.105255:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f9009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875064458349440:0@lo:400:kworker.0 00000100:00100000:3.0:1788201680.105265:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458349056:0@lo:400:kworker.0 00000100:00080000:2.0:1788201680.105705:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201680.105711:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201680.105728:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458349312 00000100:00100000:2.0:1788201680.105733:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458349312 00000100:00100000:2.0:1788201680.105813:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1788201680.105823:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f965b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458349312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201680.105874:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f965b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458349312:12345-0@lo:400:kworker.0 Request processed in 55us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201680.105880:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00080000:0.0:1788201680.106131:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201680.106199:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f964df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458349312:0@lo:400:kworker.0 00000100:00100000:3.0:1788201680.106222:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c49f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458349568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201680.106258:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201680.106412:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458349568 00000100:00100000:2.0:1788201680.106417:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458349568 00000100:00100000:2.0:1788201680.106520:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788201680.106527:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d094ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458349568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201680.106552:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 39256064 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201680.106598:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d094ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875064458349568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201680.106605:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788201680.106935:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c49f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875064458349568:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788201680.869424:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201681.662017:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201681.665882:0:13526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442795264 00000100:00100000:3.0:1788201681.665900:0:13526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442795264 00000100:00100000:3.0:1788201681.665981:0:13526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:3.0:1788201681.665994:0:13526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04d8091450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+505:2361:x1875064442795264:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201681.666012:0:13526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 117 locks, starting at 0 00002000:00010000:3.0:1788201681.666035:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7c:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.666039:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7c:0x0] updating lvb mtime from disk: 0 -> 1788201081 00002000:00010000:3.0:1788201681.666042:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7c:0x0] updating lvb ctime from disk: 0 -> 1788201081 00002000:00010000:3.0:1788201681.666044:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7c:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.666071:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccf69dc7/0x9383f985bc4a8942 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b952a expref: 505 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.666103:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7b:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.666106:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7b:0x0] updating lvb mtime from disk: 0 -> 1788201081 00002000:00010000:3.0:1788201681.666108:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7b:0x0] updating lvb ctime from disk: 0 -> 1788201081 00002000:00010000:3.0:1788201681.666110:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7b:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.666118:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7caad63/0x9383f985bc4a88ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b950e expref: 504 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.666134:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7a:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.666137:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7a:0x0] updating lvb mtime from disk: 0 -> 1788201081 00002000:00010000:3.0:1788201681.666139:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7a:0x0] updating lvb ctime from disk: 0 -> 1788201081 00002000:00010000:3.0:1788201681.666141:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7a:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.666148:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f190b834/0x9383f985bc4a889a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b94f2 expref: 503 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.666166:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x78:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.666169:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x78:0x0] updating lvb mtime from disk: 0 -> 1788201081 00002000:00010000:3.0:1788201681.666171:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x78:0x0] updating lvb ctime from disk: 0 -> 1788201081 00002000:00010000:3.0:1788201681.666173:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x78:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.666180:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073b2a07e/0x9383f985bc4a87f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b94ba expref: 502 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.666201:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x77:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.666204:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x77:0x0] updating lvb mtime from disk: 0 -> 1788201081 00002000:00010000:3.0:1788201681.666206:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x77:0x0] updating lvb ctime from disk: 0 -> 1788201081 00002000:00010000:3.0:1788201681.666207:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x77:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.666215:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000563bb494/0x9383f985bc4a879e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b949e expref: 501 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.666230:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x76:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.666232:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x76:0x0] updating lvb mtime from disk: 0 -> 1788201081 00002000:00010000:3.0:1788201681.666234:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x76:0x0] updating lvb ctime from disk: 0 -> 1788201081 00002000:00010000:3.0:1788201681.666237:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x76:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.666243:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000858c9541/0x9383f985bc4a874a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b9482 expref: 500 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.666259:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x75:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.666262:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x75:0x0] updating lvb mtime from disk: 0 -> 1788201081 00002000:00010000:3.0:1788201681.666264:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x75:0x0] updating lvb ctime from disk: 0 -> 1788201081 00002000:00010000:3.0:1788201681.666266:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x75:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.666273:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b58749ca/0x9383f985bc4a86f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b9466 expref: 499 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.666288:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x74:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.666290:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x74:0x0] updating lvb mtime from disk: 0 -> 1788201081 00002000:00010000:3.0:1788201681.666323:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x74:0x0] updating lvb ctime from disk: 0 -> 1788201081 00002000:00010000:3.0:1788201681.666325:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x74:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.666334:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025aad42e/0x9383f985bc4a86a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b944a expref: 498 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.666351:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x73:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.666353:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x73:0x0] updating lvb mtime from disk: 0 -> 1788201081 00002000:00010000:3.0:1788201681.666355:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x73:0x0] updating lvb ctime from disk: 0 -> 1788201081 00002000:00010000:3.0:1788201681.666357:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x73:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.666363:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084534efd/0x9383f985bc4a864e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b942e expref: 497 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.666377:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x72:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.666380:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x72:0x0] updating lvb mtime from disk: 0 -> 1788201081 00002000:00010000:3.0:1788201681.666382:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x72:0x0] updating lvb ctime from disk: 0 -> 1788201081 00002000:00010000:3.0:1788201681.666384:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x72:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.666392:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020d54530/0x9383f985bc4a85fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b9412 expref: 496 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.666406:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x71:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.666409:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x71:0x0] updating lvb mtime from disk: 0 -> 1788201081 00002000:00010000:3.0:1788201681.666411:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x71:0x0] updating lvb ctime from disk: 0 -> 1788201081 00002000:00010000:3.0:1788201681.666413:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x71:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.666418:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099b2b340/0x9383f985bc4a85a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b93f6 expref: 495 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.666432:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x70:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.666435:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x70:0x0] updating lvb mtime from disk: 0 -> 1788201081 00002000:00010000:3.0:1788201681.666437:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x70:0x0] updating lvb ctime from disk: 0 -> 1788201081 00002000:00010000:3.0:1788201681.666439:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x70:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.666446:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a538f2f/0x9383f985bc4a8552 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b93da expref: 494 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.666461:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6e:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.666463:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6e:0x0] updating lvb mtime from disk: 0 -> 1788201080 00002000:00010000:3.0:1788201681.666465:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6e:0x0] updating lvb ctime from disk: 0 -> 1788201080 00002000:00010000:3.0:1788201681.666467:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6e:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.666473:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000591fd062/0x9383f985bc4a84aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b93a2 expref: 493 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.666488:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6d:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.666490:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6d:0x0] updating lvb mtime from disk: 0 -> 1788201080 00002000:00010000:3.0:1788201681.666492:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6d:0x0] updating lvb ctime from disk: 0 -> 1788201080 00002000:00010000:3.0:1788201681.666494:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6d:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.666500:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afbaa893/0x9383f985bc4a8456 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b9386 expref: 492 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.666515:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6c:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.666517:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6c:0x0] updating lvb mtime from disk: 0 -> 1788201080 00002000:00010000:3.0:1788201681.666519:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6c:0x0] updating lvb ctime from disk: 0 -> 1788201080 00002000:00010000:3.0:1788201681.666520:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6c:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.666527:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fd52991/0x9383f985bc4a8402 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b936a expref: 491 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.666544:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6b:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.666547:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6b:0x0] updating lvb mtime from disk: 0 -> 1788201080 00002000:00010000:3.0:1788201681.666549:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6b:0x0] updating lvb ctime from disk: 0 -> 1788201080 00002000:00010000:3.0:1788201681.666551:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6b:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.666558:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bb14710/0x9383f985bc4a83ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b934e expref: 490 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.666573:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6a:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.666575:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6a:0x0] updating lvb mtime from disk: 0 -> 1788201080 00002000:00010000:3.0:1788201681.666577:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6a:0x0] updating lvb ctime from disk: 0 -> 1788201080 00002000:00010000:3.0:1788201681.666579:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6a:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.666585:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f435025/0x9383f985bc4a835a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b9332 expref: 489 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.666601:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x40:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.666603:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x40:0x0] updating lvb mtime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.666605:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x40:0x0] updating lvb ctime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.666607:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x40:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.666613:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000650660f/0x9383f985bc4a7592 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8e9a expref: 488 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.666627:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x69:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.666630:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x69:0x0] updating lvb mtime from disk: 0 -> 1788201080 00002000:00010000:3.0:1788201681.666632:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x69:0x0] updating lvb ctime from disk: 0 -> 1788201080 00002000:00010000:3.0:1788201681.666634:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x69:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.666641:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086396d1f/0x9383f985bc4a8306 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b9316 expref: 487 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788201681.666656:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1788201681.666659:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x68:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.666664:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x68:0x0] updating lvb mtime from disk: 0 -> 1788201080 00002000:00010000:3.0:1788201681.666666:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x68:0x0] updating lvb ctime from disk: 0 -> 1788201080 00002000:00010000:3.0:1788201681.666668:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x68:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.666679:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008437830f/0x9383f985bc4a82b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b92fa expref: 486 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.666696:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x67:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.666698:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x67:0x0] updating lvb mtime from disk: 0 -> 1788201080 00002000:00010000:3.0:1788201681.666700:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x67:0x0] updating lvb ctime from disk: 0 -> 1788201080 00002000:00010000:3.0:1788201681.666702:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x67:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.666709:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2f9d123/0x9383f985bc4a825e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b92de expref: 485 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.666722:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x66:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.666724:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x66:0x0] updating lvb mtime from disk: 0 -> 1788201080 00002000:00010000:3.0:1788201681.666726:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x66:0x0] updating lvb ctime from disk: 0 -> 1788201080 00002000:00010000:3.0:1788201681.666728:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x66:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.666734:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054540aa6/0x9383f985bc4a820a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b92c2 expref: 484 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.666748:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.666750:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb mtime from disk: 0 -> 1788201080 00002000:00010000:3.0:1788201681.666752:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb ctime from disk: 0 -> 1788201080 00002000:00010000:3.0:1788201681.666753:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x65:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.666760:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a15909ee/0x9383f985bc4a81b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b92a6 expref: 483 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.666794:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.666796:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb mtime from disk: 0 -> 1788201080 00002000:00010000:3.0:1788201681.666798:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb ctime from disk: 0 -> 1788201080 00002000:00010000:3.0:1788201681.666800:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x64:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.666809:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c77e8835/0x9383f985bc4a8162 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b928a expref: 482 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.666830:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x63:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.666833:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x63:0x0] updating lvb mtime from disk: 0 -> 1788201080 00002000:00010000:3.0:1788201681.666835:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x63:0x0] updating lvb ctime from disk: 0 -> 1788201080 00002000:00010000:3.0:1788201681.666837:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x63:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.666845:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f81d923/0x9383f985bc4a810e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b926e expref: 481 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.666866:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.666868:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb mtime from disk: 0 -> 1788201080 00002000:00010000:3.0:1788201681.666870:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb ctime from disk: 0 -> 1788201080 00002000:00010000:3.0:1788201681.666871:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.666878:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c14e774/0x9383f985bc4a80ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b9252 expref: 480 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.666894:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x61:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.666896:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x61:0x0] updating lvb mtime from disk: 0 -> 1788201080 00002000:00010000:3.0:1788201681.666898:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x61:0x0] updating lvb ctime from disk: 0 -> 1788201080 00002000:00010000:3.0:1788201681.666900:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x61:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.666908:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641473e3/0x9383f985bc4a8066 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b9236 expref: 479 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.666926:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x60:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.666930:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x60:0x0] updating lvb mtime from disk: 0 -> 1788201080 00002000:00010000:3.0:1788201681.666932:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x60:0x0] updating lvb ctime from disk: 0 -> 1788201080 00002000:00010000:3.0:1788201681.666935:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x60:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.666943:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bee1cbf/0x9383f985bc4a8012 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b921a expref: 478 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.666966:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5f:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.666969:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5f:0x0] updating lvb mtime from disk: 0 -> 1788201080 00002000:00010000:3.0:1788201681.666972:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5f:0x0] updating lvb ctime from disk: 0 -> 1788201080 00002000:00010000:3.0:1788201681.666974:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5f:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.666984:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbb0f973/0x9383f985bc4a7fbe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b91fe expref: 477 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.667003:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5d:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.667005:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5d:0x0] updating lvb mtime from disk: 0 -> 1788201079 00002000:00010000:3.0:1788201681.667007:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5d:0x0] updating lvb ctime from disk: 0 -> 1788201079 00002000:00010000:3.0:1788201681.667009:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5d:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.667015:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000047aa299/0x9383f985bc4a7f16 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b91c6 expref: 476 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.667030:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5c:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.667032:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5c:0x0] updating lvb mtime from disk: 0 -> 1788201079 00002000:00010000:3.0:1788201681.667034:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5c:0x0] updating lvb ctime from disk: 0 -> 1788201079 00002000:00010000:3.0:1788201681.667037:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5c:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.667045:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d0ca4d2/0x9383f985bc4a7ec2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b91aa expref: 475 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.667060:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5b:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.667062:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5b:0x0] updating lvb mtime from disk: 0 -> 1788201079 00002000:00010000:3.0:1788201681.667064:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5b:0x0] updating lvb ctime from disk: 0 -> 1788201079 00002000:00010000:3.0:1788201681.667066:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5b:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.667073:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e570d4fd/0x9383f985bc4a7e6e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b918e expref: 474 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.667093:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5a:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.667095:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5a:0x0] updating lvb mtime from disk: 0 -> 1788201079 00002000:00010000:3.0:1788201681.667097:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5a:0x0] updating lvb ctime from disk: 0 -> 1788201079 00002000:00010000:3.0:1788201681.667100:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5a:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.667107:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083dbf05f/0x9383f985bc4a7e1a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b9172 expref: 473 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.667131:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x59:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.667134:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x59:0x0] updating lvb mtime from disk: 0 -> 1788201079 00002000:00010000:3.0:1788201681.667136:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x59:0x0] updating lvb ctime from disk: 0 -> 1788201079 00002000:00010000:3.0:1788201681.667138:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x59:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.667145:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8fb81a6/0x9383f985bc4a7dc6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b9156 expref: 472 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.667165:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x58:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.667168:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x58:0x0] updating lvb mtime from disk: 0 -> 1788201079 00002000:00010000:3.0:1788201681.667170:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x58:0x0] updating lvb ctime from disk: 0 -> 1788201079 00002000:00010000:3.0:1788201681.667173:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x58:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.667180:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd4f8701/0x9383f985bc4a7d72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b913a expref: 471 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.667202:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.667204:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb mtime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.667207:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb ctime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.667209:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.667216:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad503177/0x9383f985bc4a724a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8d82 expref: 470 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.667237:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x57:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.667240:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x57:0x0] updating lvb mtime from disk: 0 -> 1788201079 00002000:00010000:3.0:1788201681.667242:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x57:0x0] updating lvb ctime from disk: 0 -> 1788201079 00002000:00010000:3.0:1788201681.667244:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x57:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.667252:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000412dd5fd/0x9383f985bc4a7d1e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b911e expref: 469 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.667271:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x56:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.667274:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x56:0x0] updating lvb mtime from disk: 0 -> 1788201079 00002000:00010000:3.0:1788201681.667276:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x56:0x0] updating lvb ctime from disk: 0 -> 1788201079 00002000:00010000:3.0:1788201681.667278:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x56:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.667287:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059a03578/0x9383f985bc4a7cca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b9102 expref: 468 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.667347:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x54:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.667350:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x54:0x0] updating lvb mtime from disk: 0 -> 1788201079 00002000:00010000:3.0:1788201681.667353:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x54:0x0] updating lvb ctime from disk: 0 -> 1788201079 00002000:00010000:3.0:1788201681.667355:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x54:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.667365:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001647d93b/0x9383f985bc4a7c22 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b90ca expref: 467 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.667388:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x53:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.667391:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x53:0x0] updating lvb mtime from disk: 0 -> 1788201079 00002000:00010000:3.0:1788201681.667393:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x53:0x0] updating lvb ctime from disk: 0 -> 1788201079 00002000:00010000:3.0:1788201681.667396:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x53:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.667404:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6729362/0x9383f985bc4a7bce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b90ae expref: 466 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.667425:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x52:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.667427:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x52:0x0] updating lvb mtime from disk: 0 -> 1788201079 00002000:00010000:3.0:1788201681.667429:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x52:0x0] updating lvb ctime from disk: 0 -> 1788201079 00002000:00010000:3.0:1788201681.667431:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x52:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.667439:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f60f39cd/0x9383f985bc4a7b7a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b9092 expref: 465 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.667455:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x51:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.667457:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x51:0x0] updating lvb mtime from disk: 0 -> 1788201079 00002000:00010000:3.0:1788201681.667460:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x51:0x0] updating lvb ctime from disk: 0 -> 1788201079 00002000:00010000:3.0:1788201681.667461:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x51:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.667469:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063a61f4d/0x9383f985bc4a7b26 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b9076 expref: 464 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.667492:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x50:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.667494:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x50:0x0] updating lvb mtime from disk: 0 -> 1788201079 00002000:00010000:3.0:1788201681.667496:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x50:0x0] updating lvb ctime from disk: 0 -> 1788201079 00002000:00010000:3.0:1788201681.667498:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x50:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.667509:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037164e1b/0x9383f985bc4a7ad2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b905a expref: 463 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.667526:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4f:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.667529:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4f:0x0] updating lvb mtime from disk: 0 -> 1788201079 00002000:00010000:3.0:1788201681.667531:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4f:0x0] updating lvb ctime from disk: 0 -> 1788201079 00002000:00010000:3.0:1788201681.667533:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4f:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.667540:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022aa4182/0x9383f985bc4a7a7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b903e expref: 462 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.667558:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4e:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.667561:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4e:0x0] updating lvb mtime from disk: 0 -> 1788201078 00002000:00010000:3.0:1788201681.667563:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4e:0x0] updating lvb ctime from disk: 0 -> 1788201078 00002000:00010000:3.0:1788201681.667565:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4e:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.667573:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000223a77d/0x9383f985bc4a7a2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b9022 expref: 461 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.667589:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4d:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.667591:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4d:0x0] updating lvb mtime from disk: 0 -> 1788201078 00002000:00010000:3.0:1788201681.667593:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4d:0x0] updating lvb ctime from disk: 0 -> 1788201078 00002000:00010000:3.0:1788201681.667595:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4d:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.667601:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9995c92/0x9383f985bc4a79d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b9006 expref: 460 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.667615:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4c:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.667617:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4c:0x0] updating lvb mtime from disk: 0 -> 1788201078 00002000:00010000:3.0:1788201681.667619:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4c:0x0] updating lvb ctime from disk: 0 -> 1788201078 00002000:00010000:3.0:1788201681.667621:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4c:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.667627:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093a9fcc7/0x9383f985bc4a7982 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8fea expref: 459 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.667640:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4a:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.667642:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4a:0x0] updating lvb mtime from disk: 0 -> 1788201078 00002000:00010000:3.0:1788201681.667644:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4a:0x0] updating lvb ctime from disk: 0 -> 1788201078 00002000:00010000:3.0:1788201681.667646:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4a:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.667654:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d82eb62/0x9383f985bc4a78da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8fb2 expref: 458 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.667670:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x49:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.667672:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x49:0x0] updating lvb mtime from disk: 0 -> 1788201078 00002000:00010000:3.0:1788201681.667674:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x49:0x0] updating lvb ctime from disk: 0 -> 1788201078 00002000:00010000:3.0:1788201681.667676:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x49:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.667684:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055c4bbe0/0x9383f985bc4a7886 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8f96 expref: 457 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.667700:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x48:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.667702:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x48:0x0] updating lvb mtime from disk: 0 -> 1788201078 00002000:00010000:3.0:1788201681.667704:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x48:0x0] updating lvb ctime from disk: 0 -> 1788201078 00002000:00010000:3.0:1788201681.667707:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x48:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.667717:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081446cfc/0x9383f985bc4a7832 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8f7a expref: 456 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.667731:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x47:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.667734:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x47:0x0] updating lvb mtime from disk: 0 -> 1788201078 00002000:00010000:3.0:1788201681.667736:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x47:0x0] updating lvb ctime from disk: 0 -> 1788201078 00002000:00010000:3.0:1788201681.667738:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x47:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.667744:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d030a3e8/0x9383f985bc4a77de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8f5e expref: 455 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.667758:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x46:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.667760:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x46:0x0] updating lvb mtime from disk: 0 -> 1788201078 00002000:00010000:3.0:1788201681.667762:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x46:0x0] updating lvb ctime from disk: 0 -> 1788201078 00002000:00010000:3.0:1788201681.667764:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x46:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.667783:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000233fd6b5/0x9383f985bc4a778a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8f42 expref: 454 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.667802:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2c:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.667805:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2c:0x0] updating lvb mtime from disk: 0 -> 1788201076 00002000:00010000:3.0:1788201681.667807:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2c:0x0] updating lvb ctime from disk: 0 -> 1788201076 00002000:00010000:3.0:1788201681.667809:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2c:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.667818:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e09630cf/0x9383f985bc4a6f02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8c6a expref: 453 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.667839:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x45:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.667842:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x45:0x0] updating lvb mtime from disk: 0 -> 1788201078 00002000:00010000:3.0:1788201681.667845:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x45:0x0] updating lvb ctime from disk: 0 -> 1788201078 00002000:00010000:3.0:1788201681.667847:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x45:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.667854:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6f9761f/0x9383f985bc4a7736 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8f26 expref: 452 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.667870:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x44:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.667872:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x44:0x0] updating lvb mtime from disk: 0 -> 1788201078 00002000:00010000:3.0:1788201681.667874:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x44:0x0] updating lvb ctime from disk: 0 -> 1788201078 00002000:00010000:3.0:1788201681.667876:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x44:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.667882:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037ad9b2b/0x9383f985bc4a76e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8f0a expref: 451 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.667901:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x43:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.667904:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x43:0x0] updating lvb mtime from disk: 0 -> 1788201078 00002000:00010000:3.0:1788201681.667906:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x43:0x0] updating lvb ctime from disk: 0 -> 1788201078 00002000:00010000:3.0:1788201681.667908:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x43:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.667916:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000565fded7/0x9383f985bc4a768e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8eee expref: 450 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.667937:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.667939:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 0 -> 1788201078 00002000:00010000:3.0:1788201681.667942:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 0 -> 1788201078 00002000:00010000:3.0:1788201681.667944:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.667952:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000364de068/0x9383f985bc4a763a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8ed2 expref: 449 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.667968:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x41:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.667971:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x41:0x0] updating lvb mtime from disk: 0 -> 1788201078 00002000:00010000:3.0:1788201681.667973:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x41:0x0] updating lvb ctime from disk: 0 -> 1788201078 00002000:00010000:3.0:1788201681.667975:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x41:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.667983:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1ba7cb9/0x9383f985bc4a75e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8eb6 expref: 448 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.668003:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3f:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.668005:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3f:0x0] updating lvb mtime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668007:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3f:0x0] updating lvb ctime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668010:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3f:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.668018:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c1814fd/0x9383f985bc4a753e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8e7e expref: 447 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.668040:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3e:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.668043:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3e:0x0] updating lvb mtime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668045:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3e:0x0] updating lvb ctime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668047:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3e:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.668054:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d453afb/0x9383f985bc4a74ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8e62 expref: 446 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.668072:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3d:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.668075:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3d:0x0] updating lvb mtime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668077:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3d:0x0] updating lvb ctime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668079:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3d:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.668087:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c72ece59/0x9383f985bc4a7496 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8e46 expref: 445 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.668110:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3c:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.668112:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3c:0x0] updating lvb mtime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668115:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3c:0x0] updating lvb ctime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668117:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3c:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.668127:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000721bddad/0x9383f985bc4a7442 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8e2a expref: 444 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.668145:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3b:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.668147:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3b:0x0] updating lvb mtime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668149:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3b:0x0] updating lvb ctime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668151:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3b:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.668160:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000575f60a9/0x9383f985bc4a73ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8e0e expref: 443 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.668178:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3a:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.668180:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3a:0x0] updating lvb mtime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668183:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3a:0x0] updating lvb ctime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668185:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3a:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.668194:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089fb0bee/0x9383f985bc4a739a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8df2 expref: 442 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.668213:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.668216:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb mtime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668219:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb ctime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668221:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.668230:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d565a6e/0x9383f985bc4a7346 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8dd6 expref: 441 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.668248:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x38:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.668250:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x38:0x0] updating lvb mtime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668252:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x38:0x0] updating lvb ctime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668254:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x38:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.668261:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a57be0/0x9383f985bc4a72f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8dba expref: 440 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.668278:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x37:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.668281:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x37:0x0] updating lvb mtime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668283:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x37:0x0] updating lvb ctime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668285:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x37:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.668322:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019a6f75d/0x9383f985bc4a729e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8d9e expref: 439 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.668340:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x35:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.668342:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x35:0x0] updating lvb mtime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668345:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x35:0x0] updating lvb ctime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668347:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x35:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.668356:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5e8f97f/0x9383f985bc4a71f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8d66 expref: 438 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.668375:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x34:0x0] updating lvb size from disk: 0 -> 8 00002000:00010000:3.0:1788201681.668378:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x34:0x0] updating lvb mtime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668380:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x34:0x0] updating lvb ctime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668384:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x34:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.668394:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069b2a630/0x9383f985bc4a71a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8d4a expref: 437 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.668419:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x33:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.668422:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x33:0x0] updating lvb mtime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668425:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x33:0x0] updating lvb ctime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668427:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x33:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.668435:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bced015f/0x9383f985bc4a714e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8d2e expref: 436 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.668454:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x32:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.668457:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x32:0x0] updating lvb mtime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668459:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x32:0x0] updating lvb ctime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668461:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x32:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.668470:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb2a7584/0x9383f985bc4a70fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8d12 expref: 435 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.668499:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x31:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.668502:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x31:0x0] updating lvb mtime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668504:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x31:0x0] updating lvb ctime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668506:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x31:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.668517:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bf4568d/0x9383f985bc4a70a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8cf6 expref: 434 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.668534:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x30:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.668537:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x30:0x0] updating lvb mtime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668540:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x30:0x0] updating lvb ctime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668542:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x30:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.668549:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a234ae2/0x9383f985bc4a7052 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8cda expref: 433 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.668564:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.668566:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb mtime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668568:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb ctime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668570:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.668577:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b68a83a/0x9383f985bc4a6ffe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8cbe expref: 432 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.668593:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2e:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.668596:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2e:0x0] updating lvb mtime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668599:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2e:0x0] updating lvb ctime from disk: 0 -> 1788201077 00002000:00010000:3.0:1788201681.668601:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2e:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.668611:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5189027/0x9383f985bc4a6faa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8ca2 expref: 431 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.668634:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2d:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.668637:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2d:0x0] updating lvb mtime from disk: 0 -> 1788201076 00002000:00010000:3.0:1788201681.668640:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2d:0x0] updating lvb ctime from disk: 0 -> 1788201076 00002000:00010000:3.0:1788201681.668642:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2d:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.668650:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b323b185/0x9383f985bc4a6f56 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8c86 expref: 430 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.668667:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2b:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.668671:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2b:0x0] updating lvb mtime from disk: 0 -> 1788201076 00002000:00010000:3.0:1788201681.668673:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2b:0x0] updating lvb ctime from disk: 0 -> 1788201076 00002000:00010000:3.0:1788201681.668675:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2b:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.668682:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c37db30/0x9383f985bc4a6eae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8c4e expref: 429 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.668699:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2a:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.668702:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2a:0x0] updating lvb mtime from disk: 0 -> 1788201076 00002000:00010000:3.0:1788201681.668705:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2a:0x0] updating lvb ctime from disk: 0 -> 1788201076 00002000:00010000:3.0:1788201681.668707:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2a:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.668716:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a6acebe/0x9383f985bc4a6e5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8c32 expref: 428 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.668736:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x29:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.668739:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x29:0x0] updating lvb mtime from disk: 0 -> 1788201076 00002000:00010000:3.0:1788201681.668742:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x29:0x0] updating lvb ctime from disk: 0 -> 1788201076 00002000:00010000:3.0:1788201681.668744:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x29:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.668752:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5031900/0x9383f985bc4a6e06 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8c16 expref: 427 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.668769:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x28:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.674682:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x28:0x0] updating lvb mtime from disk: 0 -> 1788201076 00002000:00010000:3.0:1788201681.674689:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x28:0x0] updating lvb ctime from disk: 0 -> 1788201076 00002000:00010000:3.0:1788201681.674692:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x28:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.674731:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b06aeb2f/0x9383f985bc4a6db2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8bfa expref: 426 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.674795:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x27:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.674798:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x27:0x0] updating lvb mtime from disk: 0 -> 1788201076 00002000:00010000:3.0:1788201681.674800:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x27:0x0] updating lvb ctime from disk: 0 -> 1788201076 00002000:00010000:3.0:1788201681.674802:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x27:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.674812:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d6deb6c/0x9383f985bc4a6d5e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8bde expref: 425 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.674829:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x26:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.674831:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x26:0x0] updating lvb mtime from disk: 0 -> 1788201076 00002000:00010000:3.0:1788201681.674833:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x26:0x0] updating lvb ctime from disk: 0 -> 1788201076 00002000:00010000:3.0:1788201681.674836:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x26:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.674843:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000265954d8/0x9383f985bc4a6d0a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8bc2 expref: 424 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.674857:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x25:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.674860:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x25:0x0] updating lvb mtime from disk: 0 -> 1788201076 00002000:00010000:3.0:1788201681.674862:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x25:0x0] updating lvb ctime from disk: 0 -> 1788201076 00002000:00010000:3.0:1788201681.674864:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x25:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.674871:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004999dbff/0x9383f985bc4a6cb6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8ba6 expref: 423 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.674887:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x24:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.674889:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x24:0x0] updating lvb mtime from disk: 0 -> 1788201076 00002000:00010000:3.0:1788201681.674891:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x24:0x0] updating lvb ctime from disk: 0 -> 1788201076 00002000:00010000:3.0:1788201681.674892:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x24:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.674899:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035202120/0x9383f985bc4a6c62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8b8a expref: 422 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.674912:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.674915:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 0 -> 1788201076 00002000:00010000:3.0:1788201681.674916:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 0 -> 1788201076 00002000:00010000:3.0:1788201681.674918:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.674925:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffab24a8/0x9383f985bc4a6c0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8b6e expref: 421 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.674939:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.674941:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788201076 00002000:00010000:3.0:1788201681.674943:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1788201076 00002000:00010000:3.0:1788201681.674945:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.674952:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b39ed346/0x9383f985bc4a6bba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8b52 expref: 420 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.674970:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x21:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.674973:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x21:0x0] updating lvb mtime from disk: 0 -> 1788201076 00002000:00010000:3.0:1788201681.674975:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x21:0x0] updating lvb ctime from disk: 0 -> 1788201076 00002000:00010000:3.0:1788201681.674977:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x21:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.674984:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bafc1b8b/0x9383f985bc4a6b66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8b36 expref: 419 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.674999:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x20:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.675001:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x20:0x0] updating lvb mtime from disk: 0 -> 1788201076 00002000:00010000:3.0:1788201681.675003:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x20:0x0] updating lvb ctime from disk: 0 -> 1788201076 00002000:00010000:3.0:1788201681.675006:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x20:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.675012:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb970080/0x9383f985bc4a6b12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8b1a expref: 418 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.675028:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.675030:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb mtime from disk: 0 -> 1788201075 00002000:00010000:3.0:1788201681.675032:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb ctime from disk: 0 -> 1788201075 00002000:00010000:3.0:1788201681.675034:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.675041:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db04285f/0x9383f985bc4a6abe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8afe expref: 417 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.675056:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.675058:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb mtime from disk: 0 -> 1788201075 00002000:00010000:3.0:1788201681.675060:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb ctime from disk: 0 -> 1788201075 00002000:00010000:3.0:1788201681.675061:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.675069:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000235a9696/0x9383f985bc4a6a6a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8ae2 expref: 416 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.675084:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x1d:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.675086:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x1d:0x0] updating lvb mtime from disk: 0 -> 1788201075 00002000:00010000:3.0:1788201681.675088:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x1d:0x0] updating lvb ctime from disk: 0 -> 1788201075 00002000:00010000:3.0:1788201681.675090:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x1d:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.675097:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002980b6d/0x9383f985bc4a6a16 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8ac6 expref: 415 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.675111:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x1c:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.675114:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x1c:0x0] updating lvb mtime from disk: 0 -> 1788201075 00002000:00010000:3.0:1788201681.675116:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x1c:0x0] updating lvb ctime from disk: 0 -> 1788201075 00002000:00010000:3.0:1788201681.675118:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x1c:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.675124:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020ea5d73/0x9383f985bc4a69c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8aaa expref: 414 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.675142:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x1b:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.675144:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x1b:0x0] updating lvb mtime from disk: 0 -> 1788201075 00002000:00010000:3.0:1788201681.675146:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x1b:0x0] updating lvb ctime from disk: 0 -> 1788201075 00002000:00010000:3.0:1788201681.675148:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x1b:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.675153:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017e36f27/0x9383f985bc4a696e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8a8e expref: 413 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.675168:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x1a:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.675171:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x1a:0x0] updating lvb mtime from disk: 0 -> 1788201075 00002000:00010000:3.0:1788201681.675172:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x1a:0x0] updating lvb ctime from disk: 0 -> 1788201075 00002000:00010000:3.0:1788201681.675174:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x1a:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.675180:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004942f7fd/0x9383f985bc4a691a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8a72 expref: 412 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.675195:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x19:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.675198:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x19:0x0] updating lvb mtime from disk: 0 -> 1788201075 00002000:00010000:3.0:1788201681.675200:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x19:0x0] updating lvb ctime from disk: 0 -> 1788201075 00002000:00010000:3.0:1788201681.675202:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x19:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.675209:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5bab120/0x9383f985bc4a68c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8a56 expref: 411 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.675225:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.675228:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb mtime from disk: 0 -> 1788201075 00002000:00010000:3.0:1788201681.675230:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb ctime from disk: 0 -> 1788201075 00002000:00010000:3.0:1788201681.675232:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.675240:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000449b12a7/0x9383f985bc4a6872 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8a3a expref: 410 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.675257:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x17:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.675260:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x17:0x0] updating lvb mtime from disk: 0 -> 1788201075 00002000:00010000:3.0:1788201681.675262:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x17:0x0] updating lvb ctime from disk: 0 -> 1788201075 00002000:00010000:3.0:1788201681.675264:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x17:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.675271:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0ce2cf1/0x9383f985bc4a681e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8a1e expref: 409 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.675286:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.675288:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb mtime from disk: 0 -> 1788201074 00002000:00010000:3.0:1788201681.675290:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb ctime from disk: 0 -> 1788201074 00002000:00010000:3.0:1788201681.675312:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.675320:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050f647cd/0x9383f985bc4a67ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8a02 expref: 408 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.675337:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x15:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.675340:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x15:0x0] updating lvb mtime from disk: 0 -> 1788201074 00002000:00010000:3.0:1788201681.675342:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x15:0x0] updating lvb ctime from disk: 0 -> 1788201074 00002000:00010000:3.0:1788201681.675344:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x15:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.675351:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf53c570/0x9383f985bc4a6776 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b89e6 expref: 407 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.675369:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.675372:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb mtime from disk: 0 -> 1788201074 00002000:00010000:3.0:1788201681.675374:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb ctime from disk: 0 -> 1788201074 00002000:00010000:3.0:1788201681.675376:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.675382:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068f22415/0x9383f985bc4a6722 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b89ca expref: 406 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.675396:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x13:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.675399:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x13:0x0] updating lvb mtime from disk: 0 -> 1788201074 00002000:00010000:3.0:1788201681.675401:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x13:0x0] updating lvb ctime from disk: 0 -> 1788201074 00002000:00010000:3.0:1788201681.675403:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x13:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.675409:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060545796/0x9383f985bc4a66ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b89ae expref: 405 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.675423:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.675425:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb mtime from disk: 0 -> 1788201074 00002000:00010000:3.0:1788201681.675428:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb ctime from disk: 0 -> 1788201074 00002000:00010000:3.0:1788201681.675430:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.675437:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db3e7432/0x9383f985bc4a667a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8992 expref: 404 pid: 12363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.675452:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.675455:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb mtime from disk: 0 -> 1788201074 00002000:00010000:3.0:1788201681.675456:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb ctime from disk: 0 -> 1788201074 00002000:00010000:3.0:1788201681.675458:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.675466:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000807c6e76/0x9383f985bc4a6626 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8976 expref: 403 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.675479:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.675482:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb mtime from disk: 0 -> 1788201074 00002000:00010000:3.0:1788201681.675483:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb ctime from disk: 0 -> 1788201074 00002000:00010000:3.0:1788201681.675485:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.675491:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004571b349/0x9383f985bc4a65d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b895a expref: 402 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.675506:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.675508:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb mtime from disk: 0 -> 1788201074 00002000:00010000:3.0:1788201681.675510:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb ctime from disk: 0 -> 1788201074 00002000:00010000:3.0:1788201681.675511:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.675519:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013f675a3/0x9383f985bc4a657e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b893e expref: 401 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.675533:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.675535:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb mtime from disk: 0 -> 1788201074 00002000:00010000:3.0:1788201681.675537:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb ctime from disk: 0 -> 1788201074 00002000:00010000:3.0:1788201681.675539:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.675545:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009678ed35/0x9383f985bc4a652a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8922 expref: 400 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.675561:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.675563:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb mtime from disk: 0 -> 1788201074 00002000:00010000:3.0:1788201681.675565:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb ctime from disk: 0 -> 1788201074 00002000:00010000:3.0:1788201681.675567:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.675575:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf612777/0x9383f985bc4a64d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8906 expref: 399 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.675592:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.675595:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc:0x0] updating lvb mtime from disk: 0 -> 1788201074 00002000:00010000:3.0:1788201681.675597:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc:0x0] updating lvb ctime from disk: 0 -> 1788201074 00002000:00010000:3.0:1788201681.675599:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.675606:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015dae8ba/0x9383f985bc4a6482 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b88ea expref: 398 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.675622:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.675625:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb mtime from disk: 0 -> 1788201073 00002000:00010000:3.0:1788201681.675626:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb ctime from disk: 0 -> 1788201073 00002000:00010000:3.0:1788201681.675628:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.675635:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9a6ebe/0x9383f985bc4a642e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b88ce expref: 397 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.675649:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.675651:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb mtime from disk: 0 -> 1788201073 00002000:00010000:3.0:1788201681.675653:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb ctime from disk: 0 -> 1788201073 00002000:00010000:3.0:1788201681.675655:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.675662:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd820dc9/0x9383f985bc4a63da lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b88b2 expref: 396 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.675677:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x9:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.675680:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x9:0x0] updating lvb mtime from disk: 0 -> 1788201073 00002000:00010000:3.0:1788201681.675682:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x9:0x0] updating lvb ctime from disk: 0 -> 1788201073 00002000:00010000:3.0:1788201681.675684:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x9:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.675691:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088543164/0x9383f985bc4a6386 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8896 expref: 395 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.675708:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.675710:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb mtime from disk: 0 -> 1788201073 00002000:00010000:3.0:1788201681.675712:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb ctime from disk: 0 -> 1788201073 00002000:00010000:3.0:1788201681.675714:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.675721:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed2d149c/0x9383f985bc4a6332 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b887a expref: 394 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.675735:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:3.0:1788201681.675738:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 0 -> 1788201073 00002000:00010000:3.0:1788201681.675740:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 0 -> 1788201073 00002000:00010000:3.0:1788201681.675742:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.675748:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008479ecce/0x9383f985bc4a62de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b885e expref: 393 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.675762:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 6 00002000:00010000:3.0:1788201681.675764:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788201073 00002000:00010000:3.0:1788201681.675765:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 0 -> 1788201073 00002000:00010000:3.0:1788201681.675767:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.675784:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003cb6a8fb/0x9383f985bc4a628a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8842 expref: 392 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.675802:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 6 00002000:00010000:3.0:1788201681.675805:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788201073 00002000:00010000:3.0:1788201681.675807:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788201073 00002000:00010000:3.0:1788201681.675809:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.675817:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000925a77cf/0x9383f985bc4a6236 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b8826 expref: 391 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.675832:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 6 00002000:00010000:3.0:1788201681.675835:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788201073 00002000:00010000:3.0:1788201681.675836:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788201073 00002000:00010000:3.0:1788201681.675838:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.675845:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb0750ca/0x9383f985bc4a61e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b880a expref: 390 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201681.675860:0:13526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 6 00002000:00010000:3.0:1788201681.675863:0:13526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788201073 00002000:00010000:3.0:1788201681.675865:0:13526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788201073 00002000:00010000:3.0:1788201681.675867:0:13526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788201681.675874:0:13526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004117b6fa/0x9383f985bc4a618e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1b87ee expref: 389 pid: 10484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201681.675885:0:13526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201681.675972:0:13526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04d8091450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:35604eb4-baf9-45be-a20a-4883a2cd8cf9+388:2361:x1875064442795264:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 9979us (13961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201681.675982:0:13526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:1.0:1788201681.809632:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201681.809692:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201681.809736:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201681.809859:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442795648 00000100:00100000:0.0:1788201681.809867:0:24542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442795520 00000100:00100000:3.0:1788201681.809874:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442795648 00000100:00100000:0.0:1788201681.809888:0:24542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442795520 00000100:00100000:3.0:1788201681.809984:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 398 00000100:00100000:3.0:1788201681.810001:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2360:x1875064442795648:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788201681.810013:0:24542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:0.0:1788201681.810042:0:24542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442795520:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201681.810125:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2360:x1875064442795648:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 127us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201681.810135:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 398 00000100:00100000:0.0:1788201681.810146:0:24542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:2360:x1875064442795520:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 119us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201681.810155:0:24542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00080000:1.0:1788201681.810249:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201681.810256:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201681.813182:0:24526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442795392 00000100:00100000:2.0:1788201681.813198:0:24526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442795392 00000100:00100000:2.0:1788201681.813278:0:24526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:2.0:1788201681.813287:0:24526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442795392:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788201681.813491:0:24526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ad49433-54fa-4e21-b756-859420d95603+10:2360:x1875064442795392:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 204us (3872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201681.813499:0:24526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 69 00010000:00010000:2.0:1788201681.893788:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201682.920101:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201683.331286:0:25371:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130b: DoM file create (inherited) replay ========================================================== 14:41:21 (1788201681) 00000100:00100000:3.0:1788201683.474687:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201683.474805:0:24544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442795776 00000100:00100000:2.0:1788201683.474819:0:24544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442795776 00000100:00100000:2.0:1788201683.474914:0:24544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:2.0:1788201683.474928:0:24544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:31667:x1875064442795776:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1788201683.474957:0:24544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201683.474985:0:24544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d68b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5977 expref: -99 pid: 24544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201683.475066:0:24544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d68b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201683.475083:0:24544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d68b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201683.475095:0:24544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d68b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201683.475115:0:24544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d68c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201683.475122:0:24544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d68c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201683.475129:0:24544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d68c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201683.475498:0:24544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d68b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201683.475508:0:24544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d68b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201683.475515:0:24544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d68b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201683.475522:0:24544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bd600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201683.475527:0:24544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d68b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201683.475537:0:24544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d68b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201683.475554:0:24544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c34bb400) 00010000:00010000:2.0:1788201683.475558:0:24544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201683.475563:0:24544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d68b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201683.475569:0:24544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd600/0x9383f985bc4d68b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201683.475585:0:24544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d68c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201683.475591:0:24544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d68c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201683.475597:0:24544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d68c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201683.475603:0:24544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201683.475606:0:24544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d68c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201683.475612:0:24544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d68c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201683.475620:0:24544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9e03c34bbc00) 00010000:00010000:2.0:1788201683.475622:0:24544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201683.475626:0:24544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d68c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201683.475632:0:24544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d68c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201683.475680:0:24544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d68b2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5977 expref: 8 pid: 24544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201683.475693:0:24544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c34bb400) 00010000:00010000:2.0:1788201683.475695:0:24544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201683.475699:0:24544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d68b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5977 expref: 8 pid: 24544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201683.475709:0:24544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bdc00, rc 0) 00000100:00100000:2.0:1788201683.475818:0:24544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:31667:x1875064442795776:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 893us (1152us total) trans 0 rc 301/301 00000100:00100000:2.0:1788201683.475828:0:24544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00080000:1.0:1788201683.476318:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201683.485450:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201683.485583:0:24543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442796032 00000100:00100000:3.0:1788201683.485598:0:24543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442796032 00000100:00100000:3.0:1788201683.485686:0:24543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:3.0:1788201683.485700:0:24543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0501b34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:31667:x1875064442796032:12345-192.168.201.30@tcp:36:lfs.0 00010000:00010000:3.0:1788201683.485792:0:24543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201683.485841:0:24543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bce00/0x9383f985bc4d686c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5969 expref: 7 pid: 24542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201683.485867:0:24543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c34bb400) 00010000:00010000:3.0:1788201683.485888:0:24543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201683.486589:0:24543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d68c7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201683.486610:0:24543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d68c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201683.486624:0:24543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d68c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201683.486639:0:24543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d68ce lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201683.486646:0:24543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d68ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201683.486654:0:24543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d68ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201683.495594:0:24543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x42c:0x0]: returning size 512 00010000:00010000:3.0:1788201683.495626:0:24543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d68c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201683.495640:0:24543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d68c7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201683.495648:0:24543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d68c7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201683.495655:0:24543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201683.495661:0:24543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d68c7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201683.495670:0:24543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d68c7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201683.495706:0:24543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e04d9f56400) 00010000:00010000:3.0:1788201683.495710:0:24543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201683.495717:0:24543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d68c7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201683.495724:0:24543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d68c7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201683.495759:0:24543:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cac73f38 reply state 000000006f386927 transno 30064771073 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d68ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201683.495777:0:24543:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201683.495944:0:24543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0501b34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:31667:x1875064442796032:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 10241us (10506us total) trans 30064771073 rc 0/0 00000100:00100000:3.0:1788201683.495954:0:24543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00010000:00010000:0.0:1788201683.506041:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d68ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201683.506065:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d68ce lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201683.506074:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d68ce lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201683.506081:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201683.506087:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d68ce lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201683.506097:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d68ce lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201683.506121:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9e04d9f56800) 00010000:00010000:0.0:1788201683.506125:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201683.506132:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d68ce lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201683.506139:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d68ce lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201683.523910:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201683.524097:0:24542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442796160 00000100:00100000:3.0:1788201683.524112:0:24542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442796160 00000100:00100000:3.0:1788201683.524198:0:24542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:3.0:1788201683.524223:0:24542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f4e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:31668:x1875064442796160:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788201683.524259:0:24542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201683.524322:0:24542:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d68d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c597e expref: -99 pid: 24542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201683.524413:0:24542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97200/0x9383f985bc4d68dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201683.524431:0:24542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97200/0x9383f985bc4d68dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201683.524445:0:24542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97200/0x9383f985bc4d68dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201683.524532:0:24542:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788201683.524538:0:24542:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201683.524568:0:24542:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97200/0x9383f985bc4d68dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201683.524599:0:24542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d68d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c597e expref: 9 pid: 24542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201683.524626:0:24542:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97200/0x9383f985bc4d68dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c597e expref: 8 pid: 24542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201683.524636:0:24542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e04d9f56400) 00010000:00010000:3.0:1788201683.524640:0:24542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201683.524644:0:24542:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c1b97200, rc 0) 00000100:00100000:3.0:1788201683.525466:0:24542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f4e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:31668:x1875064442796160:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1252us (1567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201683.525479:0:24542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:3.0:1788201683.534767:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201683.534838:0:24543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442796288 00000100:00100000:0.0:1788201683.534852:0:24543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442796288 00000100:00100000:0.0:1788201683.534928:0:24543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:0.0:1788201683.534940:0:24543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:31668:x1875064442796288:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1788201683.534967:0:24543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201683.534993:0:24543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e7a00/0x9383f985bc4d68e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5985 expref: -99 pid: 24543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201683.535082:0:24543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6600/0x9383f985bc4d68ea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201683.535098:0:24543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6600/0x9383f985bc4d68ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201683.535112:0:24543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6600/0x9383f985bc4d68ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201683.535128:0:24543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6800/0x9383f985bc4d68f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201683.535134:0:24543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6800/0x9383f985bc4d68f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201683.535141:0:24543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6800/0x9383f985bc4d68f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201683.535281:0:24543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e7200/0x9383f985bc4d68f8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x42c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201683.535290:0:24543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e7200/0x9383f985bc4d68f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x42c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201683.535332:0:24543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e7200/0x9383f985bc4d68f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x42c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201683.535383:0:24543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x42c:0x0]: returning size 512 00000004:00200000:0.0:1788201683.535388:0:24543:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201683.535415:0:24543:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e7200/0x9383f985bc4d68f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x42c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201683.535433:0:24543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6600/0x9383f985bc4d68ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201683.535440:0:24543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6600/0x9383f985bc4d68ea lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201683.535448:0:24543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6600/0x9383f985bc4d68ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201683.535455:0:24543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c36e6600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201683.535461:0:24543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6600/0x9383f985bc4d68ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201683.535469:0:24543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6600/0x9383f985bc4d68ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201683.535484:0:24543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e04d9f56400) 00010000:00010000:0.0:1788201683.535487:0:24543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201683.535492:0:24543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6600/0x9383f985bc4d68ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201683.535499:0:24543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6600/0x9383f985bc4d68ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201683.535514:0:24543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6800/0x9383f985bc4d68f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201683.535520:0:24543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6800/0x9383f985bc4d68f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201683.535525:0:24543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6800/0x9383f985bc4d68f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201683.535531:0:24543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c36e6800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201683.535533:0:24543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6800/0x9383f985bc4d68f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201683.535539:0:24543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6800/0x9383f985bc4d68f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201683.535546:0:24543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9e03c1339700) 00010000:00010000:0.0:1788201683.535549:0:24543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201683.535552:0:24543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6800/0x9383f985bc4d68f1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201683.535557:0:24543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6800/0x9383f985bc4d68f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201683.535593:0:24543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e7a00/0x9383f985bc4d68e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5985 expref: 10 pid: 24543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201683.535608:0:24543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e7200/0x9383f985bc4d68f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x42c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5985 expref: 9 pid: 24543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201683.535616:0:24543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x42c:0x0].0x0 (ffff9e03c1339200) 00010000:00010000:0.0:1788201683.535618:0:24543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201683.535621:0:24543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c36e7200, rc 0) 00000100:00100000:0.0:1788201683.535714:0:24543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:31668:x1875064442796288:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 776us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201683.535723:0:24543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:0.0:1788201683.558250:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201683.578700:0:24544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442796544 00000100:00100000:3.0:1788201683.578721:0:24544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442796544 00000100:00100000:3.0:1788201683.579330:0:24544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:3.0:1788201683.579344:0:24544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c49f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+9:31668:x1875064442796544:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788201683.579372:0:24544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201683.579398:0:24544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d68ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c598c expref: -99 pid: 24544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201683.579559:0:24544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x42c:0x0]: returning size 512 00010000:00010000:3.0:1788201683.579715:0:24544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d68ff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c598c expref: 11 pid: 24544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201683.579733:0:24544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e04d9f56400) 00010000:00010000:3.0:1788201683.579736:0:24544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201683.579755:0:24544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d68ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c598c expref: 11 pid: 24544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201683.579776:0:24544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c1b97800, rc 0) 00000100:00100000:3.0:1788201683.581081:0:24544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c49f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:31668:x1875064442796544:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1727us (22834us total) trans 30064771074 rc 301/301 00000100:00100000:3.0:1788201683.581167:0:24544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:2.0:1788201683.586431:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201683.586637:0:24543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442796800 00000100:00100000:3.0:1788201683.586651:0:24543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442796800 00000100:00100000:3.0:1788201683.586727:0:24543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:3.0:1788201683.586749:0:24543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:31668:x1875064442796800:12345-192.168.201.30@tcp:36:lfs.0 00010000:00010000:3.0:1788201683.586825:0:24543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201683.586858:0:24543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e7200/0x9383f985bc4d68f8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x42c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5985 expref: 10 pid: 24543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201683.586947:0:24543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x42c:0x0].0x0 (ffff9e03c1339200) 00010000:00010000:3.0:1788201683.586961:0:24543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201683.586993:0:24543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d690d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x42c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201683.587009:0:24543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d690d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x42c:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201683.587021:0:24543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d690d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x42c:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201683.588362:0:24543:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b3977a2 reply state 000000008039eef0 transno 30064771075 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d690d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x42c:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201683.588382:0:24543:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788201683.588407:0:24543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x42c:0x0]: returning size 512 00000100:00100000:3.0:1788201683.588542:0:24543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:31668:x1875064442796800:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 1801us (2117us total) trans 30064771075 rc 0/0 00000100:00100000:3.0:1788201683.588552:0:24543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 17 00010000:00010000:2.0:1788201683.600786:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d690d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x42c:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201683.600808:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d690d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x42c:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201683.600818:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d690d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x42c:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201683.600826:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b96c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201683.600832:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d690d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x42c:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201683.600842:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d690d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x42c:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201683.600863:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x42c:0x0].0x0 (ffff9e04d9f56a00) 00010000:00010000:2.0:1788201683.600867:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788201683.600873:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d690d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x42c:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201683.600884:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d690d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x42c:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201683.618786:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201683.618856:0:24545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442797056 00000100:00100000:2.0:1788201683.620350:0:24545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442797056 00000100:00100000:2.0:1788201683.620436:0:24545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:2.0:1788201683.620448:0:24545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c1a73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:31668:x1875064442797056:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:2.0:1788201683.622677:0:24545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c1a73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:31668:x1875064442797056:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 2217us (3892us total) trans 30064771076 rc 0/0 00000100:00100000:2.0:1788201683.622693:0:24545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2 00010000:00010000:0.0:1788201683.941419:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201684.587336:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201684.587417:0:24544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442797184 00000100:00100000:3.0:1788201684.587430:0:24544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442797184 00000100:00100000:3.0:1788201684.587509:0:24544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:3.0:1788201684.587521:0:24544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:31677:x1875064442797184:12345-192.168.201.30@tcp:41:lfs.0 00000004:00000024:3.0:1788201684.587589:0:24544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788201684.587696:0:24544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:31677:x1875064442797184:12345-192.168.201.30@tcp:41:lfs.0 Request processed in 178us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201684.587704:0:24544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:0.0:1788201684.611779:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201684.613701:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442797312 00000100:00100000:3.0:1788201684.613717:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442797312 00000100:00100000:3.0:1788201684.614032:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 276 00000100:00100000:3.0:1788201684.614053:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c49f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+388:31677:x1875064442797312:12345-192.168.201.30@tcp:13:lfs.0 00002000:00000024:3.0:1788201684.614116:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524353536 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1788201684.614212:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c49f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+388:31677:x1875064442797312:12345-192.168.201.30@tcp:13:lfs.0 Request processed in 170us (2452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201684.614221:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 276 00000100:00100000:3.0:1788201684.618102:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201684.618499:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442797440 00000100:00100000:2.0:1788201684.618511:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442797440 00000100:00080000:0.0:1788201684.619919:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201684.619930:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201684.621413:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 277 00000100:00100000:2.0:1788201684.621436:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f900a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:31677:x1875064442797440:12345-192.168.201.30@tcp:13:lfs.0 00002000:00000024:2.0:1788201684.621492:0:6708:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 39256064 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201684.622269:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f900a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:31677:x1875064442797440:12345-192.168.201.30@tcp:13:lfs.0 Request processed in 169us (3510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201684.622290:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 277 00000100:00100000:1.0:1788201684.732830:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201684.733229:0:24543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442797696 00000100:00100000:3.0:1788201684.733244:0:24543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442797696 00000100:00100000:3.0:1788201684.733336:0:24543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:3.0:1788201684.733348:0:24543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:31684:x1875064442797696:12345-192.168.201.30@tcp:36:mcreate.0 00010000:00010000:3.0:1788201684.733429:0:24543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201684.734948:0:24543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97200/0x9383f985bc4d68dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c597e expref: 11 pid: 24542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.734977:0:24543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e04d9f56400) 00010000:00010000:3.0:1788201684.734992:0:24543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201684.735794:0:24543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d6914 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.735815:0:24543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d6914 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.735828:0:24543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d6914 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.735842:0:24543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d691b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.735850:0:24543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d691b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.735856:0:24543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d691b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.739997:0:24543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d6914 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.740019:0:24543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d6914 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.740028:0:24543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d6914 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.740035:0:24543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b96c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201684.740041:0:24543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d6914 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.740797:0:24543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d6914 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.740822:0:24543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e04d9f56d00) 00010000:00010000:3.0:1788201684.740826:0:24543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201684.740832:0:24543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d6914 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.740840:0:24543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d6914 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201684.740867:0:24543:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c05f9e9 reply state 00000000d8db16b5 transno 30064771077 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d691b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201684.740879:0:24543:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201684.741041:0:24543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:31684:x1875064442797696:12345-192.168.201.30@tcp:36:mcreate.0 Request processed in 7690us (8221us total) trans 30064771077 rc 0/0 00000100:00100000:3.0:1788201684.742501:0:24543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 19 00010000:00010000:1.0:1788201684.750875:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d691b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201684.750898:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d691b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201684.750908:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d691b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201684.750915:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201684.750920:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d691b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201684.750929:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d691b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201684.750958:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf2391a86 (ffff9e04d9f56900) 00010000:00010000:1.0:1788201684.750962:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201684.750968:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d691b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201684.750974:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97800/0x9383f985bc4d691b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201684.771390:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201684.771789:0:24542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442797824 00000100:00100000:2.0:1788201684.771803:0:24542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442797824 00000100:00100000:2.0:1788201684.771925:0:24542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:2.0:1788201684.771936:0:24542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:31687:x1875064442797824:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1788201684.771969:0:24542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201684.771997:0:24542:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d6922 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c5993 expref: -99 pid: 24542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.772180:0:24542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d6929 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.772196:0:24542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d6929 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.772209:0:24542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d6929 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201684.772282:0:24542:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788201684.772285:0:24542:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201684.772357:0:24542:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d6929 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.772385:0:24542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d6922 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5993 expref: 13 pid: 24542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.772406:0:24542:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d6929 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5993 expref: 12 pid: 24542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.772416:0:24542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c34bbc00) 00010000:00010000:2.0:1788201684.772419:0:24542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201684.772423:0:24542:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bcc00, rc 0) 00000100:00100000:2.0:1788201684.772498:0:24542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:31687:x1875064442797824:12345-192.168.201.30@tcp:101:rm.0 Request processed in 564us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201684.772504:0:24542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:1.0:1788201684.782036:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201684.782196:0:24543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442797952 00000100:00100000:3.0:1788201684.782209:0:24543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442797952 00000100:00100000:3.0:1788201684.782290:0:24543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:3.0:1788201684.782328:0:24543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:31687:x1875064442797952:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1788201684.782355:0:24543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201684.782379:0:24543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d6930 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c599a expref: -99 pid: 24543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.782465:0:24543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97200/0x9383f985bc4d6937 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.782481:0:24543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97200/0x9383f985bc4d6937 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.782495:0:24543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97200/0x9383f985bc4d6937 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.782513:0:24543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d693e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.782521:0:24543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d693e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.782528:0:24543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d693e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.782665:0:24543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97400/0x9383f985bc4d6945 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x42d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.782673:0:24543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97400/0x9383f985bc4d6945 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x42d:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.782680:0:24543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97400/0x9383f985bc4d6945 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x42d:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201684.782731:0:24543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x42d:0x0]: returning size 0 00000004:00200000:3.0:1788201684.782736:0:24543:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788201684.782763:0:24543:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97400/0x9383f985bc4d6945 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x42d:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.782775:0:24543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97400/0x9383f985bc4d6945 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x42d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.782789:0:24543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97200/0x9383f985bc4d6937 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.782795:0:24543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97200/0x9383f985bc4d6937 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.782801:0:24543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97200/0x9383f985bc4d6937 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.782808:0:24543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201684.782813:0:24543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97200/0x9383f985bc4d6937 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.782822:0:24543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97200/0x9383f985bc4d6937 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.782835:0:24543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c34bbc00) 00010000:00010000:3.0:1788201684.782838:0:24543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201684.782843:0:24543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97200/0x9383f985bc4d6937 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.782850:0:24543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97200/0x9383f985bc4d6937 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.782865:0:24543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d693e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.782872:0:24543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d693e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.782877:0:24543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d693e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.782883:0:24543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1788201684.782886:0:24543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d693e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.782892:0:24543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d693e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.782899:0:24543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf2391a86 (ffff9e04d9f56d00) 00010000:00010000:3.0:1788201684.782901:0:24543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201684.782904:0:24543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d693e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.782911:0:24543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d693e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.782947:0:24543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b96c00/0x9383f985bc4d6930 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c599a expref: 14 pid: 24543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.782960:0:24543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97400/0x9383f985bc4d6945 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x42d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c599a expref: 13 pid: 24543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.782968:0:24543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x42d:0x0].0x0 (ffff9e04d9f56400) 00010000:00010000:3.0:1788201684.782971:0:24543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201684.782974:0:24543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c1b97400, rc 0) 00000100:00100000:3.0:1788201684.784587:0:24543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:31687:x1875064442797952:12345-192.168.201.30@tcp:101:rm.0 Request processed in 722us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201684.784613:0:24543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:1.0:1788201684.792566:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201684.792680:0:24542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442798208 00000100:00100000:2.0:1788201684.792694:0:24542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442798208 00000100:00100000:2.0:1788201684.792786:0:24542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:2.0:1788201684.792799:0:24542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:31687:x1875064442798208:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1788201684.792882:0:24542:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788201684.792923:0:24542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97400/0x9383f985bc4d6945 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x42d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c599a expref: 13 pid: 24543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.792949:0:24542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x42d:0x0].0x0 (ffff9e04d9f56400) 00010000:00010000:2.0:1788201684.792969:0:24542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d6929 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5993 expref: 12 pid: 24542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.792978:0:24542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c34bbc00) 00010000:00010000:2.0:1788201684.792992:0:24542:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201684.793025:0:24542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d694c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.793040:0:24542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d694c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.793061:0:24542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d694c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.793077:0:24542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d6953 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.793084:0:24542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d6953 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.793090:0:24542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d6953 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.793251:0:24542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d695a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x42d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.793259:0:24542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d695a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x42d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.793267:0:24542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d695a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x42d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.793964:0:24542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d6961 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x42d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.793975:0:24542:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d6961 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x42d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.793982:0:24542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d6961 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x42d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.793988:0:24542:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d6961 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x42d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.793992:0:24542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d6961 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x42d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.793996:0:24542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d6961 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x42d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.794013:0:24542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201684.794032:0:24542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d695a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x42d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.794035:0:24542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d695a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x42d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.794040:0:24542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d695a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x42d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.794045:0:24542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201684.794049:0:24542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d695a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x42d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.794054:0:24542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d695a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x42d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.794061:0:24542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x42d:0x0].0x0 (ffff9e03c34bbb00) 00010000:00010000:2.0:1788201684.794064:0:24542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201684.794069:0:24542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d695a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x42d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.794075:0:24542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d695a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x42d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.794095:0:24542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d694c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.794102:0:24542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d694c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.794108:0:24542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d694c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.794113:0:24542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201684.794117:0:24542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d694c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.794127:0:24542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d694c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.794135:0:24542:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c34bbf00) 00010000:00010000:2.0:1788201684.794137:0:24542:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201684.794140:0:24542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d694c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.794145:0:24542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc400/0x9383f985bc4d694c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201684.794159:0:24542:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a6eb667 reply state 00000000ba39909d transno 30064771078 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d6953 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201684.794167:0:24542:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201684.794266:0:24542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+13:31687:x1875064442798208:12345-192.168.201.30@tcp:36:rm.0 Request processed in 1468us (1713us total) trans 30064771078 rc 0/0 00000100:00100000:2.0:1788201684.794276:0:24542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 22 00010000:00010000:1.0:1788201684.794767:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201684.794776:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d6961 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x42d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201684.794783:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bd800 already unused, calling callback (ffffffffc13fbfe0) 00010000:00010000:1.0:1788201684.794786:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d6961 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x42d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201684.794792:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d6961 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x42d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201684.794802:0:7645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x42d:0x0].0x0 (ffff9e03c34bbb00) 00010000:00010000:1.0:1788201684.794805:0:7645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201684.794808:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d6961 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x42d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201684.794813:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bd800/0x9383f985bc4d6961 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x42d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201684.794832:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201684.794834:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201684.794836:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201684.797746:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d6953 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.797768:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d6953 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.797777:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d6953 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.797783:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201684.797788:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d6953 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.797802:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d6953 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.797822:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf2391a86 (ffff9e03c34bb600) 00010000:00010000:2.0:1788201684.797825:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201684.797834:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d6953 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.797841:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc000/0x9383f985bc4d6953 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf2391a86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24542 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201684.973165:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201685.226083:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c5485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458349952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201685.226203:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201685.226312:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788201685.226321:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458349824:0@lo:400:kworker.0 00000100:00100000:1.0:1788201685.226354:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201685.226381:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f9009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458349696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201685.226402:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201685.226520:0:24559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458349824 00000100:00100000:3.0:1788201685.226530:0:24559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458349824 00000100:00100000:3.0:1788201685.226588:0:24559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788201685.226598:0:24559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3313:x1875064458349824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201685.226660:0:24559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3313:x1875064458349824:12345-0@lo:400:kworker.0 Request processed in 63us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201685.226667:0:24559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788201685.226752:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c6bbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875064458350080:0@lo:400:kworker.0 00000100:00100000:1.0:1788201685.226786:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201685.226810:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201685.226815:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f4f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875064458350208:0@lo:400:kworker.0 00000100:00100000:1.0:1788201685.226837:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201685.227030:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458349952 00000100:00100000:2.0:1788201685.227035:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458349952 00000100:00100000:2.0:1788201685.227086:0:16084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458349696 00000100:00080000:1.0:1788201685.227089:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201685.227089:0:16084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458349696 00000100:00100000:2.0:1788201685.227110:0:16084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00080000:1.0:1788201685.227112:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201685.227118:0:16084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458349952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201685.227140:0:16084:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 10223616 granted 524353536 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1788201685.227153:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788201685.227162:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458349696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201685.227174:0:6707:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 39256064 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788201685.227179:0:16084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458349952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201685.227185:0:16084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788201685.227200:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875064458349696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201685.227205:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788201685.227216:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c56f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458350336:0@lo:400:kworker.0 00000100:00100000:2.0:1788201685.227247:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201685.227280:0:24544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458350080 00000100:00100000:3.0:1788201685.227285:0:24544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458350080 00000100:00100000:3.0:1788201685.227361:0:24544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458350208 00000100:00100000:3.0:1788201685.227365:0:24544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458350208 00000100:00100000:3.0:1788201685.227379:0:24544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458350336 00000100:00100000:3.0:1788201685.227381:0:24544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458350336 00000100:00100000:3.0:1788201685.227394:0:24544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788201685.227401:0:24544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875064458350080:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788201685.227451:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201685.228795:0:24543:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788201685.228811:0:24543:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788201685.228830:0:24544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875064458350080:12345-0@lo:400:kworker.0 Request processed in 1426us (2039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201685.228840:0:24544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788201685.228865:0:24544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788201685.228875:0:24544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875064458350208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201685.228926:0:24544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875064458350208:12345-0@lo:400:kworker.0 Request processed in 54us (2087us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201685.228935:0:24544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788201685.228947:0:24544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788201685.228954:0:24544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458350336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201685.228991:0:24544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875064458350336:12345-0@lo:400:kworker.0 Request processed in 38us (1742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201685.228997:0:24544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788201685.229100:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c6bbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875064458350080:0@lo:400:kworker.0 00000100:00100000:1.0:1788201685.229125:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f4f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875064458350208:0@lo:400:kworker.0 00000100:00100000:2.0:1788201685.230004:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c56f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875064458350336:0@lo:400:kworker.0 00000100:00100000:2.0:1788201685.230393:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458349824:0@lo:400:kworker.0 00000100:00100000:2.0:1788201685.230424:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f9009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458349696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201685.230440:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c5485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875064458349952:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788201685.989727:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788201686.626192:0:25521:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=4008668d len=0 uarg=00007ffe2cc4d100 00000004:00000080:2.0:1788201686.626209:0:25521:0:(mdt_handler.c:8183:mdt_iocontrol()) lustre-MDT0000: cmd=4008668d len=576 karg=ffff9e03c51b4800 uarg=0000000000000000 00000001:00080000:1.0:1788201686.741650:0:24555:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771078 is committed 00080000:00020000:0.0:1788201686.757954:0:25521:0:(osd_handler.c:720:osd_ro()) lustre-MDT0000: *** setting device osd-zfs read-only *** 00000100:00100000:3.0:1788201686.931275:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201686.931320:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201686.931344:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201686.931362:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201686.931394:0:24544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442798464 00000100:00100000:3.0:1788201686.931405:0:24544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442798464 00000100:00100000:3.0:1788201686.931489:0:24544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:3.0:1788201686.931502:0:24544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2361:x1875064442798464:12345-192.168.201.30@tcp:400:kworker.0 00010000:00000080:3.0:1788201686.931548:0:24544:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e04f9008a80 x1875064442798464/t0(0) o400->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:52/0 lens 224/224 e 0 to 0 dl 1788201697 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201686.931629:0:24544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:2361:x1875064442798464:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 130us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201686.931638:0:24544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:3.0:1788201686.931669:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442798720 00000100:00100000:3.0:1788201686.931673:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442798720 00000100:00100000:3.0:1788201686.931712:0:13440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442798592 00000100:00100000:3.0:1788201686.931715:0:13440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442798592 00000100:00100000:3.0:1788201686.931742:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 399 00000100:00100000:3.0:1788201686.931749:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f900b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2361:x1875064442798720:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201686.931781:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f900b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35604eb4-baf9-45be-a20a-4883a2cd8cf9+5:2361:x1875064442798720:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 33us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201686.931788:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 399 00000100:00100000:3.0:1788201686.931800:0:13440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 400 00000100:00100000:3.0:1788201686.931806:0:13440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f900bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35604eb4-baf9-45be-a20a-4883a2cd8cf9+388:2362:x1875064442798592:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788201686.931831:0:13440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f900bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35604eb4-baf9-45be-a20a-4883a2cd8cf9+388:2362:x1875064442798592:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201686.931837:0:13440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 400 00000100:00080000:3.0:1788201686.931860:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201686.931864:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201686.931867:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201686.935396:0:24528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442798336 00000100:00100000:1.0:1788201686.935415:0:24528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442798336 00000100:00100000:1.0:1788201686.935487:0:24528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 71 00000100:00100000:1.0:1788201686.935498:0:24528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c2f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442798336:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788201686.935604:0:24528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c2f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ad49433-54fa-4e21-b756-859420d95603+10:2362:x1875064442798336:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 107us (4256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201686.935614:0:24528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 71 00010000:00010000:1.0:1788201687.014440:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201687.686765:0:25571:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:3.0:1788201687.746925:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788201687.747067:0:24543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442798848 00000100:00100000:0.0:1788201687.747080:0:24543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442798848 00000100:00100000:0.0:1788201687.747157:0:24543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:0.0:1788201687.747170:0:24543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+6:31719:x1875064442798848:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:0.0:1788201687.747199:0:24543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201687.747231:0:24543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6c00/0x9383f985bc4d6968 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c59a1 expref: -99 pid: 24543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201687.747367:0:24543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6200/0x9383f985bc4d696f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201687.747382:0:24543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6200/0x9383f985bc4d696f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201687.747396:0:24543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6200/0x9383f985bc4d696f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201687.747925:0:24543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1788201687.747932:0:24543:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1788201687.748105:0:24543:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6200/0x9383f985bc4d696f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201687.748139:0:24543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6c00/0x9383f985bc4d6968 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c59a1 expref: 8 pid: 24543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201687.748162:0:24543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6200/0x9383f985bc4d696f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c59a1 expref: 7 pid: 24543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201687.748171:0:24543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c1339700) 00010000:00010000:0.0:1788201687.748175:0:24543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201687.748179:0:24543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c36e6200, rc 0) 00010000:00000080:0.0:1788201687.748188:0:24543:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e04f9008380 x1875064442798848/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:53/0 lens 576/688 e 0 to 0 dl 1788201698 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201687.748273:0:24543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:31719:x1875064442798848:12345-192.168.201.30@tcp:101:touch.0 Request processed in 1105us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201687.748278:0:24543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:1.0:1788201687.755577:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788201687.755716:0:24544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442798976 00000100:00100000:2.0:1788201687.755730:0:24544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442798976 00000100:00100000:2.0:1788201687.755806:0:24544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:2.0:1788201687.755818:0:24544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c5484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+7:31719:x1875064442798976:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:2.0:1788201687.755844:0:24544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201687.755868:0:24544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d6976 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c59a8 expref: -99 pid: 24544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201687.755940:0:24544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d697d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201687.755957:0:24544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d697d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201687.755970:0:24544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d697d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201687.755987:0:24544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d6984 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201687.755992:0:24544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d6984 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201687.755997:0:24544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d6984 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201687.756422:0:24544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d698b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x42c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201687.756430:0:24544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d698b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x42c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201687.756435:0:24544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d698b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x42c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201687.756498:0:24544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x42c:0x0]: returning size 7680 00000004:00200000:2.0:1788201687.756501:0:24544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788201687.757096:0:24544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d698b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x42c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201687.757110:0:24544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d697d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201687.757115:0:24544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d697d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201687.757120:0:24544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d697d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201687.757125:0:24544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bcc00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201687.757128:0:24544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d697d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201687.757133:0:24544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d697d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201687.757145:0:24544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e03c1339700) 00010000:00010000:2.0:1788201687.757148:0:24544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201687.757152:0:24544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d697d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201687.757156:0:24544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bcc00/0x9383f985bc4d697d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201687.757165:0:24544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d6984 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201687.757168:0:24544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d6984 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201687.757172:0:24544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d6984 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201687.757175:0:24544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c32bc600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1788201687.757177:0:24544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d6984 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201687.757180:0:24544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d6984 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201687.757184:0:24544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9e03c34bbc00) 00010000:00010000:2.0:1788201687.757185:0:24544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201687.757187:0:24544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d6984 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201687.757190:0:24544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc600/0x9383f985bc4d6984 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201687.757226:0:24544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bc200/0x9383f985bc4d6976 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c59a8 expref: 9 pid: 24544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201687.757240:0:24544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d698b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x42c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c59a8 expref: 8 pid: 24544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201687.757245:0:24544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x42c:0x0].0x0 (ffff9e03c34bb400) 00010000:00010000:2.0:1788201687.757247:0:24544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788201687.757249:0:24544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c32bdc00, rc 0) 00010000:00000080:2.0:1788201687.757257:0:24544:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e03c5484380 x1875064442798976/t0(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:53/0 lens 592/584 e 0 to 0 dl 1788201698 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201687.757355:0:24544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c5484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:31719:x1875064442798976:12345-192.168.201.30@tcp:101:touch.0 Request processed in 1540us (1787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201687.757362:0:24544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:2.0:1788201687.762911:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201687.763027:0:25446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442799232 00000100:00100000:1.0:1788201687.763040:0:25446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442799232 00000100:00100000:1.0:1788201687.763090:0:25446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:1.0:1788201687.763098:0:25446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+8:31719:x1875064442799232:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:1.0:1788201687.763123:0:25446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201687.763144:0:25446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1800/0x9383f985bc4d6992 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x42c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4605c7c97e1c59af expref: -99 pid: 25446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201687.763496:0:25446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1400/0x9383f985bc4d6999 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x42c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201687.763512:0:25446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1400/0x9383f985bc4d6999 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x42c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201687.763522:0:25446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1400/0x9383f985bc4d6999 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x42c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201687.763534:0:25446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1a00/0x9383f985bc4d69a0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x42c:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201687.763653:0:25446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1a00/0x9383f985bc4d69a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x42c:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201687.763661:0:25446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1a00/0x9383f985bc4d69a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x42c:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201687.766923:0:25446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6c00/0x9383f985bc4d69a7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x42e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201687.766952:0:25446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6c00/0x9383f985bc4d69a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x42e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201687.766966:0:25446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6c00/0x9383f985bc4d69a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x42e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201687.767147:0:25446:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000bd1:0x42e:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1788201687.767150:0:25446:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000bd1:0x42e:0x0] updating lvb mtime from disk: 0 -> 1788201687 00000004:00010000:0.0:1788201687.767152:0:25446:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000bd1:0x42e:0x0] updating lvb atime from disk: 0 -> 1788201687 00000004:00010000:0.0:1788201687.767154:0:25446:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000bd1:0x42e:0x0] updating lvb ctime from disk: 0 -> 1788201687 00000004:00010000:0.0:1788201687.767155:0:25446:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000bd1:0x42e:0x0] updating lvb blocks from disk: 18427282363563114435 -> 2 00002000:00010000:0.0:1788201687.767158:0:25446:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:0.0:1788201687.767165:0:25446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1400/0x9383f985bc4d6999 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x42c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201687.767171:0:25446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1400/0x9383f985bc4d6999 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x42c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201687.767176:0:25446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1400/0x9383f985bc4d6999 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x42c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201687.767180:0:25446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef1400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201687.767184:0:25446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1400/0x9383f985bc4d6999 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x42c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201687.767189:0:25446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1400/0x9383f985bc4d6999 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x42c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201687.767201:0:25446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x42c:0x0].0x0 (ffff9e03c34bb400) 00010000:00010000:0.0:1788201687.767204:0:25446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201687.767207:0:25446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1400/0x9383f985bc4d6999 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x42c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201687.767212:0:25446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1400/0x9383f985bc4d6999 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x42c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201687.767221:0:25446:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000063ac2e71 reply state 00000000a258d0ad transno 30064771079 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1a00/0x9383f985bc4d69a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x42c:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25446 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201687.767227:0:25446:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201687.767264:0:25446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1800/0x9383f985bc4d6992 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x42c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c59af expref: 11 pid: 25446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201687.767275:0:25446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6c00/0x9383f985bc4d69a7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x42e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c59af expref: 10 pid: 25446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201687.767284:0:25446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x42e:0x0].0x0 (ffff9e03c1339300) 00010000:00010000:0.0:1788201687.767286:0:25446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:0.0:1788201687.767287:0:25446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03c36e6c00, rc 0) 00010000:00000080:0.0:1788201687.767312:0:25446:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e04c56f6300 x1875064442799232/t30064771079(0) o101->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:53/0 lens 752/824 e 0 to 0 dl 1788201698 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201687.767410:0:25446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:31719:x1875064442799232:12345-192.168.201.30@tcp:101:touch.0 Request processed in 4311us (4512us total) trans 30064771079 rc 0/0 00000100:00100000:0.0:1788201687.767419:0:25446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 25 00010000:00010000:1.0:1788201687.771023:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1a00/0x9383f985bc4d69a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x42c:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201687.771043:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1a00/0x9383f985bc4d69a0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x42c:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201687.771052:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1a00/0x9383f985bc4d69a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x42c:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201687.771059:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef1a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1788201687.771064:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1a00/0x9383f985bc4d69a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x42c:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201687.771079:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1a00/0x9383f985bc4d69a0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x42c:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201687.771100:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x42c:0x0].0xfa0fa5c1 (ffff9e03c316f500) 00010000:00010000:1.0:1788201687.771103:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201687.771107:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1a00/0x9383f985bc4d69a0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x42c:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201687.771112:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c2ef1a00/0x9383f985bc4d69a0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x42c:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25446 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201687.771907:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201687.772359:0:24544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442799488 00000100:00100000:3.0:1788201687.772370:0:24544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442799488 00000100:00100000:3.0:1788201687.772423:0:24544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 26 00000100:00100000:3.0:1788201687.772432:0:24544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+10:31719:x1875064442799488:12345-192.168.201.30@tcp:36:touch.0 00010000:00010000:3.0:1788201687.772539:0:24544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d69b5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x42e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201687.772565:0:24544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6c00/0x9383f985bc4d69a7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x42e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c59af expref: 10 pid: 25446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201687.772575:0:24544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d69b5 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x42e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201687.772618:0:24544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6c00/0x9383f985bc4d69a7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x42e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c59af expref: 10 pid: 25446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201687.772641:0:24544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6c00/0x9383f985bc4d69a7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x42e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c59af expref: 10 pid: 25446 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201687.772659:0:24544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f900ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:24544:1875064458350464:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788201687.772930:0:24544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e04c83fc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201687.778385:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788201687.778910:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442799616 00000100:00100000:1.0:1788201687.778923:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442799616 00010000:00010000:1.0:1788201687.778975:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6c00/0x9383f985bc4d69a7 lrc: 5/0,0 mode: PW/PW res: [0x200000bd1:0x42e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c59af expref: 11 pid: 25446 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201687.779029:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1606 00000100:00100000:1.0:1788201687.779041:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:2359:x1875064442799616:12345-192.168.201.30@tcp:102:ldlm_bl.0 00010000:00010000:1.0:1788201687.779063:0:5842:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6c00/0x9383f985bc4d69a7 lrc: 5/0,0 mode: PW/PW res: [0x200000bd1:0x42e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c59af expref: 11 pid: 25446 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201687.779077:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6c00/0x9383f985bc4d69a7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x42e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c59af expref: 11 pid: 25446 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201687.779090:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6c00/0x9383f985bc4d69a7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x42e:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c59af expref: 11 pid: 25446 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201687.779099:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x42e:0x0].0x0 (ffff9e03c1339300) 00010000:00010000:1.0:1788201687.779104:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:1.0:1788201687.779108:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d69b5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x42e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201687.779121:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d69b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x42e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201687.779128:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d69b5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x42e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201687.779156:0:5842:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6c00/0x9383f985bc4d69a7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x42e:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c59af expref: 11 pid: 25446 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201687.779222:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:2359:x1875064442799616:12345-192.168.201.30@tcp:102:ldlm_bl.0 Request processed in 184us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201687.779230:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1606 00000100:00100000:3.0:1788201687.789235:0:24544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f900ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:24544:1875064458350464:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788201687.789280:0:24544:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d69b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x42e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201687.789311:0:24544:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d69b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x42e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201687.789318:0:24544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d69b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x42e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201687.789517:0:24544:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000bd1:0x42e:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:3.0:1788201687.789522:0:24544:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000bd1:0x42e:0x0] updating lvb mtime from disk: 1788201687 -> 1788201687 00000004:00010000:3.0:1788201687.789525:0:24544:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000bd1:0x42e:0x0] updating lvb atime from disk: 1788201687 -> 1788201687 00000004:00010000:3.0:1788201687.789527:0:24544:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000bd1:0x42e:0x0] updating lvb ctime from disk: 1788201687 -> 1788201687 00000004:00010000:3.0:1788201687.789530:0:24544:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000bd1:0x42e:0x0] updating lvb blocks from disk: 2 -> 2 00000004:00010000:3.0:1788201687.789538:0:24544:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dbeb464e reply state 000000009374c4b7 transno 30064771080 ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d69b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x42e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201687.789558:0:24544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:3.0:1788201687.789625:0:24544:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e04c56f6a00 x1875064442799488/t30064771080(0) o36->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:53/0 lens 488/456 e 0 to 0 dl 1788201698 ref 1 fl Interpret:/200/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201687.789743:0:24544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:31719:x1875064442799488:12345-192.168.201.30@tcp:36:touch.0 Request processed in 17310us (17843us total) trans 30064771080 rc 0/0 00000100:00100000:3.0:1788201687.789753:0:24544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 26 00010000:00010000:0.0:1788201687.793942:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d69b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x42e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201687.793968:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d69b5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x42e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201687.793978:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d69b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x42e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201687.793985:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c1b97600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1788201687.793990:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d69b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x42e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201687.794000:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d69b5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x42e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201687.794140:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x42e:0x0].0x0 (ffff9e03c1339300) 00010000:00010000:0.0:1788201687.794145:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201687.794150:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d69b5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x42e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201687.794163:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c1b97600/0x9383f985bc4d69b5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x42e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201687.795917:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788201687.795963:0:24545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064442799872 00000100:00100000:3.0:1788201687.795975:0:24545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064442799872 00000100:00100000:3.0:1788201687.796599:0:24545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:3.0:1788201687.796616:0:24545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f900ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+11:31719:x1875064442799872:12345-192.168.201.30@tcp:35:touch.0 00010000:00000080:3.0:1788201687.797192:0:24545:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e04f900ad80 x1875064442799872/t30064771081(0) o35->35604eb4-baf9-45be-a20a-4883a2cd8cf9@192.168.201.30@tcp:53/0 lens 392/456 e 0 to 0 dl 1788201698 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201687.797276:0:24545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f900ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35604eb4-baf9-45be-a20a-4883a2cd8cf9+12:31719:x1875064442799872:12345-192.168.201.30@tcp:35:touch.0 Request processed in 666us (1371us total) trans 30064771081 rc 0/0 00000100:00100000:3.0:1788201687.797286:0:24545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3 00010000:00010000:2.0:1788201688.040739:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201689.062385:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788201689.473198:0:25668:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788201689.473646:0:25668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d65cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d65d3 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201689.473661:0:25668:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d65cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d65d3 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201689.473669:0:25668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d65cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d65d3 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201689.473676:0:25668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d65cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d65d3 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201689.473701:0:25668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788201689.473707:0:25668:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788201689.473730:0:25668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201689.473734:0:25668:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788201689.473740:0:25668:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788201689.473763:0:25668:0:(import.c:65:import_set_state_nolock()) ffff9e04fae46000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788201689.473918:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c49f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875064458350592:0@lo:39:umount.0 00000100:00100000:2.0:1788201689.473975:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201689.474015:0:24543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458350592 00000100:00100000:0.0:1788201689.474022:0:24543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458350592 00000100:00100000:0.0:1788201689.474074:0:24543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788201689.474084:0:24543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04c56f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875064458350592:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788201689.474109:0:24543:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d685e 00000100:00080000:0.0:1788201689.474124:0:24543:0:(import.c:65:import_set_state_nolock()) ffff9e04f98c5800 : changing import state from FULL to CLOSED 00010000:00000080:0.0:1788201689.474158:0:24543:0:(ldlm_lib.c:3303:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9e04c56f4380 x1875064458350592/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:55/0 lens 224/224 e 0 to 0 dl 1788201700 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788201689.474160:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201689.474166:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d65cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d65d3 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201689.474174:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2cc6400 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:2.0:1788201689.474178:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d65cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d65d3 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201689.474187:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d65cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x9383f985bc4d65d3 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201689.474195:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d65cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x9383f985bc4d65d3 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201689.474201:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788201689.474204:0:5845:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788201689.474206:0:5845:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:0.0:1788201689.474208:0:24543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04c56f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3309:x1875064458350592:12345-0@lo:39:umount.0 Request processed in 126us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201689.474215:0:24543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000020:00000080:0.0:1788201689.474224:0:24543:0:(genops.c:906:class_export_put()) final put ffff9e04f98c7800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1788201689.474232:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d65cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d65d3 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201689.474238:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201689.474254:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d65cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d65d3 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201689.474260:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c2cc6400/0x9383f985bc4d65cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d65d3 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201689.474271:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201689.474273:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201689.474275:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201689.474284:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c1a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458350720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201689.474336:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201689.474384:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458350720 00000100:00100000:0.0:1788201689.474389:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458350720 00000100:00080000:2.0:1788201689.474412:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04fae46000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788201689.474419:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788201689.474420:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c49f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875064458350592:0@lo:39:umount.0 00000100:00100000:0.0:1788201689.474424:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3313:x1875064458350720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201689.474434:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201689.474448:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e04c0031800/0x9383f985bc4d65d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d65cc expref: 19 pid: 24526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201689.474462:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201689.474498:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b60c000b-7335-444d-a8dc-1a5956712fb2+18:3313:x1875064458350720:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201689.474505:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788201689.474516:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c1a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b60c000b-7335-444d-a8dc-1a5956712fb2:3313:1875064458350720:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788201689.474523:0:25668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201689.474526:0:25668:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788201689.474530:0:25668:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788201689.474657:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788201689.474815:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04f98c7800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788201689.474869:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04f98c5800 for lustre-MDT0000 00010000:00010000:0.0:1788201689.475414:0:25668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04c0031400/0x9383f985bc4d651d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6524 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201689.475425:0:25668:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04c0031400/0x9383f985bc4d651d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d6524 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201689.475431:0:25668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04c0031400/0x9383f985bc4d651d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d6524 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201689.475442:0:25668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e04c0031400/0x9383f985bc4d651d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d6524 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201689.475457:0:25668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201689.475464:0:25668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea6600/0x9383f985bc4d65ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d65f6 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201689.475470:0:25668:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea6600/0x9383f985bc4d65ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d65f6 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201689.475476:0:25668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea6600/0x9383f985bc4d65ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d65f6 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201689.475483:0:25668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea6600/0x9383f985bc4d65ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d65f6 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201689.475500:0:25668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788201689.475506:0:25668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef0000/0x9383f985bc4d65be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d65c5 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201689.475507:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201689.475512:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e04c0031400/0x9383f985bc4d651d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d6524 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201689.475513:0:25668:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef0000/0x9383f985bc4d65be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d65c5 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201689.475520:0:25668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef0000/0x9383f985bc4d65be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d65c5 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201689.475526:0:25668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef0000/0x9383f985bc4d65be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d65c5 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201689.475528:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0031400 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1788201689.475531:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e04c0031400/0x9383f985bc4d651d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d6524 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201689.475544:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e04c0031400/0x9383f985bc4d651d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x9383f985bc4d6524 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201689.475545:0:25668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788201689.475550:0:25668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04c0030a00/0x9383f985bc4d650f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9383f985bc4d6516 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201689.475551:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e04c0031400/0x9383f985bc4d651d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x9383f985bc4d6524 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201689.475557:0:25668:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04c0030a00/0x9383f985bc4d650f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9383f985bc4d6516 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201689.475557:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788201689.475560:0:5846:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788201689.475563:0:25668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff9e04c0030a00/0x9383f985bc4d650f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d6516 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201689.475568:0:25668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff9e04c0030a00/0x9383f985bc4d650f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9383f985bc4d6516 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201689.475575:0:25668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788201689.475576:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e04c0031400/0x9383f985bc4d651d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d6524 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201689.475578:0:25668:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788201689.475580:0:25668:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1788201689.475582:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201689.475600:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e04c0031400/0x9383f985bc4d651d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d6524 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788201689.475601:0:25668:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788201689.475605:0:25668:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00010000:00010000:3.0:1788201689.475607:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e04c0031400/0x9383f985bc4d651d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d6524 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788201689.475608:0:25668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1788201689.475613:0:25668:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:3.0:1788201689.475616:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788201689.475619:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea6600/0x9383f985bc4d65ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d65f6 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201689.475624:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c7ea6600 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1788201689.475627:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea6600/0x9383f985bc4d65ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d65f6 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201689.475632:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea6600/0x9383f985bc4d65ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9383f985bc4d65f6 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201689.475651:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea6600/0x9383f985bc4d65ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9383f985bc4d65f6 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201689.475657:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788201689.475659:0:5846:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788201689.475661:0:5846:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788201689.475673:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea6600/0x9383f985bc4d65ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d65f6 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201689.475679:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201689.475685:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea6600/0x9383f985bc4d65ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d65f6 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201689.475691:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e04c7ea6600/0x9383f985bc4d65ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d65f6 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201689.475706:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201689.475710:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef0000/0x9383f985bc4d65be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d65c5 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201689.475720:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03c2ef0000 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:3.0:1788201689.475723:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef0000/0x9383f985bc4d65be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d65c5 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201689.475729:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef0000/0x9383f985bc4d65be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9383f985bc4d65c5 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201689.475734:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef0000/0x9383f985bc4d65be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9383f985bc4d65c5 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201689.475738:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788201689.475740:0:5846:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788201689.475742:0:5846:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788201689.475755:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef0000/0x9383f985bc4d65be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d65c5 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201689.475760:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201689.475773:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef0000/0x9383f985bc4d65be lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d65c5 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201689.475780:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e03c2ef0000/0x9383f985bc4d65be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d65c5 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201689.475856:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201689.475860:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff9e04c0030a00/0x9383f985bc4d650f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d6516 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201689.475872:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e04c0030a00 already unused, calling callback (ffffffffc1a17c20) 10000000:00010000:2.0:1788201689.475874:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff9e04c0030a00/0x9383f985bc4d650f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9383f985bc4d6516 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201689.475881:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff9e04c0030a00/0x9383f985bc4d650f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9383f985bc4d6516 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201689.475888:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff9e04c0030a00/0x9383f985bc4d650f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9383f985bc4d6516 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201689.475893:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788201689.475895:0:5845:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788201689.475897:0:5845:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788201689.475912:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff9e04c0030a00/0x9383f985bc4d650f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d6516 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201689.475917:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201689.475923:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff9e04c0030a00/0x9383f985bc4d650f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d6516 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201689.475930:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff9e04c0030a00/0x9383f985bc4d650f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9383f985bc4d6516 expref: -99 pid: 24521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201689.475942:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201689.475944:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201689.475945:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201689.475978:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201689.475980:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201689.475982:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201689.476023:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f9009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458350848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201689.476065:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201689.476139:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201689.476145:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f900b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458350976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201689.476167:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788201689.476204:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201689.476369:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458350848 00000100:00100000:2.0:1788201689.476375:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458350848 00000100:00100000:2.0:1788201689.476412:0:13458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458350976 00000100:00100000:2.0:1788201689.476415:0:13458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458350976 00000100:00100000:2.0:1788201689.476438:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788201689.476446:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f900a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b60c000b-7335-444d-a8dc-1a5956712fb2+19:3310:x1875064458350848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201689.476456:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201689.476468:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c2cc7800/0x9383f985bc4d6524 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d651d expref: 19 pid: 24528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201689.476479:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201689.476513:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f900a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b60c000b-7335-444d-a8dc-1a5956712fb2+18:3310:x1875064458350848:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201689.476519:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788201689.476536:0:13458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788201689.476543:0:13458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f9008e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b60c000b-7335-444d-a8dc-1a5956712fb2+17:3310:x1875064458350976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201689.476550:0:13458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201689.476558:0:13458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e04c0031c00/0x9383f985bc4d65f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d65ef expref: 17 pid: 24526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201689.476567:0:13458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201689.476587:0:13458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f9008e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b60c000b-7335-444d-a8dc-1a5956712fb2+16:3310:x1875064458350976:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201689.476593:0:13458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788201689.476653:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04f9009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458351104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201689.476679:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201689.476734:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201689.476740:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03c33f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458351232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201689.476761:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201689.476935:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458351104 00000100:00100000:2.0:1788201689.476936:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458351232 00000100:00100000:1.0:1788201689.476941:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458351104 00000100:00100000:2.0:1788201689.476942:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458351232 00000100:00100000:2.0:1788201689.476978:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788201689.476987:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f900aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b60c000b-7335-444d-a8dc-1a5956712fb2+17:3312:x1875064458351232:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201689.476992:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00010000:00010000:2.0:1788201689.476999:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788201689.477004:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e04f900b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b60c000b-7335-444d-a8dc-1a5956712fb2+17:3312:x1875064458351104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201689.477011:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e04c7ea6800/0x9383f985bc4d6516 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d650f expref: 17 pid: 24526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201689.477014:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201689.477030:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c2cc7a00/0x9383f985bc4d65c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d65be expref: 16 pid: 24528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201689.477034:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201689.477045:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201689.477070:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f900aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b60c000b-7335-444d-a8dc-1a5956712fb2+15:3312:x1875064458351232:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201689.477078:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788201689.477084:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e04f900b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b60c000b-7335-444d-a8dc-1a5956712fb2+15:3312:x1875064458351104:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201689.477093:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788201689.477144:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03c33f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458351232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201689.477154:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f9009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b60c000b-7335-444d-a8dc-1a5956712fb2:3312:1875064458351104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201689.477182:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f900b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458350976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201689.477190:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04f9009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458350848:0@lo:103:ldlm_bl.0 00000004:00000080:0.0:1788201689.477548:0:25668:0:(mdt_handler.c:8183:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:1.0:1788201689.498491:0:24555:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771079 is committed 00000001:00080000:1.0:1788201689.498508:0:24555:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771081 is committed 00000020:00000080:0.0:1788201689.498672:0:25668:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 3/7 00000020:00080000:0.0:1788201689.498681:0:25668:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e04c6b18800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201689.498687:0:25668:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e04c6b1e800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201689.498694:0:25668:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e04f4e64800 35604eb4-baf9-45be-a20a-4883a2cd8cf9 192.168.201.30@tcp 8 (0 0 3) 0 0 0 0: 0000000000000000 30064771081 stale:0 00000020:00080000:0.0:1788201689.498699:0:25668:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9e04eadc99c0) has exports, disconnecting them 00000020:00080000:0.0:1788201689.498704:0:25668:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e04c6b18800), last request at 1788201685 00000020:00000080:0.0:1788201689.498711:0:25668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d6881 00000100:00080000:0.0:1788201689.498721:0:25668:0:(import.c:65:import_set_state_nolock()) ffff9e04c6b19000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788201689.498751:0:25668:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e04c6b18800): rc 0 00000020:00000080:0.0:1788201689.498754:0:25668:0:(genops.c:906:class_export_put()) final put ffff9e04c6b18800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788201689.498767:0:25668:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e04c6b1e800), last request at 1788201685 00000020:00000080:0.0:1788201689.498775:0:25668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d687a 00000100:00080000:0.0:1788201689.498780:0:25668:0:(import.c:65:import_set_state_nolock()) ffff9e04c6b1a000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788201689.498788:0:25668:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e04c6b1e800): rc 0 00000020:00000080:0.0:1788201689.498790:0:25668:0:(genops.c:906:class_export_put()) final put ffff9e04c6b1e800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1788201689.498795:0:25668:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.201.30@tcp (ffff9e04f4e64800), last request at 1788201687 00000020:00000080:0.0:1788201689.498798:0:25668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d655c 00000020:00010000:0.0:1788201689.498806:0:25668:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e04f4e64800: total 2 00000100:00080000:0.0:1788201689.498809:0:25668:0:(import.c:65:import_set_state_nolock()) ffff9e04f48d6000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788201689.498815:0:25668:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.30@tcp (ffff9e04f4e64800): rc 0 00000004:00000080:0.0:1788201689.498820:0:25668:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffad6101cf3ae0 00000100:00080000:0.0:1788201689.498835:0:25668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788201689.498838:0:25668:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968895 gen 3 00000004:00080000:0.0:1788201689.498847:0:25668:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788201689.498899:0:25668:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788201689.498917:0:25668:0:(import.c:65:import_set_state_nolock()) ffff9e04c6411800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788201689.498932:0:25668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788201689.498934:0:25668:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968895 gen 3 00000004:00080000:0.0:1788201689.498940:0:25668:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788201689.498997:0:25668:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788201689.499007:0:25668:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4be000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788201689.499034:0:25668:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9e04eadc99c0) has no exports 00000020:00080000:0.0:1788201689.499251:0:25668:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9e04eadc99c0) has no exports 00000020:00010000:3.0:1788201689.499611:0:5846:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e04f4e64800: total 2 00010000:00010000:3.0:1788201689.499615:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201689.499661:0:5846:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e04f4e64800, canceled 0 locks, left on hash table 3. 00010000:00010000:3.0:1788201689.499697:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c32bdc00/0x9383f985bc4d698b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x42c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c59a8 expref: 4 pid: 24544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201689.499726:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6200/0x9383f985bc4d696f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c59a1 expref: 3 pid: 24543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201689.499744:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03c36e6c00/0x9383f985bc4d69a7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x42e:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c59af expref: 2 pid: 25446 timeout: 1063 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201689.499756:0:5846:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e04f4e64800, canceled 3 locks, left on hash table 0. 00010000:00010000:1.0:1788201689.500485:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201689.500492:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788201689.501129:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c6b18800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788201689.501588:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c6b1e800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788201689.501698:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04c6b19000 for lustre-MDT0000 00000020:00000080:2.0:1788201689.501704:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04c6b1a000 for lustre-MDT0000 00000100:00100000:2.0:1788201689.501730:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c49f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458351360:0@lo:9:umount.0 00000100:00100000:2.0:1788201689.502431:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201689.502473:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c49f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458351488:0@lo:9:umount.0 00000100:00100000:2.0:1788201689.502494:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201689.502563:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458351360 00000100:00100000:1.0:1788201689.502571:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458351360 00000100:00100000:1.0:1788201689.502629:0:13449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875064458351488 00000100:00100000:1.0:1788201689.502632:0:13449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875064458351488 00000100:00100000:1.0:1788201689.502669:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4408 00000100:00100000:1.0:1788201689.502679:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3309:x1875064458351360:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788201689.502707:0:13449:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d659b 00000100:00080000:1.0:1788201689.502715:0:13449:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4be800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788201689.502751:0:13449:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968895 00000100:00080000:2.0:1788201689.502936:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201689.502941:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201689.503031:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+2:3309:x1875064458351360:12345-0@lo:9:umount.0 Request processed in 352us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201689.503039:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4408 00000100:00100000:1.0:1788201689.503053:0:13449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4409 00000100:00100000:1.0:1788201689.503060:0:13449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03c33f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3309:x1875064458351488:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788201689.503072:0:13449:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d65a9 00000100:00080000:1.0:1788201689.503078:0:13449:0:(import.c:65:import_set_state_nolock()) ffff9e04cff48800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788201689.503098:0:13449:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968895 00000100:00100000:1.0:1788201689.503344:0:13449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03c33f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+2:3309:x1875064458351488:12345-0@lo:9:umount.0 Request processed in 283us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201689.503351:0:13449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4409 00010000:00010000:1.0:1788201689.503374:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201689.503380:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788201689.503890:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04c6411800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788201689.503909:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788201689.503917:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788201689.503921:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c49f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458351360:0@lo:9:umount.0 00000100:00080000:2.0:1788201689.503933:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e04ff4be000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788201689.503937:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788201689.503938:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788201689.503940:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e04c49f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875064458351488:0@lo:9:umount.0 00000020:00000080:3.0:1788201689.533006:0:5846:0:(genops.c:906:class_export_put()) final put ffff9e04f4e64800/35604eb4-baf9-45be-a20a-4883a2cd8cf9 00000020:00000080:2.0:1788201689.533338:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04f4e64800/35604eb4-baf9-45be-a20a-4883a2cd8cf9 for lustre-MDT0000 00000020:00000080:2.0:1788201689.533397:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04f48d6000 for lustre-MDT0000 00010000:00010000:2.0:1788201689.533408:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201689.533411:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201689.533414:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788201689.556106:0:25668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d6571 00000020:00000080:0.0:1788201689.556124:0:25668:0:(genops.c:906:class_export_put()) final put ffff9e04fae21000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788201689.556186:0:25668:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788201689.556387:0:25668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201689.556398:0:25668:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788201689.556402:0:25668:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9e03c2640000) has no exports 00000020:00000080:0.0:1788201689.556799:0:25668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d656a 00000020:00000080:0.0:1788201689.556805:0:25668:0:(genops.c:906:class_export_put()) final put ffff9e04fae26800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788201689.557089:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04fae21000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788201689.557265:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04fae26800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788201689.557456:0:25668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201689.557574:0:25668:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788201689.557578:0:25668:0:(genops.c:906:class_export_put()) final put ffff9e04c347a000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788201689.557581:0:25668:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c347a000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788201689.557589:0:25668:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1788201689.557700:0:25668:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e05015a44e0 - data ffff9e04ff849798/ffff9e03c279d400 00000020:01000000:1.0:1788201689.557798:0:25668:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e04d8bb1cc0 - data ffff9e04dd0c4bd0/ffff9e04d9f18400 00000100:00080000:0.0:1788201689.590878:0:25668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788201689.590886:0:25668:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968895 gen 4 00000004:00080000:0.0:1788201689.591090:0:25668:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201689.591093:0:25668:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788201689.591483:0:24565:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788201689.591488:0:24565:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1c:0x0] index 1 count 1 00000040:00080000:2.0:1788201689.591499:0:24565:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 7 count 2 00000100:00080000:0.0:1788201689.593464:0:25668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788201689.593470:0:25668:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968895 gen 4 00000004:00080000:0.0:1788201689.593520:0:25668:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201689.593523:0:25668:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788201689.593836:0:24567:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788201689.593840:0:24567:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1e:0x0] index 1 count 1 00000040:00080000:2.0:1788201689.593851:0:24567:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 7 count 2 00000020:00000080:2.0:1788201689.625233:0:25668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d6532 00000020:00000080:2.0:1788201689.625247:0:25668:0:(genops.c:906:class_export_put()) final put ffff9e04d8184800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788201689.625504:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04d8184800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788201689.626733:0:25668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d6547 00000020:00000080:2.0:1788201689.626789:0:25668:0:(genops.c:906:class_export_put()) final put ffff9e04d8183800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788201689.626830:0:25668:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788201689.626837:0:25668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201689.626846:0:25668:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788201689.626851:0:25668:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9e04f9650000) has no exports 00000004:01000000:2.0:1788201689.627194:0:25668:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788201689.627205:0:25668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d65a2 00000020:00000080:2.0:1788201689.627209:0:25668:0:(genops.c:906:class_export_put()) final put ffff9e04d8180800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201689.627322:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04d8183800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788201689.627431:0:25668:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788201689.627486:0:25668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201689.627494:0:25668:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788201689.627497:0:25668:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9e04eadc8000) has no exports 00000020:00000080:3.0:1788201689.627504:0:25668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d6594 00000020:00000080:3.0:1788201689.627509:0:25668:0:(genops.c:906:class_export_put()) final put ffff9e04ff4b9000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788201689.627533:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04d8180800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1788201689.628220:0:25668:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788201689.628226:0:25668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788201689.628230:0:25668:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968895 gen 5 00000004:00080000:3.0:1788201689.628235:0:25668:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788201689.628238:0:25668:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788201689.628269:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04ff4b9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788201689.628440:0:25668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201689.628448:0:25668:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201689.628454:0:25668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d6586 00000020:00000080:3.0:1788201689.628460:0:25668:0:(genops.c:906:class_export_put()) final put ffff9e04c6416800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201689.628482:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04ff4be000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788201689.628487:0:38:0:(genops.c:906:class_export_put()) final put ffff9e04d8186800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201689.628490:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04d8186800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788201689.628497:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788201689.628652:0:25668:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788201689.628657:0:25668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201689.628662:0:25668:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788201689.628665:0:25668:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff9e04ff1e3380) has no exports 00000020:00000080:3.0:1788201689.628670:0:25668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d657f 00000020:00000080:3.0:1788201689.628673:0:25668:0:(genops.c:906:class_export_put()) final put ffff9e04c6410800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788201689.628690:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c6416800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:3.0:1788201689.629410:0:25668:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788201689.629414:0:25668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788201689.629417:0:25668:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968895 gen 5 00000004:00080000:3.0:1788201689.629421:0:25668:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788201689.629422:0:25668:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788201689.629472:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c6410800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788201689.629657:0:25668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201689.629663:0:25668:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201689.629694:0:25668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201689.629698:0:25668:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201689.629702:0:25668:0:(genops.c:906:class_export_put()) final put ffff9e04d8181000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788201689.629705:0:25668:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04d8181000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788201689.629717:0:25668:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201689.629859:0:25668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d654e 00000020:00000080:3.0:1788201689.629865:0:25668:0:(genops.c:906:class_export_put()) final put ffff9e04d8181800/lustre-MDD0000_UUID 00000020:00000080:0.0:1788201689.629962:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04c6411800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788201689.629969:0:38:0:(genops.c:906:class_export_put()) final put ffff9e04ff4bd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201689.629971:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04ff4bd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788201689.629976:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788201689.630248:0:25668:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788201689.630254:0:25668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201689.630259:0:25668:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788201689.630262:0:25668:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9e04eadccd40) has no exports 00000020:00000080:3.0:1788201689.630310:0:25668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201689.630314:0:25668:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788201689.630319:0:25668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d6555 00000020:00000080:3.0:1788201689.630323:0:25668:0:(genops.c:906:class_export_put()) final put ffff9e04d8185800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788201689.630379:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04d8181800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788201689.630384:0:38:0:(genops.c:906:class_export_put()) final put ffff9e04d8186000/lustre-MDD0000_UUID 00000020:00000080:0.0:1788201689.630387:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04d8186000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788201689.630393:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:3.0:1788201689.630715:0:25668:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e04c8351000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788201689.630720:0:25668:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e04c8351000 3 00000020:01000004:3.0:1788201689.630724:0:25668:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e04c8351000 from lustre-MDT0000 00000020:00000080:3.0:1788201689.630749:0:25668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201689.630753:0:25668:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788201689.630756:0:25668:0:(genops.c:906:class_export_put()) final put ffff9e04d8182800/lustre-MDT0000_UUID 00000020:00000080:3.0:1788201689.630759:0:25668:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04d8182800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788201689.630767:0:25668:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788201689.630800:0:25668:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1788201689.630804:0:25668:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788201689.630807:0:25668:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788201689.630811:0:25668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201689.630814:0:25668:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788201689.630821:0:25668:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9e03c55b4000 b60c000b-7335-444d-a8dc-1a5956712fb2 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788201689.630830:0:25668:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9e04c6b8e000 7ad49433-54fa-4e21-b756-859420d95603 192.168.201.30@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788201689.630835:0:25668:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9e04f9654d40) has exports, disconnecting them 00000020:00080000:3.0:1788201689.630840:0:25668:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9e03c55b4000), last request at 1788201659 00000020:00000080:3.0:1788201689.630861:0:25668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d64f3 00000020:00010000:3.0:1788201689.630867:0:25668:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e03c55b4000: total 1 00000100:00080000:3.0:1788201689.630872:0:25668:0:(import.c:65:import_set_state_nolock()) ffff9e03c55b5800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788201689.630892:0:25668:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e03c55b4000): rc 0 00000020:00010000:2.0:1788201689.630970:0:7645:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e03c55b4000: total 1 00010000:00010000:2.0:1788201689.631002:0:7645:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e03c55b4000, canceled 0 locks, left on hash table 8. 00000020:00080000:3.0:1788201689.631113:0:25668:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.201.30@tcp (ffff9e04c6b8e000), last request at 1788201651 00000020:00000080:3.0:1788201689.631221:0:25668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d64d0 00000020:00010000:3.0:1788201689.631225:0:25668:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e04c6b8e000: total 1 00000100:00080000:3.0:1788201689.631229:0:25668:0:(import.c:65:import_set_state_nolock()) ffff9e04c6b8d800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788201689.631245:0:25668:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.30@tcp (ffff9e04c6b8e000): rc 0 00000020:00080000:3.0:1788201689.631250:0:25668:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9e04f9654d40) has no exports 00000100:00100000:3.0:1788201689.631313:0:24559:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff9e03c1f1b400:24559] 3 exiting: rc = 0 00000100:00100000:3.0:1788201689.631402:0:24527:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9e03c2b0e200:24527] 1 exiting: rc = 0 00010000:00010000:2.0:1788201689.631487:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c1b97000/0x9383f985bc4d6612 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d660b expref: 9 pid: 24527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201689.631511:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c1b96600/0x9383f985bc4d6620 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d6619 expref: 8 pid: 24559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201689.631523:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c2cc7400/0x9383f985bc4d663c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d6635 expref: 7 pid: 24559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201689.631533:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c2ef0400/0x9383f985bc4d662e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d6627 expref: 6 pid: 24527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201689.631549:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e04c7ea7000/0x9383f985bc4d664a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d6643 expref: 5 pid: 24527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201689.631562:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e04c7ea7a00/0x9383f985bc4d6658 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d6651 expref: 4 pid: 24559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201689.631574:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c2cc7c00/0x9383f985bc4d6666 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d665f expref: 3 pid: 24527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201689.631584:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e04c7ea6e00/0x9383f985bc4d6604 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9383f985bc4d65fd expref: 2 pid: 24526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201689.631593:0:7645:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e03c55b4000, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1788201689.631611:0:7645:0:(genops.c:906:class_export_put()) final put ffff9e03c55b4000/b60c000b-7335-444d-a8dc-1a5956712fb2 00000020:00000080:0.0:1788201689.631662:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04d8185800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:1.0:1788201689.631662:0:5845:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e04c6b8e000: total 2 00010000:00010000:1.0:1788201689.631698:0:5845:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e04c6b8e000, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1788201689.631718:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e04c7ea7c00/0x9383f985bc4d64de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c594d expref: 5 pid: 24528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201689.631725:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201689.631729:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201689.631732:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201689.631736:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e04c0030000/0x9383f985bc4d64ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c595b expref: 4 pid: 24527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788201689.631753:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03c55b4000/b60c000b-7335-444d-a8dc-1a5956712fb2 for MGS 00010000:00010000:1.0:1788201689.631756:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c2ef0200/0x9383f985bc4d64e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5954 expref: 3 pid: 24526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201689.631772:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03c2cc6000/0x9383f985bc4d666d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4605c7c97e1c5962 expref: 2 pid: 24528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201689.631784:0:5845:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e04c6b8e000, canceled 4 locks, left on hash table 0. 00000020:00000080:1.0:1788201689.631795:0:5845:0:(genops.c:906:class_export_put()) final put ffff9e04c6b8e000/7ad49433-54fa-4e21-b756-859420d95603 00010000:00010000:1.0:1788201689.632109:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201689.632112:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201689.632115:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788201689.632131:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e03c55b5800 for MGS 00000100:00100000:1.0:1788201689.632144:0:24528:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9e04d80e2400:24528] 2 exiting: rc = 0 00000100:00100000:1.0:1788201689.632215:0:24526:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9e03c198d000:24526] 0 exiting: rc = 1 00000020:00000080:0.0:1788201689.632234:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c6b8e000/7ad49433-54fa-4e21-b756-859420d95603 for MGS 00000100:00100000:3.0:1788201689.632326:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632339:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632348:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632356:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632365:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632374:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632382:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632391:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632399:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632405:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632412:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632418:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632424:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632430:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632437:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632443:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632448:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632454:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632460:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632466:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632472:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632478:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632483:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632489:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632493:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632498:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632504:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632510:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632516:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632521:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632527:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632532:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632538:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632543:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632549:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632556:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632565:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632573:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632581:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632589:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632598:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632606:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632615:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632623:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632631:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632654:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632664:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632676:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632684:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632690:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632710:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632720:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632726:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632735:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632741:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632747:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632753:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632759:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632769:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632775:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632781:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632788:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632794:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.632800:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1788201689.633413:0:25668:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788201689.633417:0:25668:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:0.0:1788201689.634451:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04c6b8d800 for MGS 00000020:01000000:0.0:1788201689.635815:0:25668:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e03c1df3b40 - data ffff9e04d8fe76c0/ffff9e03c2451000 00000020:01000000:0.0:1788201689.636029:0:25668:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e03c35697e0 - data ffff9e04dd367798/ffff9e03c2452400 00000020:00000080:0.0:1788201689.636732:0:25668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d64c9 00000020:00000080:0.0:1788201689.636740:0:25668:0:(genops.c:906:class_export_put()) final put ffff9e04c8366000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788201689.636788:0:25668:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e04c8351000 from MGS, refs=2 00000020:01000004:0.0:1788201689.636792:0:25668:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e04c8351000 2 00000020:01000004:0.0:1788201689.636795:0:25668:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e04c8351000 from MGS 00000020:00000080:0.0:1788201689.636814:0:25668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201689.636820:0:25668:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788201689.636823:0:25668:0:(genops.c:906:class_export_put()) final put ffff9e04c8366800/MGS 00000020:00000080:0.0:1788201689.636825:0:25668:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c8366800/MGS for MGS 00000020:01000000:0.0:1788201689.636831:0:25668:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788201689.636893:0:25668:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788201689.636961:0:25668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201689.636969:0:25668:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788201689.636976:0:25668:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9e03c531c800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201689.636982:0:25668:0:(genops.c:1574:class_disconnect_exports()) OBD device 17 (ffff9e04eadcb380) has exports, disconnecting them 00000020:00080000:0.0:1788201689.636987:0:25668:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9e03c531c800), last request at 1788201659 00000020:00000080:0.0:1788201689.636991:0:25668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d65e1 00000020:00080000:0.0:1788201689.637000:0:25668:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e03c531c800): rc 0 00000020:00000080:0.0:1788201689.637005:0:25668:0:(genops.c:906:class_export_put()) final put ffff9e03c531c800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788201689.637541:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c8366000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788201689.637972:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03c531c800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788201689.640396:0:25668:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788201689.640405:0:25668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201689.640409:0:25668:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788201689.640417:0:25668:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788201689.640508:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e04fae46000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788201689.640630:0:25668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201689.640649:0:25668:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788201689.640654:0:25668:0:(genops.c:906:class_export_put()) final put ffff9e04cff4a800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788201689.640658:0:25668:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04cff4a800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788201689.640664:0:25668:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788201689.640724:0:25668:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e04c8351000 1 00000020:00000080:2.0:1788201689.640729:0:25668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9383f985bc4d64bb 00000020:00000080:2.0:1788201689.640736:0:25668:0:(genops.c:906:class_export_put()) final put ffff9e04c8361800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788201689.640753:0:25668:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788201689.640758:0:25668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201689.640762:0:25668:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788201689.640766:0:25668:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9e04ff1e4d40) has no exports 00000020:00000080:3.0:1788201689.641322:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c8361800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788201689.645540:0:25668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201689.645552:0:25668:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788201689.645558:0:25668:0:(genops.c:906:class_export_put()) final put ffff9e04c8353800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788201689.645562:0:25668:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c8353800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788201689.645569:0:25668:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788201689.648197:0:25668:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e04c8352800 00000020:01000000:2.0:1788201689.648233:0:25668:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788201689.648240:0:25668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201689.648246:0:25668:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788201689.648251:0:25668:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9e04f9653380) has no exports 00000100:00100000:3.0:1788201689.648461:0:24542:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9e04d8041e00:24542] 0 exiting: rc = 1 00000100:00100000:2.0:1788201689.648524:0:25446:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9e04cff02400:25446] 3 exiting: rc = 0 00000100:00100000:3.0:1788201689.648735:0:24544:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9e04c3351400:24544] 2 exiting: rc = 0 00000100:00100000:2.0:1788201689.649403:0:24543:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9e04d8040e00:24543] 1 exiting: rc = 0 00000100:00100000:3.0:1788201689.649513:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649524:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649530:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649536:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649542:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649548:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649554:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649560:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649566:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649572:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649579:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649587:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649598:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649610:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649621:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649628:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649649:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649687:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649694:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649707:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649718:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649724:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649733:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649740:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649746:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649753:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649763:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649769:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649776:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649782:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649788:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649794:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649800:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649806:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649823:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649831:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649838:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649844:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649851:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649857:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649863:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649870:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649876:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649883:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649889:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649960:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649969:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649975:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649981:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649990:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.649999:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.650006:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.650013:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.650021:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.650029:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.650102:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.650109:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.650116:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.650122:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.650128:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.650196:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.650204:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.650210:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.650217:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201689.654266:0:24545:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9e04c3351800:24545] 0 exiting: rc = 1 00000100:00100000:3.0:1788201689.654446:0:24546:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9e03c32a4200:24546] 1 exiting: rc = 0 00000100:00100000:3.0:1788201689.654510:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654521:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654527:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654533:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654538:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654544:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654550:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654556:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654563:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654569:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654575:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654583:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654593:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654603:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654616:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654622:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654627:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654679:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654690:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654701:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654707:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654713:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654718:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654724:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654730:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654736:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654742:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654748:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654754:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654760:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654766:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654772:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654777:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654784:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654789:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654795:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654801:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654806:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654812:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654819:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654824:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654830:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654836:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654842:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654847:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654854:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654860:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654865:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654871:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654876:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654882:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654888:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654959:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654967:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654973:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654978:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654984:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654990:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.654995:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.655001:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.655007:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.655013:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.655019:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.655025:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201689.655817:0:24547:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9e03c32a5a00:24547] 0 exiting: rc = 1 00000100:00100000:2.0:1788201689.655985:0:24548:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9e03c2f5b600:24548] 1 exiting: rc = 0 00000100:00100000:3.0:1788201689.656196:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656207:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656214:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656221:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656228:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656235:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656241:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656248:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656267:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656274:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656280:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656287:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656318:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656325:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656332:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656339:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656345:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656351:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656357:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656364:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656386:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656395:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656402:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656409:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656416:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656422:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656429:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656437:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656444:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656451:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656458:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656466:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656503:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656511:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656520:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656528:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656535:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656542:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656548:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656556:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656563:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656570:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656585:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656598:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656606:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656613:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656620:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656630:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656647:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656654:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656661:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656667:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656674:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656681:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656688:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656694:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656702:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656709:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656716:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656722:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656728:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656735:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656741:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.656748:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201689.665949:0:24549:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9e04d11fae00:24549] 0 exiting: rc = 1 00000100:00100000:1.0:1788201689.665997:0:24550:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9e04d11fb200:24550] 1 exiting: rc = 0 00000100:00100000:3.0:1788201689.666147:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666157:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666165:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666174:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666182:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666190:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666197:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666205:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666212:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666220:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666231:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666241:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666247:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666258:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666276:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666285:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666291:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666316:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666323:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666330:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666335:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666341:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666347:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666357:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666363:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666369:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666374:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666380:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666386:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666391:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666397:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666403:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666408:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666414:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666419:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666424:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666430:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666436:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666441:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666447:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666453:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666464:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666472:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666481:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666488:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666493:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666502:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666507:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666513:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666519:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666525:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666531:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666537:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666544:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666549:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666554:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666560:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666565:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666571:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666585:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666590:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666596:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666605:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.666611:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201689.667244:0:24551:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9e03c29c4200:24551] 0 exiting: rc = 1 00000100:00100000:1.0:1788201689.667507:0:24552:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9e04d11fb800:24552] 1 exiting: rc = 0 00000100:00100000:3.0:1788201689.667715:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667726:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667735:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667743:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667750:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667758:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667766:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667774:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667785:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667797:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667808:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667815:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667821:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667827:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667874:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667880:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667886:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667902:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667908:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667913:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667919:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667924:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667930:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667936:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667942:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667947:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667953:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667959:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667965:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667971:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667977:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667982:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667988:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667993:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.667999:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.668005:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.668010:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.668016:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.668022:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.668028:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.668197:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.668207:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.668213:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.668218:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.668224:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.668229:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.668235:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.668240:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.668245:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.668251:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.668257:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.668263:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.668269:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.668275:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.668281:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.668287:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.668570:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.668581:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.668587:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.668593:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.668599:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.668605:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.668610:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.668615:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201689.670398:0:24553:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9e03c29c4e00:24553] 0 exiting: rc = 1 00000100:00100000:3.0:1788201689.670533:0:24554:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9e03c29c4600:24554] 1 exiting: rc = 0 00000100:00100000:3.0:1788201689.670587:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670594:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670648:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670658:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670664:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670668:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670674:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670679:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670685:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670689:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670694:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670699:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670704:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670708:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670713:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670717:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670722:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670727:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670732:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670738:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670744:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670749:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670754:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670759:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670766:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670771:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670778:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670783:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670789:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670795:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670801:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670807:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670813:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670818:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670824:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670830:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670835:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670841:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670846:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670852:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670858:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670863:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670875:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670881:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670886:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670892:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670965:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670970:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670976:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670981:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670987:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670992:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.670998:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.671003:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.671008:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.671014:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.671019:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.671024:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.671029:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.671214:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.671220:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.671225:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.671231:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.671236:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201689.671950:0:24557:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9e03c32c4200:24557] 1 exiting: rc = 0 00000100:00100000:3.0:1788201689.672356:0:24556:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9e04d888c600:24556] 0 exiting: rc = 1 00000100:00100000:3.0:1788201689.672613:0:24558:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9e03c3045c00:24558] 2 exiting: rc = 0 00000100:00100000:3.0:1788201689.672679:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672685:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672692:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672700:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672706:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672712:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672724:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672731:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672737:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672743:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672749:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672755:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672777:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672784:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672790:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672796:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672802:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672808:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672816:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672823:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672829:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672835:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672841:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672847:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672852:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672858:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672864:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672871:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672877:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672883:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672904:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672911:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672917:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672923:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672929:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672935:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672956:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672963:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672969:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672974:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672980:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672986:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672993:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.672999:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.673006:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.673012:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.673019:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.673025:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.673096:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.673106:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.673112:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.673120:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.673126:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.673241:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.673250:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.673256:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.673261:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.673268:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.673274:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.673280:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.673286:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.673357:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.673365:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201689.673370:0:25668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788201689.679279:0:25668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201689.679485:0:25668:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788201689.679491:0:25668:0:(genops.c:906:class_export_put()) final put ffff9e04c8367800/MDS_uuid 00000020:00000080:2.0:1788201689.679496:0:25668:0:(genops.c:865:class_export_destroy()) destroying export ffff9e04c8367800/MDS_uuid for MDS 00000020:01000000:2.0:1788201689.679503:0:25668:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788201689.679769:0:25668:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788201690.085441:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201690.344560:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c49f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b60c000b-7335-444d-a8dc-1a5956712fb2:3310:1875064458351616:0@lo:400:kworker.0 00000100:00100000:1.0:1788201690.344741:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c49f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875064458351744:0@lo:400:kworker.0 00000400:00000100:1.0:1788201690.344772:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458351744 offset 0 length 224: 4 00000400:00000100:3.0:1788201690.344799:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875064458351616 offset 0 length 224: 4 00000100:00100000:3.0:1788201690.344966:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e04c49f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875064458351872:0@lo:400:kworker.0 00000400:00000100:3.0:1788201690.344991:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875064458351872 offset 0 length 224: 4 Debug log: 68640 lines, 68640 kept, 0 dropped, 0 bad.